I'm struggling to unravel the original post.
I'm thinking you are playing music on a PC, using some kind of media player. You have some kind of amp and speakers plugged into the headphone output socket on the PC.
If so, the little amp on the PC will generate hiss to headphone port, whether you are actively playing music or not. Then, many modestly priced amps will likely add even more hiss. If you used a good quality amp to drive speakers, it will have no audible hiss if its own, but it will amplify any hiss coming from the PC.
IMHO, the best way to get good, hiss-free sound from a PC is to make sure you are sending only a digital signal out of it, usually using a USB port. If you do, you will need some kind of USB DAC to convert the digital signal to an analogue signal for your amp to use. Unless you have a good amp though, a cheap amp will still add hiss (as said) but at least that hiss won't be "PC amp hiss + main amp hiss" combined.
In my office, my PC connects to a Topping DX1 over USB and I feed it using exclusive mode from Foobar2000. There is no discernable hiss from either headphones or from a separate amp and speakers, driven from the RCA outputs on the DX1, when I prefer listening without headphones. There are hundreds of similar products that should give you less hiss, or none. If you have active speakers, you can plug them into the DAC (watch out for volume control though), but active speakers vary in the amount of hiss they may produce. A lot depends on budget.
Sorry if this is not your "use-case". But "digital out" is the only way to go with most PCs.