I also like to listen to music when I'm scrubbing through footage, looking for b-roll. The way I kill the sound in Premiere so I don't have to listen to the chipmunk version of my footage when scrubbing is to go to Edit>Preferences>Audio Hardware and select "ASIO Settings". This gives me a few different output options. At least one option is required, so I just check an output that I'm not using and leave my main output unchecked. This effectively mutes Premiere.
Not the most elegant solution, but it works.