The issue is a Chrome bug, it ignores the lack of "autoplay" attribute which is supposed to tell browsers to automatically begin playback, and plays it anyway.
There's tons of posts over on code.google.com regarding these issues in Chrome.
I'm getting the same issue of random sounds. I've noticed that whenever a user changes something in their settings such as font or color, I hear the pop noise. I've tried it in Firefox and Chrome.