When I just click play, no problem, just like you.

Have your rendered it to a .wav file?

That's where the issue lies.

Here's a pic of what the rendered .wav file looks like and shows the 4 seconds of silence that appears before each track I render.