So when I export my songs, one of the first things I do is open them in my WAV editor. In there, I do three things.
First, I normalize it. This puts the volume up to standards.
Second, I trim the count in to the start of the WAV and I trim the end to the exact millisecond of silence.
Third, I add 500 milliseconds off silence at the start. This gives a barely noticeable delay after the start is pushed.

Try adding a period of silence at the start and see if that solves the problem you mentioned

You can find my music at:
www.herbhartley.com
Add nothing that adds nothing to the music.
You can make excuses or you can make progress but not both.

The magic you are looking for is in the work you are avoiding.