Without, with Coyote wavetable and Halion Sonic SE no differences. No Midi mappers ...
Maybe something to do with Midiclock etc, you made me think LoL.

ADDED: been experimenting with various settings ... same delay. Reset factory defaults. NADA.

Note: BIAB and all other video or audio runs fine, no irritant playback start delays.