If a VST i or fx on one tracks adds latency, do all the tracks automatically sync up?

Some of my plugins have fixed latency - say 5ms, or 11ms, while others vary based on how much I have them do.