Make sure our actual interface/soundcard drivers are set to low buffers. I get some latency at 512.
256 or below usually OK.