Disabling "Allow lead-in bars" is doing what I was looking for! Thanks Andrew!
On zzjazz.sty though, whether "Audible Lead-in" is enabled or not makes no difference, I am not sure this is expected.