I have to say that I've several times tried the medley tool and have always given up on it. Maybe I expect too much, or maybe I over-think it. Personally I found it very frustrating and maddening. Maybe someone else who uses it successfully will give a better view.

For a quick group of soloists for practising, I now just pick one of the pre-built medley soloist tracks and just go with that. They seem generally to be OK and presumably prove that it's possible to get them to behave, suggesting that the problem is with me rather than the tool.

If I want to do something in more depth or breadth, then I'll build multiple soloists as Matt describes, putting each one on its own track (normally a utility track) and play/mute when I want or fade in/out when I want. That does also mean one can control things like, for example, having the soloist anticipate the chorus by half a bar.

Jazz relative beginner, starting at a much older age than was helpful.
AVL:MXE Linux; Windows 11
BIAB2025 Audiophile, a bunch of other software.
Kawai MP6, Ui24R, Focusrite Saffire Pro40 and Scarletts
.