"The top players are not simply playing one mode, scale, whatever over a set of changes. No, I wish it were that simple. They're playing one mode for two changes, switching it up to a different one for one bar, doing something else for the next couple bars, yet another one for a turnaround and then for the second time through it's different again"

I'm not sure I'll ever get there, but there are lots of top rock and blues players that do wonders with the Pentatonic scale for MANY MANY changes. Can there not be other changes with accompanying scales and modes that sound good ? Heck - the beauty of the guitar is the ability to change keys while maintaining the same fingering. I think most guitar players can get the fingering in their head, but the hard part is knowing it quickly enough during the changes to actually add some feel and some phrasing.

...and my guess is that moste of those top players doing what you have described have to be playing by feel and ear (as opposed to 'cognitively)without explicitly thinking of the underlying theory, because they have had the luxury (or made the life sacrifice) to practice 'cognitively' for enough hours so that they can do it automatically or instinctively. Given the fact that I have to work for a living - I'm looking for a tool that can help me jump a little closer to their level in less time than they had to spend (barring the 'natural' talent I wasn't born with : )