A small computer might be a better idea.

Sometimes you need to go from song to song very quickly, and a little mp3 player usually requires multiple button pushes to select a particular song.

Here is how I make my backing tracks and how I use them on stage (plus some of the reasons why I do it that way)
http://www.nortonmusic.com/backing_tracks.html

Insights and incites by Notes


Bob "Notes" Norton smile Norton Music
https://www.nortonmusic.com

100% MIDI Super-Styles recorded by live, pro, studio musicians for a live groove
& Fake Disks for MIDI and/or RealTracks