I think PowerTracks Pro Audio is the program you need for that. PowerTracks will import MP3s to a stereo track and then you can layer your parts onto additional tracks.

Burn a CD and pass them out to your friends.