Well, sort of.
If you use the key signature drop-down control (just left of the tempo control), the song will regenerate and continue playing in the new key. However, there will be a pause to regenerate. The more RealTracks you use, and the less powerful the computer, the longer the pause.
CD 2-minute preview. Studio recordings of songs composed in Band in a Box.