Once you have it tempo mapped you can generate up a midi track and drag that into Reaper it will get the tempo map from the midi.
Now drag all your tracks into Reaper and run this script after selecting all the bars that you want a constant tempo
right click Save Link/Target As
ReaTrak set tempo mapped items in selection to constant tempo.lua