That would be awesome ! yes make some videos for your songs.
If you only have one camera just video the whole song from one angle then do another take from another angle, all you need to do is play the song from CD while videoing then mix the video tracks with the original audio you have up there now. Have the CD playing loud enough for the camera to pick up so to give a sync reference to align with the original audio.
You can make it with Reaper or there are plenty of other free video creating software.

This one was just all style tracks and got on CMT, there's another one somewhere there too.
https://www.pgmusic.com/forums/ubbthreads.php?ubb=showflat&Number=317099