One way to test is to plug it in to USB 5v with the batteries removed. If it still works, you are good leaving them in.