So after quite a few experiments with Move and the solar panel it is as I suspected. The solar panel is way too small to charge the batteries. Even when left for a few days with no movement on the motor, it was unable to reclaim any significant charge. So I think I am going to just use direct power with no batteries at this point.
Slower speeds however do significantly reduce the noise.