The panel is connected to the batteries using Schottky diode on the positive lead that prevents battery discharge at night. This one-way valve allows current to flow from the panel to the battery, but does not allow current to flow backwards out of the battery through the solar panel. In this design I am continuously trickle charging the battery when sunlight is present.
Update: It works. So far a month on solar power.