Three possibilities. The charger's not charging to full capacity, they're being drawn down by electricity being consumed or there is one or more bad batteries in each bank. Treat each bank independently and find out which it is. You'll need an inexpensive (<$50) multimeter and a battery hygrometer (hydrometer) to measure specific gravity of the acid in each cell.
To see if the charger's doing its job, charge them up fully and turn off both banks at the big switch. Measure the voltage of each bank with your multi-meter. A fully charged 32V bank should have 35.5 to 37.0 volts right after charging, depending on your charger. After sitting for an hour,turned off, they should have something over 34.5 to 35 volts. If they do, the charger's doing its job.
Then find out how much draw there is on each bank when they're turned on. You can do this with your multi-meter via an ammeter reading parallel setup. See your multimeter's owners manual. Do this when they're turned off (should be zero amps) and turned on. The batteries in the bank will have a known amp-hour rating. If you have four 8 volt batteries to make 32V, the amp-hours for the bank is the same as the amp-hours for one battery. Compare the amps of draw and the number of hours to draw down to dead batteries to the battery bank's amp-hour rating. It should match within maybe 75% accuracy (it's not that accurate of a test).
If the charger and the amp-hour capacity utilization both seem to be OK, you just have too much draw. Find it and fix it, usually by isolating each consumer one by one (turn every other circuit breaker off) to find what's causing the excess draw.
If the charger is doing its job, but the bank is being depleted too soon, find the bad batteries. Get a hygrometer, the kind that measures specific gravity NUMBERS and check each individual cell in each battery (wear golves and glasses of course). If the batteries are charged, it'll probably be around 1250 or so. There should not be a cell out of range with the other cells by more than about 10 points in any one battery. If 3 cells are at 1245, 1250 and 1250, and one is at 1200, that's a dead cell. If you find a battery with one or more cells out of range, that can keep the whole bank from being charged because it'll give the charger a false reading which shuts off the charger early and then the battery and bank can go from charged to dead in just a few minutes. Check every battery and replace the bad ones.
Good luck,
Doug Shuman