Batteries contain heavy metals which are toxic and harmful for the environment (nickel, cadmium, mercury, lead, iron, zinc, calcium, aluminium, magnesium, lithium). It is important to recycle them and not let them degrade in nature.
SOLUTION
There is no easy solution. They need to be collected and sent to specialised industries which recycle batteries. see batrec: batrec.ch