Not true. Foragers were quite resilient to stuff like drought, because they could just move along and ate foods from many different sources. Drought etc. started to become a real problem only once people were dependent on agriculture.