The general population doesn't know what's happening, and it doesn't even know that it doesn't know.
Of course, a positive growth rate might be taken as evidence that a population is below its optimum.
It's never a good idea to organize society in a way that depletes the energy of half the population.
Along with issues like global warming, I think a problem with the world today is population decline.