Wealthier societies are in general much healthier. People live longer. Pushing growth can allow many more social welfare oriented gains to happen, like concern for the environment.
My point we need to recognize any thing that hurts economic growth isn’t just about money: people will lead shorter lives that are lacking in other ways.