I work for a non-profit as an IT Director, M-F 8:30 - 4:30. Don't work evenings or weekends ever.
Before getting into IT and non-profits, I had working hours all over the place including nights and weekends. My mission was to not work weekends or nights and spend that time with my wife, hobbies, and other things that aren't work-related.
Plenty of time for fun stuff: Hiking, dogs (got two), golfing, fishing, driving the stang, and sometimes just being outdoors.
Not saying life is easy and perfect, but it took a long time to get to my current situation of working normal hours, being debt-free, and planning for the future. One small goal at a time. I'm not old either, just in my early 30s.