I stopped going out fishing at sunrise a few years ago when I noticed it didn't matter. Either the fish were there or they weren't, no different than any other time of the day.
Yet, for some reason, I still feel the need to be out at sunrise to go for a squirrel hunt.
I think the main reason for being out there so early is for these sunrises.
It's definitely not for the squirrels. They're lazy, they get up and about when they feel like it. Today I timed them. I saw three, the first at 9 AM, the second at 11:15 AM and the last was at 12:15 PM.
Hardly worth being out there so early, except, of course, for the sunrise.