Really Hate Aero...Stick with it or switch back to a road bike?

Is it just comfort, or handling?   Handling just takes getting used to.  But if comfort, have you had a fit on the bike? [ETA if I could read right, looks like you have not   )    TT bikes can be uncomfortable if not fit correctly so wonder if that's the issue.   The bike may not be the correct size for you

But ultimately you have to ride what you are comfortable on   Plenty of folks do HIMs on road bikes (i'd still recommend a fit, with clip on bars though)

Could be but also, not turtling your head as much and relaxing helps quite a bit.  Frameless glasses or a visor make it easier to look up the road.

Pros can endure discomfort a little more because they're not on the bike as long.

Could be a couple things in your case, but it would be shame to have an aero TT bike and not ride it because it's too uncomfortable. 

1. Make sure you're not in a wacky setup

Usually this isn't a problem if you got some sort of fitting at a bike shop, but you should check youtube for 'aero positioning' just to get the basic recommendations for aero positioning. They're pretty simple - stuff like 1-4 inches of seat to aerobar pad drop, elbow angle, etc. Photo yourself from the side and make sure you're not in any wacky setup.

2. Get it comfortable

This may mean a less steep body position. One easy way to check it out is to do a trainer workout and just put some folded towels under your elbows to give yourself 1-5 cm of extra height and see if that helps things. If so, you can then add spacers to the stem to get a similar position. 

3. Train more in aero

If your discomfort isn't too bad, and you have a reasonable position (you can just find youtube videos that tell you the simple guidelines to a basic aero setup), your pain should improve as you acclimate to the position. Even a perfect aero position will be uncomfortable to someone who has never spent any time in it or a lot of time in the drops on a road bike.