I'm confused, should I go for it?

Sounds like a good connection, I would continue trying to foster this relationship. Do not worry about the age difference. My wife and I are separated in age by twenty years and we have a great marriage. We met just like you and your guy. Good luck