"Sometime" isn't an invitation
"Let's hang out sometime" has no date, so nobody is on the hook. A specific invitation names a time, a place or a plan, and asks if it works for you. It means he actually intends to see you and is willing to risk hearing no.