I'm not particularly in the same boat as you, but I somewhat agree with what you're saying. Working hard for the family is usually never a bad thing, but what's the point of it if you're not bonding with your kids or being a good dad to your kids?
From your descriptions of your father, I can understand why you have no respect for him and is unwilling to be open to him. If I had a father like that, I'd probably do things no different from what you're doing.
Also, it's CDadFA