Family pressuring me to baptize son

Why is my family making me feel bad for not baptizing my son? I grew up catholic and have turned away from the religion years ago. I’ve told them that if I were to baptize my son right now, it wouldn’t be for God or for the faith. It would be to make you happy and that isn’t the right reason. My grandpa went as far as to say “I just hope you do you baptize him before I die” WHAT THE HECK?!