To the OP;
be as selfish as you want concerning this. It is YOUR life, you only get one, so continue going down the path that makes YOU happy. If ANY one can't understand that, be willing to participate in that, without pressuring you into shit you don't want, you don't need it.
Good luck.