Do what's best for you, because at the end of the day you have to be able to stand yourself. If you feel like you're wasting your time doing the "right" thing, stop doing it and do what's right for you. Do not let the idea of fear hold you back. Whenever I decide to take a leap of faith and jump into something that terrifies me, I plunge ahead thinking of the greats who did exactly the same thing.
Yves Saint Laurent walked away from a career at Dior, sure there were special circumstances that lead to separating of the two entities but he did't just go home and stop designing. He opened his own house so he could be free to design what he wanted. Read or listen to books that inspire you. I currently have You Are A Badass on repeat overtime I get in the car. When I think things can't be done I think of the stories Jen includes in the text. How a friend of hers bought a villa in Italy with no money, a villa in Italy with no money!
Remember you have one life, I know it sounds cheesy but it's true. You have one life and it's yours. Do what you want. If you want to take off every weekend to a beach, sit down and crunch the numbers and then figure out how to do that. If you want to paint a room in your house pink, do it. Home Depot has some great colors, I personally like Pink Wink, Starlight Pink and Palm Beach Pink, but that's just me.
Im not saying become selfish, I'm just saying become selfish to a point, take care of yourself, mind, body and soul. If you get up and run everyday and hate it, stop. Try swimming instead, or surfing or pilates. The more you take care of yourself, the better you'll be, the happier and more free you will feel, the more good you will attract to you.
That being said, I'm off to a meditation, because that makes me feel good.