To switch or not to switch

I'm a lawyer, 2 years into it, I love my profession, however I have also developed interest in baking. I want to pursue a professional career in baking. I'm confused about leaving my present profession for baking. I also cannot afford to do side baking business as my profession demands my full time. I'm confused of what to do.