Saving tax with business income

I was thinking to start a business. I need to pay a hefty tax with my current salaried income. Needed some inputs if I can save taxes if I own a small business. Would it help in saving taxes because first year of most businesses incur losses. And there is cost involved to setup that business. What are your thoughts on this?