It's great that you want to follow your passion! You're smart to do your homework ahead of time.
Most of the people I know who are involved in food prep on their own have a ServSafe certificate. It's not so much about your kitchen being inspected as about being trained yourself: https://www.servsafe.com/home
I'm not sure how regulations vary from state to state, but having your kitchen inspected is more than just having them look at cleanliness. You also need separate sinks for hand washing vs. dishwashing, for example. That will be covered, most likely, in ServSafe. Check with the health department (they inspect restaurants) and also check with the town clerk about what you need in for a business certificate. Zoning issues may apply too.
Beyond that, you need a marketing plan and a good website (as well as a way to drive traffic to it). This is not just a matter of having cute business cards - you need a real plan. That means an advertising/marketing professional. You have to distinguish yourself from other businesses, and determine what niche you will fill (who are your customers? - supermarkets, small independent markets, farm stands, private parties, what?). One baking company in my area got started with a woman setting up shop at the weekly farmer's market from May to October, and making products available for sale at some local farm stands too. She now has a storefront in town. Her specialty happens to be brownies and she has at least 6 different types. At the same markets there was also a bread baking vendor with rolls and loaves of various types. It's good visibility. You might consider that as a starting point just to get your name out there - you have time to get certified before May.