Maybe I should just do it on weekends to test the waters?

That sounds like a great idea. Definitely don’t just quit your job without testing the idea first. Start cheap and small, and if there is enough demand, you can always upsize later.