Some updates to my rss to podcast pipeline and the quest for the best open-source TTS model.

A couple of years ago I decided to turn this blog into a podcast. At the time, I decided to make up a stupid rule: whatever model I use to clone my voice and generate article transcripts needs to be an open model.

  • PlanterTree@discuss.tchncs.deOPEnglish
    3·
    3 months ago

    The guy has pretty big constraints on his setup: Voice Cloning AND open source …

    At the top of the leaderboard is Kokoro. Kokoro is an amazing model! Especially for a modest 82 Million (!) parameters and a mere 360 MB (!). However, like many models in this leaderboard - I can’t use it - since it doesn’t support voice cloning.

    • BananaTrifleViolin@lemmy.worldEnglish
      2·
      3 months ago

      To be fair there are quite a few open source TTS AI engines that support voice cloning. Coqui TTS springs to mind. They do take some configuring and training to get right, especially for voice cloning, but it’s definitely doable opensource.

      Kokoro is designed to turn epubs into audio books, and designed to be lightweight. I think he’s looking at the wrong tools for his use case.