• Gerudo@lemm.ee
    link
    fedilink
    arrow-up
    50
    ·
    7 months ago

    Damn this could help me every day. i have trouble understanding people if there is background noise.

  • onlinepersona
    link
    fedilink
    English
    arrow-up
    38
    arrow-down
    5
    ·
    7 months ago

    Amazing. And they even made it opensource! I’m amazed at how readable it is, even though I don’t get most of it. Code written by people with 20 years of C experience looks leagues worse than what this repo looks like. Bravo!

    Anti Commercial-AI license

  • saigot@lemmy.ca
    link
    fedilink
    arrow-up
    16
    ·
    edit-2
    7 months ago

    If this application is legit it’s going to get snatched up by Apple/Amazon/Google to make their voice assistants better, right now they can’t handle cross talk at all.

    • BlameThePeacock@lemmy.ca
      link
      fedilink
      English
      arrow-up
      7
      ·
      7 months ago

      This particular implementation doesn’t really apply to those situations, there are already existing technologies which can pre-train on specific voices they could be using for that since the target is known. The main “improvement” from this system is that you can train it on any target subject, even with background noise, in only a few seconds.

      It’s most useful in scenarios they’ve outlined in their study, like using it with your friend you ran into on the bus, your tour guide, etc.

  • MHLoppy@fedia.io
    link
    fedilink
    arrow-up
    4
    ·
    7 months ago

    Cool idea, though I was surprised by the level of fidelity loss in the fountain example. I would’ve expected that to be a good case scenario for noise cancellation so maybe it just needs some more time to iterate and improve on its level of “false positive” removal.

  • lemmeout@lemm.ee
    link
    fedilink
    arrow-up
    4
    arrow-down
    1
    ·
    7 months ago

    The video fails to explain what about this is “AI” as opposed to active noise cancelling with some regular old signal processing.

    • floofloof@lemmy.caOP
      link
      fedilink
      English
      arrow-up
      10
      ·
      7 months ago

      I think once it has taken a profile of the voice it no longer requires you to be facing the person because it can now recognize that voice among the noise. The AI but is taking an imprint of the voice and then extracting it.

    • blindsight@beehaw.org
      link
      fedilink
      arrow-up
      5
      ·
      7 months ago

      To add to what the other poster said:

      I’m not an expert, but my understanding is that noise cancellation works by inverting sounds waves to deaden the sound. So, like, if you add sin(x) and –sin(x) you get 0.

      This system is actively adding inverted sound waves to cancel most sounds. What makes this system unique is that it samples the voice and uses the unique “voice print” to selectively not invert the sound waves from the targeted voice.

      Or that’s what I’m getting from reading this, as a layman.