Does GitHub Copilot Improve Code Quality? Here's How We Lie With Statistics | Jadarma's Blog
jadarma.github.io
A critique of GitHub's research blog and marketing-driven science.

Counter article: https://jadarma.github.io/blog/posts/2024/11/does-github-copilot-improve-code-quality-heres-how-we-lie-with-statistics/ about the original statistics article from Github this talk and blog post is about: https://github.blog/news-insights/research/does-github-copilot-improve-code-quality-heres-what-the-data-says/

If you rather like a reactionary video commentary to the article from The Primeagen: https://youtu.be/IxYN7DKefmI or watch on Invidious, a privacy focused web YouTube client without using YouTube directly: https://inv.nadeko.net/watch?v=IxYN7DKefmI

  • tyler
    1·
    18 days ago

    My team tested it out for our company (17k employees) and it was so bad we immediately said no. It wasn’t just harmful, it was actively intrusive. I’d be trying to type something and it would autocomplete the exact opposite of what I wanted to type. I was constantly deleting what it wrote because it was nowhere in the vicinity of being correct. The same experience was had across everyone else that tried it.

    Claude on the other hand is wonderful.

    • bleistift2@sopuli.xyzEnglish
      1·
      17 days ago

      trying to type something and it would autocomplete

      I don’t know what program you used, exactly, but if the autocompletion comes automatically, you’re doing it wrong. You start typing, check what Copilot is suggesting, ant if it is right, you accept it.

      • tyler
        1·
        15 days ago

        Except the defaults for copilot plugins automatically put them either on enter or tab, the normal completion mechanisms for any decent IDE.