• foggy@lemmy.world
    link
    fedilink
    English
    arrow-up
    17
    ·
    edit-2
    9 months ago

    Well they fuggin broke it.

    I’ve never had it act more stupid than it has today. I’m literally about to cancel and try Gemini Advanced or CoPilot Pro.

    Anyone got any experience with either, I’m all ears.

    • RonSijm
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      edit-2
      10 months ago

      I use Copilot, but dislike it for coding. The “place a comment and Copilot will fill it in” barely works, and is mostly annoying. It works for common stuff like “// write a function to invert a string” that you’d see in demos, that are just common functions you’d otherwise copypaste from StackOverflow. But otherwise it doesn’t really understand when you want to modify something. I’ve already turned that feature off

      The chat is semi-decent, but the “it understands the entire file you have open” concept also only just works half of time, and so the other half it responds with something irrelevant because it didn’t get your question based on the code / method it didn’t receive.

      I opted to just use the OpenAI API, and I created a slack bot that I can chat with (In a slack thread it works the same as in a “ChatGPT context window”, new messages in the main window are new chat contexts) - So far that still works best for me.

      You can create specific slash-commands if you like that preface questions, like “/askcsharp” in slack would preface it with something like “You are an assistant that provides C# based answers. Use var for variables, xunit and fluentassertions for tests”

      If you want to be really fancy you can even just vectorize your codebase, store it in Pinecone or PGVector, and have an “entire codebase aware AI”

      It takes a bit of time to custom build something, but these AIs are basically tools. And a custom build tool for your specific purpose is probably going to outperform a generic version

        • Eager Eagle@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          10 months ago

          I second this. GH Copilot for coding is an amazing tool, not just for boilerplate, but to fill complementary logic, brainstorm test cases, rewriting and refactoring, reducing typos or “copy and paste” errors, documentation, prototyping code from a human-written description, and probably several other things at different levels of competence.

          Makes me wonder what people that don’t find it useful are trying to do with it. Sure you’ll probably need or want to change some things, but that’s miles ahead of having to write it from zero.

          Hell, if you start declaring a function with a good name and good names + types for the arguments, it’ll often write an implementation that is mostly correct using the rest of the file as context.

        • RonSijm
          link
          fedilink
          English
          arrow-up
          1
          ·
          10 months ago

          Well I have Copilot Pro, but I was mainly talking about GitHub Copilot. I don’t think having the Copilot Pro really affects Copilot performance.

          I meanly use AI for programming, and (both for myself to program and inside building an AI-powered product) - So I don’t really know what you intend to use AI for, but outside of the context of programming, I don’t really know about their performance.

          And I think Copilot Pro just gives you Copilot inside office right? And more image generations per day? I can’t really say I’ve used that. For image generation I’m either using the OpenAI API again (DALL-E 3), or I’m using replicate (Mostly SDXL)

          • foggy@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            10 months ago

            I mainly use it for troubleshooting stuff, which includes everything from bash to node and react, Python to …DNS. idk.

            Copilot Pro, confusingly, isn’t GitHub copilot related. I do have GitHub copilot, I agree gpt4 is better in general, just not in my IDE.

            Idk how Microsoft has bungled this naming… They own GitHub now right?!

            So there’s Microsoft Copilot, which is like bing chat for windows. But now there is Microsoft Copilot Pro for $20/mo, which uses gpt4 turbo. Haven’t seen much on it.

            And even more recently, Google Bard is now Gemini, but you can do Gemini Ultra for $20/mo. Supposedly trying to contend with ChatGPT 4 as well.

            • abhibeckert@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              edit-2
              10 months ago

              Idk how Microsoft has bungled this naming

              You haven’t followed been following Microsoft for long have you? The first version of Windows was version 3.0 (there were technically earlier versions but they were “a work in progress” and weren’t really usable at all). The third version of Xbox was called “Xbox One”.

              • foggy@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                ·
                9 months ago

                I have been using Windows since before 3.0.

                Your point, while comical, is kind of irrelevant as far as naming two independent products the same thing.

    • Defaced@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      10 months ago

      I’ve briefly used bard before they rolled it into Gemini and bard was really quick and accurate. Now that bard is Gemini they seem to have deliberately handicapped the performance of the free product as it really needs very specific prompts to get an answer that’s helpful and takes twice as long as bard. Currently I use codeium (not to be confused with codium which is another ai code product) for code reviewing and a linter, and bing AI for general questions. Bing AI is quick, but I’ve noticed it provides the simplest and quickest answers it can provide, almost like it provides the first answer it finds and nothing else, that can be good and bad. As for copilot, I refuse to pay for it because it really is a good product and should be available to everyone that wants to learn coding, but I get it, they gotta make money I just think it’s bullshit to withhold something like that.

      • foggy@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        9 months ago

        Did you pay for advanced or are you referring to the thing everyone has access to?

        • s0ckpuppet@kbin.social
          link
          fedilink
          arrow-up
          2
          ·
          9 months ago

          Free one. I found it to be a lot worse than Chat GPT’s free tier. I didn’t test it mega in depth but I threw some of the same “rewrite this copy but make it better in <this> way” sort of tasks I’ve used GPT for and it turned around ridiculously bad writing.

          I then asked it if it thought that what it had produced was good writing and comically it told me that it was bad and full of cliches and that I should avoid using it. I’m not making that up.

          • foggy@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            9 months ago

            I’m not interested in reviews of the free tier. I’m looking to see how ChatGPT4 compares with Copilot Pro and Gemini Advanced.