Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful youā€™ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cutā€™nā€™paste it into its own post ā€” thereā€™s no quota for posting and the bar really isnā€™t that high.

The post Xitter web has spawned soo many ā€œesotericā€ right wing freaks, but thereā€™s no appropriate sneer-space for them. Iā€™m talking redscare-ish, reality challenged ā€œculture criticsā€ who write about everything but understand nothing. Iā€™m talking about reply-guys who make the same 6 tweets about the same 3 subjects. Theyā€™re inescapable at this point, yet I donā€™t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldnā€™t be surgeons because they didnā€™t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I canā€™t escape them, I would love to sneer at them.

(Semi-obligatory thanks to @dgerard for starting this.)

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      9
      Ā·
      6 days ago

      AGI is coming, weā€™re already at the ā€œdumb guy who doesnā€™t understand math but thinks heā€™s smartā€ level

      • blakestacey@awful.systemsOP
        link
        fedilink
        English
        arrow-up
        6
        Ā·
        6 days ago

        Jim Propp once wrote,

        I asked ChatGPT, the modern apotheosis of unjustified self-confidence, to prove that .999ā€¦ is less than 1. Its reply began ā€œHere is a proof that .999ā€¦ is less than 1.ā€ It then proceeded to show (using familiar arguments) that .999ā€¦ is equal to 1, before majestically concluding ā€œBut our goal was to show that .999ā€¦ is less than 1. Hence the proof is complete.ā€ This reply, as an example of brazen mathematical non sequitur, can scarcely be improved upon.

    • froztbyte@awful.systems
      link
      fedilink
      English
      arrow-up
      9
      Ā·
      7 days ago

      Iā€™ve said it before a few times: this shit is a tunguska-level event on society today

      that thereā€™s now even retroactive contamination fallout is sickening :|

      • skillissuer@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        12
        Ā·
        6 days ago

        tunguska incident only wiped out local squirrel population and its fallout was inert. this is more like leaded gasoline: introduced for profit, polluting for decades, makes people dumber during entire duration of it, entrenches techbros and makes them responsible for development of infrastructure going forward

      • nightsky@awful.systems
        link
        fedilink
        English
        arrow-up
        12
        Ā·
        7 days ago

        Sooner or later the only remaining source of reliable digital information will be 1990s multimedia CD-ROM encyclopedias.

          • nightsky@awful.systems
            link
            fedilink
            English
            arrow-up
            3
            Ā·
            6 days ago

            As a fan of physical media, I recently bought another drive as a spare, currently is IMO a good time for that. They still make really good drives in large enough quantities so theyā€™re cheap, but that could end any time. Once production stops, they will vanish silently. Learned that lesson back then when floppy drives were suddendly goneā€¦ kinda wish I had stocked up a few new ones (for retro computing purposes) when they were still available.

          • Sailor Sega Saturn@awful.systems
            link
            fedilink
            English
            arrow-up
            10
            Ā·
            edit-2
            6 days ago

            Iā€™m the weirdo who installs blu-ray drives in all my computers. Iā€™m also the weirdo who has multiple computers. There are currently three or four (Iā€™ve lost count) blu-ray drives in my house.

            Itā€™s great being able to buy and own movies without dealing with the horrors of streaming. Unfortunately discs are becoming less and less popular commercially, so a lot of stuff nowadays is streaming only.

            Also my car can play MP3 CDs so of course I need to be able to create those from a computer disregard the fact that my car also supports USB which I neglect since itā€™s less retro.

            • BigMuffin69@awful.systems
              link
              fedilink
              English
              arrow-up
              7
              Ā·
              6 days ago

              My father-in-law is a hoarder of both physical and digital things. His house is filled with hard drives where he has like stored copies of every movie ever made as mp4s and then he sends the drives to us because he has no physical space for them since he has junk from like 30 years ago piling up in the living room. So now my house is filled with random ass hard drives of (definitely not pirated) movies.

            • ShakingMyHead@awful.systems
              link
              fedilink
              English
              arrow-up
              2
              Ā·
              5 days ago

              Yeah, wanted to get the new seasons of Futurama on bluray as a gift, turns out that they only are on streaming. Of course.

  • Sailor Sega Saturn@awful.systems
    link
    fedilink
    English
    arrow-up
    4
    Ā·
    edit-2
    5 days ago

    Days since last open source issue tracker pollution by annoying nerds: zero

    My investigation tracked to you [Outlier.ai] as the source of problems - where your instructional videos are tricking people into creating those issues to - apparently train your AI.

    I couldnā€™t locate these particular instructional videos, but from what I can gather outlier.ai farms out various ā€œtasksā€ to internet gig workers as part of some sort of AI training scheme.

    Bonus terribleness: one of the tasks a few months back was apparently to wear a head mounted camera ā€œdeviceā€ to record ones every waking moment.

    • istewart@awful.systems
      link
      fedilink
      English
      arrow-up
      4
      Ā·
      6 days ago

      Oof yeah, thatā€™s rough. The AI generated header image isnā€™t helping his credibility, either. Didnā€™t he happily trot along to one of the rat conventions in Berkeley, and everyone was wondering why?

      The Ballyā€™s story is its own source of hilarity - not only are they scrambling to fund this Chicago thing, theyā€™re also making promises about a Las Vegas resort that will host the ex-Oakland Aā€™s in what would be the smallest major league baseball stadium; with equally ??? funding gaps that their client press is all too happy to ignore.

    • froztbyte@awful.systems
      link
      fedilink
      English
      arrow-up
      11
      Ā·
      12 days ago

      I recall seeing something of this sort happening on goog for about 12~18mo - every so often a researcher post does the rounds where someone finds Yet Another way goog is fucking it up

      the advertising dept has completely captured all mindshare and it is (demonstrably) the only part that goog-the-business cares about

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      13
      Ā·
      7 days ago

      Youā€™d think the AI safety chuds would have more reservations about using GPT, which they believe has sapience, to learn things. They have the concept of an AI being a good convincer, which, hey, idiots, how have none of you thought the great convincing has started? Also, how have none of you realised that maybe you should be a little harder to convince in general???

      • YourNetworkIsHaunted@awful.systems
        link
        fedilink
        English
        arrow-up
        9
        Ā·
        7 days ago

        It is a long-established truth that itā€™s significantly easier to con someone who thinks theyā€™re smarter than you. Also as I think about it a little bit there seems to be a reasonable corollary of their approach towards Bayesian thinking that you not question anything that matches your expectations, which is exactly how you get taken advantage of by the kind of grifter theyā€™re attached to. Like, theyā€™ve been thinking about the singularity for long enough that the Sams (bankman-fried, Altman, etc) have a well-developed script for what they expect the first stages to look like and it is, as demonstrated, very easy to fake that.

    • istewart@awful.systems
      link
      fedilink
      English
      arrow-up
      11
      Ā·
      12 days ago

      Hmm, surely there is no downside to doing all of oneā€™s marketing, both personal* and professional, through the false certainty and low signal of short-form social media. The leopard has only licked Samā€™s face, it will never bite and begin chewing!

      *You and I may find the concept of a ā€œpersonal brandā€ to be horrifying, but these guys clearly want to become brands more fervently than Bruce Wayne wanted to become a bat

  • istewart@awful.systems
    link
    fedilink
    English
    arrow-up
    14
    Ā·
    8 days ago

    This is a thought Iā€™ve been entertaining for some time, but this weekā€™s discussion about Ars Technicaā€™s article on Anthropic, as well as the NIH funding freeze, finally prodded me to put it out there.

    A core strategic vulnerability that Musk, his hangers-on, and geek culture more broadly havenā€™t cottoned onto yet: Space is 20th-century propaganda. Certainly, there is still worthwhile and inspirational science to be done with space probes and landers; and the terrestrial satellite network wonā€™t dwindle in importance. I went to high school with a guy who went on to do his PhD and get into research through working with the first round of micro-satellites. Resources will still be committed to space. But as a core narrative of technical progress to bind a nation together? Itā€™s gassed. The idea that ā€œit might be ME up there one day!ā€ persisted through the space shuttle era, but it seems more and more remote. Going back to the moon would be a remake of an old television show, that went off the air because people ended up getting bored with it the first time. Boots on Mars (at least healthy boots with a solid chance to return home) are decades away, even if we start throwing Apollo money at it immediately. The more outlandish ideas like orbital data centers and asteroid mining donā€™t have the same inspirational power, because they are meant to be private enterprises operated by thoroughly unlikeable men who have shackled themselves to a broadly destructive political program.

    For better or worse, biotechnology and nanotechnology are the most important technical programs of the 21st century, and by backgrounding this and allowing Trump to threaten funding, the tech oligarchs kowtowing to him right now are undermining themselves. Biotech should be obvious, although regulatory capture and the impulse for rent-seeking will continue to hold it back in the US. I expect even more money to be thrown at nanotechnology manufacturing going into the 2030s, to try to overcome the fact that semiconductor scaling is hitting a wall, although most of what Iā€™ve seen so far is still pursuing the Drexlerian vision of MEMS emulating larger mechanical systemsā€¦ which, if itā€™s not explicitly biocompatible, is likely going down a cul-de-sac.

    Everybodyā€™s looking for a positive vision of the future to sell, to compete with and overcome the fraudulent tech-fascists who lead the industry right now. A program of accessible technology at the juncture of those two fields would not develop overnight, but could be a pathway there. Am I off base here?

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      12
      Ā·
      7 days ago

      This seems like yet another disconnect between however the fuck science communication has been failing the general public and myself.

      Like when you say space I think, fuck yeah, space! Those crisp pictures of Pluto! Pictures of black holes! The amazing JWST data! Gravitational waves detection! Recreating the conditions of the early universe in particle accelerators to unlock the secrets of spacetime! Just most amazing geek shit that makes me as excited as I was when I was 12 looking at the night sky through my cheap-ass telescope.

      Who gives a single fuck about sending people up there when we have probes and rovers, true marvels of engineering, feeding us data back here? Did you know Voyager 1, Voyager Fucking ONE, almost 50 years old probe, over 150 AU away from Earth, is STILL SENDING US DATA? We engineered the fuck of that bolt bucket so that even the people that designed it are surprised by how long it lasted. You think a human would last 50 years in the interstellar medium? I donā€™t fucking think so.

      Weā€™re unlocking the secrets of the universe and confirming theories from decades ago, has there been a more exciting time to be a scientist? Wouldnā€™t you want to run a particle accelerator? Do science on the ISS? Be the engineer behind the next legendary probe that will benefit mankind even after youā€™re gone? If you canā€™t spin this into a narrative of technical progrees and humans being amazing then thatā€™s a skill issue, you lack fucking whimsy.

      And I donā€™t think thereā€™s a person in the world less whimsical than Elon fucking Musk.

    • gerikson@awful.systems
      link
      fedilink
      English
      arrow-up
      11
      Ā·
      8 days ago

      Agree with space travel being retro-futurist fluff. Itā€™s very rich men badly remembering mediocre science fiction.

      The US could lead the world in innovation in green technology but thatā€™s now tainted by wokeness.

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      6
      Ā·
      8 days ago

      Hmm, any sort of vision for generating public support for development of a technology has to have either ideological backing or a profit incentive. I donā€™t say this to mean that the future must be profitable, rather, I say this to mean that you donā€™t get the space race if western powers arenā€™t afraid of communism appearing as a viable alternative to capitalism, on both ideological and commercial fronts.

      Unfortunately, a vision of that kind is necessarily technofascist. Rather than look for a tech-forward vision of the future, we need deprogram ourselves and unlearn the unspoken narratives that prop up capitalism and liberal democracy as the only viable forms of society. We need to dismantle the systems and structures that require the complex political buy-in for projects that are clearly good for society at large.

      Uh, I guess Iā€™ve kind of gone completely orthogonal to your point of discussion. Iā€™m kind of saying the collapse of the US is inevitable.

      • BlueMonday1984@awful.systems
        link
        fedilink
        English
        arrow-up
        12
        Ā·
        8 days ago

        On another somewhat orthogonal point, I suspect AI has likely soured the public on any kinda tech-forward vision for the foreseeable future.

        Both directly and indirectly, the AI slop-nami has caused a lot of bad shit for the general public - from plagiarism to misinformation, from shit-tier AI art to screwing human artists, the public has come to view AI as an active blight on society, and use of AI as a virtual ā€œKick Meā€ sign.

        • FredFig@awful.systems
          link
          fedilink
          English
          arrow-up
          9
          Ā·
          8 days ago

          Iā€™ve been struggling with what the appropriate level of engagement for all the tech shit is.

          I can stick to making fun of the AI crap and whatever else the tech people shit out because itā€™s tangible for me, and I can more or less be an effective gatekeeper for my community, but the problems go beyond just a bunch of rich tech weirdos floating bad ideas, itā€™s what theyā€™re trying to paper over. The fact that theyā€™re incompetent at it is very funny, but Iā€™ve been laughing with gritted teeth for too long.

      • blakestacey@awful.systemsOP
        link
        fedilink
        English
        arrow-up
        11
        Ā·
        8 days ago

        For the US to avoid collapse, the Democrats would have to sweep the board in multiple successive elections and be more unified and committed to deep reform than they ever have been.

        I will pause for the laughter to fade.

        • swlabr@awful.systems
          link
          fedilink
          English
          arrow-up
          12
          Ā·
          8 days ago

          Snark answer: for the US to avoid collapse, the democrats will have to do literally anything, so yeah collapse is inevitable.

          Optimistic answer: a third, actually leftist, anti-liberal party suddenly gains popularity and power and reforms the US entirely.

          Realistic answer: trump and the republicans will fully construct a fascist chokehold over the US probably by the end of this year at the earliest. Anyone who has any hope in non-violent action is deluding themselves.

        • Sailor Sega Saturn@awful.systems
          link
          fedilink
          English
          arrow-up
          11
          Ā·
          8 days ago

          In completely related news Iā€™m strongly considering getting my affairs in order and moving anywhere in the entire world besides the united states somewhere in Europe; as itā€™s apparently no longer safe for trans people or C++ developers* in the US. So if anyone has any advice (or job leads) please do share.

          * This is a memory safety joke

        • swlabr@awful.systems
          link
          fedilink
          English
          arrow-up
          5
          Ā·
          7 days ago

          ah, am conflating the cold war and the space race. Though, why the nations wanted to develop ICBMs is entirely relevant.

      • istewart@awful.systems
        link
        fedilink
        English
        arrow-up
        10
        Ā·
        8 days ago

        No actually, I think what you have to say is in line with my broader point. As the top source of global consumer demand, America is primarily held together by its supply chains at this point. To be crude about it, the best reasons to be an American in the 21st century are the swag and the cheap gas. When the MAGA and Fox News crowd are pointing fingers and ranting about Marxism, theyā€™re actively trying to obscure materialism and keep people from thinking about material conditions. Having a material program, that at least has elements that can be built from the bottom up, is at least as crucial as having an electoral program. I know the Four Thieves people got rightfully shredded here a few weeks back, and that kind of technical pushback on amateur dreams is necessary, so itā€™s a tough needle to thread. But for instance, consider Gavin Newsomā€™s plan to have California operate its own insulin production, within existing systems and regulations: https://calmatters.org/health/2025/01/insulin-production-gavin-newsom/ This is a Newsom policy I actually think is a fantastic idea, and a big credit to him if it happens! But itā€™s bogged down in the production-line validation stage, because we already know how to synthesize insulin and that itā€™s effective. And the production may not even be in California when it happens! Thereā€™s plenty of room for improvement here.

        Space and centralized, rent-seeking ā€œAIā€ are not material programs that improve conditions for the broader population. The original space program was successful because a more tightly controlled media environment gave the opportunity to use it to cover for the missile development that was the enduring practical outcome. Positive consumer outcomes from all that have always felt, to me, like something that was bolted onto the history later. We wouldnā€™t have Tang and transistors if not for Apollo! Well, one is kind of shitty and useless, the other is so overwhelmingly advantageous that it surely would have happened anyway.

        And to your last point, I somewhat sadly feel like a lot of doomer shit I was reading ~15 years ago actually prepared me to at least be unsurprised about the situation weā€™re in. A lot of those writers (James Howard Kunstler, John Michael Greer for instance) have either softly capitulated, or else happily slotted themselves into the middle of the red-brown alliance. I think thatā€™s a big part of why weā€™re at where weā€™re at: a lot of people who were actually willing to consider the idea of American collapse were perfectly fine with letting it happen.

  • BigMuffin69@awful.systems
    link
    fedilink
    English
    arrow-up
    14
    Ā·
    11 days ago

    Reposting this for the new week thread since it truly is a record of how untrustworthy sammy and co are. Remember how OAI claimed that O3 had displayed superhuman levels on the mega hard Frontier Math exam written by Fields Medalist? Funny/totally not fishy story haha. Turns out OAI had exclusive access to that test for months and funded its creation and refused to let the creators of test publicly acknowledge this until after OAI did their big stupid magic trick.

    From Subbarao Kambhampati via linkedIn:

    "šŽš§ š­š”šž š¬šžšžšš² šØš©š­š¢šœš¬ šØšŸ ā€œš‘©š’–š’Šš’š’…š’Šš’š’ˆ š’‚š’ š‘Øš‘®š‘° š‘“š’š’‚š’• š’ƒš’š š‘Ŗš’š’“š’“š’‚š’š’š’Šš’š’ˆ š‘©š’†š’š’„š’‰š’Žš’‚š’“š’Œ š‘Ŗš’“š’†š’‚š’•š’š’“š’”ā€ hashtag#SundayHarangue. One of the big reasons for the increased volume of ā€œš€š†šˆ š“šØš¦šØš«š«šØš°ā€ hype has been o3ā€™s performance on the ā€œfrontier mathā€ benchmarkā€“something that other models basically had no handle on.

    We are now being told (https://lnkd.in/gUaGKuAE) that this benchmark data may have been exclusively available (https://lnkd.in/g5E3tcse) to OpenAI since before o1ā€“and that the benchmark creators were not allowed to disclose this *until after o3 *.

    That o3 does well on frontier math held-out set is impressive, no doubt, but the mental picture of ā€œš’1/š’3 š’˜š’†š’“š’† š’‹š’–š’”š’• š’ƒš’†š’Šš’š’ˆ š’•š’“š’‚š’Šš’š’†š’… š’š’ š’”š’Šš’Žš’‘š’š’† š’Žš’‚š’•š’‰, š’‚š’š’… š’•š’‰š’†š’š š’ƒš’š’š’•š’”š’•š’“š’‚š’‘š’‘š’†š’… š’•š’‰š’†š’Žš’”š’†š’š’—š’†š’” š’•š’ š’‡š’“š’š’š’•š’Šš’†š’“ š’Žš’‚š’•š’‰ā€ā€“that the AGI tomorrow crowd seem to haveā€“that š˜–š˜±š˜¦š˜Æš˜ˆš˜ š˜øš˜©š˜Ŗš˜­š˜¦ š˜Æš˜°š˜µ š˜¦š˜¹š˜±š˜­š˜Ŗš˜¤š˜Ŗš˜µš˜­š˜ŗ š˜¤š˜­š˜¢š˜Ŗš˜®š˜Ŗš˜Æš˜Ø, š˜¤š˜¦š˜³š˜µš˜¢š˜Ŗš˜Æš˜­š˜ŗ š˜„š˜Ŗš˜„š˜Æā€™š˜µ š˜„š˜Ŗš˜³š˜¦š˜¤š˜µš˜­š˜ŗ š˜¤š˜°š˜Æš˜µš˜³š˜¢š˜„š˜Ŗš˜¤š˜µā€“is shattered by this. (I have, in fact, been grumbling to my students since o3 announcement that I donā€™t completely believe that OpenAI didnā€™t have access to the Olympiad/Frontier Math data before handā€¦ )

    I do think o1/o3 are impressive technical achievements (see https://lnkd.in/gvVqmTG9 )

    š‘«š’š’Šš’š’ˆ š’˜š’†š’š’ š’š’ š’‰š’‚š’“š’… š’ƒš’†š’š’„š’‰š’Žš’‚š’“š’Œš’” š’•š’‰š’‚š’• š’šš’š’– š’‰š’‚š’… š’‘š’“š’Šš’š’“ š’‚š’„š’„š’†š’”š’” š’•š’ š’Šš’” š’”š’•š’Šš’š’ š’Šš’Žš’‘š’“š’†š’”š’”š’Šš’—š’†ā€“š’ƒš’–š’• š’…š’š’†š’”š’ā€™š’• š’’š’–š’Šš’•š’† š’”š’„š’“š’†š’‚š’Ž ā€œš‘Øš‘®š‘° š‘»š’š’Žš’š’“š’“š’š’˜.ā€

    We all know that data contamination is an issue with LLMs and LRMs. We also know that reasoning claims need more careful vetting than ā€œš˜øš˜¦ š˜„š˜Ŗš˜„š˜Æā€™š˜µ š˜“š˜¦š˜¦ š˜µš˜©š˜¢š˜µ š˜“š˜±š˜¦š˜¤š˜Ŗš˜§š˜Ŗš˜¤ š˜±š˜³š˜°š˜£š˜­š˜¦š˜® š˜Ŗš˜Æš˜“š˜µš˜¢š˜Æš˜¤š˜¦ š˜„š˜¶š˜³š˜Ŗš˜Æš˜Ø š˜µš˜³š˜¢š˜Ŗš˜Æš˜Ŗš˜Æš˜Øā€ (see ā€œIn vs. Out of Distribution analyses are not that useful for understanding LLM reasoning capabilitiesā€ https://lnkd.in/gZ2wBM_F ).

    At the very least, this episode further argues for increased vigilance/skepticism on the part of AI research community in how they parse the benchmark claims put out commercial entities."

    Big stupid snake oil strikes again.

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      15
      Ā·
      11 days ago

      Every time they go ā€˜this wasnt in the dataā€™ it turns out it was. A while back they did the same with translating rareish languages. Turns out it was trained on it. Fucked up. But also, wtf how are they expecting this to stay secret and there being no backlash? This world needs a better class of criminals.

      • FredFig@awful.systems
        link
        fedilink
        English
        arrow-up
        13
        Ā·
        11 days ago

        The conspiracy theorist who lives in my brain wants to say its intentional to make us more open to blatant cheating as something thatā€™s just a ā€œcost of doing business.ā€ (I swear I saw this phrase a half dozen times in the orange site thread about this)

        The earnest part of me tells me no, these guys are just clowns, but I dunno, they canā€™t all be this dumb right?

        • self@awful.systems
          link
          fedilink
          English
          arrow-up
          12
          Ā·
          11 days ago

          holy shit, thatā€™s the excuse theyā€™re going for? they cheated on a benchmark so hard the results are totally meaningless, sold their most expensive new models yet on the back of that cheated benchmark, further eroded the scientific process both with their cheating and by selling those models as better for scientific researchā€¦ and these weird fucks want that to be fine and normal? fuck them

          • David Gerard@awful.systemsM
            link
            fedilink
            English
            arrow-up
            9
            Ā·
            11 days ago

            they canā€™t even sell o3 really - in o3 high mode, needed to do this level of query, itā€™s about $1000 per query lol

            • self@awful.systems
              link
              fedilink
              English
              arrow-up
              4
              Ā·
              11 days ago

              do you figure itā€™s $1000/query because the algorithms they wrote with their insider knowledge to cheat the benchmark are very expensive to run, or is it $1000/query because theyā€™re grifters and all high mode does is use the model trained on frontiermath and allocate more resources to the query? and like any good grifter, theyā€™re targeting whales and institutional marks who are so invested that throwing away $1000 on horseshit feels like a bargain

              • froztbyte@awful.systems
                link
                fedilink
                English
                arrow-up
                3
                Ā·
                edit-2
                11 days ago

                so, for an extremely unscientific demonstration, here (warning: AWS may try hard to get you to engage with Explainer[0]) is an instance of an aws pricing estimate for big handwave ā€œsome gpu computeā€

                and when I say ā€œextremely unscientificā€, I mean ā€œI largely pulled the numbers out of my assā€. even so, theyā€™re not entirely baseless, nor just picking absolute maxvals and laughing

                parameters assumptions made:

                • ā€œsomewhat beefyā€ gpu instances (g4dn.4xlarge, selected through the tried and tested ā€œsquint until it looks rightā€ method)
                • 6-day traffic pattern, excluding sunday[1]
                • daily ā€œ4h peakā€ total peak load profile[2]
                • 50 instances mininum, 150 maximum (letā€™s pretend weā€™re not openai but are instead some random fuckwit flybynight modelfuckery startup)
                • us west coast
                • spot instances, convertible spot reserves, 3y full prepay commit (yeah I know full vs partial is a big diff; once again, snore)

                (and before we get any fucking ruleslawyering dumb motherfuckers rolling in here about accuracy or whatever: get fucked kthx. this is just a very loosely demonstrative example)

                so youā€™d have a variable buffer of 50ā€¦150 instances, featuring 3.2ā€¦9.6TiB of RAM for working set size, 800ā€¦2400 vCPU, 50ā€¦150 nvidia t4 cores, and 800ā€¦2400GiB gpu vram

                letā€™s presume a perfectly spherical ops team of uniform capability[3] and imagine that we have some lovely and capable active instance prewarming and correct host caching and whatnot. yā€™know, things to reduce user latency. letā€™s pretend weā€™re fully dynamic[4]

                so, by the numbers, then

                1y times 4h daily gives us 1460h (in seconds, thatā€™s 5256000). this extremely inaccurate full-of-presumptions number gives us ā€œservice-capable life timeā€. the times your concierge is at the desk, the times you can get pizza delivered.

                x3 to get to lifetime matching our spot commit, x50ā€¦x150 to get to ā€œtotal possible instance hoursā€. which is the top end of our sunshine and rainbows pretend compute budget. which, of course, we still have exactly no idea how to spend. because we donā€™t know the real cost of servicing a query!

                but letā€™s work backwards from some made-up shit, using numbers The Poor Public gets (vs numbers Free Microsoft Credits will imbue unto you), and see where we end up!

                so that means our baseline:

                • upfront cost: $4,527,400.00
                • monthly: $1460.00 (x3 x12 = $52560)
                • whatever the hell else is incurred (s3, bandwidth, ā€¦)
                • >=200k/y per ops/whatever person we have

                3y of 4h-daily at 50 instances = 788400000 seconds. at 150 instances, 2365200000 seconds.

                so we can say that, for our deeply Whiffs Ever So Slightly values, a secondā€™s compute on the low instance-count end is $0.01722755 and $0.00574252 at the higher instance-count end! which gives us a bit of a handle!

                this, of course, entirely ignores parallelism, n-instance job/load/whatever distribution, database lookups, network traffic, allllllll kinds of shit. which we canā€™t really have good information on without some insider infrastructure leaks anyway. if we pretend to look at the compute alone.

                so what does $1000/query mean, in the sense of our very ridiculous and fantastical numbers? since the units are now The Same, we can simply divide things!

                at the 50 instance mark, weā€™d need to hypothetically spend 174139.68 instance-seconds. thatā€™s 2.0154 days of linear compute!

                at the 150 instance mark, 522419.05 instance-seconds! 6.070 days of linear compute!

                so! what have we learned? well, weā€™ve learned that we couldnā€™t deliver responses to prompts in Reasonable Time at these hardware presumptions! which, again, are linear presumptions. and thereā€™s gonna be a fair chunk of parallelism and other parts involved here. but even so, turns out itā€™d be a bit of a sizable chunk of compute allocated. to even a single prompt response.

                [0] - a product/service whose very existence I find hilarious; the entire suite of aws products is designed to extract as much money from every possible function whatsoever, leading to complexity, which they then respond to byā€¦ producing a chatbot to ā€œguide usersā€

                [1] - yes yes I know, the world is not uniform and the fucking promptfans come from everywhere. Iā€™m presuming amerocentric design thinking (which imo is probably not wrong)

                [2] - letā€™s pretend that the calculatorsā€™ presumption of 4h persistent peak load and our presumption of short-duration load approaching 4h cumulative are the same

                [3] - oh, who am I kidding, you know itā€™s gonna be some dumb motherfuckers with ansible and k8s and terraform and chucklefuckery

                • froztbyte@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  4
                  Ā·
                  11 days ago

                  when digging around I happened to find this thread which has some benchmarks for a diff model

                  itā€™s apples to square fenceposts, of course, since one llm is not another. but it gives something to presume from. if g4dn.2xl gave them 214 tok/s, and if we make the extremely generous presumption that tok==word (which, well, no; cf. strawberry), then any Use Deserving Of o3 (letā€™s say 5~15k words) would mean you need a tok-rate of 1000~3000 tok/s for a ā€œreasonableā€ response latency (ā€œ5-ish secondsā€)

                  so youā€™d need something like 5x g4dn.2xl just to shit out 5000 words with dolphin-llama3 in ā€œquickā€ time. which, again, isnā€™t even whatever the fuck people are doing with openaiā€™s garbage.

                  utter, complete, comprehensive clownery. era-redefining clownery.

                  but some dumb motherfucker in a bar will keep telling me itā€™s the future. and I get to not boop 'em on the nose. le sigh.

          • FredFig@awful.systems
            link
            fedilink
            English
            arrow-up
            6
            Ā·
            edit-2
            11 days ago

            They understand that all of the major model providers is doing it, but since the major model providers are richer than they are, they canā€™t possibly ask OpenAI and friends to stop, so in their heads, it is what it is and therefore must be allowed to continue.

            Or at least, thatā€™s my face value read of it, I certainly hope Iā€™m simplifying things too much.

      • V0ldek@awful.systems
        link
        fedilink
        English
        arrow-up
        9
        Ā·
        11 days ago

        But also, wtf how are they expecting this to stay secret and there being no backlash?

        No, they bet on it not mattering and theyā€™ve been completely right thus far.

  • skillissuer@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    13
    Ā·
    edit-2
    11 days ago

    til that thereā€™s not one millionaire with family business in south african mining in current american oligarchy, but at least two. (thielā€™s father was an exec at mine in what is today Namibia). (they mined uranium). (it went towards RSA nuclear program). (thatā€™s easily most ghoulish thing iā€™ve learned today, but iā€™m up only for 2h)

    • froztbyte@awful.systems
      link
      fedilink
      English
      arrow-up
      8
      Ā·
      11 days ago

      thereā€™s probably a fair couple more. tracing anything de beers or a good couple of other industries will probably indicate a couple more

      (my hypothesis is: the kinds of people that flourished under apartheid, the effect that had on local-developed industry, and then the ā€œwider worldā€ of opportunities prey they got to sink their teeth into after apartheid went away; doubly so because staying ZA-only is extremely limiting for ghouls of their sort - itā€™s a fixed-size pool, and the still-standing apartheid-vintage capital controls are Limiting for the kinds of bullshit they want to pull)

  • Sailor Sega Saturn@awful.systems
    link
    fedilink
    English
    arrow-up
    12
    Ā·
    edit-2
    7 days ago

    I hope everyone is ready for the constant overlap between politics and AI / Silicon Valley; because Iā€™m not.

    Trump Admin Accused of Using AI to Draft Executive Orders (Source Bluesky Thread).

    Iā€™m not 100% sure I buy that the EOs were written by AI rather than people who simply donā€™t care about or donā€™t know the details; but it certainly looks possible. Especially that example about the Gulf of Mexico. Either way I am heartened that this is the conclusion people jump to.

    Aside: I also like how much media is starting to cite bluesky (and activitypub to a lesser extent). I assume a bunch of journalists moved off of twitter or went multi-platform.

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      9
      Ā·
      7 days ago

      Isnā€™t this one of the things that LW was spooked by? Giving the reins to an AI? Wonā€™t someone think of the wrongers???

    • YourNetworkIsHaunted@awful.systems
      link
      fedilink
      English
      arrow-up
      6
      Ā·
      7 days ago

      Thanks, I hate it.

      Especially because Trumpā€™s legal teams have historically been more than incompetent enough to produce this kind of work on their own.

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        8
        Ā·
        7 days ago

        In a way that they have been historically awful and thwarted by the courts is a thing that worries me. Iā€™d expect that somebody the past 8 years went ā€˜this time we will not be bogged down in thatā€™. But considering they went 100% in on repression from day 1 Iā€™m slightly less worried about that.

        For context, going all in on day 1 is actually bad for them, when the nazis took over The Netherlands/Belgium they methods there differed. In .nl they worked slowly and with gov already there, in .be they went full pogroms a lot faster. This meant that in .be a lot of people saw the threat sooner (WW1 and Belgium prob also didnā€™t help) and acted and took better care of the vulnerable. The amount of Dutch Jewish people who survived ww2 vs Belgian Jewish people is very tragic. (and a very dark part of our history which we donā€™t really talk about like this as mentioning that parts of your own country also are to blame for the holocaust is not a thing a lot of people want to talk about). At least I hope that stuff like going all crazy on the bishop will turn out to be big wakeup for random Americans and a strategic mistake on their part, they certainly didnā€™t seem to have learned from the nazis (at least not this lesson, which fits with how fascism is blind for their own mistakes).

        • YourNetworkIsHaunted@awful.systems
          link
          fedilink
          English
          arrow-up
          5
          Ā·
          6 days ago

          I donā€™t know if this is good news for the underlying risk of how willing the nuts and bolts of society are to resist unlawful or monstrous policies. IDK, on the subject of complicity I think the fact that we eventually joined the war has caused a deep cultural amnesia about how much influence the Reich had on the states and vice versa. Charles Lindbergh, Madison Square Garden, etc. We didnā€™t really acknowledge how much our cultural and political structures are open to authoritarianism, much less addressing those issues.

  • BurgersMcSlopshot@awful.systems
    link
    fedilink
    English
    arrow-up
    11
    Ā·
    11 days ago

    Banner start to the next US presidency, with Wiener Von Wrong tossing a Nazi salute and the ADL papering that one over as an ā€œawkward gestureā€. 2025 is going to be great for my country.

    Incidentally is ā€œWiener Von Wrongā€ or ā€œWernher Von Brownnoseā€ better?