In the piece — titled “Can You Fool a Self Driving Car?” — Rober found that a Tesla car on Autopilot was fooled by a Wile E. Coyote-style wall painted to look like the road ahead of it, with the electric vehicle plowing right through it instead of stopping.

The footage was damning enough, with slow-motion clips showing the car not only crashing through the styrofoam wall but also a mannequin of a child. The Tesla was also fooled by simulated rain and fog.

  • /home/pineapplelover@lemm.ee
    link
    fedilink
    English
    arrow-up
    35
    arrow-down
    13
    ·
    edit-2
    5 hours ago

    To be fair, if you were to construct a wall and paint it exactly like the road, people will run into it as well. That being said, tesla shouldn’t rely on cameras

    Edit: having just watched the video, that was a very obvious fake wall. You can see the outlines of it pretty well. I’m also surprised it failed other tests when not on autopilot, seems pretty fucking dangerous.

    • Echo Dot@feddit.uk
      link
      fedilink
      English
      arrow-up
      13
      ·
      10 hours ago

      Watch the video it’s extremely obvious to a human driver that there is something wrong with that view ahead. It’s even pointed out in the video that humans use additional visual clues when a situation is ambiguous.

      The cars don’t have deduction and reasoning capabilities so they need additional sensors to give them more information to compensate due to their lack of brains. So it’s not really sensible to compare self-driving systems to humans. Humans have limited sensory input but it’s compensated for by reasoning abilities, Self-Driving cars do not have reasoning abilities but it’s compensated for by enhanced sensory input.

      • AA5B@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        4
        ·
        8 hours ago

        Huh, I thought the exact opposite. The clues were small. While they were sufficient for a focussed driver at slow speeds, it also looked like something that would fool a human at typical speeds and attention span.

        Painting exactly like the road is a gimmick that really doesn’t demonstrate anything.

        Personally I wished they went full looney tunes to better entertain us and to demonstrate that even significant clues may not be enough

    • utopiah@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      edit-2
      16 hours ago

      I’d take that bet. I imagine at least some drivers would notice something sus’ (due to depth perception, which should be striking as you get close, or lack of ANY movement or some kind of reflection) and either

      • slow down
      • use a trick, e.g. flicking lights or driving a bit to the sides and back, to try to see what’s off

      or probably both, but anyway as other already said, it’s being compared to other autopilot systems, not human drivers.

    • FuglyDuck@lemmy.world
      link
      fedilink
      English
      arrow-up
      27
      ·
      edit-2
      20 hours ago

      To be fair, if you were to construct a wall and paint it exactly like the road, people will run into it as well.

      this isn’t being fair. It’s being compared to the other- better- autopilot systems that use both LIDAR and radar in addition to daylight and infrared optical to sense the world around them.

      Teslas only use daylight and infrared. LIDAR and radar systems both would not have been deceived.

      • Echo Dot@feddit.uk
        link
        fedilink
        English
        arrow-up
        6
        ·
        10 hours ago

        So out of interest I looked it up.

        The new BYD cars that are coming out also have self-driving probably to directly compete with Tesla.

        However they do use lidar, and radar, and cameras, and infrared cameras, and ultrasonic sensors. All have to be working or the car won’t go into self-drive. So other companies consider even one of their sensors failing to be enough to disable self-driving capabilities yet Tesla are claiming that it’s perfectly safe to drive around with those features not even installed let alone functional.

        So yeah that’s a real bad look.

      • AA5B@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        4
        ·
        8 hours ago

        I don’t see how this test demonstrates anything is better. It is a gimmick designed for a specific sensor to get an intended result. Show me a realistic test if they want to be useful, or go full looney tunes if they want to be entertaining

        • oatscoop@midwest.social
          link
          fedilink
          English
          arrow-up
          2
          ·
          4 hours ago

          The cartoon wall is just an exagerated illustration of why a vision only system sucks compared to other systems.

          If you watch the rest of the video, you’d see Tesla’s vision only system is inferior to cars using radar/lidar in other, more realistic situations like heavy rain and fog.

    • comfy@lemmy.ml
      link
      fedilink
      English
      arrow-up
      16
      ·
      edit-2
      20 hours ago

      The video does bring up human ability too with the fog test (“Optically, with my own eyes, I can no longer see there’s a kid through this fog. The lidar has no issue.”) But, as they show, this wall is extremely obvious to the driver.

        • T156@lemmy.world
          link
          fedilink
          English
          arrow-up
          6
          ·
          18 hours ago

          They already have trouble enough with trucks carrying traffic lights, or with speed limit drivers on them.

            • Echo Dot@feddit.uk
              link
              fedilink
              English
              arrow-up
              4
              ·
              10 hours ago

              I have seen trucks with landscape scenes painted on the side and I’ve never crashed into one of those thinking that it was a portal to a random sunlit field.

              • FuglyDuck@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                10 hours ago

                see, that’s what you’re supposed to think. because you’re not special. but really, it’s a secret portal to a magical world, a world that’s very exciting for a few seconds.

    • TorJansen@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      6
      ·
      22 hours ago

      Yeah, the Roadrunner could easily skip by such barriers, frustrating the Coyote to no end. Tesla is not a Roadrunner.