New Footage Shows Tesla On Autopilot Crashing Into Police Car After Alerting Driver 150 Times::Six officers who were injured in the crash are suing Tesla despite the fact that the driver was allegedly impaired

  • hoodlem@hoodlem.me
    link
    fedilink
    English
    arrow-up
    150
    ·
    1 year ago

    In fact, by the time the crash happens, it’s alerted the driver to pay more attention no less than 150 times over the course of about 45 minutes. Nevertheless, the system didn’t recognize a lack of engagement to the point that it shut down Autopilot

    I blame the driver, but if the above is true there was a problem with the Tesla as well. The Tesla is intended to disengage and disable autopilot for the remainder of the drive after a small number of ignored alerts. If the car didn’t do that, there’s a bug in the Tesla software.

    I think it’s more likely the driver used a trick to make the car think he was engaged when he was not. You can do things like put a water bottle wedged in the steering wheel to make the car think you have tugged on the steering wheel to prove you are engaged. (Don’t ask me how I know)

    • NeoNachtwaechter@lemmy.world
      link
      fedilink
      English
      arrow-up
      75
      arrow-down
      1
      ·
      1 year ago

      The Tesla is intended to disengage and disable autopilot

      What about: slow down, pull up to the right, stop the car, THEN disengage?

        • thekinghaslost@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          1 year ago

          IIRC it doesn’t pull up to the side, but it does slow down slowly and safely until a full-stop.

          Then the autopilot disengage.

        • NeoNachtwaechter@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          3
          ·
          1 year ago

          That wasn’t what it did here.

          Like all the poor delusional fanbois here, you are going on the wrong assumption that some warning has been ignored. Just watch the initial video again and listen better this time.

          • Technoguyfication@lemmy.ml
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            2
            ·
            1 year ago

            I’m not even replying to the article or the original commenter. I’m replying to the person that said “why doesn’t the car slow down and stop when the warnings are ignored?” which is precisely what it does.

            I’m far from a Tesla fanboy, and there is no shortage of valid criticisms against Tesla. However, misrepresenting what autopilot does in the event of a forced disengagement isn’t right either.

    • RushingSquirrel@lemm.ee
      link
      fedilink
      English
      arrow-up
      33
      ·
      1 year ago

      After 3 alerts, it’s off until you park. There are visual cues that precede the alert though and these do not count. I don’t recall how many there are and for how long, but you start by seeing a message asking to have your hands on the wheel, then a blue line at the top, them the line starts pulsing ,then you’ve got an audio alert that is the first strike. Three strikes during the same drive and you need to park before using autopilot again.

  • daikiki@lemmy.world
    link
    fedilink
    English
    arrow-up
    76
    arrow-down
    11
    ·
    1 year ago

    I have a lot of trouble understanding how the NTSB (or whoever’s ostensibly in charge of vetting tech like this) is allowing these not-quite self driving cars on the road. The technology doesn’t seem mature enough to be safe yet, and as far as I can tell, nobody seems to have the authority or be willing to use that authority to make manufacturers step back until they can prove their systems can be integrated safely into traffic.

    • SpaceNoodle@lemmy.world
      link
      fedilink
      English
      arrow-up
      78
      arrow-down
      6
      ·
      1 year ago

      It’s just ADAS - essentially fancy cruise control. There are a number of autonomous vehicle companies who are carefully and successfully developing real self-driving technology, and Tesla should be censured and forbidden for labeling their assistance software as “full self-driving.” It’s damaging the real industry.

    • RushingSquirrel@lemm.ee
      link
      fedilink
      English
      arrow-up
      28
      arrow-down
      2
      ·
      1 year ago

      That’s similar to cruise control. Cruise control can be dangerous because someone could fall asleep (not having to manage your speed can afford up sleepiness) and the car wouldn’t slow down.

      In my opinion, those options are all the driver’s responsibility to know their own limit and understand that the tool is just a tool and you are responsible to making sure your driving is safe for others. Tesla autopilot adds a ton of safety features that avoid a lot of collisions based on lacking attention, sleepiness, and actively avoiding other drivers faults. But it’s still just a tool and the driver is responsible of their own car and driving.

    • Not_Alec_Baldwin@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      3
      ·
      1 year ago

      It’s not “not-quite-self-driving” though, it’s literal garbage. It’s cruise control, lane assist and brake assist. The robot vision in use is horrible.

      There are Tesla engineers bad mouthing the system openly.

      Musk is a scammer and they need to issue an apology for all of the claims around autopilot, probably pay a great deal of money, and then change the name and advertising around it.

      Oh, and also this guy should never drive again.

  • zerbey@lemmy.world
    link
    fedilink
    English
    arrow-up
    70
    arrow-down
    8
    ·
    1 year ago

    150 more warnings than a regular car would give, ultimately it’s the driver’s fault.

  • CaptainProton@lemmy.world
    link
    fedilink
    English
    arrow-up
    51
    arrow-down
    2
    ·
    edit-2
    1 year ago

    This is stupid. Teslas can park themselves, they’re not just on rails. It should be pulling over and putting the flashers on if a driver is unresponsive.

    That being said, the driver knew this behavior, acted with wanton disregard for safe driving practices, and so the incident is the driver’s fault and they should be held responsible for their actions. It’s not the courts job to legislate.

    It’s actually the NTSB’s job to regulate car safety so if they don’t already have it congress needs to grant them the authority to regulate what AI behavior is acceptable/define safeguards against misbehaving AI.

    • socsa@lemmy.ml
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      There’s no way the headline is true. Zero percent. The car will literally do exactly what you stated if it goes too long without driver engagement and I’ve experienced it first hand.

    • chris2112@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      The driver is responsible for this accident, Tesla still should be liable imo for all the shady and outright misleading advertising around their so called “self driving”. Compare Tesla’s marketing to like GMs of Hyundai’s, both of which essentially have parity with Teslas system in terms of actual features, and you’ll see a big difference

    • dzire187@feddit.de
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      1 year ago

      It should be pulling over and putting the flashers on if a driver is unresponsive.

      Yes. Actually, just stopping in the middle of the road with hazard lights would be sufficient.

      • limelight79@lemm.ee
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        I turned off the “lane assist” in our Mazda because it kept steering me back toward obstacles I was trying to avoid, like cyclists, oversized loads, potholes, etc. I don’t know why anyone thought that was a good idea.

        But try buying a car without those features now…sigh.

  • thatKamGuy@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    47
    ·
    1 year ago

    Driver is definitely the one ultimately at fault here, but how is it that Tesla doesn’t perform an emergency stop in this situation - but just barrels into an obstacle?

    Even my relatively ‘dumb’ car with adaptive cruise control handles this type of situation better than Tesla?!

  • Jeena@jemmy.jeena.net
    link
    fedilink
    English
    arrow-up
    43
    ·
    1 year ago

    So if the guy behind the wheel died and couldn’t react to the alerts then the car can’t do a decision to just stop instead of crashing into a police car?

    • pec@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      8
      ·
      edit-2
      1 year ago

      He was reacting to alerts, complying to them by simply touching the steering wheel. He did that 150 times during that 45 minute trip ( not all the trip was on auto pilot).

      So if the guy died the car would of disengaged auto pilot (I’m not sure how this works).

      You can check the video in the article. It’s quite informative .

      Edit

      I saw another video and it takes ~60 seconds after taking off your hand from the steering wheel for the car to safely come to a full stop.

        • Landmammals@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          Was he drunk? The article seems to use the fact that the car nagged him 150 times as evidence that he was impaired.

  • Md1501@lemmy.world
    link
    fedilink
    English
    arrow-up
    36
    arrow-down
    1
    ·
    1 year ago

    You know what might work, program the car so that after the second unanswered “alert” the autopilot pulls the car over, or reduces speed and turns on the hazards. The third violation of this auto pilot is disabled for that car for a period of time.

    • HalcyonReverb@midwest.social
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      1 year ago

      I drive a Ford Maverick that is equipped with adaptive cruise control, and if I were to get 3 “keep your hands on the wheel” notifications, it deactivates adaptive cruise until the vehicle is completely turned off and on again. It blew my mind to learn that Tesla doesn’t do something similar.

      • tony@lemmy.hoyle.me.uk
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        It does and did… He kept driving anyway. Drink drivers FTW.

        I presume AEB kicked in but all that can do is reduce the speed of inpact… if you’re determined to kill yourself there’s not much the car can do.

          • CmdrShepard@lemmy.one
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            1 year ago

            The problem with this is what if the car thinks there’s a barrier in front of you but there isn’t? People are arguing that these systems are too intrusive while also arguing that they don’t go far enough to take control away from drivers.

            This situation happened because a drunk driver ran into police cars, something that has been happening for as long as cars have existed.

            • Obi@sopuli.xyz
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 year ago

              That’s the issue with current “self driving” systems in a nutshell. We’re in this terrible middle ground right now where these features let careless drivers take their attention away, but not actually be able to control the vehicle safely. We should ban all that crap until actual self driving is viable.

              • CmdrShepard@lemmy.one
                link
                fedilink
                English
                arrow-up
                0
                arrow-down
                1
                ·
                1 year ago

                How does it become viable if you ban the technology? What we have now is advanced cruise control that protects drivers in some circumstances while having zero effect in others. Drivers were equally dumb and careless long before this technology existed. This new tech doesn’t make that aspect any worse. Banning it now just means more people will crash and more people will be injured.

    • Technoguyfication@lemmy.ml
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      1 year ago

      This is literally exactly how it works already. The driver must have been pulling on the steering wheel right before it gave him a strike. The system will warn you to pay attention for a few seconds before shutting down. Here’s a video: https://youtu.be/oBIKikBmdN8

        • stealin@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          The system with cars is that you don’t distract the driver from driving, having a system that takes over driving is exactly that, so the idea of the system is flawed to begin with.

      • NeoNachtwaechter@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        edit-2
        1 year ago

        The system will warn you to pay attention

        … and if we have learned anything from that incident, it is that the warnings have been worthless.

        The system can be tricked even by the worst drunkards! 150 times in a row.

        for a few seconds before shutting down.

        Few seconds are not enough. The crash was already unavoidable.

  • N3Cr0@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    arrow-down
    1
    ·
    1 year ago

    Poor drunk impaired driver falling victim to autonomous driving… Hopefully that driver lost their license.

    • Cyber Yuki@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      3
      ·
      1 year ago

      That doesn’t drive the problem of autopilot not taking the right choices. What is the driver wasn’t drunk, but they had a heart attack? What if someone put a roofie on their drink? What if the driver was diabetic or hypoglycemic and suffered a blood glucose fall? What if they had a stroke?

      Furthermore, what if the driver got drunk BECAUSE the car’s AI was advertised as being able to drive for you? Think of false publicity.

      If your AI can’t handle one simple case of a driver being unresponsive, that’s negligence on the company’s part.

      • CmdrShepard@lemmy.one
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        How could the company be negligent if someone gets drunk or has a heart attack and crashes their car? No company has a Level 5 autonomous vehicle where no human intervention is needed. Tesla is only Level 2. Mercedes has a Level 3 option (in extremely limited conditions). Waymo claims Level 4 but is geofenced.

  • Jordan Lund@lemmy.one
    link
    fedilink
    English
    arrow-up
    37
    arrow-down
    17
    ·
    1 year ago

    Don’t see how that’s a Tesla problem… Drunk/high driver operating their car incorrectly.

        • coffeebiscuit@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          3
          ·
          1 year ago

          It was on autopilot, so technically the drunk wasn’t driving it. But he is the one responsible.

          • Jordan Lund@lemmy.one
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            1
            ·
            1 year ago

            Autopilot doesn’t work that way, the drunk should have known that when he wasn’t drunk and not tried to use it that way.

            It’s like the old shaggy dog story about the guy driving a camper, setting the cruise control, then going into the back to make lunch.

            That’s not the fault of the cruise control.

  • r00ty@kbin.life
    link
    fedilink
    arrow-up
    17
    arrow-down
    1
    ·
    1 year ago

    I’m not so sure disengaging autopilot because the driver’s hands were not on the wheel while on a highway, is the best option. Engage hazard lights, remain in lane (or if able move to the slowest lane) and come to a stop. Surely that’s the better way?

    Just disengaging the autopilot seems like such a copout to me. Also the fact it disengaged right at the end “The driver was in control at the moment of the crash” just again feels like bad “self” driving. Especially when the so-called self-driving is able to come to a stop as part of its software in other situations.

    Also if you cannot recognize an emergency vehicle (I wonder if this was a combination of the haze and the usually bright emergency lights saturating the image it was trying to analyse) it’s again a sign you shouldn’t be releasing this to the public. It’s clearly just not ready.

    Not taking any responsibility away from the human driver here. I just don’t think the behaviour was good enough for software controlling a car used by the public.

    Not to mention, of course, the reason for suing Tesla isn’t because they think they’re more liable. It’s because they can actually get some money from them.

      • NeoNachtwaechter@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        1 year ago

        That’s not the main problem. It is more like an excuse. The main problem has been explained in the video right before that:

        Their radar is bad at recognizing immobile cars on the road. This means all objects. All obstacles on your road!

        The emergency vehicles just happen to be your most frequent kind of obstacles.

        The fallback to the camera is a bad excuse anyway, because radar is needed first to detect any obstacles. The cam will usually be later (=at closer distance) than the radar.

        The even better solution (Trigger warning: nerdy stuff incoming) is to always mix all results of all kinds of sensors at an early stage in the processing software. That’s what european car makers do right from the beginning, but Tesla is way behind with their engineering. Their sensors still work indepently, and each does their own processing. So every shortcoming of one sensor creates a faulty detection result that has to be covered later (read: seconds later, not milliseconds) by other kinds of sensors.

        • Blaidd@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 year ago

          Their radar is bad at recognizing immobile cars on the road. This means all objects. All obstacles on your road!

          Teslas don’t use radar, just cameras. That’s why Teslas crash at way higher rates than real self driving cars like Waymo.

        • r00ty@kbin.life
          link
          fedilink
          arrow-up
          2
          arrow-down
          1
          ·
          1 year ago

          Their radar is bad at recognizing immobile cars on the road. This means all objects. All obstacles on your road!

          I feel like this is bad tech understanding in journalism (which is hardly new). There’s no reason radar couldn’t see stationary vehicles. In fact, very specifically, they’re NOT stationary relative to the radar transceiver. Radar would see them no problem.

          My actual suspicion here is that Tesla actively ignores stationary vehicles (it can know they’re stationary by adding its known speed to the relative speed) not in front of the vehicle. Now, in normal streets this makes sense (or at least those on the non-driver’s side). Do you pay attention to every car parked by the side of the road when driving? You’re maybe looking for signs of movement, or lights on, etc. But you’re not tracking them all, and neither will the autopilot. However, on a highway if you have more than 1 vehicle on the shoulder every now and then it should be making you wonder what else is ahead (and I’d argue a single car on the shoulder is a risk to keep watch on). A long line of them should definitely make you slow down.

          I think Human drivers would do this, and I think an autopilot should be considering what kind of road it is on, and whether it should treat scenarios different.

          I also have another suspicion, but it’s just a thought. If this Tesla was really using radar as well as cameras, haze or not, it should have seen that stationary vehicle further ahead than it did. Since newer Tesla cars don’t have radar, and coming from a software development background, I can actually see a logical (in terms of corporate thinking) reason to remove the code for radar. They would do this simply because they will not want to maintain it if they have no plans to return to radar. Think of it like this. After a few versions of augmenting the camera detection logic, it is unlikely to work with the existing radar logic. Do they spend the time to make them work together for the older vehicles, or only allow camera based AI on newer software versions? I would suspect the latter would be the business decision.

      • r00ty@kbin.life
        link
        fedilink
        arrow-up
        2
        ·
        1 year ago

        The question here is, could you see there was a reason to stop the car significantly (more than 3 seconds) before the autopilot did? If we can recognize it through the haze the autopilot must too.

        Moreover, it needs to now be extra good at spotting vehicles in bad lighting conditions because other sensors are removed on newer Teslas. It only has cameras to go on.

  • redcalcium@lemmy.institute
    link
    fedilink
    English
    arrow-up
    10
    ·
    edit-2
    1 year ago

    Data from the Autopilot system shows that it recognized the stopped car 37 yards or 2.5 seconds before the crash.

    Is the video slowed down? In the video, if you pause 2.5s before the crash, the stopped police car seems to be very close already. A (awake) human driver would’ve recognized the stopped police car from way more distance than that.

    • Thetimefarm@lemm.ee
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      I find that it can be hard to tell when a car ahead is stopped, maybe the visual system on the tesla has similar limitations. I think autopilot is controlled by the cameras alone but I’m not super up to date on tesla stuff. I would assume even a basic radar set up could tell something was stationary from quite far away.

  • Peanut@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    2
    ·
    1 year ago

    i still think tesla did a poor job in conveying the limitations on the larger scale. they piggybacked waymo’s capability and practice without matching it, which is probably why so many are over reliant. i’ve always been against mass-producing semi-autonomous vehicles to the general public. this is why.

    and then this garbage is used to attack the general concept of autonomous vehicles, which may become a fantastic life-saver, because then it can safely drive these assholes around.

  • hark@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    1
    ·
    1 year ago

    Setting aside the driver issue, isn’t this another case that could’ve been prevented with LIDAR?

    • Thorny_Thicket@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      13
      arrow-down
      13
      ·
      edit-2
      1 year ago

      Tesla on autopilot/FSD is almost 4 times less likely to be involved in a crash than a human driven Tesla which even then is half as likely to end up in a accident compared to average car. You not liking Musk fortunelately doesn’t change these facts.

      In the 2nd quarter, we recorded one crash for every 4.41 million miles driven in which drivers were using Autopilot technology (Autosteer and active safety features). For drivers who were not using Autopilot technology (no Autosteer and active safety features), we recorded one crash for every 1.2 million miles driven. By comparison, NHTSA’s most recent data shows that in the United States there is an automobile crash every 484,000 miles.

      Source

      • tiny_electron@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        19
        arrow-down
        1
        ·
        1 year ago

        There is a bias here in the numbers. Teslas are expensive and not everyone is buying them. The lower accident rate can be explained by the different demographic driving the vehicle rather than Teslas being better. For exemple, younger people might be more likely to cause accident because of different factors and they are also less likely to buy a Tesla because they are so expensive. I dont have the numbers for this, but we should all be careful with the claims of Tesla on safety when they compared themself to the global average.

        • Thorny_Thicket@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          8
          ·
          1 year ago

          Sure. There are always multiple factors in play. However I’d still be willing to bet that there’s nothing in Teslas that makes them inherently unsafe compared to other cars.

        • Thorny_Thicket@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          12
          ·
          1 year ago

          Perhaps. I’m sure you’ll provide me with the independent data you’re basing that “Teslas are not safe” claim on

            • narp@feddit.de
              link
              fedilink
              English
              arrow-up
              5
              arrow-down
              3
              ·
              1 year ago

              You made the first comment: “Teslas aren’t safe”, without providing proof.

              And now you’re calling someone a hypocrite because he asks for data of exactly what you claimed, while you’re redefining your first argument as “the contrary”.

              So, do you have proof that Tesla’s aren’t safe in comparison to other cars, or is it just your opinion?

                • narp@feddit.de
                  link
                  fedilink
                  English
                  arrow-up
                  3
                  arrow-down
                  2
                  ·
                  1 year ago

                  But you can’t base a fact on one accident. Or even multiple. What if newspapers like to write especially about Tesla accidents to generate clicks?

                  Teslas seemingly have a lot of accidents, but without checking the statistics and comparing it to other manufacturers you wouldn’t really know if the perceived truth is a fact or not.

            • Thorny_Thicket@sopuli.xyz
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              5
              ·
              edit-2
              1 year ago

              Tesla model Y scored the highest possible score on IIHS crash test as well as 5 stars on Euro NCAP

              Their other models have similar results. I believe Model X is the safest SUV ever made.

              EDIT:

              More than just resulting in a 5-star rating, the data from NHTSA’s testing shows that Model X has the lowest probability of injury of any SUV it has ever tested," Tesla said in a statement. "In fact, of all the cars NHTSA has ever tested, Model X’s overall probability of injury was second only to Model S.

              Source

              Also might want to check this

              EDIT2: Imagine downvoting the guy providing hard evidence and upvoting the fanatic making baseless claims backed by nothing

                • Thorny_Thicket@sopuli.xyz
                  link
                  fedilink
                  English
                  arrow-up
                  3
                  arrow-down
                  4
                  ·
                  1 year ago

                  Or maybe you’re so blinded by the hatred towards Musk that you can’t even think straight and no evidence in the world could convince you otherwise?

                  You really should’ve checked the last link.

      • NeoNachtwaechter@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        2
        ·
        edit-2
        1 year ago

        almost 4 times less likely to be involved in a crash than a human driven

        Not relevant at all here, when we are discussing occurences that seem so easily and obviously avoidable.

        (But it’s nice to see that the Fanboi team is awake now)