{"author":"DeepLogin","children":[{"author":"readthenotes1","children":[{"author":"kyleee","children":[],"created_at":"2026-11-19T03:17:33.000Z","created_at_i":1795058253,"id":50555615,"options":[],"parent_id":50555529,"points":null,"story_id":50554641,"text":"Correct, because no self respecting white student would be eating Doritos; they prefer Takis","title":null,"type":"comment","url":null},{"author":"PeeMcGee","children":[{"author":"what","children":[{"author":"sky2224","children":[],"created_at":"2026-11-19T04:41:51.000Z","created_at_i":1795063311,"id":50556154,"options":[],"parent_id":50555918,"points":null,"story_id":50554641,"text":"How? The topic of not making your AI model racist has been around for a long time.","title":null,"type":"comment","url":null},{"author":"arvid-lind","children":[],"created_at":"2026-11-19T05:18:18.000Z","created_at_i":1795065498,"id":50556342,"options":[],"parent_id":50555918,"points":null,"story_id":50554641,"text":"You&#x27;re uninformed if that&#x27;s your take.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T04:00:09.000Z","created_at_i":1795060809,"id":50555918,"options":[],"parent_id":50555771,"points":null,"story_id":50554641,"text":"Unhinged.","title":null,"type":"comment","url":null},{"author":"autoexec","children":[{"author":"metalman","children":[],"created_at":"2026-11-19T08:30:25.000Z","created_at_i":1795077025,"id":50557470,"options":[],"parent_id":50556101,"points":null,"story_id":50554641,"text":"Tests for AI racial desrimination are not mandated, yet, but are an inevitability.\n We could work up a joke about driving while bieng AI, ok too egdy and wry to be very funny, but still.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T04:30:33.000Z","created_at_i":1795062633,"id":50556101,"options":[],"parent_id":50555771,"points":null,"story_id":50554641,"text":"The AI must have been trained on all the police reports and news articles where police mistook common everyday items for deadly firearms when black people hold them such as cordless phones, cellphones, wallets, canes, hair brushes, gas pump nozzles, bicycle parts, sun glasses, pill bottles, ipods, Wii remotes, toy trucks, cologne bottles, sandwiches, bibles, candy bars, shower rods, flashlights, broomsticks, underwear, beer bottles, wrenches, and vape pens. AI really is just a reflection of ourselves.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T03:36:46.000Z","created_at_i":1795059406,"id":50555771,"options":[],"parent_id":50555529,"points":null,"story_id":50554641,"text":"&gt; is the implication that AI would not have identified the bag of Doritos as a weapon on white Students?<p>Yes","title":null,"type":"comment","url":null},{"author":"johnpython","children":[{"author":"VladVladikoff","children":[],"created_at":"2026-11-19T04:06:41.000Z","created_at_i":1795061201,"id":50555958,"options":[],"parent_id":50555808,"points":null,"story_id":50554641,"text":"Where do they mention feeling threatened?","title":null,"type":"comment","url":null},{"author":"mitchdoogle","children":[],"created_at":"2026-11-19T04:13:10.000Z","created_at_i":1795061590,"id":50555995,"options":[],"parent_id":50555808,"points":null,"story_id":50554641,"text":"And you should question why you feel the need to imply others were threatened when they didn&#x27;t mention that word or give any indication that they were.","title":null,"type":"comment","url":null},{"author":"drdaeman","children":[{"author":"eesmith","children":[{"author":"drdaeman","children":[{"author":"eesmith","children":[{"author":"belorn","children":[],"created_at":"2026-11-19T13:51:48.000Z","created_at_i":1795096308,"id":50560111,"options":[],"parent_id":50558264,"points":null,"story_id":50554641,"text":"Image training data can only ever hold surface details, and will thus always results in discrimination. Factors that will impact the decision process, among others, are gender, age, race, physical fitness, clothing, hair color and style, accessories, gate, and more. Algorithms based on image training data is guarantied to make unfair and biased decisions.<p>Change gender, age, and many of the other aspects in the correct direction and the AI in this case would likely not have flagged the bag as a gun. There is no way to fix AI so they make fair and unbiased decision in that regard, and so the tool is unfit for that purpose.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T10:19:35.000Z","created_at_i":1795083575,"id":50558264,"options":[],"parent_id":50557968,"points":null,"story_id":50554641,"text":"Your criticism seems directed towards the HN submitter, as the actual title is:<p>&quot;Lawyers\u2019 Committee Files Lawsuit on Behalf of Black Students Detained and Searched Due to AI Alert Falsely Identifying a Bag of Chips as a Firearm&quot;<p>while the alternatives you mentioned, like \u201cGinger high school students sue after AI mistakes\u2026\u201d are variants of the HN title &quot;Black high school students sue after AI mistakes Doritos bag for gun&quot;.<p>Since you think the headline is supposed to contain the most important details, can you explain why &quot;high school&quot; is one of the most important details, even more important than Black, as your objection has only been to that last detail.<p>Then repeat with why we need to know it was specifically &quot;Doritos&quot; chips.<p>You wrote &quot;totally fails to provide any more details that connect to it&quot; but it links to <a href=\"https:&#x2F;&#x2F;www.lawyerscommittee.org&#x2F;ai-civil-rights-act&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.lawyerscommittee.org&#x2F;ai-civil-rights-act&#x2F;</a> with more details which connect to it, where you can see their viewpoint (quoting the one-pager):<p>```As AI has increasingly been unleashed on the public, millions of Americans are impacted by the outputs of complex algorithms that few of us understand. Algorithms are used to make decisions about all aspects of our lives, determining who gets bail, who can rent a house, and where we can go to school.<p>Those decisions haven\u2019t been made equitably or fairly. Over and over again, promises of innovation have resulted in products that lead to discrimination, disproportionately harming Black communities and other communities of color. Because these algorithmic technologies are built using data that reflects generations of redlining and segregation, they often replicate and reinforce generations of discrimination. Because the teams that develop and deploy these products often don\u2019t resemble the people that are affected by them, blind spots and biased assumptions are baked in. Because inadequate testing doesn\u2019t reflect the diversity of the real world, our lives and experiences are reduced to the narrow parameters of lab conditions which work against us.<p>The irony is deep. The tools of the future are locking us into the mistakes of the past.```","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T09:40:51.000Z","created_at_i":1795081251,"id":50557968,"options":[],"parent_id":50556879,"points":null,"story_id":50554641,"text":"Yes, both examples are not entirely random groups.<p>Problem is in the article itself being sloppy. Unlike your comment, it highlights a detail in the title then totally fails to provide any more details that connect to it. There\u2019s that one story and then a statement that some communities are affected more, and that\u2019s about it. And this explanation gap doesn\u2019t <i>feel</i> right: the most important detail of the story (for why else would it get into the title) ultimately gets a couple relevant sentences in the whole text - that just cannot be right for some.<p>And then people ask \u201cwhy Black\u201d and other people accuse of racism\u2026 and so goes the misunderstanding.<p>Just one of many possible explanations, of course.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T07:03:28.000Z","created_at_i":1795071808,"id":50556879,"options":[],"parent_id":50556371,"points":null,"story_id":50554641,"text":"&gt; \u201cGoth high school students sue after AI mistakes\u2026\u201d - with a sociocultural group.<p>That&#x27;s pretty much our universe.<p>After the Columbine massacre in 1999 there were a lot of rumors and headlines about how goth culture was a major contributing factor to blame, with Marilyn Manson as a scapegoat.<p>A Goth kid wearing a trenchcoat was eyed suspiciously as being the next killer in hiding.<p>There was a widespread satanic panic at the time, including training some police to recognize &quot;satanic ritual abuse&quot;. Had there been AI the time you know that some of the training data would have included these so-called &quot;indicators&quot;, leading to false notifications resulting in a AI mistakes.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T05:23:51.000Z","created_at_i":1795065831,"id":50556371,"options":[],"parent_id":50555808,"points":null,"story_id":50554641,"text":"They most likely don\u2019t feel that way. Check out a few headlines from weirder parallel universes where identity-highlighting culture somehow evolved different:<p>\u201cGinger high school students sue after AI mistakes\u2026\u201d - with an inherited body variation.<p>\u201cGoth high school students sue after AI mistakes\u2026\u201d - with a sociocultural group.<p>Most likely those would raise some eyebrows as to \u201cok, but why a highlight, what importance does it serve here?\u201d<p>There\u2019s likely no brunette or hippie fragility involved there. So, it\u2019s possible to imagine there\u2019s possibly some different idea rather than a feeling of threat here. Don\u2019t so easily dismiss it to a convenient fragility excuse here. It\u2019s surely not that simple.<p>And if anything, explaining the importance (if you know it and don\u2019t just conform) would do a lot more bridge-building than accusing of fear. For all it\u2019s worth, the article does a really poor job at this, mentioning a single Black student with a bag of chips, and not covering how that expanded onto their peers.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T03:42:23.000Z","created_at_i":1795059743,"id":50555808,"options":[],"parent_id":50555529,"points":null,"story_id":50554641,"text":"You should question why your immediate reaction is to feel threatened that race was mentioned in the story","title":null,"type":"comment","url":null},{"author":"Spivak","children":[{"author":"poulpy123","children":[{"author":"Spivak","children":[],"created_at":"2026-11-19T15:47:42.000Z","created_at_i":1795103262,"id":50561656,"options":[],"parent_id":50558473,"points":null,"story_id":50554641,"text":"Look I see what you&#x27;re trying to get at here and the data somewhat supports you but it mostly doesn&#x27;t. The part where the data backs you up is that black students are over represented relative to student population in shootings that take place on school grounds. Where it doesn&#x27;t is that white students are also over represented and  a majority of school shooters and an even greater majority of mass&#x2F;indiscriminate shooters.<p>Following your logic if you&#x27;re going to tune your algorithm to be more wary based on risk of harm it would be pointed squarely at white boys, then black boys, then hispanic boys, then asian boys.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T10:50:21.000Z","created_at_i":1795085421,"id":50558473,"options":[],"parent_id":50556309,"points":null,"story_id":50554641,"text":"Or &quot;Student of demographic currently disproportionately responsable of homicides sue school for using shoddy AI to call the cops on them saying they have a fun&quot;","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T05:13:27.000Z","created_at_i":1795065207,"id":50556309,"options":[],"parent_id":50555529,"points":null,"story_id":50554641,"text":"&quot;Students of demographic historically and currently disproportionately harmed by police violence sue school for using shoddy AI to call the cops on them saying they have a gun.&quot;<p>Being wrong has worse consequences for black students than white students so you can maybe imagine why they might be extra mad at such a system being implemented even if the false positive rate was equal.<p>&gt; The false alert eventually led to armed local police swarming the teenagers on campus just steps away from their school\u2019s entrance. They were ordered to their knees, handcuffed, and searched, despite doing nothing wrong.<p>Good thing there&#x27;s no chance of a cop &quot;fearing for their life&quot; and someone ending up dead in a situation like this.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T03:03:09.000Z","created_at_i":1795057389,"id":50555529,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"Not sure what the race of the Students has to do with the story, or is the implication that AI would not have identified the bag of Doritos as a weapon on white Students?","title":null,"type":"comment","url":null},{"author":"AngryData","children":[{"author":"kQq9oHeAz6wLLS","children":[],"created_at":"2026-11-19T03:41:12.000Z","created_at_i":1795059672,"id":50555800,"options":[],"parent_id":50555563,"points":null,"story_id":50554641,"text":"<i>ATF has entered the chat</i>","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T03:09:04.000Z","created_at_i":1795057744,"id":50555563,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"Unsure if you got a problem or not? Call the cops and now you know you have atleast 1 problem.<p>Fuck this dystopian shit.","title":null,"type":"comment","url":null},{"author":"ChrisArchitect","children":[],"created_at":"2026-11-19T03:10:06.000Z","created_at_i":1795057806,"id":50555572,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"Some discussion on the October 2025 incident at the time:<p><a href=\"https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=45684934\">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=45684934</a>","title":null,"type":"comment","url":null},{"author":"snvzz","children":[{"author":"aftbit","children":[{"author":"Someone","children":[{"author":"watwut","children":[],"created_at":"2026-11-19T07:27:34.000Z","created_at_i":1795073254,"id":50557037,"options":[],"parent_id":50556892,"points":null,"story_id":50554641,"text":"Because it is a.) idiotic b.) adults doing it are commiting much worst offence then the original one.<p>Power abuse is worst then unaproved snack. Ability to make rules is not carte blanche for mistreatment, even if you feel good and powerful when mistreating people.","title":null,"type":"comment","url":null},{"author":"ungut","children":[{"author":"mirddes","children":[{"author":"ungut","children":[],"created_at":"2026-11-19T10:07:16.000Z","created_at_i":1795082836,"id":50558164,"options":[],"parent_id":50558144,"points":null,"story_id":50554641,"text":"lmao","title":null,"type":"comment","url":null},{"author":"Esophagus4","children":[],"created_at":"2026-11-19T13:17:23.000Z","created_at_i":1795094243,"id":50559711,"options":[],"parent_id":50558144,"points":null,"story_id":50554641,"text":"Now that you mention it, I do think the silly example must be teased out here.<p>For example, where did a child get the money for all those Doritos? Plus, presumably, the cost of the containers and shipping?<p>Where do they store the shipping containers? Where does one even buy that many Doritos?<p>And what are they going to <i>do</i> with all those chips?? This is more than just selling sneakers online, this is a whole operation.<p>This deserves at least a local news segment.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T10:03:15.000Z","created_at_i":1795082595,"id":50558144,"options":[],"parent_id":50557574,"points":null,"story_id":50554641,"text":"It would entertain me to no end suggesting any child possessing multiple shipping containers filled with Doritos should be investigated. But that might be considered silly.","title":null,"type":"comment","url":null},{"author":"Someone","children":[],"created_at":"2026-11-19T12:00:43.000Z","created_at_i":1795089643,"id":50559000,"options":[],"parent_id":50557574,"points":null,"story_id":50554641,"text":"Oops. I misinterpreted \u2018detention\u2019, reading it as school detention.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T08:43:40.000Z","created_at_i":1795077820,"id":50557574,"options":[],"parent_id":50556892,"points":null,"story_id":50554641,"text":"I can&#x27;t believe what I&#x27;m reading. Are you seriously suggesting there is an amount of Doritos that warrants use of force on school children? \nI&#x27;m vexed. What amount of Doritos do you think would be appropriate before calling the misnamed American death squad to come and shoot some black kids?","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T07:05:40.000Z","created_at_i":1795071940,"id":50556892,"options":[],"parent_id":50556513,"points":null,"story_id":50554641,"text":"&gt; Students who choose to bring unapproved snacks to class shouldn&#x27;t face detention<p>If there are clear rules that forbid it, why not, for example on repeat offences?<p>Having said that, it doesn\u2019t seem that was the case here. FTA:\n<i>\u201cNo child in Baltimore County should face this kind of danger while waiting outside his own school for a ride home from his mother,\u201d said Freida Winfield, who was on her way to pick up her son Keith and the students when they were all ordered to their knees, handcuffed, and searched.</i>","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T05:53:32.000Z","created_at_i":1795067612,"id":50556513,"options":[],"parent_id":50556308,"points":null,"story_id":50554641,"text":"Students who choose to bring unapproved snacks to class shouldn&#x27;t face detention and search by the police.","title":null,"type":"comment","url":null},{"author":"eesmith","children":[],"created_at":"2026-11-19T06:57:47.000Z","created_at_i":1795071467,"id":50556842,"options":[],"parent_id":50556308,"points":null,"story_id":50554641,"text":"Do you often make up excuses as a form of post-hoc justification?<p>They didn&#x27;t bring the Doritos and it wasn&#x27;t during class, nor in a school building, nor during normal school hours.<p>From the linked-to complaint at <a href=\"https:&#x2F;&#x2F;www.lawyerscommittee.org&#x2F;wp-content&#x2F;uploads&#x2F;2026&#x2F;11&#x2F;Allen-v.-Baltimore-County-Complaint-STAMPED.pdf\" rel=\"nofollow\">https:&#x2F;&#x2F;www.lawyerscommittee.org&#x2F;wp-content&#x2F;uploads&#x2F;2026&#x2F;11&#x2F;...</a><p>```37. On Monday, October 20, 2025, Plaintiffs attended football practice after school. Practice ended at approximately 6:30 PM. After practice, their coach passed out individual bags of Doritos to the team, as he occasionally did after practices. Taki took several.<p>38. Plaintiffs then went outside the school to wait for Keith\u2019s mom to pick them up, just as they did many days after practice.<p>39. Plaintiffs convened near the picnic tables near the back entrance of the school. As they waited for their ride, they were talking and eating the Doritos their coach had given to them.```","title":null,"type":"comment","url":null},{"author":"pvaldes","children":[{"author":"snvzz","children":[{"author":"pvaldes","children":[{"author":"snvzz","children":[],"created_at":"2026-11-19T10:09:01.000Z","created_at_i":1795082941,"id":50558181,"options":[],"parent_id":50557804,"points":null,"story_id":50554641,"text":"Myth?!<p>If teachers carried, these shootings would not go very far, if happen at all.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T09:17:37.000Z","created_at_i":1795079857,"id":50557804,"options":[],"parent_id":50557673,"points":null,"story_id":50554641,"text":"The myth of the child hero is that, just a myth. Weapons fail 200 times a year, each year, to stop children to shoot other children or their teachers in USA. School shootings rarely end with a &quot;childhero&quot; or a &quot;janithero&quot; killing the shooter before they can kill tens of people. At this moment is too late yet. Self blocking doors, is a realistic solution. Your children being put in the situation to kill somebuddy or being killed just because they went to school is not. Is unfair to ask them to manage this psychologically. Many times they will end shooting collateral innocent victims by mistake and left scarred for life, or will be mistaken by the aggressor by police, and killed.<p>So your fix will never happen, because exactly zero adolescents should be allowed to bring a hidden gun at their school and because is very unfair to ask them to fix the problem, so you don&#x27;t need to lose a dollar. Doors that detect guns are placed yet for some reason. The idea of allowing only the &quot;good children&quot; to carry guns inside, just because, is 120% nuts. Adolescents are hormonal imbalanced by definition.<p>Why to spend money on this doors if you have guns available in the teacher&#x27;s room? Every mass shooter would go directly there first.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T08:59:04.000Z","created_at_i":1795078744,"id":50557673,"options":[],"parent_id":50557163,"points":null,"story_id":50554641,"text":"&gt;weapons that call police and self-block if they enter into some protected areas, or that self-block if manipulated to remove this feature.<p>And, in a life and death situation, you&#x27;d be dead because, unlike the one that the bad guy is carrying, your gun can&#x27;t connect to the network to authorize a discharge.<p>Or when it does, it&#x27;s too late; latency was too high.","title":null,"type":"comment","url":null},{"author":"RataNova","children":[],"created_at":"2026-11-19T13:33:30.000Z","created_at_i":1795095210,"id":50559878,"options":[],"parent_id":50557163,"points":null,"story_id":50554641,"text":"Any electronic lock with a chip can usually be bypassed in ten minutes with a soldering iron, or just tossed in a faraday bag so it can&#x27;t ping anything","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T07:44:20.000Z","created_at_i":1795074260,"id":50557163,"options":[],"parent_id":50556308,"points":null,"story_id":50554641,"text":"You never know when you will need an extra of energy to run from a mass shooter, because politicians refused to do anything about it, literally, in centuries.<p>----------<p>A better way to solve the problem would be weapons that call the police and sleep when entering some protected areas, or enter in self-blocked mode if manipulated to remove this feature.<p>Your fridge can call South Korea all day, but nobody can built such type of weapons? for Pete&#x27;s sake.<p>The police would <i>love</i> to have the series number of the weapon that is being fired inside a school before to reach the scene. Much faster response to help the family also. (Often mass shooters shoot their family first. If you reach them sooner, many of this victims could survive instead to bleed to death).<p>The gun makers would salivate about a gun that go to sleep automatically when entering into a school area.<p>First because the invaluable publicity of being the safest family brand in the market (only maker that really had the fucking galls to <i>do something</i> about it). The parents would <i>love</i> to have the option to block a gun from being used in a configurable range of areas of their choice, like for example their own bedrooms.<p>Second because the maker would avoid events that make they look bad or be sued. Their insurance company would love that also.<p>But most of all, because that would increase the profits. A self-blocked gun must be bought again, or fixed by the maker for a price. And families would gladly want to pay this price. Still much better than seeing your confused boy rotting in jail after a temporary depression, an adolescent broken heart or a drug&#x2F;booze mistake.<p>Old brands will never change until forced to change, and politicians will not move a finger, so make a &quot;Tesla for guns&quot; and take all the market for yourself by assault. If you can&#x27;t do it for the children, at least do it for capitalism.","title":null,"type":"comment","url":null},{"author":"mrgoldenbrown","children":[],"created_at":"2026-11-19T15:35:40.000Z","created_at_i":1795102540,"id":50561478,"options":[],"parent_id":50556308,"points":null,"story_id":50554641,"text":"They weren&#x27;t in class when this happened.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T05:13:18.000Z","created_at_i":1795065198,"id":50556308,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"Students shouldn&#x27;t be bringing bags of Doritos to class either.","title":null,"type":"comment","url":null},{"author":"syradar","children":[{"author":"thereader12","children":[{"author":"npteljes","children":[],"created_at":"2026-11-19T09:52:39.000Z","created_at_i":1795081959,"id":50558058,"options":[],"parent_id":50557259,"points":null,"story_id":50554641,"text":"False positives are not necessary a problem. A false positive is just a wrong suspicion.<p>In this particular case, the automated alert was just the beginning of the chain of events. The chain could have been stopped well after, and it looks like that they even tried to stop is, but were unsuccessful. That&#x27;s the problem.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T07:59:30.000Z","created_at_i":1795075170,"id":50557259,"options":[],"parent_id":50556713,"points":null,"story_id":50554641,"text":"It sounds like AI was the problem. Omnialert&#x27;s ai gave it a 90% probability. The company also had multiple failures before it got out but the alert is designed to be sent quickly.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T06:29:26.000Z","created_at_i":1795069766,"id":50556713,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"Doesn\u2019t sound like AI was the problem. Multiple human errors and process errors led to the armed response.","title":null,"type":"comment","url":null},{"author":"thereader12","children":[],"created_at":"2026-11-19T08:09:02.000Z","created_at_i":1795075742,"id":50557330,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"So, apparently Omnialert sells enabling computer vision on existing cameras and backs up mistakes with human review. They at least claim no facial recognition, just guns. Reviews on reddit say the system (and similar ones) has many false positives, and failed to detect real guns like rifles.<p>Garbage in, garbage out. The system should not have been deployed because of it&#x27;s incompetence if nothing else.","title":null,"type":"comment","url":null},{"author":"ChrisRR","children":[{"author":"alyeska2","children":[{"author":"ethbr1","children":[],"created_at":"2026-11-19T15:00:12.000Z","created_at_i":1795100412,"id":50560998,"options":[],"parent_id":50560589,"points":null,"story_id":50554641,"text":"Aka the fact that there has been a kid with a gun at a school somewhere, sometime, doesn&#x27;t justify deploying aggressive technology to all schools, for all time.<p>Especially when the school system doesn&#x27;t have sufficient policy wherewithal to prevent armed law enforcement responses to known false positives.<p>These kids could have been shot.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T14:29:08.000Z","created_at_i":1795098548,"id":50560589,"options":[],"parent_id":50557935,"points":null,"story_id":50554641,"text":"Obvious counterpoint - there is no such need.<p>We don&#x27;t need TSA strip searching grandmothers flying to visit their kids. We don&#x27;t need Flock cameras recording the movement of every citizen at all times. We don&#x27;t need gun detection AI at schools.<p>But, it&#x27;s easy to make people scared and scared people will support unneccessary things that make them feel safe against their fears no matter how unlikely or irrational, so here we are.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T09:36:01.000Z","created_at_i":1795080961,"id":50557935,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"The need for for gun detection AI at US schools is already massively concerning","title":null,"type":"comment","url":null},{"author":"npteljes","children":[{"author":"left-struck","children":[{"author":"npteljes","children":[],"created_at":"2026-11-19T11:19:46.000Z","created_at_i":1795087186,"id":50558689,"options":[],"parent_id":50558185,"points":null,"story_id":50554641,"text":"Oh yes. In fact, it&#x27;s the least of the problems. Any detection system can have a false positive. The important thing is how people handle its output.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T10:09:19.000Z","created_at_i":1795082959,"id":50558185,"options":[],"parent_id":50558044,"points":null,"story_id":50554641,"text":"Sounds like AI isn\u2019t the only problem here.","title":null,"type":"comment","url":null},{"author":"anal_reactor","children":[{"author":"npteljes","children":[],"created_at":"2026-11-19T11:22:18.000Z","created_at_i":1795087338,"id":50558719,"options":[],"parent_id":50558666,"points":null,"story_id":50554641,"text":"&gt;Feels like the main use case of AI is to offload responsibility<p>Yes, and that&#x27;s a wild thing to do, anal_reactor.<p>&gt;Nobody wants to manually recall the alarm because if they do and something happens, they&#x27;ll be fucked<p>The weird thing about this particular case is that they recalled the alarm, and the cops still showed up. Someone definitely set that system up wrong.<p>&gt;Nobody wants to be the politician that removes them<p>I also agree that this is why many bad systems stay in place. Another oft-cited example is Japan&#x27;s weird porn censorship law.","title":null,"type":"comment","url":null},{"author":"RataNova","children":[{"author":"ethbr1","children":[],"created_at":"2026-11-19T15:47:21.000Z","created_at_i":1795103241,"id":50561646,"options":[],"parent_id":50559747,"points":null,"story_id":50554641,"text":"Or, chillingly more and more accurate, the humans in the loop don&#x27;t actually understand how the system functions, so they don&#x27;t even know they need to cancel the alert on the police side too.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T13:21:01.000Z","created_at_i":1795094461,"id":50559747,"options":[],"parent_id":50558666,"points":null,"story_id":50554641,"text":"The most ironic part of this story is that the people on site actually weren&#x27;t afraid and canceled the alarm anyway. But the dumb system still called the cops. You try to do the human thing, and the code just trips you up.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T11:17:24.000Z","created_at_i":1795087044,"id":50558666,"options":[],"parent_id":50558044,"points":null,"story_id":50554641,"text":"Feels like the main use case of AI is to offload responsibility. It&#x27;s been very visible in corporate situations that people are extremely risk-averse because a mistake could cost them their career. This culture has penetrated other parts of the society. Nobody wants to manually recall the alarm because if they do and something happens, they&#x27;ll be fucked.<p>Similarly to why Spain security checks on high-speed trains. Nobody wants to be the politician that removes them and then is blamed for an attack.","title":null,"type":"comment","url":null},{"author":"bemtevi","children":[{"author":"ethbr1","children":[],"created_at":"2026-11-19T15:01:52.000Z","created_at_i":1795100512,"id":50561023,"options":[],"parent_id":50558975,"points":null,"story_id":50554641,"text":"Especially since many of these AI solutions are known for lying about their own effectiveness in marketing and practice (e.g. Flock) and impeding transparent oversight.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T11:55:21.000Z","created_at_i":1795089321,"id":50558975,"options":[],"parent_id":50558044,"points":null,"story_id":50554641,"text":"But if AI is sufficiently tempting, then it is the problem. People have instincts and will operate on them, and if something exists to trigger those instincts, then it is as much the problem as the people who made the decision.","title":null,"type":"comment","url":null},{"author":"ndsipa_pomu","children":[],"created_at":"2026-11-19T13:03:01.000Z","created_at_i":1795093381,"id":50559563,"options":[],"parent_id":50558044,"points":null,"story_id":50554641,"text":"Using AI is one of the problems. It seems to me it has the same level of reliability as rolling a dice.","title":null,"type":"comment","url":null},{"author":"RataNova","children":[],"created_at":"2026-11-19T13:17:19.000Z","created_at_i":1795094239,"id":50559710,"options":[],"parent_id":50558044,"points":null,"story_id":50554641,"text":"The cancel button is broken, no doubt about it. But honestly a model that spends 90% of its time talking about chips is clearly half-baked and shouldn&#x27;t have been released to the public yet","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T09:50:21.000Z","created_at_i":1795081821,"id":50558044,"options":[],"parent_id":50554641,"points":null,"story_id":50554641,"text":"AI is not the problem here.<p>&gt;The AI surveillance system\u2019s error prompted the false alarm and set off a chain of human failures\n&gt;armed police were dispatched anyway because school and police officials failed to have sufficient protocols in place to prevent cancelled alerts<p>This is a mistaken setup, by humans. The human override (cancelling the false alert) hasn&#x27;t worked.","title":null,"type":"comment","url":null}],"created_at":"2026-11-19T00:57:20.000Z","created_at_i":1795049840,"id":50554641,"options":[],"parent_id":null,"points":107,"story_id":50554641,"text":null,"title":"Black high school students sue after AI mistakes Doritos bag for gun","type":"story","url":"https://www.lawyerscommittee.org/lawyers-committee-files-lawsuit-on-behalf-of-black-students-detained-and-searched-due-to-ai-alert-falsely-identifying-a-bag-of-chips-as-a-firearm/"}
