{"author":"dkpk","children":[{"author":"testplzignore","children":[{"author":"erdoc69","children":[],"created_at":"2026-11-13T08:43:02.000Z","created_at_i":1794559382,"id":50480271,"options":[],"parent_id":50471685,"points":null,"story_id":50471731,"text":"If by &quot;reports&quot; you mean &quot;literally every Outlook user on the planet&quot;, sure","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:18:25.000Z","created_at_i":1794507505,"id":50471685,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"<a href=\"https:&#x2F;&#x2F;x.com&#x2F;MSFT365Status&#x2F;status&#x2F;2120938282204688468\" rel=\"nofollow\">https:&#x2F;&#x2F;x.com&#x2F;MSFT365Status&#x2F;status&#x2F;2120938282204688468</a><p>&gt; We&#x27;re investigating reports of users experiencing issues accessing Exchange Online mailboxes through multiple connection methods in the Americas. More details can be found in the Microsoft 365 admin center under EX1550543.","title":null,"type":"comment","url":null},{"author":"EvanAnderson","children":[{"author":"vachina","children":[],"created_at":"2026-11-12T18:23:58.000Z","created_at_i":1794507838,"id":50471792,"options":[],"parent_id":50471690,"points":null,"story_id":50471668,"text":"502\nThe service behind this page isn&#x27;t responding to Azure Front Door.","title":null,"type":"comment","url":null},{"author":"nazgulsenpai","children":[{"author":"moronicles","children":[{"author":"EvanAnderson","children":[{"author":"SoftTalker","children":[],"created_at":"2026-11-12T19:26:29.000Z","created_at_i":1794511589,"id":50472815,"options":[],"parent_id":50472254,"points":null,"story_id":50471668,"text":"The service has redundancy, better than individual operators could provide on-prem. From the customer standpoint though, the service as a whole is a single point of failure: it either works or it doesn&#x27;t.","title":null,"type":"comment","url":null},{"author":"moronicles","children":[],"created_at":"2026-11-12T19:27:48.000Z","created_at_i":1794511668,"id":50472842,"options":[],"parent_id":50472254,"points":null,"story_id":50471668,"text":"It sounds like you are talking more about product reliability of M365 than you are about enterprise infrastructure reliability. M365 is a Microsoft product. M365 has no bearing on the credibility of cloud infrastructure as a whole, which is what your original comment spoke to.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:51:34.000Z","created_at_i":1794509494,"id":50472254,"options":[],"parent_id":50472135,"points":null,"story_id":50471731,"text":"The &quot;you can&#x27;t possibly have better redundancy in your on-prem&quot; was absolutely a sales pitch I heard to move to Microsoft 365.<p>The biggest site I work for, who went M365 hybrid last year, has incurred more Exchange downtime today than they had all of last year with their on-prem Exchange servers.","title":null,"type":"comment","url":null},{"author":"nazgulsenpai","children":[],"created_at":"2026-11-12T19:18:29.000Z","created_at_i":1794511109,"id":50472700,"options":[],"parent_id":50472135,"points":null,"story_id":50471668,"text":"Maybe not where you are but that&#x27;s legitimately what our project managers were saying. We all knew better, of course.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:45:07.000Z","created_at_i":1794509107,"id":50472135,"options":[],"parent_id":50471818,"points":null,"story_id":50471668,"text":"That was never the promise. The nearest to that is the promise of multi-cloud or hybrid infrastructure, but neither of those have anything to do with outages of specific Microsoft services.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:25:20.000Z","created_at_i":1794507920,"id":50471818,"options":[],"parent_id":50471690,"points":null,"story_id":50471668,"text":"I was assured that with cloud we wouldn&#x27;t have a single point of failure like we did on-premise. I must have fallen asleep at my desk.","title":null,"type":"comment","url":null},{"author":"toss1","children":[],"created_at":"2026-11-12T19:11:44.000Z","created_at_i":1794510704,"id":50472591,"options":[],"parent_id":50471690,"points":null,"story_id":50471668,"text":"YEah, that is not loading, along with the root status.cloud.microsoft , which MS links in their Xitter update [0]<p>What MS has posted so far:<p>&gt;&gt; Microsoft 365 Status\n&gt;&gt; @MSFT365Status\n&gt;&gt; We&#x27;re investigating reports of users experiencing issues accessing Exchange Online mailboxes through multiple connection methods in the Americas. More details can be found in the Microsoft 365 admin center under EX1550543.\n12:54 PM \u00b7 Nov 12, 2026<p>&gt;&gt; Microsoft 365 Status\n&gt;&gt; @MSFT365Status\n&gt;&gt; While we&#x27;re working to mitigate impact, we&#x27;ve confirmed the issue may affect Microsoft 365 service connectivity for users in any region, more information will be provided in the Microsoft 365 admin center under EX1550543.<p>&gt;&gt; Microsoft 365 Status\n&gt;&gt; @MSFT365Status\n&gt;&gt; We&#x27;ve determined a portion of infrastructure is experiencing elevated load across multiple regions, which is likely contributing to the connectivity errors. We&#x27;re providing more information under EX1550543 and MO1550821 in the Microsoft 365 admin center, as well as <a href=\"https:&#x2F;&#x2F;status.cloud.microsoft\" rel=\"nofollow\">https:&#x2F;&#x2F;status.cloud.microsoft</a><p>&gt;&gt; Microsoft 365 Status\n&gt;&gt; @MSFT365Status\n&gt;&gt; 20m\n&gt;&gt; We&#x27;ve begun redistributing connection traffic across our broader worldwide infrastructure to help balance the load. More info under EX1550543 and MO1550821 in the Microsoft 365 admin center, as well as <a href=\"https:&#x2F;&#x2F;status.cloud.microsoft\" rel=\"nofollow\">https:&#x2F;&#x2F;status.cloud.microsoft</a>\n if the admin center is not available to you.<p>[0] <a href=\"https:&#x2F;&#x2F;x.com&#x2F;MSFT365Status&#x2F;status&#x2F;2120938282204688468\" rel=\"nofollow\">https:&#x2F;&#x2F;x.com&#x2F;MSFT365Status&#x2F;status&#x2F;2120938282204688468</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:18:40.000Z","created_at_i":1794507520,"id":50471690,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"<a href=\"https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;</a> is very slow to load.<p>The page is showing a &quot;Service Degredation&quot; for &quot;Microsoft 365 (Business or Enterprise)&quot;<p>Updates below in reverse chronological order:<p>From the Thurdsay, November 12, 2026 at 7:30:36 PM UTC update:<p>Current status: We&#x27;re aggressively pursuing all pathways to reduce impact. As a precaution, we&#x27;ve paused all deployments and configuration changes while we review recent changes for any correlation to this event. We&#x27;ve determined that the elevated load isn&#x27;t driven by an overall increase in traffic, but by a large number of servers being unexpectedly unavailable, which is shifting load onto the remaining infrastructure. We&#x27;re investigating what&#x27;s causing these servers to become unavailable while we work to safely return them to service.<p>---<p>From the Thurdsay, November 12, 2026 at 7:16:03 PM UTC update:<p>Current status: We&#x27;re aggressively pursuing all pathways to reduce impact. As a precaution, we&#x27;ve paused all deployments and configuration changes while we review recent changes for any correlation to this event. We&#x27;ve also moved traffic for some services off the affected infrastructure to further reduce load, with additional traffic moves in progress.<p>---<p>From the Thurdsay, November 12, 2026 at 6:59:24 PM UTC update:<p>Current status: We&#x27;ve completed redistributing connection traffic across our worldwide infrastructure, and we&#x27;re moving additional traffic off the affected infrastructure to further reduce load. We&#x27;re also restarting affected servers to return them to service. In parallel, we&#x27;re investigating whether the elevated traffic reflects a genuine increase in requests or a shift in how traffic is being routed across our infrastructure.<p>---<p>From the Thursday, November 12, 2026 at 6:32:25 PM UTC update:<p>Title: Users may be unable to connect to multiple Microsoft 365 services<p>User impact: Users may be unable to connect to multiple Microsoft 365 services.<p>More info: Potentially impacted services include:<p>- Exchange Online<p>- Microsoft Teams<p>- SharePoint Online<p>- Microsoft Copilot 365<p>- Microsoft Defender XDR<p>Current status: We\u2019re investigating an issue impacting multiple Microsoft 365 services and we&#x27;ve determined the affected infrastructure is experiencing elevated load across multiple regions, which is likely contributing to the connectivity errors. We&#x27;re restarting and repairing impacted portions of this infrastructure to restore capacity, and reviewing an unexpected increase in a specific type of service traffic to determine whether it&#x27;s contributing to the elevated load. In parallel, we&#x27;re evaluating options to redirect traffic to alternate infrastructure to expedite relief.<p>Scope of impact: This issue may affect users attempting to access the affected Microsoft 365 services.<p>---<p>From the Thursday, November 12, 2026 at 6:10:02 PM UTC update:<p>Scope of impact: This issue may affect users attempting to access the affected Microsoft 365 services.<p>User impact: Users may be unable to connect to their mailboxes in Exchange Online through multiple connection methods.<p>More info: Potentially impacted connection methods may include:<p>- Outlook on the web<p>- Messaging API (MAPI)<p>- Exchange ActiveSync (EAS)<p>- Representational State Transfer (REST) API<p>Current status: We\u2019ve identified connectivity errors occurring on a portion of Exchange Online infrastructure which receives and processes users\u2019 access requests. We\u2019ve collected networking logs to review to further investigate the source of these errors and confirm our next steps.<p>Scope of impact: This issue may affect users attempting to access their mailbox in Exchange Online using the affected connection methods.<p>Next update by: Thursday, November 12, 2026, at 8:00 PM UTC<p>---<p>Aside: What with the nature of the Teams, OneDrive, etc, products being Sharepoint and Exchange in a trenchcoat this is probably creating quite a mess for services besides Exchange Online, too.<p>Edit: Looks like the status page needs a status page.<p>Edit: Verified w&#x2F; multiple other parties that Teams and OneDrive are having issues, too. Interestingly, Microsoft 365 Family services are working fine. That makes me wonder if that product is running on separate infrastructure (or just hasn&#x27;t caught fire yet).<p>Edit: The RSS feed seems to load fairly quickly: <a href=\"https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;api&#x2F;feed&#x2F;mac\" rel=\"nofollow\">https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;api&#x2F;feed&#x2F;mac</a>","title":null,"type":"comment","url":null},{"author":"neilsimp1","children":[{"author":"Aboutplants","children":[],"created_at":"2026-11-12T18:22:34.000Z","created_at_i":1794507754,"id":50471766,"options":[],"parent_id":50471695,"points":null,"story_id":50471731,"text":"Same here","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:18:59.000Z","created_at_i":1794507539,"id":50471695,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Down for our whole organization as well.","title":null,"type":"comment","url":null},{"author":"Waterluvian","children":[],"created_at":"2026-11-12T18:19:30.000Z","created_at_i":1794507570,"id":50471700,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"The M365 status page not loading reminds me of one of my favourite Simpsons jokes: <a href=\"https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=3Hz2uOSdV24\" rel=\"nofollow\">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=3Hz2uOSdV24</a>","title":null,"type":"comment","url":null},{"author":"lajy","children":[{"author":"Aboutplants","children":[{"author":"inChargeOfIT","children":[],"created_at":"2026-11-12T19:21:28.000Z","created_at_i":1794511288,"id":50472744,"options":[],"parent_id":50471759,"points":null,"story_id":50471731,"text":"I think a lot of ms orgs&#x2F;window users may have external links blocked when defender is down. So it may appear other services are down.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:22:16.000Z","created_at_i":1794507736,"id":50471759,"options":[],"parent_id":50471710,"points":null,"story_id":50471731,"text":"A whole host of services are being effected. First glance, perhaps an AWS issue","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:20:00.000Z","created_at_i":1794507600,"id":50471710,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"<a href=\"https:&#x2F;&#x2F;downdetector.com&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;downdetector.com&#x2F;</a>","title":null,"type":"comment","url":null},{"author":"duxup","children":[{"author":"infamouscow","children":[],"created_at":"2026-11-12T21:43:47.000Z","created_at_i":1794519827,"id":50474742,"options":[],"parent_id":50471785,"points":null,"story_id":50471731,"text":"Everyone that is a whole stack programmer (say, kernel to webapp) has seen just how unnecessarily complicated everything has become. Watching it burn to the ground would be a pornographic miracle.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:23:37.000Z","created_at_i":1794507817,"id":50471785,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Same for me.  Status won\u2019t load even.<p>Personally I kinda enjoy these outages\u2026","title":null,"type":"comment","url":null},{"author":"bix6","children":[],"created_at":"2026-11-12T18:26:20.000Z","created_at_i":1794507980,"id":50471836,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Down","title":null,"type":"comment","url":null},{"author":"throwaway_1016","children":[{"author":"geekamongus","children":[{"author":"jp191919","children":[],"created_at":"2026-11-12T18:44:49.000Z","created_at_i":1794509089,"id":50472128,"options":[],"parent_id":50471976,"points":null,"story_id":50471731,"text":"I&#x27;m so down","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:35:07.000Z","created_at_i":1794508507,"id":50471976,"options":[],"parent_id":50471837,"points":null,"story_id":50471731,"text":"I&#x27;m down with that.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:26:24.000Z","created_at_i":1794507984,"id":50471837,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Ironically, this article is down as well.","title":null,"type":"comment","url":null},{"author":"LtdJorge","children":[],"created_at":"2026-11-12T18:26:45.000Z","created_at_i":1794508005,"id":50471845,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Our Outlook doesn&#x27;t work either","title":null,"type":"comment","url":null},{"author":"sonicrocketman","children":[{"author":"marcosdumay","children":[{"author":"tsherb","children":[],"created_at":"2026-11-12T18:51:51.000Z","created_at_i":1794509511,"id":50472257,"options":[],"parent_id":50472205,"points":null,"story_id":50471731,"text":"Right - don&#x27;t get too ambitious! :D","title":null,"type":"comment","url":null},{"author":"function_seven","children":[],"created_at":"2026-11-12T18:54:33.000Z","created_at_i":1794509673,"id":50472288,"options":[],"parent_id":50472205,"points":null,"story_id":50471731,"text":"Yup. I just tried to search my chats for a specific phrase. It came back with nothing, even though I <i>know</i> I used it in a recent conversation.<p>I just assumed it was Teams being Teams.","title":null,"type":"comment","url":null},{"author":"ratelimitsteve","children":[{"author":"hinkley","children":[{"author":"com2kid","children":[],"created_at":"2026-11-12T19:47:20.000Z","created_at_i":1794512840,"id":50473132,"options":[],"parent_id":50472475,"points":null,"story_id":50471731,"text":"I remember the first version of office communicator, that when installed, left you with about 6hrs of phone battery.<p>Back on Window Mobile 6.1.<p>Battery life usage quickly improved. :)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:04:42.000Z","created_at_i":1794510282,"id":50472475,"options":[],"parent_id":50472415,"points":null,"story_id":50471731,"text":"Remember when Teams ate cellphone batteries like candy? Pepperidge Farms remembers.","title":null,"type":"comment","url":null},{"author":"marcosdumay","children":[],"created_at":"2026-11-12T19:04:49.000Z","created_at_i":1794510289,"id":50472477,"options":[],"parent_id":50472415,"points":null,"story_id":50471731,"text":"Funny thing is that my work&#x27;s VPN that uses the MS authenticator just quit, immediately after I made that comment. So you are even more correct than usual.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:01:06.000Z","created_at_i":1794510066,"id":50472415,"options":[],"parent_id":50472205,"points":null,"story_id":50471731,"text":"Teams: Either It&#x27;s Working, Or You Are","title":null,"type":"comment","url":null},{"author":"burningChrome","children":[{"author":"abirch","children":[],"created_at":"2026-11-12T20:37:01.000Z","created_at_i":1794515821,"id":50473870,"options":[],"parent_id":50473440,"points":null,"story_id":50471731,"text":"If you could create a real world Outlook, it&#x27;d become the new Office Space fax machine.","title":null,"type":"comment","url":null},{"author":"Khaine","children":[],"created_at":"2026-11-12T22:53:39.000Z","created_at_i":1794524019,"id":50475563,"options":[],"parent_id":50473440,"points":null,"story_id":50471731,"text":"The new version which is a skinned web browser is terrible","title":null,"type":"comment","url":null},{"author":"ant6n","children":[{"author":"D13Fd","children":[{"author":"ant6n","children":[],"created_at":"2026-11-13T11:21:15.000Z","created_at_i":1794568875,"id":50481932,"options":[],"parent_id":50476889,"points":null,"story_id":50471731,"text":"That choice is also so stupid. Why doesn&#x27;t Outlook just store the text of every single email on all devices. The stupid software needs gigabytes of storage, why can&#x27;t it spend a couple of megabytes on making e-mail actually work.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:22:48.000Z","created_at_i":1794532968,"id":50476889,"options":[],"parent_id":50476724,"points":null,"story_id":50471731,"text":"It\u2019s not just that it\u2019s stupid. It\u2019s broken. It can\u2019t handle email that is on the server and not on the machine, and they\u2019ve configured the app to store most email only on the server.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:58:44.000Z","created_at_i":1794531524,"id":50476724,"options":[],"parent_id":50473440,"points":null,"story_id":50471731,"text":"Office on Mac is like malware. It brings the system to a halt.<p>The worst part about Outlook is the broken search. In the world of infinitely smart AI, the e-mail search in Outlook is embarrassingly stupid.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:10:03.000Z","created_at_i":1794514203,"id":50473440,"options":[],"parent_id":50472205,"points":null,"story_id":50471731,"text":"I asked someone in our teams meeting if they were having issues with their outlook today. What followed was a 5 minute hate fest on outlook. I&#x27;m not a big fan, but was kind of surprised so many people genuinely hate it.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:49:11.000Z","created_at_i":1794509351,"id":50472205,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"Teams is working!<p>Or, rather, it&#x27;s acting like it usually does.","title":null,"type":"comment","url":null},{"author":"notatoad","children":[],"created_at":"2026-11-12T19:07:11.000Z","created_at_i":1794510431,"id":50472518,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"down detector always looks like this during big cloud service outages. i think partly because people don&#x27;t actually know what services they&#x27;re using and report wrong things, and partly because downdetector parses social media posts like &quot;outlook is down but gmail still works&quot; as outlook and gmail both being down.","title":null,"type":"comment","url":null},{"author":"fmbb","children":[{"author":"coldbrewed","children":[],"created_at":"2026-11-12T19:57:27.000Z","created_at_i":1794513447,"id":50473286,"options":[],"parent_id":50472849,"points":null,"story_id":50471731,"text":"As luck would have it GitHub sign-ups are down <a href=\"https:&#x2F;&#x2F;www.githubstatus.com&#x2F;incidents&#x2F;nwbjzl7nfrc2\" rel=\"nofollow\">https:&#x2F;&#x2F;www.githubstatus.com&#x2F;incidents&#x2F;nwbjzl7nfrc2</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:28:10.000Z","created_at_i":1794511690,"id":50472849,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"Not GitHub!","title":null,"type":"comment","url":null},{"author":"midas89","children":[{"author":"jwnin","children":[],"created_at":"2026-11-12T22:36:04.000Z","created_at_i":1794522964,"id":50475375,"options":[],"parent_id":50473072,"points":null,"story_id":50471731,"text":"Entra is not impacted, SSO is working for non-M365 apps.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:43:09.000Z","created_at_i":1794512589,"id":50473072,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"I work in IT and people are complaining about Atlassian and about AWS but in reality if your organization is using SSO then that would get impacted.<p>If your org is using Intune or Defender EDR then you probably also are impacted.","title":null,"type":"comment","url":null},{"author":"peanut-walrus","children":[],"created_at":"2026-11-12T19:54:49.000Z","created_at_i":1794513289,"id":50473243,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"Downdetector does not measure service availability. It&#x27;s more of a vibes thing.","title":null,"type":"comment","url":null},{"author":"cwillu","children":[{"author":"hunter2_","children":[],"created_at":"2026-11-12T20:55:19.000Z","created_at_i":1794516919,"id":50474139,"options":[],"parent_id":50473444,"points":null,"story_id":50471731,"text":"Especially when looking constitutes reporting (Schr\u00f6dinger&#x27;s downdetector?) and people look at everything after showing up for one thing.","title":null,"type":"comment","url":null},{"author":"kube-system","children":[],"created_at":"2026-11-12T22:21:27.000Z","created_at_i":1794522087,"id":50475177,"options":[],"parent_id":50473444,"points":null,"story_id":50471731,"text":"It also suffers from people reporting functionally related (but not technical related) things.<p>Any other service that interacts with Outlook in some way will create downstream effects in other services expecting Outlook to work normally.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:10:15.000Z","created_at_i":1794514215,"id":50473444,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"Downdetector is a survey, not a detector, and suffers from user confusion when a high-profile service is actually down, as users start reporting unrelated things","title":null,"type":"comment","url":null},{"author":"hydrox24","children":[],"created_at":"2026-11-13T00:58:56.000Z","created_at_i":1794531536,"id":50476728,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"The biggest problem with downdetector is how they visualise their outage graphs.<p>The Y axes are entirely independent, and so when there&#x27;s an outage for Microsoft Outlook (which peaked at ~130k reports) and you get a negligable spike in pepole who get confused and report gmail (~1k reports), the graphs all look correlated and connected.<p>They need to show the graphs with an absolute y-axis set by the worst outage, or scale the graphs by estimated average daily users or something.","title":null,"type":"comment","url":null},{"author":"chilli_axe","children":[],"created_at":"2026-11-13T08:20:19.000Z","created_at_i":1794558019,"id":50480080,"options":[],"parent_id":50471863,"points":null,"story_id":50471731,"text":"AWS seems fine?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:27:44.000Z","created_at_i":1794508064,"id":50471863,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Down detector shows like <i>everything</i> is down. AWS, Azure, Office, Gmail. Everything. <a href=\"https:&#x2F;&#x2F;downdetector.com\" rel=\"nofollow\">https:&#x2F;&#x2F;downdetector.com</a>","title":null,"type":"comment","url":null},{"author":"sonicrocketman","children":[{"author":"SomeonesAccount","children":[],"created_at":"2026-11-12T18:32:05.000Z","created_at_i":1794508325,"id":50471930,"options":[],"parent_id":50471898,"points":null,"story_id":50471668,"text":"Damn. That is crazy. The curve kinda looks like the curve that happens every november to the Google searches of &quot;all I want for christmas is you&quot;","title":null,"type":"comment","url":null},{"author":"Icathian","children":[{"author":"sonicrocketman","children":[],"created_at":"2026-11-12T18:36:59.000Z","created_at_i":1794508619,"id":50472012,"options":[],"parent_id":50471992,"points":null,"story_id":50471731,"text":"It&#x27;s something to reference. My view is that it&#x27;s better than &quot;doesn&#x27;t load for me&quot;.","title":null,"type":"comment","url":null},{"author":"marifjeren","children":[{"author":"Icathian","children":[{"author":"ceejayoz","children":[{"author":"pacoWebConsult","children":[{"author":"ceejayoz","children":[],"created_at":"2026-11-12T19:17:37.000Z","created_at_i":1794511057,"id":50472685,"options":[],"parent_id":50472660,"points":null,"story_id":50471731,"text":"&gt; Still can.<p>No. It requires an account now, and they did away with the recent posts firehose.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:16:04.000Z","created_at_i":1794510964,"id":50472660,"options":[],"parent_id":50472515,"points":null,"story_id":50471668,"text":"Still can. AWS Status pages are still terrible. See HN for the outage a year ago <a href=\"https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=45640838\">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=45640838</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:07:04.000Z","created_at_i":1794510424,"id":50472515,"options":[],"parent_id":50472363,"points":null,"story_id":50471731,"text":"Back in the golden days you could just go to search.twitter.com, search &quot;AWS&quot;, and sort by recent.","title":null,"type":"comment","url":null},{"author":"krazydad","children":[],"created_at":"2026-11-12T19:08:47.000Z","created_at_i":1794510527,"id":50472542,"options":[],"parent_id":50472363,"points":null,"story_id":50471668,"text":"&quot;Start Free Trial&quot; -- uh, no thanks. You seem skeptical of crowd sourcing. Enjoy your Encyclopedia Brittanica.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:58:22.000Z","created_at_i":1794509902,"id":50472363,"options":[],"parent_id":50472313,"points":null,"story_id":50471668,"text":"The snarky but honest response is HackerNews&#x2F;Reddit.  But if you&#x27;re trying for something that actually checks the sites you point it at instead of relying on users reporting &quot;issues&quot;, a buddy of mine runs <a href=\"https:&#x2F;&#x2F;onlineornot.com&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;onlineornot.com&#x2F;</a> and it seems generally more reliable.","title":null,"type":"comment","url":null},{"author":"andrewinardeer","children":[{"author":"dymk","children":[],"created_at":"2026-11-12T19:17:54.000Z","created_at_i":1794511074,"id":50472689,"options":[],"parent_id":50472365,"points":null,"story_id":50471731,"text":"Apparently Outlook, Gmail, etc are all working on the server at 192.168.1.1 then - ping says it&#x27;s responding just fine","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:58:27.000Z","created_at_i":1794509907,"id":50472365,"options":[],"parent_id":50472313,"points":null,"story_id":50471731,"text":"Ping?","title":null,"type":"comment","url":null},{"author":"tristor","children":[{"author":"MadrasTh0rn","children":[],"created_at":"2026-11-12T19:53:44.000Z","created_at_i":1794513224,"id":50473225,"options":[],"parent_id":50472902,"points":null,"story_id":50471668,"text":"Thank you for the recommendation!<p>They indicate sharepoint is getting blown out... again.","title":null,"type":"comment","url":null},{"author":"justusthane","children":[{"author":"tristor","children":[{"author":"tristor","children":[],"created_at":"2026-11-12T20:37:12.000Z","created_at_i":1794515832,"id":50473874,"options":[],"parent_id":50473516,"points":null,"story_id":50471731,"text":"<a href=\"https:&#x2F;&#x2F;status.thousandeyes.com&#x2F;incidents&#x2F;3tnqsbbgvw4x\" rel=\"nofollow\">https:&#x2F;&#x2F;status.thousandeyes.com&#x2F;incidents&#x2F;3tnqsbbgvw4x</a>","title":null,"type":"comment","url":null},{"author":"Stiereng","children":[],"created_at":"2026-11-12T21:05:54.000Z","created_at_i":1794517554,"id":50474270,"options":[],"parent_id":50473516,"points":null,"story_id":50471731,"text":"How ironic","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:15:20.000Z","created_at_i":1794514520,"id":50473516,"options":[],"parent_id":50473256,"points":null,"story_id":50471731,"text":"Yes, just to confirm, it seems that our platform is getting hammered at the moment and it&#x27;s causing the page to take a long time to load or intermittently load.  We are looking into it.","title":null,"type":"comment","url":null},{"author":"tristor","children":[],"created_at":"2026-11-12T21:05:38.000Z","created_at_i":1794517538,"id":50474266,"options":[],"parent_id":50473256,"points":null,"story_id":50471731,"text":"It is back up now.<p>There will be a more detailed message when we finish the SII on our status page at the link I previously provided, but the short version is we took way more traffic than normal to our platform and the related workers were running out of memory.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:55:37.000Z","created_at_i":1794513337,"id":50473256,"options":[],"parent_id":50472902,"points":null,"story_id":50471731,"text":"It is ironic that this outage map _also_ is not loading for me right now","title":null,"type":"comment","url":null},{"author":"ishtanbul","children":[],"created_at":"2026-11-12T20:00:03.000Z","created_at_i":1794513603,"id":50473321,"options":[],"parent_id":50472902,"points":null,"story_id":50471668,"text":"it seems to be down... lol","title":null,"type":"comment","url":null},{"author":"janlukacs","children":[],"created_at":"2026-11-12T20:41:14.000Z","created_at_i":1794516074,"id":50473946,"options":[],"parent_id":50472902,"points":null,"story_id":50471668,"text":"still down :)","title":null,"type":"comment","url":null},{"author":"xtiansimon","children":[{"author":"stronglikedan","children":[{"author":"rico735","children":[{"author":"stronglikedan","children":[{"author":"rico735","children":[],"created_at":"2026-11-14T00:18:10.000Z","created_at_i":1794615490,"id":50492077,"options":[],"parent_id":50485507,"points":null,"story_id":50471731,"text":"How are you defining &quot;most popular platform&quot;, then.\nX is pretty small compared with any of the big ones.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T16:03:50.000Z","created_at_i":1794585830,"id":50485507,"options":[],"parent_id":50476333,"points":null,"story_id":50471731,"text":"X to Whatsapp is apples to oranges","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:09:28.000Z","created_at_i":1794528568,"id":50476333,"options":[],"parent_id":50474670,"points":null,"story_id":50471731,"text":"It&#x27;s not that popular, is it?\nIt&#x27;s tiny compared to, like, Whatsapp.","title":null,"type":"comment","url":null},{"author":"xtiansimon","children":[],"created_at":"2026-11-14T20:18:48.000Z","created_at_i":1794687528,"id":50500410,"options":[],"parent_id":50474670,"points":null,"story_id":50471731,"text":"HA! One size fits all. If that&#x27;s the community this website is targeted towards, then have at it. Elsewhere in the world of sharing, users get to choose the platform where they&#x27;re at.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:38:29.000Z","created_at_i":1794519509,"id":50474670,"options":[],"parent_id":50474534,"points":null,"story_id":50471731,"text":"seems smart to link to the most popular platform by default. there&#x27;s other share links at the bottom for the less popular ones","title":null,"type":"comment","url":null},{"author":"tristor","children":[],"created_at":"2026-11-12T21:59:42.000Z","created_at_i":1794520782,"id":50474923,"options":[],"parent_id":50474534,"points":null,"story_id":50471731,"text":"The public outage map is primarily a marketing page, because customers receive deeper insights in-product.  Given that most people discuss outages live&#x2F;up-to-the-minute on Twitter, that is why its where we default to sharing.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:27:16.000Z","created_at_i":1794518836,"id":50474534,"options":[],"parent_id":50472902,"points":null,"story_id":50471731,"text":"LOL. Share defaults to X.com","title":null,"type":"comment","url":null},{"author":"VCFundedGenYer","children":[{"author":"throooooo","children":[],"created_at":"2026-11-13T00:03:35.000Z","created_at_i":1794528215,"id":50476270,"options":[],"parent_id":50474846,"points":null,"story_id":50471731,"text":"Downdetector said basically everything was down today (including Google, AWS, etc.) but they aren&#x27;t affected. This makes me NOT trust downdetector.","title":null,"type":"comment","url":null},{"author":"tristor","children":[],"created_at":"2026-11-13T15:46:18.000Z","created_at_i":1794584778,"id":50485210,"options":[],"parent_id":50474846,"points":null,"story_id":50471731,"text":"That&#x27;s definitely your prerogative. Internet Insights uses various techniques to analyze billions of metrics gathered daily from hundreds of thousands of vantage points around the Internet to detect outages in minutes, while providing (in the paid product) corroborating evidence based on that collected telemetry to support its conclusions.  Crowdsourcing is subject to the vagaries of crowds.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:52:39.000Z","created_at_i":1794520359,"id":50474846,"options":[],"parent_id":50472902,"points":null,"story_id":50471731,"text":"Honestly I trust downdetector more than that. Crowdsourcing always wins.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:31:27.000Z","created_at_i":1794511887,"id":50472902,"options":[],"parent_id":50472313,"points":null,"story_id":50471731,"text":"Full Disclosure, this is a Cisco product and I work there.<p>ThousandEyes Internet Insights offers a public outage map at <a href=\"https:&#x2F;&#x2F;www.thousandeyes.com&#x2F;outages&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.thousandeyes.com&#x2F;outages&#x2F;</a> that is MASSIVELY more accurate (and faster to detect) than Down Detector because its based on actual telemetry and not on crowdsourcing.","title":null,"type":"comment","url":null},{"author":"spelunker","children":[],"created_at":"2026-11-12T21:38:18.000Z","created_at_i":1794519498,"id":50474665,"options":[],"parent_id":50472313,"points":null,"story_id":50471668,"text":"My extensive DDoS bot network... er I mean my distributed website validation platform!","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:55:45.000Z","created_at_i":1794509745,"id":50472313,"options":[],"parent_id":50471992,"points":null,"story_id":50471731,"text":"What&#x27;s your preferred alternative?","title":null,"type":"comment","url":null},{"author":"akersten","children":[],"created_at":"2026-11-12T19:14:35.000Z","created_at_i":1794510875,"id":50472637,"options":[],"parent_id":50471992,"points":null,"story_id":50471668,"text":"It seems like one of the best methodologies there is? Real people reporting real outages of a service they use?<p>I often know about outages dozens of minutes in advance of it being posted on official channels (or in the case of AWS, three days later...).<p>So what if the resolution is low because people can&#x27;t log in to Fortnite and an Azure outage gets shown as an Epic Games outage. Doesn&#x27;t matter. The live feed is incredibly reassuring from a &quot;down for anyone else this instant, before official status page has a chance to see it?&quot; Saves me so much time knowing whether it&#x27;s a me-or-them issue.","title":null,"type":"comment","url":null},{"author":"inChargeOfIT","children":[{"author":"cush","children":[{"author":"OGWhales","children":[],"created_at":"2026-11-12T20:38:27.000Z","created_at_i":1794515907,"id":50473898,"options":[],"parent_id":50473070,"points":null,"story_id":50471731,"text":"At least it reports the numbers they are getting, you can see that outlook has 130k reports while AWS only has 1.3k.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:43:01.000Z","created_at_i":1794512581,"id":50473070,"options":[],"parent_id":50472824,"points":null,"story_id":50471731,"text":"Yeah, but the methodology means that normies are going to inaccurately blame AWS and Google (both are down right now according to downdetector)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:26:59.000Z","created_at_i":1794511619,"id":50472824,"options":[],"parent_id":50471992,"points":null,"story_id":50471731,"text":"How is it garbage? It&#x27;s crowdsourced monitoring so sure, there will be false positives (especially when aws&#x2F;cloudflare&#x2F;azure&#x2F;bgp services have a bad day), but it&#x27;s one of the best indicators to quickly know if _something_ is going on.","title":null,"type":"comment","url":null},{"author":"greenchair","children":[],"created_at":"2026-11-12T19:41:15.000Z","created_at_i":1794512475,"id":50473050,"options":[],"parent_id":50471992,"points":null,"story_id":50471731,"text":"not really, soon as i had a problem with outlook i went there and already saw user reports and a massive spike confirming it wasn&#x27;t anything on my end.","title":null,"type":"comment","url":null},{"author":"pigggg","children":[],"created_at":"2026-11-12T19:59:40.000Z","created_at_i":1794513580,"id":50473314,"options":[],"parent_id":50471992,"points":null,"story_id":50471731,"text":"As someone who ends up being unofficial downdetector-primary at a company, dealing with this shit and the fact that people cannot comprehend its mis-attribtion wastes so much of my time.","title":null,"type":"comment","url":null},{"author":"denysvitali","children":[],"created_at":"2026-11-12T20:57:37.000Z","created_at_i":1794517057,"id":50474165,"options":[],"parent_id":50471992,"points":null,"story_id":50471731,"text":"Still more reliable than most of the status pages that even lie after the outages","title":null,"type":"comment","url":null},{"author":"rdiddly","children":[{"author":"NetMageSCW","children":[{"author":"rdiddly","children":[],"created_at":"2026-11-13T08:47:01.000Z","created_at_i":1794559621,"id":50480304,"options":[],"parent_id":50475697,"points":null,"story_id":50471731,"text":"At the time I believed it was an Azure outage. And Office 365 relies on Azure stuff and would probably go down with it.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:04:45.000Z","created_at_i":1794524685,"id":50475697,"options":[],"parent_id":50474491,"points":null,"story_id":50471731,"text":"Since this isn\u2019t an Azure outage why would that page show anything ever?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:24:13.000Z","created_at_i":1794518653,"id":50474491,"options":[],"parent_id":50471992,"points":null,"story_id":50471731,"text":"At the other extreme is Microsoft&#x27;s own dashboard (<a href=\"https:&#x2F;&#x2F;azure.status.microsoft&#x2F;en-us&#x2F;status\" rel=\"nofollow\">https:&#x2F;&#x2F;azure.status.microsoft&#x2F;en-us&#x2F;status</a>) whose methodology is so &quot;rigorous&quot; that it probably won&#x27;t show anything about today&#x27;s outage until next week, if at all!","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:35:53.000Z","created_at_i":1794508553,"id":50471992,"options":[],"parent_id":50471898,"points":null,"story_id":50471731,"text":"Downdetector&#x27;s methodology is pretty garbage. I&#x27;m always surprised to see techies referencing them.","title":null,"type":"comment","url":null},{"author":"dudus","children":[{"author":"busymom0","children":[{"author":"MiguelPablo","children":[],"created_at":"2026-11-12T20:14:59.000Z","created_at_i":1794514499,"id":50473507,"options":[],"parent_id":50472543,"points":null,"story_id":50471731,"text":"With how many people are unable to associate a &quot;broken&quot; monitor with an unplugged HDMI&#x2F;DisplayPort or power cable, it doesn&#x27;t surprise me that most people would not make a disctinction between the &quot;internet&quot; and &quot;Outlook&quot;.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:08:51.000Z","created_at_i":1794510531,"id":50472543,"options":[],"parent_id":50472233,"points":null,"story_id":50471731,"text":"My housemate texted me saying our internet is so slow because outlook wasn&#x27;t loading. So I think lots of people associate email not working with entire internet not working..","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:50:48.000Z","created_at_i":1794509448,"id":50472233,"options":[],"parent_id":50471898,"points":null,"story_id":50471731,"text":"From what I&#x27;ve seen it seems people complaining they can&#x27;t get emails from MS so that&#x27;s why gmail is showing as down.<p>And with Google is people complaining Chrome doesn&#x27;t load their &quot;pages&quot;. I bet they mean outlook.","title":null,"type":"comment","url":null},{"author":"paxy","children":[{"author":"patrickmay","children":[],"created_at":"2026-11-12T19:02:03.000Z","created_at_i":1794510123,"id":50472434,"options":[],"parent_id":50472311,"points":null,"story_id":50471731,"text":"&quot;There&#x27;s nothing wrong with . . . Facebook.&quot;<p>That&#x27;s a bold claim to make on HN.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:55:44.000Z","created_at_i":1794509744,"id":50472311,"options":[],"parent_id":50471898,"points":null,"story_id":50471731,"text":"This happens every time there&#x27;s an outage. People see their email not working and go there and mark <i>everything</i> as down regardless of whether it is affected or not. There&#x27;s nothing wrong with Gmail or AWS or Cloudflare or Facebook.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:30:03.000Z","created_at_i":1794508203,"id":50471898,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Downdetector says LOTS of stuff is down. <a href=\"https:&#x2F;&#x2F;downdetector.com\" rel=\"nofollow\">https:&#x2F;&#x2F;downdetector.com</a>","title":null,"type":"comment","url":null},{"author":"dkpk","children":[],"created_at":"2026-11-12T18:30:08.000Z","created_at_i":1794508208,"id":50471900,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Here&#x27;s the Reddit post with discussions around this: <a href=\"https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;sysadmin&#x2F;comments&#x2F;1xuje83&#x2F;microsoft_office_seems_to_be_down&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;sysadmin&#x2F;comments&#x2F;1xuje83&#x2F;microsoft...</a>","title":null,"type":"comment","url":null},{"author":"NichoPaolucci","children":[{"author":"eightysixfour","children":[{"author":"NichoPaolucci","children":[{"author":"AnimalMuppet","children":[{"author":"esseph","children":[],"created_at":"2026-11-12T20:38:58.000Z","created_at_i":1794515938,"id":50473907,"options":[],"parent_id":50472479,"points":null,"story_id":50471731,"text":"The speed of change has accelerated drastically at some organizations, so even if quality stayed the same, the number of outages would increase because of the # of changes has condensed to happen over much shorter time frames.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:04:53.000Z","created_at_i":1794510293,"id":50472479,"options":[],"parent_id":50472253,"points":null,"story_id":50471731,"text":"Hmm.  More than normal?<p>And everybody has spent a year letting AI write code.  Correlation is not causation, but I wonder...","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:51:34.000Z","created_at_i":1794509494,"id":50472253,"options":[],"parent_id":50472054,"points":null,"story_id":50471731,"text":"Yeah - I get it. Just poking the bear a bit. We&#x27;ve had some major incidents this year from multiple vendors, it has been aggravating.","title":null,"type":"comment","url":null},{"author":"maxboone","children":[{"author":"tesin","children":[],"created_at":"2026-11-12T19:10:50.000Z","created_at_i":1794510650,"id":50472577,"options":[],"parent_id":50472425,"points":null,"story_id":50471731,"text":"At will applies on a one by one basis - at a certain headcount, WARN legislation applies <a href=\"https:&#x2F;&#x2F;www.dol.gov&#x2F;agencies&#x2F;eta&#x2F;layoffs&#x2F;warn\" rel=\"nofollow\">https:&#x2F;&#x2F;www.dol.gov&#x2F;agencies&#x2F;eta&#x2F;layoffs&#x2F;warn</a><p>And the other part is the &quot;goodwill&quot; you mention - if you jettison people for nothin en masse, word gets out, and make it hard to hire in the future","title":null,"type":"comment","url":null},{"author":"coredog64","children":[],"created_at":"2026-11-12T19:12:27.000Z","created_at_i":1794510747,"id":50472597,"options":[],"parent_id":50472425,"points":null,"story_id":50471668,"text":"A layoff of any real size has negative impacts to their unemployment insurance premiums and restricts their ability to file PERM for employees.  Meeting those targets with voluntary separation prevents those impacts.","title":null,"type":"comment","url":null},{"author":"gmane","children":[{"author":"evenhash","children":[],"created_at":"2026-11-12T20:41:59.000Z","created_at_i":1794516119,"id":50473960,"options":[],"parent_id":50472610,"points":null,"story_id":50471731,"text":"That\u2019s not entirely accurate. Washington State pays unemployment, not the company. The state funds unemployment by taxing payrolls, but it\u2019s much more indirect than most people think.<p>Claims do affect the rate they pay next year, but the company isn\u2019t \u201con the hook\u201d for you personally, at least not any more than they are for your social security income.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:12:54.000Z","created_at_i":1794510774,"id":50472610,"options":[],"parent_id":50472425,"points":null,"story_id":50471731,"text":"If you lay people off, you\u2019re on the hook for their unemployment. A voluntary buyout avoids that, and also avoids mandatory reporting for layoffs.","title":null,"type":"comment","url":null},{"author":"StableAlkyne","children":[],"created_at":"2026-11-12T19:13:31.000Z","created_at_i":1794510811,"id":50472622,"options":[],"parent_id":50472425,"points":null,"story_id":50471668,"text":"Voluntary reductions do not have the same reporting requirements or protections that actual layoffs have.","title":null,"type":"comment","url":null},{"author":"NotMichaelBay","children":[{"author":"ifwinterco","children":[],"created_at":"2026-11-12T19:31:27.000Z","created_at_i":1794511887,"id":50472901,"options":[],"parent_id":50472643,"points":null,"story_id":50471731,"text":"Can go the other way though: people who&#x27;ve been there for a while, are motivated and back themselves to get another job will take redundancy (i.e. the people you want to keep).<p>People who aren&#x27;t motivated and&#x2F;or don&#x27;t back themselves to get another job will stay (i.e. probably the people you want to get rid of)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:14:50.000Z","created_at_i":1794510890,"id":50472643,"options":[],"parent_id":50472425,"points":null,"story_id":50471731,"text":"I think both parties probably benefit; people who are more likely to take the offer are those who have another reason to leave (unfulfilled, etc). This will benefit the company in the long run because they can eventually replace them with someone who want to join (people applying for the job).","title":null,"type":"comment","url":null},{"author":"rustystump","children":[],"created_at":"2026-11-12T19:46:18.000Z","created_at_i":1794512778,"id":50473118,"options":[],"parent_id":50472425,"points":null,"story_id":50471668,"text":"You can at will fire but that doesnt stop lawsuits. Most of these require signing docs to get the payout. It is a way to cut cleanly and derisk the cut","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:01:42.000Z","created_at_i":1794510102,"id":50472425,"options":[],"parent_id":50472054,"points":null,"story_id":50471731,"text":"Why do they offer these buy outs at all, doesn&#x27;t the US have at will employment?<p>Or is this just a gesture of goodwill to avoid people jumping the ship on their own?","title":null,"type":"comment","url":null},{"author":"asdff","children":[],"created_at":"2026-11-12T19:24:16.000Z","created_at_i":1794511456,"id":50472781,"options":[],"parent_id":50472054,"points":null,"story_id":50471731,"text":"The fact that it is always Big Even Number shows how stupid it is. Imagine if it was serious like &quot;23.5176%&quot; then you&#x27;d know they actually did their homework on leaning up operations instead of just cutting off limbs and seeing if it can still walk or not.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:40:03.000Z","created_at_i":1794508803,"id":50472054,"options":[],"parent_id":50471944,"points":null,"story_id":50471731,"text":"&gt; Isn&#x27;t this the company that is trying to get rid of 25% of their employees?<p>Just clarifying this in general, when a company makes a voluntary offer to some segment of employees, especially at this size, it is a statistics game of how many people accept the buy out.<p>They did not make the offer to 25% of the employees to downsize by 25%, they did it to downsize by 5% (or something like that), and then made the offer based on how many they expect to accept. This is specifically covered in this line of the geekwire article:<p>&gt; Microsoft didn\u2019t provide a projection for how many employees will accept, but the company told GeekWire it anticipates a much smaller share than the roughly 30% who took its earlier voluntary retirement offer, which went to longtime employees more likely to take the deal.<p>They probably expect 10-20% of those offered to take it, which would result in a 2.5-5% total downsizing.","title":null,"type":"comment","url":null},{"author":"hn_submit","children":[],"created_at":"2026-11-12T19:41:45.000Z","created_at_i":1794512505,"id":50473057,"options":[],"parent_id":50471944,"points":null,"story_id":50471731,"text":"I can&#x27;t access my Outlook.com account so I guess Azure&#x27;s having problems.","title":null,"type":"comment","url":null},{"author":"nightski","children":[{"author":"alpineman","children":[],"created_at":"2026-11-13T07:32:03.000Z","created_at_i":1794555123,"id":50479654,"options":[],"parent_id":50473712,"points":null,"story_id":50471731,"text":"Sure but if you&#x27;re one of the 22% you aren&#x27;t exactly going to be very motivated after that","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:27:27.000Z","created_at_i":1794515247,"id":50473712,"options":[],"parent_id":50471944,"points":null,"story_id":50471731,"text":"The CFO said in an interview they only expected 3% or less to actually take the offer.","title":null,"type":"comment","url":null},{"author":"dastari","children":[],"created_at":"2026-11-12T20:47:16.000Z","created_at_i":1794516436,"id":50474038,"options":[],"parent_id":50471944,"points":null,"story_id":50471731,"text":"Relax. I&#x27;m sure they have copilot working on it.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:32:58.000Z","created_at_i":1794508378,"id":50471944,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Isn&#x27;t this the company that is trying to get rid of 25% of their employees?<p>Status page is down. Much of our org is halted.<p>Fingers crossed that Azure isn&#x27;t impacted (seems fine so far)<p>(<a href=\"https:&#x2F;&#x2F;www.geekwire.com&#x2F;2026&#x2F;microsoft-makes-new-voluntary-exit-offer-to-more-than-a-quarter-of-its-workforce-including-some-execs&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.geekwire.com&#x2F;2026&#x2F;microsoft-makes-new-voluntary-...</a>)","title":null,"type":"comment","url":null},{"author":"bearjaws","children":[],"created_at":"2026-11-12T18:35:46.000Z","created_at_i":1794508546,"id":50471987,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Seems like URL scanning is down entirely and some intermittent failures in Sharepoint.","title":null,"type":"comment","url":null},{"author":"agumonkey","children":[],"created_at":"2026-11-12T18:36:02.000Z","created_at_i":1794508562,"id":50471994,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Anybody else was served raw text of source by default ? (gwire is down too)","title":null,"type":"comment","url":null},{"author":"debo_","children":[{"author":"francisofascii","children":[],"created_at":"2026-11-12T18:45:45.000Z","created_at_i":1794509145,"id":50472147,"options":[],"parent_id":50472019,"points":null,"story_id":50471731,"text":"For anyone doubting Nvidia&#x27;s close ties to Microsoft, here&#x27;s your proof.","title":null,"type":"comment","url":null},{"author":"FranOntanaya","children":[],"created_at":"2026-11-12T19:00:06.000Z","created_at_i":1794510006,"id":50472392,"options":[],"parent_id":50472019,"points":null,"story_id":50471731,"text":"Maybe everything relied on an old server running a cronjob in Jensen&#x27;s basement.","title":null,"type":"comment","url":null},{"author":"pona-a","children":[],"created_at":"2026-11-12T19:52:52.000Z","created_at_i":1794513172,"id":50473210,"options":[],"parent_id":50472019,"points":null,"story_id":50471731,"text":"[delayed]","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:37:39.000Z","created_at_i":1794508659,"id":50472019,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"The GPUs are having a moment of silence for their fallen leader","title":null,"type":"comment","url":null},{"author":"dbvn","children":[{"author":"JPascal_","children":[],"created_at":"2026-11-12T18:56:34.000Z","created_at_i":1794509794,"id":50472327,"options":[],"parent_id":50472036,"points":null,"story_id":50471731,"text":"Fr lol","title":null,"type":"comment","url":null},{"author":"OhMeadhbh","children":[],"created_at":"2026-11-12T19:25:31.000Z","created_at_i":1794511531,"id":50472802,"options":[],"parent_id":50472036,"points":null,"story_id":50471731,"text":"microsoft, apparently.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:38:40.000Z","created_at_i":1794508720,"id":50472036,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"who puts their status page on servers the status is supposed to be for?","title":null,"type":"comment","url":null},{"author":"nazgulsenpai","children":[{"author":"iAMkenough","children":[{"author":"nazgulsenpai","children":[{"author":"millerm","children":[],"created_at":"2026-11-12T19:08:01.000Z","created_at_i":1794510481,"id":50472531,"options":[],"parent_id":50472331,"points":null,"story_id":50471731,"text":"Perhaps they will attempt to &quot;conscript&quot; all of our RAM.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:56:41.000Z","created_at_i":1794509801,"id":50472331,"options":[],"parent_id":50472204,"points":null,"story_id":50471731,"text":"sam altman needs a big headline to shore up AI funding","title":null,"type":"comment","url":null},{"author":"FranOntanaya","children":[],"created_at":"2026-11-12T19:09:39.000Z","created_at_i":1794510579,"id":50472554,"options":[],"parent_id":50472204,"points":null,"story_id":50471668,"text":"Maybe people trying to catch the next Nvidia headline ahead of everyone else, wherever it may be found in (likely someone&#x27;s inbox.)<p>Edit: Oh, there it is.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:49:10.000Z","created_at_i":1794509350,"id":50472204,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"Too many AI agents connecting at once?","title":null,"type":"comment","url":null},{"author":"gloosx","children":[{"author":"bix6","children":[{"author":"datadrivenangel","children":[{"author":"ingen0s","children":[],"created_at":"2026-11-12T19:51:36.000Z","created_at_i":1794513096,"id":50473192,"options":[],"parent_id":50473020,"points":null,"story_id":50471731,"text":"lol","title":null,"type":"comment","url":null},{"author":"isomorphic","children":[{"author":"card_zero","children":[],"created_at":"2026-11-12T20:12:50.000Z","created_at_i":1794514370,"id":50473473,"options":[],"parent_id":50473265,"points":null,"story_id":50471668,"text":"Recursive self-promotion.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:56:16.000Z","created_at_i":1794513376,"id":50473265,"options":[],"parent_id":50473020,"points":null,"story_id":50471668,"text":"At this point Microsoft would be better off using Copilot to brand itself.","title":null,"type":"comment","url":null},{"author":"cidd","children":[],"created_at":"2026-11-12T21:27:46.000Z","created_at_i":1794518866,"id":50474537,"options":[],"parent_id":50473020,"points":null,"story_id":50471731,"text":"A Silicon Valley reference.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:39:28.000Z","created_at_i":1794512368,"id":50473020,"options":[],"parent_id":50472885,"points":null,"story_id":50471731,"text":"The Copilot O365 Gates, Bill G==B signature box","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:30:37.000Z","created_at_i":1794511837,"id":50472885,"options":[],"parent_id":50472800,"points":null,"story_id":50471731,"text":"It\u2019s actually O365 by Microsoft featuring Copilot by Bill Gates.","title":null,"type":"comment","url":null},{"author":"rawbee1989","children":[{"author":"ahartmetz","children":[{"author":"wiml","children":[],"created_at":"2026-11-13T02:59:17.000Z","created_at_i":1794538757,"id":50477587,"options":[],"parent_id":50475650,"points":null,"story_id":50471731,"text":"\u2026for workgroups","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:01:17.000Z","created_at_i":1794524477,"id":50475650,"options":[],"parent_id":50474155,"points":null,"story_id":50471731,"text":"Surely you mean Microsoft Copilot Premium for Copilot for M365 for Copilot.<p>For Copilot.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:56:31.000Z","created_at_i":1794516991,"id":50474155,"options":[],"parent_id":50472800,"points":null,"story_id":50471731,"text":"no, Copilot and Copilot Premium are products on the M365 platform, copilot is down too","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:25:19.000Z","created_at_i":1794511519,"id":50472800,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"isn&#x27;t Microsoft 365 called Copilot now?","title":null,"type":"comment","url":null},{"author":"bitteralmond","children":[{"author":"nazgulsenpai","children":[{"author":"cozzyd","children":[],"created_at":"2026-11-12T23:21:47.000Z","created_at_i":1794525707,"id":50475849,"options":[],"parent_id":50473359,"points":null,"story_id":50471731,"text":"And then they&#x27;re probably trying to debug with their AI which isn&#x27;t helping.","title":null,"type":"comment","url":null},{"author":"avisser","children":[],"created_at":"2026-11-13T15:26:30.000Z","created_at_i":1794583590,"id":50484932,"options":[],"parent_id":50473359,"points":null,"story_id":50471731,"text":"Seems unlikely to me. Different hardware requirements. AI workloads aren&#x27;t running on your standard 2U server.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:02:42.000Z","created_at_i":1794513762,"id":50473359,"options":[],"parent_id":50472963,"points":null,"story_id":50471731,"text":"I laughed then realized this is plausible","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:35:40.000Z","created_at_i":1794512140,"id":50472963,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"My guess: too many DC resources dedicated to AI, leaving insufficient free capacity to handle traffic spikes","title":null,"type":"comment","url":null},{"author":"bombcar","children":[{"author":"reaperducer","children":[],"created_at":"2026-11-12T20:11:17.000Z","created_at_i":1794514277,"id":50473453,"options":[],"parent_id":50473075,"points":null,"story_id":50471731,"text":"<i>This seems to be the smoking gnu, now what would it be ...</i><p>I saw a frog smoking on The Little Rascals once, but never a gnu.","title":null,"type":"comment","url":null},{"author":"stn8188","children":[],"created_at":"2026-11-12T20:53:09.000Z","created_at_i":1794516789,"id":50474109,"options":[],"parent_id":50473075,"points":null,"story_id":50471731,"text":"At first I thought you meant the traffic increase had something to do with free software :&#x2F;","title":null,"type":"comment","url":null},{"author":"cuu508","children":[{"author":"junga","children":[],"created_at":"2026-11-12T22:07:12.000Z","created_at_i":1794521232,"id":50475007,"options":[],"parent_id":50474556,"points":null,"story_id":50471731,"text":"CNU?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:29:03.000Z","created_at_i":1794518943,"id":50474556,"options":[],"parent_id":50473075,"points":null,"story_id":50471731,"text":"Certainy not Unix!","title":null,"type":"comment","url":null},{"author":"BLKNSLVR","children":[{"author":"berkeleyjunk","children":[{"author":"BLKNSLVR","children":[],"created_at":"2026-11-12T23:10:23.000Z","created_at_i":1794525023,"id":50475749,"options":[],"parent_id":50475685,"points":null,"story_id":50471731,"text":"Yeah, once I&#x27;m done with X-Files it&#x27;ll be next on the list. Seems there are those who love it and those who really don&#x27;t, and not much in between.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:03:45.000Z","created_at_i":1794524625,"id":50475685,"options":[],"parent_id":50475296,"points":null,"story_id":50471731,"text":"I think you would probably also like the spinoff \u201cThe lone gunmen\u201d. Pity it was only one season.","title":null,"type":"comment","url":null},{"author":"markus_zhang","children":[{"author":"OnlineTux","children":[{"author":"markus_zhang","children":[],"created_at":"2026-11-13T03:03:10.000Z","created_at_i":1794538990,"id":50477610,"options":[],"parent_id":50477473,"points":null,"story_id":50471731,"text":"Thanks you! I realized I misspelled a word.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:49:00.000Z","created_at_i":1794538140,"id":50477473,"options":[],"parent_id":50477355,"points":null,"story_id":50471731,"text":"I see you are a human of culture!","title":null,"type":"comment","url":null},{"author":"BLKNSLVR","children":[{"author":"markus_zhang","children":[],"created_at":"2026-11-13T14:36:49.000Z","created_at_i":1794580609,"id":50484145,"options":[],"parent_id":50477715,"points":null,"story_id":50471731,"text":"It is really a pity that people don&#x27;t make those nowadays. It is too politically incorrect and inconvenient to see reality turning into a comedy show.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:15:06.000Z","created_at_i":1794539706,"id":50477715,"options":[],"parent_id":50477355,"points":null,"story_id":50471731,"text":"Oh man, Yes Minister is almost too good. I was making my way through that series as well, a while back, but I think I got sidetracked by Trump winning the election and Yes Minister just seemed like the actual news.<p>I&#x27;ll get back into it. Can&#x27;t recommend it highly enough.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:31:47.000Z","created_at_i":1794537107,"id":50477355,"options":[],"parent_id":50475296,"points":null,"story_id":50471731,"text":"One of my favorite shows! I have two, the other is Yes Minister.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:30:24.000Z","created_at_i":1794522624,"id":50475296,"options":[],"parent_id":50473075,"points":null,"story_id":50471731,"text":"I&#x27;d like to think that The Smoking Gnu was a competitor publication to The Lone Gunmen.<p>(I&#x27;ve recently been revisiting the X-Files. Can recommend.)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:43:13.000Z","created_at_i":1794512593,"id":50473075,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"&gt;reviewing an unexpected increase in a specific type of service traffic to determine whether it&#x27;s contributing to the elevated load<p>This seems to be the smoking gnu, now what would it be ...","title":null,"type":"comment","url":null},{"author":"anvuong","children":[{"author":"canibalrex","children":[],"created_at":"2026-11-12T21:45:16.000Z","created_at_i":1794519916,"id":50474760,"options":[],"parent_id":50473168,"points":null,"story_id":50471731,"text":"If it would go away from a DDOS that would be a much better solution.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:49:50.000Z","created_at_i":1794512990,"id":50473168,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"If Outlook can go down because of DDOS then it&#x27;s a much worse problem.","title":null,"type":"comment","url":null},{"author":"lossolo","children":[{"author":"esseph","children":[{"author":"kabdib","children":[],"created_at":"2026-11-12T21:23:23.000Z","created_at_i":1794518603,"id":50474484,"options":[],"parent_id":50473935,"points":null,"story_id":50471731,"text":"Is this a case of &quot;who shall healthcheck the health checker?&quot;","title":null,"type":"comment","url":null},{"author":"drillsteps5","children":[{"author":"esseph","children":[{"author":"drillsteps5","children":[{"author":"esseph","children":[{"author":"macintux","children":[],"created_at":"2026-11-13T01:39:23.000Z","created_at_i":1794533963,"id":50477006,"options":[],"parent_id":50476315,"points":null,"story_id":50471731,"text":"No kidding. One computer can behave ~99.999% deterministically. A large network of them? Never.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:07:28.000Z","created_at_i":1794528448,"id":50476315,"options":[],"parent_id":50476105,"points":null,"story_id":50471731,"text":"&gt; Unexpected behavior doesn&#x27;t happen out of the blue, it&#x27;s not LLM, these are deterministic systems.<p>Oh... Oh I have news for you :)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:48:10.000Z","created_at_i":1794527290,"id":50476105,"options":[],"parent_id":50475894,"points":null,"story_id":50471731,"text":"Unexpected behavior doesn&#x27;t happen out of the blue, it&#x27;s not LLM, these are deterministic systems. It&#x27;s usually config change or code change, not necessarily in the component that&#x27;s misbehaving, but it is somewhere.<p>More often than not, it&#x27;s DNS :)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:26:55.000Z","created_at_i":1794526015,"id":50475894,"options":[],"parent_id":50475203,"points":null,"story_id":50471731,"text":"&gt;  then something must have changed just prior to that<p>Not at all, they could have simply hit an unexpected behavior for their infra they hadn&#x27;t seen, tested, or expected before. Global scale infra gets very, very complex, and tbh this is Microsoft... they&#x27;re not very good at it.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:23:24.000Z","created_at_i":1794522204,"id":50475203,"options":[],"parent_id":50473935,"points":null,"story_id":50471731,"text":"Currently (17:22EST):<p>&gt; Previous status: We&#x27;re continuing to work through restarting and validating the affected servers to safely return them to service, and we&#x27;re exploring opportunities to expedite this process. In parallel, we&#x27;re assessing whether reverting the small number of recent configuration updates we identified could help accelerate recovery.<p>If failures started at some point in time then something must have changed just prior to that. If no changes in traffic were detected (no DDOS) then it must have been a change, be it code or config. Duuuh.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:40:40.000Z","created_at_i":1794516040,"id":50473935,"options":[],"parent_id":50473296,"points":null,"story_id":50471731,"text":"Microsoft 365 Status<p>@MSFT365Status<p>16m<p>We&#x27;ve not identified any recent change correlated with the start of impact; however, our investigation indicates the failed health checks may originate from a specific component that&#x27;s responsible for processing server health. We&#x27;ve taken steps to prevent additional servers from being impacted while we work to return the affected servers to service. More info under EX1550543 and MO1550821 in the Microsoft 365 admin center, as well as status.cloud.microsoft if the admin center is not available to you.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:58:17.000Z","created_at_i":1794513497,"id":50473296,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"Probably self inflicted by some code change, as they mention &quot;specific type of service traffic&quot;.<p>EDIT: Seems like now they confirmed that: &quot;We&#x27;ve identified that affected servers are failing automated health checks, which is causing them to become unavailable, and this may be related to a recent change to a component involved in processing those checks. We&#x27;re testing a configuration change on a subset of affected infrastructure to address this and, if successful, will apply it more broadly. In parallel, we&#x27;ve initiated a restart of all affected servers and are validating whether they&#x27;re successfully returning to service.&quot;","title":null,"type":"comment","url":null},{"author":"MadrasTh0rn","children":[],"created_at":"2026-11-12T20:01:52.000Z","created_at_i":1794513712,"id":50473345,"options":[],"parent_id":50472046,"points":null,"story_id":50471668,"text":"Reminds me of this <a href=\"https:&#x2F;&#x2F;www.reuters.com&#x2F;sustainability&#x2F;boards-policy-regulation&#x2F;microsoft-knew-sharepoint-security-flaw-failed-effectively-patch-it-timeline-2025-07-22&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.reuters.com&#x2F;sustainability&#x2F;boards-policy-regulat...</a>","title":null,"type":"comment","url":null},{"author":"browningstreet","children":[{"author":"stef25","children":[],"created_at":"2026-11-13T12:45:48.000Z","created_at_i":1794573948,"id":50482730,"options":[],"parent_id":50475048,"points":null,"story_id":50471731,"text":"Or millions of xbox downloading GTA","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:10:38.000Z","created_at_i":1794521438,"id":50475048,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"Nah, just a &quot;Reply-All&quot; chain at NVDA...","title":null,"type":"comment","url":null},{"author":"cortesoft","children":[{"author":"Waterluvian","children":[{"author":"fhood","children":[],"created_at":"2026-11-13T01:15:33.000Z","created_at_i":1794532533,"id":50476843,"options":[],"parent_id":50476305,"points":null,"story_id":50471731,"text":"It is exactly that easy as long as it isn&#x27;t the gateway that is the problem.","title":null,"type":"comment","url":null},{"author":"cortesoft","children":[{"author":"macintux","children":[{"author":"cortesoft","children":[],"created_at":"2026-11-13T16:24:15.000Z","created_at_i":1794587055,"id":50485797,"options":[],"parent_id":50476991,"points":null,"story_id":50471731,"text":"Yep. There is simply no load testing you can do when you reach certain levels of traffic. Nothing can generate the type of load you get when you have millions of end users making requests from thousands of different networks, on different equipment and network configurations.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:37:28.000Z","created_at_i":1794533848,"id":50476991,"options":[],"parent_id":50476883,"points":null,"story_id":50471731,"text":"And you never really get an opportunity to thoroughly test these failure &amp; recovery modes until something catastrophic happens, at which point capturing detailed metrics and assessing the right sequence to perform the actions are both challenging at best.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:22:12.000Z","created_at_i":1794532932,"id":50476883,"options":[],"parent_id":50476305,"points":null,"story_id":50471731,"text":"In many cases, yet it is that simple.<p>However, in other cases it can be more complicated. For example, if the requesters are other internal services, they might not be behind a single gateway (although you should then have other controls you can use). Other times, it is not easy to block the RIGHT requests, because it is hard to distinguish which backend services will end up being hit by a request (a single request can trigger multiple calls to multiple services).<p>There is also the problem of catch up - if a system in a stable state is close to max capacity, it might never have the capacity to recover from a failure even if the entire system is restored. For example, imagine a log processing system that can just barely handle the normal peak load; if you have a failure where your producers locally store logs until they can send them upstream, you will have to clear that backlog, which requires additional capacity beyond a full steady state, which you might not have.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:07:06.000Z","created_at_i":1794528426,"id":50476305,"options":[],"parent_id":50475923,"points":null,"story_id":50471731,"text":"I know it\u2019s not actually that easy but don\u2019t they just have some gateway that\u2019s rejecting 100% of requests and they very gently lower that intentional rejection percentage over time?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:29:39.000Z","created_at_i":1794526179,"id":50475923,"options":[],"parent_id":50472046,"points":null,"story_id":50471731,"text":"As someone who worked in infrastructure for a large global CDN, this sort of overload issues happen all the time when trying to bring infrastructure back online after an issue.<p>First, you have every client retrying connections, whether automated or manual retries. This generates extra load over normal.<p>In addition, whichever systems come online first often get a ton of traffic sent to them, which can immediately bring them back down if you don&#x27;t have ways to prevent it. You will get a wave of systems coming back online, a ton of traffic hitting them, and then falling over again.<p>Now, I am sure Microsoft is used to this and has procedures and systems in place to mitigate the issues (I know we did).<p>However, sometimes if the right combination of services are failing, even the strategies you had to avoid this sort of failure can themselves fail.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:39:32.000Z","created_at_i":1794508772,"id":50472046,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"&gt; Current status: We\u2019re investigating an issue impacting multiple Microsoft 365 services and we&#x27;ve determined the affected infrastructure is experiencing elevated load across multiple regions, which is likely contributing to the connectivity errors. We&#x27;re restarting and repairing impacted portions of this infrastructure to restore capacity, and reviewing an unexpected increase in a specific type of service traffic to determine whether it&#x27;s contributing to the elevated load. In parallel, we&#x27;re evaluating options to redirect traffic to alternate infrastructure to expedite relief.<p>DDOS?","title":null,"type":"comment","url":null},{"author":"matt3210","children":[{"author":"worik","children":[],"created_at":"2026-11-12T18:47:56.000Z","created_at_i":1794509276,"id":50472183,"options":[],"parent_id":50472063,"points":null,"story_id":50471731,"text":"Coincidentally with massive programmer layoffs?","title":null,"type":"comment","url":null},{"author":"ocdtrekkie","children":[{"author":"iAMkenough","children":[{"author":"bitteralmond","children":[],"created_at":"2026-11-12T19:39:42.000Z","created_at_i":1794512382,"id":50473029,"options":[],"parent_id":50472244,"points":null,"story_id":50471731,"text":"AI is good at incident diagnosis, but AI slop code may have actually <i>caused</i> this: designing to avoid cascading failures is something AI doesn&#x27;t do so well","title":null,"type":"comment","url":null},{"author":"davidee","children":[{"author":"MiguelPablo","children":[],"created_at":"2026-11-12T20:09:40.000Z","created_at_i":1794514180,"id":50473436,"options":[],"parent_id":50473102,"points":null,"story_id":50471731,"text":"I work as a (depressed lol) sysadmin apprentice in a small MSP company (I live in Europe) and boy do I got a story about Ansible playbooks: We made an offer to one of our clients to automate the deployment of software to their computers (this is a client with around 150-200 employees, depending on whether you count only the &quot;core&quot; employees or also security and maintenance staff). Before we made and implemented this offer using Ansible, they did not have any sort of Software Deployment tool whatsoever, everything got installed fully manually.<p>(they also used to have local admin rights on all of their client computers until one employee got phished and literally gave away their personal ID card via a webcam)<p>In any case, guess who got to implement all the relevant playbooks for installing software and what tool they used for it? Our company literally handed the job to an intern who had no IT background whatsoever. I say this not to be mean, he was legitimately just at our company because a government program required him to do an internship.<p>He used Deepseek (our company does not believe in purchasing LLM subscriptions, at least not for us normal employees) to write literally all of the playbooks for any kind of software that mattered to our clients.<p>Now, as I said before, I am only an apprentice, and I am certainly not a good programmer by any means, but I read through parts of the Ansible documentation and had worked with it before, and I understood enough to at least be able to roughly judge whether a playbook made sense or was just way too complicated and convoluted.<p>I had to help this intern out multiple times, because he hadn&#x27;t yet understood that, in order to write a functioning playbook, you first had to somewhat understand how to deploy a piece of software on a single test machine using CMD or Powershell syntax with an according .exe or .msi.<p>He simply prompted, pasted the playbook and then reprompted with the error codes from the failed playbook until it somehow worked or until I had to help him out.<p>This took place in December or November of last year and the playbooks are mostly still pretty shitty if I am being honest.<p>I did take away an important lesson from this &quot;episode&quot;, though: LLMs can be very usefuly for writing code, or in this case, Ansible playbooks, but only if you have a somewhat decent and basic grasp of how software installation works via CMD&#x2F;powershell and if you took the time to read through and learn about at least the basic Ansible concepts.<p>Since I am only an apprentice (on paper and in terms of my knowledge and how I get paid, not in terms of how much I am expected to earn for the company), I have painfully experienced how important it is to possess a certain level of understanding about the infra-related code and scripts that you would like LLMs to write for you, because otherwise it very quickly spirals out of control and starts throwing everything at the problem, just as you described.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:44:46.000Z","created_at_i":1794512686,"id":50473102,"options":[],"parent_id":50472244,"points":null,"story_id":50471731,"text":"The place where I consistently see AI&#x2F;LLMS&#x2F;Agents&#x2F;language-widgets-with-tools fail at making decent code (and more often configuration) is infrastructure.<p>The number of times it has spit out a python program where a much simpler bash script would do, is too many to count.<p>I have a pet theory that if you don&#x27;t know what you really want, and aren&#x27;t skilled enough to understand what you got, infra code is THE WORST.<p>Anecdote: I wanted a simple change to an ansible playbook today. GPT-6-Astra&#x2F;codex came up with the most convoluted, brittle solution possible the first time, even though it was extending and already clear, idiomatic playbook. It took some amount of offensive and critical prompting to get it to use ansible&#x27;s built in modules and tooling to do the same job - and do so with nearly 80% less configuration and like 1000% more human readability.<p>Some part of me harbours a sneaking suspicion that the &quot;throw everything at it&quot; ethos is by design, not as a defensive measure against crappy code, but as a way to ensure there&#x27;s so much code and it&#x27;s so convoluted orgs and operators (or developers) are stuck&#x2F;addicted.<p>It&#x27;s still a force multiplier - but it&#x27;s by no means driverless, especially for existing&#x2F;already-running infra.","title":null,"type":"comment","url":null},{"author":"SoftTalker","children":[],"created_at":"2026-11-12T19:55:38.000Z","created_at_i":1794513338,"id":50473257,"options":[],"parent_id":50472244,"points":null,"story_id":50471731,"text":"Assuming AI agents are not the cause of the incident.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:51:20.000Z","created_at_i":1794509480,"id":50472244,"options":[],"parent_id":50472192,"points":null,"story_id":50471731,"text":"AI agents should be able to resolve this quicker than employees, right?<p>Service quality is in better hands after the layoffs, at least that\u2019s what investors are led to believe.","title":null,"type":"comment","url":null},{"author":"worik","children":[{"author":"cheesemonk66","children":[],"created_at":"2026-11-12T19:29:24.000Z","created_at_i":1794511764,"id":50472867,"options":[],"parent_id":50472272,"points":null,"story_id":50471731,"text":"Basically the number one issue these days","title":null,"type":"comment","url":null},{"author":"unethical_ban","children":[],"created_at":"2026-11-12T19:41:22.000Z","created_at_i":1794512482,"id":50473051,"options":[],"parent_id":50472272,"points":null,"story_id":50471731,"text":"I don&#x27;t consider fat-fingering a BGP route or a DNS entry to be a &quot;software&quot; issue directly.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:53:24.000Z","created_at_i":1794509604,"id":50472272,"options":[],"parent_id":50472192,"points":null,"story_id":50471731,"text":"&gt; This usually isn&#x27;t a software quality issue... overcomplicated infrastructure failures cascading through a complex environment<p>That is a software issue.","title":null,"type":"comment","url":null},{"author":"elxr","children":[],"created_at":"2026-11-12T20:04:08.000Z","created_at_i":1794513848,"id":50473378,"options":[],"parent_id":50472192,"points":null,"story_id":50471731,"text":"Infra is &gt;90% software nowadays","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:48:27.000Z","created_at_i":1794509307,"id":50472192,"options":[],"parent_id":50472063,"points":null,"story_id":50471731,"text":"This usually isn&#x27;t a software quality issue, it&#x27;s overcomplicated infrastructure failures cascading through a complex environment causing additional systems to fall over.","title":null,"type":"comment","url":null},{"author":"combobyte","children":[],"created_at":"2026-11-12T19:38:41.000Z","created_at_i":1794512321,"id":50473012,"options":[],"parent_id":50472063,"points":null,"story_id":50471731,"text":"I blame bad vibes","title":null,"type":"comment","url":null},{"author":"TacticalCoder","children":[{"author":"CamperBob2","children":[{"author":"10111001","children":[{"author":"hackerbrother","children":[{"author":"NichoPaolucci","children":[],"created_at":"2026-11-12T21:37:45.000Z","created_at_i":1794519465,"id":50474656,"options":[],"parent_id":50474461,"points":null,"story_id":50471731,"text":"With engineering rigor. They are fantastic tools for quickly navigating large codebases, ingesting large amounts of data, refactoring legacy code, compiling multiple formats of data, following defined patterns, and many other proper uses for the tools.<p>That doesn\u2019t mean the code&#x2F;result doesn\u2019t still need to meet our engineering standards.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:21:11.000Z","created_at_i":1794518471,"id":50474461,"options":[],"parent_id":50474159,"points":null,"story_id":50471731,"text":"How do you use LLMs properly?","title":null,"type":"comment","url":null},{"author":"CamperBob2","children":[{"author":"10111001","children":[],"created_at":"2026-11-12T23:34:15.000Z","created_at_i":1794526455,"id":50475957,"options":[],"parent_id":50474465,"points":null,"story_id":50471731,"text":"&gt; Hopefully the people who feel that way are already close to retirement, so the choice won&#x27;t have to be made for them.<p>One of the best ways to deal with doing something the wrong way is to get rid of all the people who know how to do it correctly. That way no one knows any better, so no one has to confront the fact they&#x27;re actually doing it wrong.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:21:36.000Z","created_at_i":1794518496,"id":50474465,"options":[],"parent_id":50474159,"points":null,"story_id":50471731,"text":"Hopefully the people who feel that way are already close to retirement, so the choice won&#x27;t have to be made for them.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:56:48.000Z","created_at_i":1794517008,"id":50474159,"options":[],"parent_id":50473845,"points":null,"story_id":50471731,"text":"&gt; Using LLMs properly leads to better software, not just more of it.<p>Current industry best practice is to use LLMs improperly.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:35:07.000Z","created_at_i":1794515707,"id":50473845,"options":[],"parent_id":50473389,"points":null,"story_id":50471731,"text":"Using LLMs properly leads to <i>better</i> software, not just more of it.","title":null,"type":"comment","url":null},{"author":"perching_aix","children":[],"created_at":"2026-11-12T21:09:44.000Z","created_at_i":1794517784,"id":50474309,"options":[],"parent_id":50473389,"points":null,"story_id":50471731,"text":"I really don&#x27;t see the correlation, actually. On the contrary, I&#x27;m finding nasty defects with it that have been dormant for long and handwaved away, with repros to reveal them.<p>It&#x27;s been full speed downhill for many years, and the failure modes are pretty distinct.","title":null,"type":"comment","url":null},{"author":"vconnor","children":[],"created_at":"2026-11-12T21:39:15.000Z","created_at_i":1794519555,"id":50474677,"options":[],"parent_id":50473389,"points":null,"story_id":50471731,"text":"It&#x27;s the same with layoffs: there&#x27;s always a top comment trying very hard to convince everybody that AI usage has played no part.","title":null,"type":"comment","url":null},{"author":"skeaker","children":[],"created_at":"2026-11-12T22:28:20.000Z","created_at_i":1794522500,"id":50475267,"options":[],"parent_id":50473389,"points":null,"story_id":50471731,"text":"Well no, Windows has been more or less all downhill since Vista.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:04:27.000Z","created_at_i":1794513867,"id":50473389,"options":[],"parent_id":50472063,"points":null,"story_id":50471731,"text":"&gt; ... has been declining for a few years IMO<p>Interesting: there&#x27;s a huge correlation with everybody beginning to use LLMs.<p>And we dismiss it as being non-causal by saying it all started going downhill before the advent of LLMs?<p>I don&#x27;t buy it. I think we&#x27;re seeing the results of what happens when you hand the keys of the kingdom to LLMs.","title":null,"type":"comment","url":null},{"author":"k0morebi","children":[],"created_at":"2026-11-13T04:56:32.000Z","created_at_i":1794545792,"id":50478528,"options":[],"parent_id":50472063,"points":null,"story_id":50471731,"text":"Give or take a few decades, maybe. Absolutely exponentially accelerating as of late so the earlier linear trend is not even visible to many","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:40:39.000Z","created_at_i":1794508839,"id":50472063,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Software &#x2F; software service quality has been declining for a few years IMO.","title":null,"type":"comment","url":null},{"author":"robotnikman","children":[],"created_at":"2026-11-12T18:41:38.000Z","created_at_i":1794508898,"id":50472077,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"No wonder my email is not working.","title":null,"type":"comment","url":null},{"author":"corvad","children":[{"author":"tanseydavid","children":[],"created_at":"2026-11-12T19:24:32.000Z","created_at_i":1794511472,"id":50472784,"options":[],"parent_id":50472117,"points":null,"story_id":50471731,"text":"I heard they moved it over to GH Actions.  &lt;&#x2F;sarc&gt;","title":null,"type":"comment","url":null},{"author":"OhMeadhbh","children":[],"created_at":"2026-11-12T19:25:12.000Z","created_at_i":1794511512,"id":50472794,"options":[],"parent_id":50472117,"points":null,"story_id":50471731,"text":"That would probably cost money or increase complexity, so I&#x27;m sure the idea was shot down.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:44:10.000Z","created_at_i":1794509050,"id":50472117,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Not sure they got the memo to host the status page in separate infrastructure...","title":null,"type":"comment","url":null},{"author":"OnceMoreUntoThe","children":[{"author":"goodthink","children":[{"author":"busymom0","children":[{"author":"gilfaethwy","children":[],"created_at":"2026-11-12T19:23:48.000Z","created_at_i":1794511428,"id":50472772,"options":[],"parent_id":50472443,"points":null,"story_id":50471731,"text":"Pangram says no.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:02:51.000Z","created_at_i":1794510171,"id":50472443,"options":[],"parent_id":50472276,"points":null,"story_id":50471731,"text":"Is that account AI?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:53:37.000Z","created_at_i":1794509617,"id":50472276,"options":[],"parent_id":50472137,"points":null,"story_id":50471731,"text":"Thanks for this LMAO. It made my day off worth taking. Now I don&#x27;t feel the need to log in and check who-knows-what mail.","title":null,"type":"comment","url":null},{"author":"Ungh","children":[],"created_at":"2026-11-12T19:05:18.000Z","created_at_i":1794510318,"id":50472485,"options":[],"parent_id":50472137,"points":null,"story_id":50471731,"text":"Exchange has been a circus for years. I think that&#x27;s why everyone went O365 in the first place. Managing to have a paid up configuration where you go down when a cloud provider goes down but you&#x27;re hosting it locally is absolutely stupid and I am laughing my ass off here.<p>Also laughing at our ops guys who are now absolutely helpless and have people phoning them. I warned about this on our risk call and it was seen as low probability low risk. I hope it&#x27;s down for a few hours :)","title":null,"type":"comment","url":null},{"author":"greatquux","children":[{"author":"OnceMoreUntoThe","children":[],"created_at":"2026-11-12T19:18:41.000Z","created_at_i":1794511121,"id":50472703,"options":[],"parent_id":50472566,"points":null,"story_id":50471731,"text":"It&#x27;s been gone-as-a-default for a few months now, but for a long time, &quot;Classic Outlook&quot; aggressively offered a one-toggle upgrade path to &quot;New Outlook&quot;, and it got used.<p>Sure, &quot;New Outlook&quot; on Windows is still entirely broken (including stuff like, oh, re-ordering mailboxes), but on Mac it&#x27;s actually quite usable, and even allows you to switch off the IMAP proxying.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:10:11.000Z","created_at_i":1794510611,"id":50472566,"options":[],"parent_id":50472137,"points":null,"story_id":50471731,"text":"I don&#x27;t think many orgs are using &quot;new Outlook&quot; to connect to on-prem Exchange because you miss a lot if you&#x27;re only doing it via IMAP and &quot;new&quot; still doesn&#x27;t support on-prem Exchange any other way.  So all my clients are using classic Outlook with their on-prem Exchange servers (and really if they have EXO too because new Outlook isn&#x27;t very good).","title":null,"type":"comment","url":null},{"author":"arboles","children":[],"created_at":"2026-11-12T19:52:57.000Z","created_at_i":1794513177,"id":50473213,"options":[],"parent_id":50472137,"points":null,"story_id":50471731,"text":"Do e-mail messages that self-hosted Exchange receives always get proxied through the outlook.com cloud?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:45:11.000Z","created_at_i":1794509111,"id":50472137,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Sure, outlook.com is down, which is bad for everyone that chose to host their email there, I guess, but as an <i>interesting</i> side-effect, everyone with an on-premise Exchange server and &quot;new Outlook&quot; clients is affected as well.<p>Because, well, once upon a time there was Exchange Server and MAPI (the &quot;Messaging API&quot;), and that actually worked pretty well, and pretty much everyone started using it (or one of its EWS&#x2F;ActiveSync offshoots), but then the Internet happened and ruined everything, but we got MAPI-over-HTTPS eventually, which by that time had grown so many warts that nobody at Microsoft really understood it anymore, so that got <i>deprecated</i>, even though, well, everyone and everything still uses it.<p>The new hotness was Azure-slash-Office-365, and that&#x27;s where the &quot;new Outlook&quot; web interface lived and (sort-of) continues to live, and the on-prem customers got stuck with the &quot;Exchange Subscription Edition&quot;, which was basically Exchange 2019 plus security hotfixes at extortionate rates, but with none of the new functionality.<p>And, since MAPI continued to be really, really hard even in the age of Copilot, access from the new hotness to the deprecated on-prem servers was implemented via IMAP (LOL), but force-proxied via the outlook.com cloud&#x2F;clownshow.<p>Which is why, right now, many Microsoft customers that thought they were self-hosting their email are entirely down. Lessons <i>might</i> be learned here, but I sort-of doubt it...","title":null,"type":"comment","url":null},{"author":"ericfrederich","children":[{"author":"Juvination","children":[],"created_at":"2026-11-12T18:53:19.000Z","created_at_i":1794509599,"id":50472271,"options":[],"parent_id":50472210,"points":null,"story_id":50471731,"text":"I don&#x27;t think this is the case, even a little bit.","title":null,"type":"comment","url":null},{"author":"ratelimitsteve","children":[{"author":"ericfrederich","children":[{"author":"zamadatix","children":[{"author":"miyuru","children":[],"created_at":"2026-11-13T08:21:03.000Z","created_at_i":1794558063,"id":50480087,"options":[],"parent_id":50473277,"points":null,"story_id":50471731,"text":"At that traffic, ISP level cache servers matter more than centralized clouds &quot;(beefy ass) severs.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:56:50.000Z","created_at_i":1794513410,"id":50473277,"options":[],"parent_id":50473024,"points":null,"story_id":50471731,"text":"It is basically nothing once you remember the cloud isn&#x27;t one computer either. I want to say Azure was already millions of (beefy ass) severs over hundreds of datacenter locations organized into dozens of zones, and not all of those servers in each region are assigned to the same sets of services.<p>6.9 Tbps to get it done in a single day is even 3x less than the minimum on Steam in the last 48 hours <a href=\"https:&#x2F;&#x2F;store.steampowered.com&#x2F;stats&#x2F;content&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;store.steampowered.com&#x2F;stats&#x2F;content&#x2F;</a> and they don&#x27;t even have GTA VI to distribute.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:39:37.000Z","created_at_i":1794512377,"id":50473024,"options":[],"parent_id":50472675,"points":null,"story_id":50471731,"text":"An estimated 2.6 million pre-orders for Xbox alone.  2.6 million people downloading 200+ GB is not nothing.<p>If they roll it out evenly the week prior, then today (1&#x2F;7th) is just 75 PB.  To get that done in a single day would require a sustained 6.9 Tbps.<p>I&#x27;m sure this is all handled by a CDN at some level... but again it&#x27;s not nothing.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:17:07.000Z","created_at_i":1794511027,"id":50472675,"options":[],"parent_id":50472210,"points":null,"story_id":50471731,"text":"I want to believe that cause is that all the world&#x27;s computing power is dedicated to calculating the incredibly large balance in my checking account but my desire is the only thing I can find to support that hypothesis.","title":null,"type":"comment","url":null},{"author":"nerdjon","children":[],"created_at":"2026-11-12T19:37:32.000Z","created_at_i":1794512252,"id":50472993,"options":[],"parent_id":50472210,"points":null,"story_id":50471731,"text":"Why would this be the case? Games preloading has been a thing for many years. This isnt like an MMO launch that there is additional impact when the game is being played.<p>Sure GTA6 may be a slight uptick in the amount of data being downloaded like any new game being released, but I would wager that the amount of data they are normally pushing out for downloads just on a regular basis (wether new purchases, redownloading games, game pass, etc) is already quite high.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:49:34.000Z","created_at_i":1794509374,"id":50472210,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Is this related to GTA6 being pushed to consoles a week prior to launch?\nWould they ever admit it if that were the case?<p>I want to believe this is the cause.  It&#x27;d be especially funny because businesses were already anticipating the productivity loss when GTA6 comes out, but now we have actual productivity loss because of this outage (and it&#x27;s affecting people who were never going to play the game anyway, lol)","title":null,"type":"comment","url":null},{"author":"ChrisArchitect","children":[],"created_at":"2026-11-12T18:53:57.000Z","created_at_i":1794509637,"id":50472284,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Some more discussion: <a href=\"https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=50471668\">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=50471668</a>","title":null,"type":"comment","url":null},{"author":"cromka","children":[{"author":"OnceMoreUntoThe","children":[],"created_at":"2026-11-12T19:01:23.000Z","created_at_i":1794510083,"id":50472422,"options":[],"parent_id":50472296,"points":null,"story_id":50471731,"text":"Nah, no way they&#x27;re getting rid of their M.C.-Escher-esque &#x27;Forefront&#x27; mail-disappearance-machine-that-nobody-in-Microsoft-seems-to-understand-or-control, but, yeah, even their Internet-facing infrastructure seems unhappy:<p>451 4.3.2 Temporary server error. Please try again later ATTR2 [MI3PEPF00008486.eurprd02.prod.outlook.com 2026-11-12Txxxxxxxxxxxxxx]","title":null,"type":"comment","url":null},{"author":"suzzer99","children":[{"author":"mjmas","children":[],"created_at":"2026-11-13T01:15:09.000Z","created_at_i":1794532509,"id":50476842,"options":[],"parent_id":50472763,"points":null,"story_id":50471731,"text":"It won&#x27;t actually bounce until either gmail gives up on its retries (which generally is 24 hours) or the outlook server gives an explicit rejection (rather than a temporary error or timeout)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:23:00.000Z","created_at_i":1794511380,"id":50472763,"options":[],"parent_id":50472296,"points":null,"story_id":50471731,"text":"Anything sent to my work or home Outlook email from gmail doesn&#x27;t bounce back, and anything sent from those is still stuck in the outbox. Microsoft.","title":null,"type":"comment","url":null},{"author":"bawolff","children":[],"created_at":"2026-11-12T20:54:02.000Z","created_at_i":1794516842,"id":50474123,"options":[],"parent_id":50472296,"points":null,"story_id":50471731,"text":"Normally if server down, smtp will wait a little while and try again.","title":null,"type":"comment","url":null},{"author":"mjmas","children":[],"created_at":"2026-11-13T01:13:37.000Z","created_at_i":1794532417,"id":50476831,"options":[],"parent_id":50472296,"points":null,"story_id":50471731,"text":"Yep.<p><pre><code>  421 4.3.2 The maximum number of concurrent connections per resource forest has exceeded a limit, closing transmission channel. xyzxyzxyz.outlook.com. PRX8 [Name=InboundProxyTrackingAgent][AGT=IPT][MxId=xyzxyzxyz] [xyzxyzxyz.ausprd01.prod.outlook.com 2026-11-13T01:08:15.373Z xyzxyzxyz]</code></pre>","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:54:58.000Z","created_at_i":1794509698,"id":50472296,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Nice, so at least your messages sent to their SMTP servers will actually bounce instead of being silently dropped &#x2F;s","title":null,"type":"comment","url":null},{"author":"vdkyes","children":[{"author":"fock","children":[],"created_at":"2026-11-12T19:30:30.000Z","created_at_i":1794511830,"id":50472883,"options":[],"parent_id":50472306,"points":null,"story_id":50471731,"text":"currently the people who brought us black october are starting it!","title":null,"type":"comment","url":null},{"author":"nhhvhy","children":[],"created_at":"2026-11-12T20:57:50.000Z","created_at_i":1794517070,"id":50474170,"options":[],"parent_id":50472306,"points":null,"story_id":50471731,"text":"Eternal October, very nice.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:55:30.000Z","created_at_i":1794509730,"id":50472306,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"In cybersecurity we had black october, now we having black November it seems","title":null,"type":"comment","url":null},{"author":"sonicrocketman","children":[],"created_at":"2026-11-12T18:56:03.000Z","created_at_i":1794509763,"id":50472320,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Relevant XKCD? <a href=\"https:&#x2F;&#x2F;xkcd.com&#x2F;303&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;xkcd.com&#x2F;303&#x2F;</a> (outages as modern compiler)","title":null,"type":"comment","url":null},{"author":"JPascal_","children":[],"created_at":"2026-11-12T18:57:22.000Z","created_at_i":1794509842,"id":50472341,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Affected in Mexico also, Azure seems fine still.","title":null,"type":"comment","url":null},{"author":"Foobar8568","children":[],"created_at":"2026-11-12T18:59:12.000Z","created_at_i":1794509952,"id":50472377,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"But Linkedin is up! Yeah!","title":null,"type":"comment","url":null},{"author":"flkiwi","children":[],"created_at":"2026-11-12T19:07:19.000Z","created_at_i":1794510439,"id":50472520,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Strangely, Teams <i>chat</i> is working fine here. Anything in Teams that is tied to other parts of O365, including the calendar, is dead. I&#x27;m currently watching a training video on sharepoint.com, so that&#x27;s fine too, for now.<p>While I don&#x27;t expect this to be the case, I&#x27;m emotionally prepared for this to be some sort of &quot;dicks out for Harambe&quot;-style action protesting JH&#x27;s departure from Nvidia, on a larger and more technical scale.<p><i>Edit:</i> Typo.","title":null,"type":"comment","url":null},{"author":"xp84","children":[{"author":"flufluflufluffy","children":[],"created_at":"2026-11-12T20:14:12.000Z","created_at_i":1794514452,"id":50473491,"options":[],"parent_id":50472558,"points":null,"story_id":50471668,"text":"how have i never seen this it is brilliant","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:09:47.000Z","created_at_i":1794510587,"id":50472558,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"In the words of an ancient ...I think newgrounds(?) video embedded in a SWF, &quot;I can&#x27;t get to my email&quot;\nEdit: here it is: <a href=\"https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=uRGljemfwUE\" rel=\"nofollow\">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=uRGljemfwUE</a><p>Hope this entertains you while we can&#x27;t get to our emails.","title":null,"type":"comment","url":null},{"author":"SirFatty","children":[{"author":"thesuitonym","children":[{"author":"SirFatty","children":[],"created_at":"2026-11-13T12:45:30.000Z","created_at_i":1794573930,"id":50482728,"options":[],"parent_id":50473952,"points":null,"story_id":50471731,"text":"No, it doesn&#x27;t depend.  Outlook is an app.  If you don&#x27;t have internet access, do you say Chrome is down?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:41:24.000Z","created_at_i":1794516084,"id":50473952,"options":[],"parent_id":50472561,"points":null,"story_id":50471731,"text":"That kind of depends on what you mean by &quot;Outlook&quot;.<p>Sure, the program on your desktop computer is fine, but the Outlook app on your phone routes everything through MSFT&#x27;s servers, so you may be impacted. Outlook.com is running EWS, so it would be down as well.<p>And finally, if you&#x27;re talking to a layperson, they&#x27;re not going to know what Exchange is. They just know they opened Outlook and it isn&#x27;t working.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:09:56.000Z","created_at_i":1794510596,"id":50472561,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Outlook is fine.  Exchange is experiencing issues.","title":null,"type":"comment","url":null},{"author":"tony69","children":[{"author":"rolph","children":[],"created_at":"2026-11-12T19:40:54.000Z","created_at_i":1794512454,"id":50473046,"options":[],"parent_id":50472652,"points":null,"story_id":50471731,"text":"quite often, and after 10,000 such hours the expert amateur emerges.","title":null,"type":"comment","url":null},{"author":"nxobject","children":[],"created_at":"2026-11-12T19:54:50.000Z","created_at_i":1794513290,"id":50473245,"options":[],"parent_id":50472652,"points":null,"story_id":50471731,"text":"GitHub Copilot strikes again, perhaps?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:15:10.000Z","created_at_i":1794510910,"id":50472652,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Amateur hour at Microsoft.\nIt baffles me how many companies can\u2019t figure out how to make a status page that can handle the high loads it\u2019ll have to sustain when the service they monitor is down. That\u2019s pretty much the only reason to have a status page in the first place.","title":null,"type":"comment","url":null},{"author":"xyst","children":[{"author":"OhMeadhbh","children":[{"author":"Tomis02","children":[{"author":"OhMeadhbh","children":[],"created_at":"2026-11-13T18:33:30.000Z","created_at_i":1794594810,"id":50487760,"options":[],"parent_id":50481990,"points":null,"story_id":50471731,"text":"<p><pre><code>   Prescient comment  as the  Outlook service  disruption enters\n   its second day.   (Though to be fair, I  hear most everything\n   is up, just  possibly a little slow.)  They can  still go for\n   another  day and  a  half  and claim  they  have  two 9&#x27;s  of\n   reliability.</code></pre>","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:28:21.000Z","created_at_i":1794569301,"id":50481990,"options":[],"parent_id":50472859,"points":null,"story_id":50471731,"text":"If","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:28:45.000Z","created_at_i":1794511725,"id":50472859,"options":[],"parent_id":50472657,"points":null,"story_id":50471731,"text":"Three 9&#x27;s is .36525 days per year.  So if this one is resolved within 8 hours, that&#x27;s about .999 uptime.  (assuming they only have one such outage this year.)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:15:52.000Z","created_at_i":1794510952,"id":50472657,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"GH and MS have been having a tough past couple weeks. Actions (hosted on shitty azure cloud) have been piss poor lately. I am honestly surprised GH and MSFT have the gall to continue advertising 99.9% uptime [1]<p>[1] <a href=\"https:&#x2F;&#x2F;github.com&#x2F;customer-terms&#x2F;github-online-services-sla\" rel=\"nofollow\">https:&#x2F;&#x2F;github.com&#x2F;customer-terms&#x2F;github-online-services-sla</a>","title":null,"type":"comment","url":null},{"author":"likelybot","children":[{"author":"LoganDark","children":[{"author":"azalemeth","children":[{"author":"hdgvhicv","children":[],"created_at":"2026-11-12T20:29:53.000Z","created_at_i":1794515393,"id":50473754,"options":[],"parent_id":50473084,"points":null,"story_id":50471731,"text":"When your system is down once a decade your boss yells and it\u2019s your fault<p>When your outsourced system to Microsoft goes down every few months your boss can\u2019t yell at you<p>Outsourcing is about shifting blame elsewhere","title":null,"type":"comment","url":null},{"author":"bawolff","children":[],"created_at":"2026-11-12T20:52:27.000Z","created_at_i":1794516747,"id":50474097,"options":[],"parent_id":50473084,"points":null,"story_id":50471731,"text":"Which is why service level agreements were invented.","title":null,"type":"comment","url":null},{"author":"antonvs","children":[{"author":"NetMageSCW","children":[{"author":"antonvs","children":[],"created_at":"2026-11-13T00:05:17.000Z","created_at_i":1794528317,"id":50476288,"options":[],"parent_id":50476113,"points":null,"story_id":50471731,"text":"I begrudgingly have to agree.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:48:53.000Z","created_at_i":1794527333,"id":50476113,"options":[],"parent_id":50474294,"points":null,"story_id":50471731,"text":"The truth is they are still managed better than most can reasonably so themselves.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:08:23.000Z","created_at_i":1794517703,"id":50474294,"options":[],"parent_id":50473084,"points":null,"story_id":50471731,"text":"The idea is that it&#x27;s someone else&#x27;s computers that are managed more comprehensively than you could reasonably do yourself. But if you choose <i>Microsoft</i> to provide such a service for you, I don&#x27;t know what to tell you.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:43:49.000Z","created_at_i":1794512629,"id":50473084,"options":[],"parent_id":50472959,"points":null,"story_id":50471731,"text":"That&#x27;s a very painful lesson in &quot;the cloud is just someone else&#x27;s computer&quot; to a crowd that normally are exposed to ideas like &quot;software and IT are not our core competency&quot;","title":null,"type":"comment","url":null},{"author":"TaLiTr","children":[{"author":"LoganDark","children":[],"created_at":"2026-11-12T19:53:48.000Z","created_at_i":1794513228,"id":50473228,"options":[],"parent_id":50473105,"points":null,"story_id":50471731,"text":"Absolutely.","title":null,"type":"comment","url":null},{"author":"joseda-hg","children":[],"created_at":"2026-11-12T19:54:56.000Z","created_at_i":1794513296,"id":50473246,"options":[],"parent_id":50473105,"points":null,"story_id":50471731,"text":"They do government and medical infra, those systems should be resilient but...","title":null,"type":"comment","url":null},{"author":"Detrytus","children":[{"author":"6031769","children":[],"created_at":"2026-11-12T20:28:51.000Z","created_at_i":1794515331,"id":50473735,"options":[],"parent_id":50473618,"points":null,"story_id":50471731,"text":"Github would like a word.","title":null,"type":"comment","url":null},{"author":"boomlinde","children":[],"created_at":"2026-11-13T07:49:17.000Z","created_at_i":1794556157,"id":50479812,"options":[],"parent_id":50473618,"points":null,"story_id":50471731,"text":"If the self-hosted email infrastructure goes down, roughly one company is deeply affected. When Microsoft&#x27;s server goes, entire industries and governments will simultaneously be unable to conduct business as usual.<p>From the individual&#x27;s perspective Microsoft might seem like the better choice if they can achieve higher availability, but the societal cost is so much greater when the one basket you&#x27;ve put all your eggs in breaks, even if everyone holding their own egg on average results in more broken eggs per year.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:21:33.000Z","created_at_i":1794514893,"id":50473618,"options":[],"parent_id":50473105,"points":null,"story_id":50471731,"text":"To be honest, Microsoft has much better chance of actually achieving that (almost) 100% uptime than your company&#x27;s own IT department self-hosting things.","title":null,"type":"comment","url":null},{"author":"jjice","children":[{"author":"boomlinde","children":[],"created_at":"2026-11-13T07:22:33.000Z","created_at_i":1794554553,"id":50479592,"options":[],"parent_id":50473680,"points":null,"story_id":50471731,"text":"<i>&gt; Businesses usually don&#x27;t care about where their email server is hosted.</i><p>Deeply irresponsible.<p><i>&gt; They shouldn&#x27;t have to care either.</i><p>According to what realistic principle?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:25:11.000Z","created_at_i":1794515111,"id":50473680,"options":[],"parent_id":50473105,"points":null,"story_id":50471731,"text":"I like to dogpile on M$ as much as the next guy, but this feels like a heavy strawman.<p>&gt; I dislike Microsoft as much as the next guy, but many businesses impacted by these outages are completely innocent and don&#x27;t deserve these consequences.<p>At no point is &quot;keeping people alive&quot; mentioned. Businesses use email for everything. Businesses usually don&#x27;t care about where their email server is hosted. They just want to send emails. They shouldn&#x27;t have to care either. I don&#x27;t put blame on a business that happened to choose Outlook, one of the largest email providers, to host their email.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:44:55.000Z","created_at_i":1794512695,"id":50473105,"options":[],"parent_id":50472959,"points":null,"story_id":50471731,"text":"If your system keeps people alive by relying on 100% Microsoft uptime, maybe they deserve some blame?","title":null,"type":"comment","url":null},{"author":"fock","children":[],"created_at":"2026-11-12T19:50:45.000Z","created_at_i":1794513045,"id":50473180,"options":[],"parent_id":50472959,"points":null,"story_id":50471731,"text":"their bosses decided for the cloud and they pretended not to care!","title":null,"type":"comment","url":null},{"author":"SoftTalker","children":[{"author":"datakan","children":[{"author":"mrguyorama","children":[],"created_at":"2026-11-12T20:45:40.000Z","created_at_i":1794516340,"id":50474013,"options":[],"parent_id":50473971,"points":null,"story_id":50471731,"text":"Why","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:42:45.000Z","created_at_i":1794516165,"id":50473971,"options":[],"parent_id":50473323,"points":null,"story_id":50471731,"text":"It\u2019s a shame we still use email in 2026","title":null,"type":"comment","url":null},{"author":"destitude","children":[],"created_at":"2026-11-12T20:57:08.000Z","created_at_i":1794517028,"id":50474161,"options":[],"parent_id":50473323,"points":null,"story_id":50471731,"text":"They then get you by spam filtering any emails not coming from the &quot;industry leaders&quot;.","title":null,"type":"comment","url":null},{"author":"NetMageSCW","children":[],"created_at":"2026-11-12T23:49:22.000Z","created_at_i":1794527362,"id":50476118,"options":[],"parent_id":50473323,"points":null,"story_id":50471731,"text":"It\u2019s not just about email.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:00:29.000Z","created_at_i":1794513629,"id":50473323,"options":[],"parent_id":50472959,"points":null,"story_id":50471731,"text":"It&#x27;s a shame there isn&#x27;t a well-standardized, free and open protocol for delivering email that could be run on inexpensive modestly provisioned hardware.","title":null,"type":"comment","url":null},{"author":"cozzyd","children":[],"created_at":"2026-11-12T23:18:54.000Z","created_at_i":1794525534,"id":50475816,"options":[],"parent_id":50472959,"points":null,"story_id":50471731,"text":"I mean, they made us take down our departmental run email (presumably postfix) and forced us to make them aliases to university-wide exchange (with crappy support for open source mail clients no less). So I don&#x27;t think my org is Innocent here...","title":null,"type":"comment","url":null},{"author":"NoPicklez","children":[],"created_at":"2026-11-13T01:57:17.000Z","created_at_i":1794535037,"id":50477111,"options":[],"parent_id":50472959,"points":null,"story_id":50471731,"text":"Of course they&#x27;re innocent, but many business also can&#x27;t afford nor want to employ people to host something like an email service for them.<p>I&#x27;d rather Microsoft host it for me than have to maintain a team of people with Microsoft Exchange skills running either on a cloud environment (similar issues) or on my own infrastructure.<p>I for one don&#x27;t miss the days of Exchange going offline or having issues and being the person having to try figure it out.<p>Microsoft has much better reliability than MOST companies.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:35:22.000Z","created_at_i":1794512122,"id":50472959,"options":[],"parent_id":50472667,"points":null,"story_id":50471731,"text":"I dislike Microsoft as much as the next guy, but many businesses impacted by these outages are completely innocent and don&#x27;t deserve these consequences.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:16:27.000Z","created_at_i":1794510987,"id":50472667,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"LETS GO HELL YEAH","title":null,"type":"comment","url":null},{"author":"Surac","children":[],"created_at":"2026-11-12T19:18:40.000Z","created_at_i":1794511120,"id":50472702,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"That are not the Druids your searching for...","title":null,"type":"comment","url":null},{"author":"loloquwowndueo","children":[],"created_at":"2026-11-12T19:21:29.000Z","created_at_i":1794511289,"id":50472745,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Remember, my guys : \u201cMicrosoft Works\u201d is an oxymoron.","title":null,"type":"comment","url":null},{"author":"Kye","children":[{"author":"nullorempty","children":[],"created_at":"2026-11-12T20:22:31.000Z","created_at_i":1794514951,"id":50473638,"options":[],"parent_id":50472810,"points":null,"story_id":50471731,"text":"my thoughts too","title":null,"type":"comment","url":null},{"author":"drillsteps5","children":[],"created_at":"2026-11-13T05:10:54.000Z","created_at_i":1794546654,"id":50478626,"options":[],"parent_id":50472810,"points":null,"story_id":50471731,"text":"They mention traffic management&#x2F;blocking more and more in their updates. Totaly could be something with routing.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:26:06.000Z","created_at_i":1794511566,"id":50472810,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It&#x27;s probably DNS.","title":null,"type":"comment","url":null},{"author":"bastien-brd","children":[],"created_at":"2026-11-12T19:27:48.000Z","created_at_i":1794511668,"id":50472841,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Maybe due to everyone pre-downloading GTA VI today ;-)","title":null,"type":"comment","url":null},{"author":"friendlypenguin","children":[],"created_at":"2026-11-12T19:30:36.000Z","created_at_i":1794511836,"id":50472884,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"No worries, the AI was installing an update...now it&#x27;s looking for the issue, found Exchange and deleted it...","title":null,"type":"comment","url":null},{"author":"mattbrewsbytes","children":[],"created_at":"2026-11-12T19:31:32.000Z","created_at_i":1794511892,"id":50472903,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Did Anthropic&#x27;s new release this week include an AI rollout plan (i.e. not approved by humans) to take down Office and Outlook for a lot of enterprises? I half-snarkily ask since we have seen &quot;rogue AI&quot; headlines before.<p>A fictional story about AI could be that it rolled out its new document, spreadsheet, slides, etc. apps, knows the IPO is coming up and decided to make a lot of opportunities for people to sign up for their new release by DDosing their competitor.","title":null,"type":"comment","url":null},{"author":"drillsteps5","children":[{"author":"steve1977","children":[],"created_at":"2026-11-12T19:39:34.000Z","created_at_i":1794512374,"id":50473022,"options":[],"parent_id":50472964,"points":null,"story_id":50471731,"text":"Maybe that&#x27;s exactly why it&#x27;s stable?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:35:44.000Z","created_at_i":1794512144,"id":50472964,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Yep my org as well.<p>It&#x27;s funny how text-only niche forum that looks like it&#x27;s running on RPi stuffed in someone&#x27;s closet is routinely used to discuss active outages in multimillion&#x2F;billion corps.","title":null,"type":"comment","url":null},{"author":"emschwartz","children":[{"author":"rvz","children":[],"created_at":"2026-11-12T19:44:13.000Z","created_at_i":1794512653,"id":50473094,"options":[],"parent_id":50473043,"points":null,"story_id":50471731,"text":"For now.<p>One of GitHub&#x27;s services will be down again by next week.","title":null,"type":"comment","url":null},{"author":"mook","children":[{"author":"emschwartz","children":[],"created_at":"2026-11-12T19:58:52.000Z","created_at_i":1794513532,"id":50473304,"options":[],"parent_id":50473216,"points":null,"story_id":50471731,"text":"I spoke too soon!","title":null,"type":"comment","url":null},{"author":"piker","children":[{"author":"throooooo","children":[],"created_at":"2026-11-13T00:01:19.000Z","created_at_i":1794528079,"id":50476245,"options":[],"parent_id":50474505,"points":null,"story_id":50471731,"text":"I was gonna say. This happens to my Mac jobs on a normal basis.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:25:07.000Z","created_at_i":1794518707,"id":50474505,"options":[],"parent_id":50473216,"points":null,"story_id":50471731,"text":"So basically business as usual with the mac runners, right?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:53:12.000Z","created_at_i":1794513192,"id":50473216,"options":[],"parent_id":50473043,"points":null,"story_id":50471731,"text":"Well, my mac CI runs aren&#x27;t being picked up, and they eventually fail because of it. So maybe wherever connects the orchestrator to the machines is having issues.","title":null,"type":"comment","url":null},{"author":"dist-epoch","children":[],"created_at":"2026-11-12T21:02:08.000Z","created_at_i":1794517328,"id":50474228,"options":[],"parent_id":50473043,"points":null,"story_id":50471731,"text":"Round robin. Github Actions were down yesterday.","title":null,"type":"comment","url":null},{"author":"shdjhdfh","children":[],"created_at":"2026-11-12T23:26:17.000Z","created_at_i":1794525977,"id":50475889,"options":[],"parent_id":50473043,"points":null,"story_id":50471731,"text":"GitHub infrastructure is for the most part completely separate from anything at Microsoft, other than using Azure.","title":null,"type":"comment","url":null},{"author":"dingaling911","children":[],"created_at":"2026-11-13T00:11:41.000Z","created_at_i":1794528701,"id":50476349,"options":[],"parent_id":50473043,"points":null,"story_id":50471731,"text":"Every third build is failing for me failing to publish test results.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:40:43.000Z","created_at_i":1794512443,"id":50473043,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I&#x27;m amazed to see so many services down and to see that Github and Github actions are still working","title":null,"type":"comment","url":null},{"author":"redwood","children":[],"created_at":"2026-11-12T19:43:11.000Z","created_at_i":1794512591,"id":50473073,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"<a href=\"https:&#x2F;&#x2F;azure.status.microsoft&#x2F;en-us&#x2F;status\" rel=\"nofollow\">https:&#x2F;&#x2F;azure.status.microsoft&#x2F;en-us&#x2F;status</a> azure not down?","title":null,"type":"comment","url":null},{"author":"caycep","children":[{"author":"drillsteps5","children":[],"created_at":"2026-11-13T04:14:35.000Z","created_at_i":1794543275,"id":50478221,"options":[],"parent_id":50473113,"points":null,"story_id":50471731,"text":"Jensen: If I&#x27;m going down I&#x27;M TAKING EVERYBODY WITH ME","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:45:55.000Z","created_at_i":1794512755,"id":50473113,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Outlook is down AND Jensen is out?  it&#x27;s like some cosmic convergence","title":null,"type":"comment","url":null},{"author":"thraway2079081","children":[{"author":"hdgvhicv","children":[{"author":"stanac","children":[],"created_at":"2026-11-12T20:23:01.000Z","created_at_i":1794514981,"id":50473644,"options":[],"parent_id":50473462,"points":null,"story_id":50471731,"text":"Focus time, and this time you don&#x27;t even have to (nor you can) reserve time-slot in the calendar.","title":null,"type":"comment","url":null},{"author":"morkalork","children":[],"created_at":"2026-11-12T20:52:01.000Z","created_at_i":1794516721,"id":50474088,"options":[],"parent_id":50473462,"points":null,"story_id":50471731,"text":"My PRs need approval but I have no way to ping anyone (screams internally)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:12:16.000Z","created_at_i":1794514336,"id":50473462,"options":[],"parent_id":50473143,"points":null,"story_id":50471731,"text":"Productivity up 20%","title":null,"type":"comment","url":null},{"author":"croes","children":[{"author":"chromatin","children":[{"author":"croes","children":[],"created_at":"2026-11-12T20:42:51.000Z","created_at_i":1794516171,"id":50473974,"options":[],"parent_id":50473807,"points":null,"story_id":50471731,"text":"Then it\u2019s a huge impact on economy","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:32:47.000Z","created_at_i":1794515567,"id":50473807,"options":[],"parent_id":50473645,"points":null,"story_id":50471731,"text":"license servers are down, so we can&#x27;t use even the desktop products at our large enterprise","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:23:03.000Z","created_at_i":1794514983,"id":50473645,"options":[],"parent_id":50473143,"points":null,"story_id":50471731,"text":"Is Excel down too?","title":null,"type":"comment","url":null},{"author":"cwbriscoe","children":[],"created_at":"2026-11-12T23:52:22.000Z","created_at_i":1794527542,"id":50476143,"options":[],"parent_id":50473143,"points":null,"story_id":50471731,"text":"Teams has been working all day for me but I haven&#x27;t been able to use outlook (app, not web) for about 7 hours now.  Fortune 20 company, BTW.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:47:47.000Z","created_at_i":1794512867,"id":50473143,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Neither email nor Teams is working at my non-tech megacorp employer. Wonder how much of the economy this is impacting.","title":null,"type":"comment","url":null},{"author":"MadrasTh0rn","children":[],"created_at":"2026-11-12T19:49:45.000Z","created_at_i":1794512985,"id":50473166,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Can confirm. Down and out","title":null,"type":"comment","url":null},{"author":"thraway2079081","children":[],"created_at":"2026-11-12T19:51:42.000Z","created_at_i":1794513102,"id":50473194,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Neither email nor Teams is working at my non-tech megacorp employer. I wonder how much of the economy this is impacting.<p>My employer is very very close to MSFT. Both my employer and MSFT have been aggressively moving jobs to India, and firing people in the US. It&#x27;s hard not to feel some schadenfreude.","title":null,"type":"comment","url":null},{"author":"Caloric3002Swed","children":[{"author":"fyrabanks","children":[{"author":"Caloric3002Swed","children":[{"author":"morkalork","children":[{"author":"butler14","children":[],"created_at":"2026-11-13T09:49:29.000Z","created_at_i":1794563369,"id":50480890,"options":[],"parent_id":50478264,"points":null,"story_id":50471731,"text":"Confirmed","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:19:49.000Z","created_at_i":1794543589,"id":50478264,"options":[],"parent_id":50473604,"points":null,"story_id":50471731,"text":"This comment may age poorly haha","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:20:36.000Z","created_at_i":1794514836,"id":50473604,"options":[],"parent_id":50473309,"points":null,"story_id":50471731,"text":"Yes? I know. I mean next workday for me :)<p>So in 10h<p>Now? I dont care Im logged off.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:59:24.000Z","created_at_i":1794513564,"id":50473309,"options":[],"parent_id":50473217,"points":null,"story_id":50471668,"text":"it&#x27;s been down for over an hour globally","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:53:20.000Z","created_at_i":1794513200,"id":50473217,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Office 365 parts goes down all the time. Usually around 20:00 CEST time, not sure if that is prime change time over in the USA but very handy as it is usually fixed next day.","title":null,"type":"comment","url":null},{"author":"anuptalwalkar","children":[],"created_at":"2026-11-12T19:54:26.000Z","created_at_i":1794513266,"id":50473241,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It looks much wider across aws, gcp? Whats going on?","title":null,"type":"comment","url":null},{"author":"tonymet","children":[],"created_at":"2026-11-12T19:56:07.000Z","created_at_i":1794513367,"id":50473263,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"- outlook is down<p>- live.com is down<p>- onedrive loads the UI, but all of my contents are missing<p>- MS Edge sync is down (503s )<p>Yup, major-major outage.","title":null,"type":"comment","url":null},{"author":"Lynicis","children":[{"author":"ahartmetz","children":[],"created_at":"2026-11-12T23:03:33.000Z","created_at_i":1794524613,"id":50475682,"options":[],"parent_id":50473270,"points":null,"story_id":50471731,"text":"*gated","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:56:28.000Z","created_at_i":1794513388,"id":50473270,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"i was gonna blame my isp but now i can see who bottlenecked my internet","title":null,"type":"comment","url":null},{"author":"andrewinardeer","children":[],"created_at":"2026-11-12T19:57:00.000Z","created_at_i":1794513420,"id":50473280,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"GitHub the other day went down because of an influx of anonymous users. Microsoft has hinted that surging connections caused the outage. I wonder if these two are linked?","title":null,"type":"comment","url":null},{"author":"beowulfey","children":[],"created_at":"2026-11-12T19:57:00.000Z","created_at_i":1794513420,"id":50473281,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"The Status page is not working well, but I managed to subscribe to their RSS feed and it has been sending out updates periodically. I&#x27;ll post some of them here.<p>7:52 PM UTC: \nWe&#x27;ve identified that affected servers are failing automated health checks, which is causing them to become unavailable, and this may be related to a recent change to a component involved in processing those checks. We&#x27;re testing a configuration change on a subset of affected infrastructure to address this and, if successful, will apply it more broadly. In parallel, we&#x27;ve initiated a restart of all affected servers and are validating whether they&#x27;re successfully returning to service.<p>7:30 PM UTC:\nWe&#x27;re aggressively pursuing all pathways to reduce impact. As a precaution, we&#x27;ve paused all deployments and configuration changes while we review recent changes for any correlation to this event. We&#x27;ve determined that the elevated load isn&#x27;t driven by an overall increase in traffic, but by a large number of servers being unexpectedly unavailable, which is shifting load onto the remaining infrastructure. We&#x27;re investigating what&#x27;s causing these servers to become unavailable while we work to safely return them to service.<p>7:16 PM UTC: \nWe&#x27;re aggressively pursuing all pathways to reduce impact. As a precaution, we&#x27;ve paused all deployments and configuration changes while we review recent changes for any correlation to this event. We&#x27;ve also moved traffic for some services off the affected infrastructure to further reduce load, with additional traffic moves in progress.<p>6:59 PM UTC: \nWe&#x27;ve completed redistributing connection traffic across our worldwide infrastructure, and we&#x27;re moving additional traffic off the affected infrastructure to further reduce load. We&#x27;re also restarting affected servers to return them to service. In parallel, we&#x27;re investigating whether the elevated traffic reflects a genuine increase in requests or a shift in how traffic is being routed across our infrastructure.","title":null,"type":"comment","url":null},{"author":"beowulfey","children":[{"author":"wmchen","children":[{"author":"beowulfey","children":[],"created_at":"2026-11-12T20:01:43.000Z","created_at_i":1794513703,"id":50473344,"options":[],"parent_id":50473310,"points":null,"story_id":50471731,"text":"Ah no that was a mistake on my part! RSS Feed was in EST and I misremembered the difference","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:59:28.000Z","created_at_i":1794513568,"id":50473310,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"Not really a big deal, but it is presently 8pm UTC time. I&#x27;m curious why their RSS feed seems to be 2 hours off?","title":null,"type":"comment","url":null},{"author":"ArcHound","children":[{"author":"justonceokay","children":[{"author":"jimmaswell","children":[],"created_at":"2026-11-12T20:44:06.000Z","created_at_i":1794516246,"id":50473993,"options":[],"parent_id":50473749,"points":null,"story_id":50471731,"text":"I suppose you might want to first rule out a break-in, and if there is one, recover evidence that won&#x27;t survive a reboot.","title":null,"type":"comment","url":null},{"author":"jamesfinlayson","children":[{"author":"Rantenki","children":[{"author":"jamesfinlayson","children":[],"created_at":"2026-11-13T06:30:12.000Z","created_at_i":1794551412,"id":50479181,"options":[],"parent_id":50478995,"points":null,"story_id":50471731,"text":"Oh, it&#x27;s been a while but I remember that.<p>I&#x27;ve used PHP in two previous jobs and certainly the stuff that I was in control of had it set to 0 because we made sure we didn&#x27;t leak memory. Other departments... I&#x27;m sure at least one had the limit set to something non-zero.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:05:36.000Z","created_at_i":1794549936,"id":50478995,"options":[],"parent_id":50478464,"points":null,"story_id":50471731,"text":"Another real world example: to this day, it&#x27;s a good idea to limit requests per PHP process using the MaxRequestsPerChild(apache)&#x2F;max_requests(php-fpm) config option to some sane limit. After that configured number of requests, the PHP worker is terminated and restarted to... &quot;fix&quot; memory leaks. I remember setting that in the late 90s on Apache...<p>I am happy to no longer use PHP for anything.","title":null,"type":"comment","url":null},{"author":"ninalanyon","children":[],"created_at":"2026-11-13T12:33:26.000Z","created_at_i":1794573206,"id":50482616,"options":[],"parent_id":50478464,"points":null,"story_id":50471731,"text":"We had a mail server that ran on an old DEC minicomputer.  I rebooted it every six months because it had a slow memory, or possibly resource, leak somewhere.<p>It was the only thing running on that box so it wasn&#x27;t a big deal to reboot.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:46:23.000Z","created_at_i":1794545183,"id":50478464,"options":[],"parent_id":50473749,"points":null,"story_id":50471731,"text":"Yeah, a place I worked at years ago had a cron job to restart some critical service at midnight because it leaked memory all day. That was there for years.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:29:47.000Z","created_at_i":1794515387,"id":50473749,"options":[],"parent_id":50473363,"points":null,"story_id":50471731,"text":"In maintenance, sometimes the dumb solution is the best. The servers that ran amazon.com had a memory leak and were subsequently restarted. This hack continues for years because it was the most cost-effective thing to do.<p>Put another way, if they didn\u2019t turn it off and on again, I would think less of them because that\u2019s the first thing you should always do unless you know better","title":null,"type":"comment","url":null},{"author":"onefiftymike","children":[{"author":"ArcHound","children":[{"author":"mapontosevenths","children":[{"author":"NetMageSCW","children":[{"author":"mapontosevenths","children":[],"created_at":"2026-11-13T22:30:07.000Z","created_at_i":1794609007,"id":50490965,"options":[],"parent_id":50485391,"points":null,"story_id":50471731,"text":"&gt;  it\u2019s a work around until a more permanent fix can be deployed.<p>If it &quot;fixes&quot; your problem, then you didn&#x27;t fix you problem you identified it. It&#x27;s another symptom of a bloated industry that can&#x27;t or won&#x27;t innovate, and I think it&#x27;s more &quot;won&#x27;t&quot; than &quot;can&#x27;t.&quot;<p>For example, we still can&#x27;t patch running Windows, and most of the information technology professionals I know are still convinced it&#x27;s impossible. Billions upon billions of dollars in time have been lost, probably enough man hours to send men to mars several times over.<p>Yet, you can just buy a version of Windows Server that already does it. It&#x27;s not only possible, they already have the code. They just don&#x27;t care enough to integrated it into the product most people use.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T15:56:27.000Z","created_at_i":1794585387,"id":50485391,"options":[],"parent_id":50474604,"points":null,"story_id":50471731,"text":"It\u2019s not a symptom, it\u2019s a work around until a more permanent fix can be deployed.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:32:56.000Z","created_at_i":1794519176,"id":50474604,"options":[],"parent_id":50474064,"points":null,"story_id":50471731,"text":"It&#x27;s not a solution at all. It&#x27;s a symptom.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:49:56.000Z","created_at_i":1794516596,"id":50474064,"options":[],"parent_id":50473991,"points":null,"story_id":50471731,"text":"It&#x27;s not a bad solution, it definitely should be tried. But I&#x27;m still rather shocked to see it in official notes, especially this &quot;late&quot; in the timeline.","title":null,"type":"comment","url":null},{"author":"taftster","children":[],"created_at":"2026-11-12T23:49:51.000Z","created_at_i":1794527391,"id":50476123,"options":[],"parent_id":50473991,"points":null,"story_id":50471731,"text":"(on the ground) is probably pretty key, though. Ha ha. I can imagine the conversation if this was in the air.","title":null,"type":"comment","url":null},{"author":"thisismyanon2","children":[],"created_at":"2026-11-13T00:39:54.000Z","created_at_i":1794530394,"id":50476593,"options":[],"parent_id":50473991,"points":null,"story_id":50471731,"text":"Rebooting is also the only solution for some problems.<p><i>looks at the Boeing 787</i>","title":null,"type":"comment","url":null},{"author":"olyjohn","children":[{"author":"SoftTalker","children":[{"author":"cyphar","children":[{"author":"hgomersall","children":[],"created_at":"2026-11-13T11:58:23.000Z","created_at_i":1794571103,"id":50482257,"options":[],"parent_id":50481121,"points":null,"story_id":50471731,"text":"Right, rebooting only really makes sense if you understand why the reboot is going to fix the problem. As in, corrupted volatile state is reasonably fixed with a reboot. Any hardware issues or persistent state problems could well get worse.","title":null,"type":"comment","url":null},{"author":"Merrill","children":[],"created_at":"2026-11-13T12:05:19.000Z","created_at_i":1794571519,"id":50482337,"options":[],"parent_id":50481121,"points":null,"story_id":50471731,"text":"The following is a few decades old --<p>A physicist, an engineer, and a computer programmer are driving down a steep mountain pass when the car\u2019s brakes fail.<p>The car speeds out of control around sharp turns, nearly flying off the edge before they miraculously manage to skid to a stop at the bottom.<p>Shaken up, they discuss what to do next:<p>\u2022 The physicist says: &quot;We need to calculate the friction coefficients in the brake pads and model the temperature rise to figure out why they failed.&quot;<p>\u2022 The engineer says: &quot;I have a few tools in the trunk. I\u2019ll take a look underneath and see if I can fix the mechanical failure.&quot;<p>\u2022 The programmer says: &quot;Why don&#x27;t we get back in and see if it&#x27;s reproducible?&quot;","title":null,"type":"comment","url":null},{"author":"electroweak","children":[{"author":"SoftTalker","children":[],"created_at":"2026-11-13T16:21:14.000Z","created_at_i":1794586874,"id":50485753,"options":[],"parent_id":50483041,"points":null,"story_id":50471731,"text":"Yes, I remember a flight that sat at the gate past departure time, the explanation to the passengers was that some essential piece of equipment wasn&#x27;t functioning, they had tried restarting it, and it was going to be replaced. About 30 minutes late, we were on our way.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:12:29.000Z","created_at_i":1794575549,"id":50483041,"options":[],"parent_id":50481121,"points":null,"story_id":50471731,"text":"But these intermittent failures lead to delays and worse. The sheer cost of repeat events leads to action. If deferrable at all the standard troubleshooting is mostly remove and replace.  The repair and reliability processes identify these rogue units fairly fast and the actual rates of that <i>in a well functioning airline</i> are very low.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:11:11.000Z","created_at_i":1794564671,"id":50481121,"options":[],"parent_id":50477298,"points":null,"story_id":50471731,"text":"Ironically there have been a fair few cases of aircraft incidents where components were reported as bad by pilots but the issue couldn&#x27;t be reproduced on the ground and &quot;it worked&quot; after a reboot and self-test so they just kept using it (with this cycle repeating multiple times). Often there were clear physical problems (cracked solder joints, stuck microswitches, broken insulation) that were only discovered <i>after</i> a catastrophic failure but could&#x27;ve been discovered with a more inquisitive engineering culture.<p>I would argue a &quot;just reboot it&quot; culture leads to more problems -- engineers should be empowered to diagnose problems <i>before</i> they become catastrophic. In the world of software we even have mechanisms for extracting data from failed systems to root cause them later, and yet most people do not take that step before &quot;just reboot[ing] it&quot;.<p>[1]: AirAsia 8501, Lauda Air 004, and SmartLynx Estonia 9001 come to mind.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:25:23.000Z","created_at_i":1794536723,"id":50477298,"options":[],"parent_id":50477126,"points":null,"story_id":50471731,"text":"Thales or Collins or Honeywell or whoever provided the system would. The technician at the airport would only follow a procedure listed on a checklist, which probably includes rebooting the system.","title":null,"type":"comment","url":null},{"author":"onefiftymike","children":[],"created_at":"2026-11-13T17:34:42.000Z","created_at_i":1794591282,"id":50486829,"options":[],"parent_id":50477126,"points":null,"story_id":50471731,"text":"The vast majority of the problems were a system that missed the time window to report it&#x27;s self test. A reboot got things in order.<p>It was a small fleet, so we had a pretty good idea if the same problem kept popping up so we could look more into that system.<p>A few fault codes were well known enough that if you called with that one the answer was to shut down and find a hotel, you aren&#x27;t going anywhere and no reboot will take care of it. (bad detectors in the engines for about 10 years until a redesign)","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:00:01.000Z","created_at_i":1794535201,"id":50477126,"options":[],"parent_id":50473991,"points":null,"story_id":50471731,"text":"If they rebooted it, and it started working again, would you just walk away? Or would you try to figure out why the fuck it needed to be rebooted in the first place?","title":null,"type":"comment","url":null},{"author":"cyberax","children":[{"author":"onefiftymike","children":[],"created_at":"2026-11-13T17:31:41.000Z","created_at_i":1794591101,"id":50486771,"options":[],"parent_id":50477945,"points":null,"story_id":50471731,"text":"I was thinking of that one as an example of why we don&#x27;t do it in the air...","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:41:36.000Z","created_at_i":1794541296,"id":50477945,"options":[],"parent_id":50473991,"points":null,"story_id":50471731,"text":"Yeah. It works, almost always: <a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Indonesia_AirAsia_Flight_8501\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Indonesia_AirAsia_Flight_8501</a>","title":null,"type":"comment","url":null},{"author":"boomlinde","children":[],"created_at":"2026-11-13T06:42:44.000Z","created_at_i":1794552164,"id":50479283,"options":[],"parent_id":50473991,"points":null,"story_id":50471731,"text":"What makes sense for something that is used for 20 hours at a time is different from what makes sense for a service that literally has &quot;365&quot; in its name.","title":null,"type":"comment","url":null},{"author":"NamTaf","children":[{"author":"mschuster91","children":[],"created_at":"2026-11-13T17:10:42.000Z","created_at_i":1794589842,"id":50486491,"options":[],"parent_id":50482067,"points":null,"story_id":50471731,"text":"In German, we say &quot;AEG-Effekt&quot;, ausschalten einschalten geht wieder.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:36:39.000Z","created_at_i":1794569799,"id":50482067,"options":[],"parent_id":50473991,"points":null,"story_id":50471731,"text":"In rail, we call it BOBO - battery off, battery on.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:43:52.000Z","created_at_i":1794516232,"id":50473991,"options":[],"parent_id":50473363,"points":null,"story_id":50471731,"text":"I worked on multi-million dollar airplanes. If a pilot called me with an issue and hadn&#x27;t rebooted the plane (on the ground), I wouldn&#x27;t even talk to them. Rebooting isn&#x27;t always a bad solution to technology.","title":null,"type":"comment","url":null},{"author":"bawolff","children":[{"author":"red-iron-pine","children":[],"created_at":"2026-11-12T22:31:04.000Z","created_at_i":1794522664,"id":50475309,"options":[],"parent_id":50474075,"points":null,"story_id":50471731,"text":"the layman understands both of those words and their meaning together.<p>we &quot;bounce&quot; the servers when on calls with customers.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:50:38.000Z","created_at_i":1794516638,"id":50474075,"options":[],"parent_id":50473363,"points":null,"story_id":50471731,"text":"Amateur hour. Everyone knows professionals say &quot;power cycling&quot; instead to make it sound complicated.","title":null,"type":"comment","url":null},{"author":"icameron","children":[{"author":"macintux","children":[],"created_at":"2026-11-13T01:31:45.000Z","created_at_i":1794533505,"id":50476955,"options":[],"parent_id":50475840,"points":null,"story_id":50471731,"text":"~25 years ago I was a firewall administrator, and the Cisco PIX we used was notorious for gradually running out of memory, effectively cutting off the entire company from the Internet when it went down (and it was a very big company).<p>We absolutely should have scheduled reboots during off hours. Lessons learned.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:20:50.000Z","created_at_i":1794525650,"id":50475840,"options":[],"parent_id":50473363,"points":null,"story_id":50471731,"text":"Powercycling is a designed method to bailout Cisco routers.  If you botch a configuration command and lose connection, you can have someone powercycle it to restore you last good configuration.  Its not just a joke it really works more often than I&#x27;d like to admit.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:02:53.000Z","created_at_i":1794513773,"id":50473363,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"They are turning it off and on again. I don&#x27;t even. If this works, our industry is cooked as the kids say.","title":null,"type":"comment","url":null},{"author":"martinald","children":[{"author":"red-iron-pine","children":[],"created_at":"2026-11-12T22:29:51.000Z","created_at_i":1794522591,"id":50475289,"options":[],"parent_id":50473455,"points":null,"story_id":50471731,"text":"copilot, make this doom and gloom situation sound better.  assume you&#x27;re using the voice of a friendly but intensely focused sysadmin.  use only neutral language.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:11:19.000Z","created_at_i":1794514279,"id":50473455,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"Absolutely bizarre wording of these updates. Strangest corporate speak with urgency turned up to the max.","title":null,"type":"comment","url":null},{"author":"dudus","children":[{"author":"6031769","children":[{"author":"bradleyjg","children":[{"author":"ahartmetz","children":[],"created_at":"2026-11-12T22:58:53.000Z","created_at_i":1794524333,"id":50475628,"options":[],"parent_id":50474098,"points":null,"story_id":50471731,"text":"Don&#x27;t worry, their replacements will receive very clear instructions instructing them to make no mistakes.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:52:29.000Z","created_at_i":1794516749,"id":50474098,"options":[],"parent_id":50473707,"points":null,"story_id":50471731,"text":"Don\u2019t worry, I\u2019m sure it\u2019ll get better after they layoff 60,000 people.","title":null,"type":"comment","url":null},{"author":"mapontosevenths","children":[{"author":"fyrabanks","children":[{"author":"codingdave","children":[{"author":"NLips","children":[],"created_at":"2026-11-13T08:07:09.000Z","created_at_i":1794557229,"id":50479965,"options":[],"parent_id":50476122,"points":null,"story_id":50471731,"text":"That\u2019s purely a choice by those claiming the nines. I\u2019ve worked in companies selling software with more than 6 nines uptime (so that we can be more confident about the 5 nines).  Not 4 nines uptime plus some money back for the other one.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:49:42.000Z","created_at_i":1794527382,"id":50476122,"options":[],"parent_id":50475329,"points":null,"story_id":50471731,"text":"Lots of nines means they have SLAs of no significant downtime. It does not guarantee that the SLAs can never be missed, just that there will be consequences when it is missed. Lawyers and accountants and sales folks will sort out the compensation payments that come back to the customers and try to negotiate relationships back to a healthy state.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:32:56.000Z","created_at_i":1794522776,"id":50475329,"options":[],"parent_id":50474599,"points":null,"story_id":50471731,"text":"i agree with everything you said here except the last part.<p>lots of nines means not having significant downtime. we passed 99.99% hours ago, and we&#x27;re on the way to 99.9%","title":null,"type":"comment","url":null},{"author":"ifwinterco","children":[{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T20:03:27.000Z","created_at_i":1794600207,"id":50488897,"options":[],"parent_id":50475407,"points":null,"story_id":50471731,"text":"When was the last major M365 outage?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:38:20.000Z","created_at_i":1794523100,"id":50475407,"options":[],"parent_id":50474599,"points":null,"story_id":50471731,"text":"Stuff happens and things break everywhere but right now at Microsoft they break badly and often, that points to actual issues.<p>Almost certainly not the fault of individual people, it&#x27;s a management failure of course","title":null,"type":"comment","url":null},{"author":"zmgsabst","children":[],"created_at":"2026-11-12T23:03:27.000Z","created_at_i":1794524607,"id":50475681,"options":[],"parent_id":50474599,"points":null,"story_id":50471731,"text":"There are lots of talented amateurs. What separates professionals is standards, quality, teamwork, etc.<p>I agree there are many talented people at Microsoft, but I don\u2019t see the professionalism in this incident.","title":null,"type":"comment","url":null},{"author":"eddythompson80","children":[{"author":"hyperhello","children":[],"created_at":"2026-11-13T01:04:31.000Z","created_at_i":1794531871,"id":50476761,"options":[],"parent_id":50475756,"points":null,"story_id":50471731,"text":"An organization can become fundamentally opposed to the purpose for which it was created. Organizations simply don&#x27;t follow the same laws as the individuals inside it do. A company can be made of geniuses and be totally ineffective; it can be full of talented go-getters and be completely unable to fix problems.","title":null,"type":"comment","url":null},{"author":"buttslut5099","children":[{"author":"gred","children":[],"created_at":"2026-11-13T03:56:04.000Z","created_at_i":1794542164,"id":50478073,"options":[],"parent_id":50477306,"points":null,"story_id":50471731,"text":"ButtSlut5099, the finest detective since Sherlock Moans.","title":null,"type":"comment","url":null},{"author":"mook","children":[{"author":"eddythompson80","children":[],"created_at":"2026-11-13T13:38:39.000Z","created_at_i":1794577119,"id":50483312,"options":[],"parent_id":50479506,"points":null,"story_id":50471731,"text":"I was confused too, but I said hey, it&#x27;s probably typical buttslut5099","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:11:18.000Z","created_at_i":1794553878,"id":50479506,"options":[],"parent_id":50477306,"points":null,"story_id":50471731,"text":"I realize I&#x27;m responding to somebody who isn&#x27;t paying much effort, but still\u2026<p>Isn&#x27;t that comment saying the direct opposite?  If it&#x27;s a cultural problem, its precisely Satya&#x27;s fault for not fixing it; that&#x27;s the executives&#x27; job.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:26:05.000Z","created_at_i":1794536765,"id":50477306,"options":[],"parent_id":50475756,"points":null,"story_id":50471731,"text":"Satya sock account found","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:11:12.000Z","created_at_i":1794525072,"id":50475756,"options":[],"parent_id":50474599,"points":null,"story_id":50471731,"text":"Individual talent is irrelevant when you have a company culture that rewards the opposite of that. Any talented person working at Microsoft knows that they are dealing with structural problem that force MS products to be massive piles of shit. There isn&#x27;t much an talented individual can do about that.","title":null,"type":"comment","url":null},{"author":"imglorp","children":[],"created_at":"2026-11-13T02:28:59.000Z","created_at_i":1794536939,"id":50477340,"options":[],"parent_id":50474599,"points":null,"story_id":50471731,"text":"The enshitification of Windows was not technical incompetence; it was intentional product direction.<p>They transformed Windows from a useful OS to a banal surveillance and advertising platform.","title":null,"type":"comment","url":null},{"author":"TheOtherHobbes","children":[],"created_at":"2026-11-13T02:55:27.000Z","created_at_i":1794538527,"id":50477540,"options":[],"parent_id":50474599,"points":null,"story_id":50471731,"text":"Microsoft&#x27;s superpower has always been hiring smart people and making them work under dumb management to create flimsy, mediocre outcomes.","title":null,"type":"comment","url":null},{"author":"taysco","children":[],"created_at":"2026-11-13T04:16:34.000Z","created_at_i":1794543394,"id":50478240,"options":[],"parent_id":50474599,"points":null,"story_id":50471731,"text":"I&#x27;m not actually sure this is true anymore. It seems most of their talent has left.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:32:19.000Z","created_at_i":1794519139,"id":50474599,"options":[],"parent_id":50473707,"points":null,"story_id":50471731,"text":"I&#x27;m not thrilled with what they&#x27;ve done to Windows lately myself, but this is just rude.<p>You know a lot of talented people who work there also post here, and it&#x27;s not fair to insinuate that they aren&#x27;t talented because some vastly complex system somewhere in the world had a bad day.<p>Stuff happens, things break. That&#x27;s why lots of nines cost a lot of money. It doesn&#x27;t automatically mean that anyone is incompetent.","title":null,"type":"comment","url":null},{"author":"freetanga","children":[],"created_at":"2026-11-13T07:59:02.000Z","created_at_i":1794556742,"id":50479896,"options":[],"parent_id":50473707,"points":null,"story_id":50471731,"text":"A few weeks ago I saw a clip of a lady walking us through a day at her Microsoft life.<p>Between breakfast, 1-hour lunch, 15-min ice cream break, 30-mins chill, 30-mins foosball games I think she worked 4 hours max.<p>At that point she caught some flak since it was timed with the layoffs. And I get that is not necessarily representative of the MS culture\u2026<p>\u2026 but talk about timing and poor choices!","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:27:10.000Z","created_at_i":1794515230,"id":50473707,"options":[],"parent_id":50473494,"points":null,"story_id":50471731,"text":"At Microsoft every hour is amateur hour.","title":null,"type":"comment","url":null},{"author":"steve1977","children":[],"created_at":"2026-11-12T20:49:52.000Z","created_at_i":1794516592,"id":50474062,"options":[],"parent_id":50473494,"points":null,"story_id":50471731,"text":"Copilot hour!","title":null,"type":"comment","url":null},{"author":"semiquaver","children":[{"author":"EvanAnderson","children":[{"author":"skeeter2020","children":[{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T20:02:00.000Z","created_at_i":1794600120,"id":50488871,"options":[],"parent_id":50475458,"points":null,"story_id":50471731,"text":"And how do those product or engineering managers get information on what\u2019s being tried and what is being discovered without slowing down the process of fixing the issue?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:42:37.000Z","created_at_i":1794523357,"id":50475458,"options":[],"parent_id":50475204,"points":null,"story_id":50471731,"text":"I disagree; the communication aspects - including external - are a hugely important part of any incident response. IME the biggest challenges in these situations are the many levels &amp; combinations of communication and coordination. You don&#x27;t need your best DevOps person doing it, but there should be plenty of competent technical product managers or engineering managers who could do this well.","title":null,"type":"comment","url":null},{"author":"cyberax","children":[],"created_at":"2026-11-13T05:08:39.000Z","created_at_i":1794546519,"id":50478611,"options":[],"parent_id":50475204,"points":null,"story_id":50471731,"text":"Microsoft is not a small startup where the CTO is getting pulled into firefighting.<p>They should have established procedures for large-scale events, and they must include a coordinator whose entire job is to manage the external and internal communication.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:23:31.000Z","created_at_i":1794522211,"id":50475204,"options":[],"parent_id":50474121,"points":null,"story_id":50471731,"text":"To be fair: I want the people who can speak most competently to a problem to be working on it versus writing commentary. Those highly-technical people can shine in the postmortem report.","title":null,"type":"comment","url":null},{"author":"codingdave","children":[],"created_at":"2026-11-12T22:47:45.000Z","created_at_i":1794523665,"id":50475509,"options":[],"parent_id":50474121,"points":null,"story_id":50471731,"text":"And that is a good thing. Well, maybe not good. But the last thing you need in a crisis is to pull people away from fixing the problem and make them type up status updates. Admittedly, having tech knowledge would help the writers - a technical incident management team would be better.  But ain&#x27;t nothing wrong with letting the PR folks write up words while the tech folk work on problem solving.<p>Actual tech write-ups can come later.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:53:50.000Z","created_at_i":1794516830,"id":50474121,"options":[],"parent_id":50473494,"points":null,"story_id":50471731,"text":"The people writing these updates are very obviously not technical and are least one step removed from the actual work being done to fix this.","title":null,"type":"comment","url":null},{"author":"shermantanktop","children":[{"author":"infamouscow","children":[{"author":"Den_VR","children":[],"created_at":"2026-11-12T23:30:02.000Z","created_at_i":1794526202,"id":50475925,"options":[],"parent_id":50475747,"points":null,"story_id":50471731,"text":"&gt; building Rube Goldberg machines that cannot be reasoned about<p>What a great phrase!, can I use that in conversation?","title":null,"type":"comment","url":null},{"author":"lebuffon","children":[{"author":"YZF","children":[{"author":"AIorNot","children":[],"created_at":"2026-11-13T02:27:59.000Z","created_at_i":1794536879,"id":50477329,"options":[],"parent_id":50476954,"points":null,"story_id":50471731,"text":"Software systems are by nature more complex than physical systems. They also lack any tangible interfaces beyond code and diagrams and collective knowledge in the minds of the humans who build and maintain them..  The rapid evolution of software is no help either..if anything AI is accelerating that rapidity as well.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:31:43.000Z","created_at_i":1794533503,"id":50476954,"options":[],"parent_id":50476781,"points":null,"story_id":50471731,"text":"There are methods for building complex systems our of smaller pieces. Humanity has done this forever. An internal combustion engine is very complex. An airplane is very complex. You put a boundary around your system, you build it to a spec, you test it to a spec, you define the behaviour across anything you can see. When two engines fail on the airplane it can maybe still at least glide. Maybe there&#x27;s an ejection seat. Because someone is doing the system thinking with some level of discipline.<p>A brick is very complex. A bearing is complex. A bolt and a nut and a washer are complex. An integrated circuit is complex. We build stuff out of that. Like buildings that don&#x27;t fall when you sneeze on them.<p>In software we use duct tape - at best. But that&#x27;s not just Microsoft, that&#x27;s pretty much everyone. With maybe few exceptions.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:08:09.000Z","created_at_i":1794532089,"id":50476781,"options":[],"parent_id":50475747,"points":null,"story_id":50471731,"text":"Isn&#x27;t a complex computer system, at the lowest levels, an example of a Rube Goldberg machine ?<p>If we could see the memory bits and the CPU internals, I think it would be good candidate, particularly branching and branch prediction.","title":null,"type":"comment","url":null},{"author":"EFreethought","children":[],"created_at":"2026-11-13T02:08:37.000Z","created_at_i":1794535717,"id":50477180,"options":[],"parent_id":50475747,"points":null,"story_id":50471731,"text":"In my experience it is always the &quot;business&quot; people that do not want to take the time to do it correctly.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:10:10.000Z","created_at_i":1794525010,"id":50475747,"options":[],"parent_id":50475247,"points":null,"story_id":50471731,"text":"Many of us insist upon not building Rube Goldberg machines that cannot be reasoned about precisely for this reason.<p>Most of the time we get demonized by resume-driven developers job-hopping every few years (seems like the lack of deep expertise is working out). Today we get to laugh at their expense. These problems were entirely foreseeable and avoidable.","title":null,"type":"comment","url":null},{"author":"llama052","children":[{"author":"motionlessveloc","children":[],"created_at":"2026-11-13T02:28:31.000Z","created_at_i":1794536911,"id":50477337,"options":[],"parent_id":50475831,"points":null,"story_id":50471731,"text":"To be fair to Microsoft (and I&#x27;m having trouble believing I just wrote that), the vast majority of everybody&#x27;s outages are &quot;self owns&quot;. If you don&#x27;t change anything, you&#x27;re not going to break anything, and major external events (fires, cable cuts etc) are rare and can usually be worked around.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:19:57.000Z","created_at_i":1794525597,"id":50475831,"options":[],"parent_id":50475247,"points":null,"story_id":50471731,"text":"Except for the fact that it seems like most Microsoft outages are self owns. I&#x27;m not sure how many times we&#x27;ve had outages due to bad deployments that somehow made it to their global infrastructure and only got noticed when customers notified.<p>Plenty of internal accounts from previous employees highlight this.","title":null,"type":"comment","url":null},{"author":"YZF","children":[{"author":"torben-friis","children":[{"author":"mschuster91","children":[{"author":"don_esteban","children":[{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T16:46:40.000Z","created_at_i":1794588400,"id":50486126,"options":[],"parent_id":50479153,"points":null,"story_id":50471731,"text":"In these times, paying more for that is not an option. Servers with lots of RAM are 5 times what they cost a couple of years ago. Cloud is a huge bargain today compared to running your own infrastructure.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:25:07.000Z","created_at_i":1794551107,"id":50479153,"options":[],"parent_id":50477616,"points":null,"story_id":50471731,"text":"The other option is to not outsource everything to the cloud. Yeah, it is more convenient ... but in these times, being a bit more self reliant is not a bad thing.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:03:44.000Z","created_at_i":1794539024,"id":50477616,"options":[],"parent_id":50477538,"points":null,"story_id":50471731,"text":"&gt; My bet is we&#x27;ll eventually get there.<p>Given that people on reddit claimed that in the entirety of New Zealand no real estate transactions can be settled, causing cascading failures [1]...<p>I think this might actually be the incident pushing governments to designate large online services such as MS 365, Gmail et al as critical infrastructure and force companies to massive, yet-unseen levels of transparency and regulation.<p>The EU is already itching to act ever since the Trump admin forced US Big Tech to terminate service to the ICC judges, and this here was a square own goal for Microsoft.<p>[1] <a href=\"https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;sysadmin&#x2F;comments&#x2F;1xus565&#x2F;comment&#x2F;19sjttdh21r29&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;sysadmin&#x2F;comments&#x2F;1xus565&#x2F;comment&#x2F;1...</a>","title":null,"type":"comment","url":null},{"author":"bigDinosaur","children":[{"author":"tarsierscripter","children":[{"author":"cowlevel","children":[{"author":"cowlevel","children":[],"created_at":"2026-11-14T11:56:05.000Z","created_at_i":1794657365,"id":50496300,"options":[],"parent_id":50483082,"points":null,"story_id":50471731,"text":"I found out they have prepared, in advance, a list of which disconnects have to be open at subatations in order for power stations to supply each other&#x27;s startup needs (for stations that are not capable of unpowered startup) while supplying no or minimal actual load. There must be a software analogy to this. Does your company have a plan to bring up the system on a rackful of blank servers and a database backup? I doubt it.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:15:27.000Z","created_at_i":1794575727,"id":50483082,"options":[],"parent_id":50478936,"points":null,"story_id":50471731,"text":"Also known as *the* blackout. <a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Northeast_blackout_of_2003\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Northeast_blackout_of_2003</a><p>Note that buggy software was a major contributing factor! The software was designed to, and would have, detected a deteriorating system an hour before anything broke, which would have provided ample time to intervene. However, a race condition caused the whole monitoring system to display stale data and then crash, including the redundant backup. This wasn&#x27;t the only problem by far, but it was one layer of swiss cheese.<p>Also note the power companies have clear procedures to reboot the grid, known as a &quot;black start[up]&quot;. And they test these procedures, though without taking down the grid.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:59:18.000Z","created_at_i":1794549558,"id":50478936,"options":[],"parent_id":50478686,"points":null,"story_id":50471731,"text":"Electrical engineering of the power grid has the exact same failure mode: cascading failures of interconnected power grids can cause loads to increase by factor of a million in a few seconds.<p>I remember a power outage in 2003 that knocked out power for 55 million people and took over a week to restore in many places.","title":null,"type":"comment","url":null},{"author":"jimnotgym","children":[{"author":"NetMageSCW","children":[{"author":"jimnotgym","children":[],"created_at":"2026-11-14T07:40:40.000Z","created_at_i":1794642040,"id":50494922,"options":[],"parent_id":50488706,"points":null,"story_id":50471731,"text":"Name some?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T19:45:50.000Z","created_at_i":1794599150,"id":50488706,"options":[],"parent_id":50481947,"points":null,"story_id":50471731,"text":"So why do other global systems have massive failures?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:23:06.000Z","created_at_i":1794568986,"id":50481947,"options":[],"parent_id":50478686,"points":null,"story_id":50471731,"text":"Which is the kind of exceptionalism that really creates these problems. Software is the only industry that allows people untrained in running global infrastructure to run global infrastructure.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:21:00.000Z","created_at_i":1794547260,"id":50478686,"options":[],"parent_id":50477538,"points":null,"story_id":50471731,"text":"I can&#x27;t think of any other engineering discipline where demand might increase by a factor of a million in a few seconds because some DNS record was propagated incorrectly or something - regulation won&#x27;t magically solve the issues unique to software. Maybe it&#x27;s doable with vastly increased costs (a classic would be running fully redundant 1:1 warm failovers, which nobody could economically do at the cloud provider level.)<p>That&#x27;s not to excuse incompetence or whatever, just to note that the benefit of software is precisely how easy it is to change, which will always lead to more problems.","title":null,"type":"comment","url":null},{"author":"matwood","children":[],"created_at":"2026-11-13T07:40:59.000Z","created_at_i":1794555659,"id":50479735,"options":[],"parent_id":50477538,"points":null,"story_id":50471731,"text":"&gt; My bet is we&#x27;ll eventually get there.<p>Until the cost is mentioned. People love free or nearly free software.","title":null,"type":"comment","url":null},{"author":"byzantinegene","children":[],"created_at":"2026-11-13T08:57:08.000Z","created_at_i":1794560228,"id":50480372,"options":[],"parent_id":50477538,"points":null,"story_id":50471731,"text":"i think it&#x27;ll go the other direction with vibe-coded software.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:55:18.000Z","created_at_i":1794538518,"id":50477538,"options":[],"parent_id":50476906,"points":null,"story_id":50471731,"text":"I&#x27;ll be the downvoted comment, since HN doesn&#x27;t like to hear this, but the other flavors of engineering do stuff we don&#x27;t because they&#x27;re regulated.<p>My bet is we&#x27;ll eventually get there. Planes kill people when they fall, software used to not be as dangerous, but it&#x27;s been a while since it became critical infrastructure.","title":null,"type":"comment","url":null},{"author":"Anon1096","children":[],"created_at":"2026-11-13T05:02:57.000Z","created_at_i":1794546177,"id":50478580,"options":[],"parent_id":50476906,"points":null,"story_id":50471731,"text":"The problem is that you are only as strong as your weakest link. At some point, something somewhere will be architected poorly and it will one day line up perfectly with 2 other bugs that were incredibly hard to predict and then you&#x27;re stuck in Microsoft&#x27;s current situation.<p>Also, power grids are a poor example. There&#x27;s been multiple instances of absolutely catastrophic failures so hoity toity capital E Engineers also make mistakes.<p><a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;2025_Iberian_Peninsula_blackout\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;2025_Iberian_Peninsula_blackou...</a><p><a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Northeast_blackout_of_2003\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Northeast_blackout_of_2003</a>","title":null,"type":"comment","url":null},{"author":"publlus_enigma","children":[{"author":"roamerz","children":[],"created_at":"2026-11-13T06:43:57.000Z","created_at_i":1794552237,"id":50479291,"options":[],"parent_id":50478610,"points":null,"story_id":50471731,"text":"I think scale is the keyword there..","title":null,"type":"comment","url":null},{"author":"Arbortheus","children":[{"author":"gpvos","children":[],"created_at":"2026-11-13T11:02:17.000Z","created_at_i":1794567737,"id":50481745,"options":[],"parent_id":50480386,"points":null,"story_id":50471731,"text":"Indeed, it&#x27;s an expectation problem, and it&#x27;s even worse in higher management.","title":null,"type":"comment","url":null},{"author":"cowlevel","children":[],"created_at":"2026-11-13T13:13:11.000Z","created_at_i":1794575591,"id":50483051,"options":[],"parent_id":50480386,"points":null,"story_id":50471731,"text":"It&#x27;s not even better though. It doesn&#x27;t have more features because it&#x27;s a distributed system. It isn&#x27;t faster because it&#x27;s a distributed system. Maybe it has a bit higher uptime but nobody was paying too much attention to that anyway, except when it&#x27;s down. And it&#x27;s much better for your PR if, when it&#x27;s down, it isn&#x27;t down for everyone at once.","title":null,"type":"comment","url":null},{"author":"shermantanktop","children":[],"created_at":"2026-11-13T23:44:45.000Z","created_at_i":1794613485,"id":50491797,"options":[],"parent_id":50480386,"points":null,"story_id":50471731,"text":"Users don&#x27;t expect infinite features.<p>Managers and marketers are the ones asking for all those useless features.  And god forbid they run out features to ask for, because then they start asking for architecture v2.0 projects.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:58:11.000Z","created_at_i":1794560291,"id":50480386,"options":[],"parent_id":50478610,"points":null,"story_id":50471731,"text":"People expect software to be feature rich, complex and solve all the world\u2019s problems. And if you don\u2019t do that, the vibe coded competition will beat your cleanly architected product commercially.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:08:38.000Z","created_at_i":1794546518,"id":50478610,"options":[],"parent_id":50476906,"points":null,"story_id":50471731,"text":"We took some of the hardest problems in computer science: distributed systems, scale, concurrency and networking, and made them the standard for every To do app.<p>This is the inevitable consequence.<p>When I look across the scale of all the failures that have occurred in big tech over the past few years, my self-hosted solutions have been cheaper and more reliable. They are simple. They are small. They are easy to fix and diagnose. Because they&#x27;re not trying to solve all the world&#x27;s problems.","title":null,"type":"comment","url":null},{"author":"danaris","children":[{"author":"NetMageSCW","children":[{"author":"danaris","children":[],"created_at":"2026-11-14T07:57:11.000Z","created_at_i":1794643031,"id":50495006,"options":[],"parent_id":50488729,"points":null,"story_id":50471731,"text":"So what&#x27;s your answer? Just ask the giant megacorporations siphoning billions of dollars a year into the pockets of oligarchs to pretty please stop ruining things for everyone else while they enrich themselves?<p>This attitude of &quot;regulations don&#x27;t work&quot; &quot;taxes will just cause wealth to flee&quot; &quot;increasing the minimum wage will just be inflated away&quot; is all <i>propaganda</i>. Propaganda meant to make us believe all we can do is give in to the megacorporations and the oligarchs who lead them, and let them do whatever they want.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T19:47:40.000Z","created_at_i":1794599260,"id":50488729,"options":[],"parent_id":50482993,"points":null,"story_id":50471731,"text":"Regulation will just make a bad situation worse- complicated things rarely get good regulation.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:08:56.000Z","created_at_i":1794575336,"id":50482993,"options":[],"parent_id":50476906,"points":null,"story_id":50471731,"text":"This is the same as what&#x27;s been happening with entire industries: Build for the critical path. Eliminate redundancies. Eliminate <i>resiliency</i>. Lean staffing. Just-in-time manufacturing. Single-vendor mandates.<p>In the name of efficiency and profit, we have stripped away all the safeguards that <i>should</i> prevent cascading failures after the first domino falls. Anything that doesn&#x27;t return profit now, today, <i>every</i> day, must be purged. Because what if that domino never falls? Then you wasted your money! Think how much you can save if you don&#x27;t need to make backups! (And every dollar saved is a dollar in <i>my</i> pocket!) Etc.<p>And torben-friis is right: the only solution to this, <i>demonstrably</i>, is regulation. <i>Require</i> multiple vendors for every major component. <i>Require</i> staffing sufficient to cover a third the company being on vacation. <i>Require</i> resilient systems, that can take a single disaster and keep on trucking, because they are the backbone of our economy.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:25:03.000Z","created_at_i":1794533103,"id":50476906,"options":[],"parent_id":50475247,"points":null,"story_id":50471731,"text":"I have lived through and debugged cascading failures and large scale distributed systems.<p>The problem is amateur hour is the entire industry. Nobody specs anything, nobody tests overload conditions, nobody thinks failure modes. The stuff that every engineer does when building anything else other than software doesn&#x27;t happen. The orgs are bloated. Too many teams. Too many silos. Incentives are stacked the wrong way. People are motivated to not think about systems but stay in their lane. Responsibilities are split in weird ways.<p>Yes. Big systems are hard. But we <i>can</i> build, manage and understand big systems with the right approach and people. Even one computer is complicated and many people get stuck trying to debug a piece of software running on one machine. At the end of the day it&#x27;s not magic. All of humanity is big systems but when I have a power failure the power company is generally able to understand why and resolve it and the water in my tap doesn&#x27;t stop flowing and the cell towers still work (generators, who would have thunk).<p>A friend who is really good had to leave Microsoft because of how AI was pushed. Before that he was telling me some other stories that make the culture seem pretty not great. Heard similar stories from other people. It used to be a great place filled with great people until at some point it&#x27;s just another big company.","title":null,"type":"comment","url":null},{"author":"UltraSane","children":[{"author":"dboreham","children":[],"created_at":"2026-11-13T04:27:44.000Z","created_at_i":1794544064,"id":50478331,"options":[],"parent_id":50477641,"points":null,"story_id":50471731,"text":"From this we can tell where Jim Roskind works.","title":null,"type":"comment","url":null},{"author":"sire-vc","children":[],"created_at":"2026-11-13T11:44:00.000Z","created_at_i":1794570240,"id":50482138,"options":[],"parent_id":50477641,"points":null,"story_id":50471731,"text":"How did that AWS DNS incident go recently? Unplanned outages are unfortunate but common, and hubris is the problem when everyone assumes that they (or their pet vendor) are immune.","title":null,"type":"comment","url":null},{"author":"venzaspa","children":[],"created_at":"2026-11-13T12:00:17.000Z","created_at_i":1794571217,"id":50482278,"options":[],"parent_id":50477641,"points":null,"story_id":50471731,"text":"Exchange Online and Microsoft 365 in general doesn&#x27;t run on Azure.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:06:32.000Z","created_at_i":1794539192,"id":50477641,"options":[],"parent_id":50475247,"points":null,"story_id":50471731,"text":"The best defense against cascading failures is limiting the blast radius, which is something AWS seems to do well but Azure does not.","title":null,"type":"comment","url":null},{"author":"rimliu","children":[],"created_at":"2026-11-13T10:16:00.000Z","created_at_i":1794564960,"id":50481171,"options":[],"parent_id":50475247,"points":null,"story_id":50471731,"text":"so, Bedlam 4?","title":null,"type":"comment","url":null},{"author":"CWuestefeld","children":[],"created_at":"2026-11-13T14:44:43.000Z","created_at_i":1794581083,"id":50484258,"options":[],"parent_id":50475247,"points":null,"story_id":50471731,"text":"We learned the hard way that there&#x27;s a very non-obvious inflection point in large distributed systems, where the your design needs to change from accommodating load resiliently via queueing, auto scaling, and such, to a posture of actively scaling <i>back</i> certain features and even shedding load when in a defensive situation.<p>It&#x27;s really not intuitive, and at least for me, the need to admit that we couldn&#x27;t just comp-sci our way out of some conditions was painful.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:26:39.000Z","created_at_i":1794522399,"id":50475247,"options":[],"parent_id":50473494,"points":null,"story_id":50471731,"text":"Amateur hour? Not sure if you&#x27;ve lived through one of these cascading failures, but they are hard to design against, hard to load&#x2F;chaos test for, and hard to recover from.  The key is that this is a dynamic load, not a static load; and it&#x27;s normally amplified by uncontrolled retry behavior by clients.<p>In retrospect, the cause and cure are obvious to everyone.","title":null,"type":"comment","url":null},{"author":"burningChrome","children":[],"created_at":"2026-11-12T22:44:08.000Z","created_at_i":1794523448,"id":50475471,"options":[],"parent_id":50473494,"points":null,"story_id":50471731,"text":"This sounds suspiciously what occurred when I was working at a large motor sports company. We had a major release of new year models coming out on the website. The deployment went super smooth and then in about 30 mins the site was crashing. Since we were a huge MS client, almost everything we ran was all MS top to bottom.<p>Site was taken offline, war rooms ensued. 48 hours later, an Ops team from Redmond was flown out. Another three days and they determined it was several legacy servers were going down and the load balancing servers were getting hit so hard, they also failed. It was a cascading effect that killed everything.<p>CIO was pissed. The company got absolutely lit up on every social media channel for their ineptitude. The CIO vowed it would never happen again, they were upgrading the entire network and infrastructure to avoid it happening again. Fast forward six months to the next major release. Same thing, same panic, same cascading failures because servers were collapsing under the traffic to the website. Another war room, another Ops team flies out. Two days later they figured out it was some buggy code that was causing it.<p>This after 8 rounds of load balancing testing to the tune of 10X the amount of traffic the site sees on these major release dates without so much as a hiccup.<p>I left two months later, but the overall <i>feeling</i> was the same - total amateur hour from Microsoft after our company was gifted major discounts to go all in with their hardware &amp; network gear. The company found out the hard way it wasn&#x27;t a smart decision.<p>The scary part was this some 20 years ago - seems like not much has changed considering how frequently Github is down now too.","title":null,"type":"comment","url":null},{"author":"mminer237","children":[{"author":"SoftTalker","children":[{"author":"jamesfinlayson","children":[{"author":"sire-vc","children":[],"created_at":"2026-11-13T11:46:42.000Z","created_at_i":1794570402,"id":50482153,"options":[],"parent_id":50478733,"points":null,"story_id":50471731,"text":"The classic &#x27;database is smaller in testing than in prod&#x27; problem which is responsible for some outages IME.\nOften the &#x27;query was not optimised but that didn&#x27;t show until prod&#x27; one.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:26:57.000Z","created_at_i":1794547617,"id":50478733,"options":[],"parent_id":50477237,"points":null,"story_id":50471731,"text":"Could be something adjacent - the last time I majorly blew up a release was because something had changed (which was fine) but it caused a list of items to be broken over two pages, but only in prod. Me and a team mate were scratching our heads for the longest time because &quot;what had changed&quot; was quite mundane itself.","title":null,"type":"comment","url":null},{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T20:00:53.000Z","created_at_i":1794600053,"id":50488862,"options":[],"parent_id":50477237,"points":null,"story_id":50471731,"text":"They did look at recent changes but none seemed to be related, but it turned out recent network changes triggered a failure mode in a much older network change. Dependent or cascading issues remain hard to diagnose or find.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:16:59.000Z","created_at_i":1794536219,"id":50477237,"options":[],"parent_id":50475672,"points":null,"story_id":50471731,"text":"I&#x27;d start with &quot;what has changed&quot; but surely they&#x27;ve looked at that.","title":null,"type":"comment","url":null},{"author":"waz0wski","children":[{"author":"Anon1096","children":[],"created_at":"2026-11-13T05:08:48.000Z","created_at_i":1794546528,"id":50478614,"options":[],"parent_id":50478012,"points":null,"story_id":50471731,"text":"Azure is still humming along working fine.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:49:12.000Z","created_at_i":1794541752,"id":50478012,"options":[],"parent_id":50475672,"points":null,"story_id":50471731,"text":"There was an article posted by a former MS &#x2F; Azure person earlier this year that described the dumpster fire of node management and their cloud control plane<p><a href=\"https:&#x2F;&#x2F;isolveproblems.substack.com&#x2F;p&#x2F;how-microsoft-vaporized-a-trillion-8f4\" rel=\"nofollow\">https:&#x2F;&#x2F;isolveproblems.substack.com&#x2F;p&#x2F;how-microsoft-vaporize...</a><p>HN discussion - <a href=\"https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=47616242\">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=47616242</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:02:51.000Z","created_at_i":1794524571,"id":50475672,"options":[],"parent_id":50473494,"points":null,"story_id":50471731,"text":"Newest update says that wasn&#x27;t the issue after all. They say relatively small loads are actually causing servers to become unresponsive and have to be restarted.<p>They still don&#x27;t know why this &quot;core process&quot; is maxing out the processor for no reason.","title":null,"type":"comment","url":null},{"author":"NoPicklez","children":[{"author":"TheOtherHobbes","children":[{"author":"NoPicklez","children":[],"created_at":"2026-11-16T00:20:32.000Z","created_at_i":1794788432,"id":50512428,"options":[],"parent_id":50477591,"points":null,"story_id":50471731,"text":"Of course keeping services online is professional hour.<p>Keeping important things working isn&#x27;t not a high bar, however inevitably it will go down and the ability for a well experienced team to identify a complex issue and resolve it is also part of their job and is what professionals do.<p>I am worked with various technical incident response teams, some are people with their arms up, some of them are good displays of technical knowledge and communication.<p>Professional hour applies when things are online and when things go down.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:00:07.000Z","created_at_i":1794538807,"id":50477591,"options":[],"parent_id":50476017,"points":null,"story_id":50471731,"text":"Professional hour would be invisible. Outages don&#x27;t happen because they were anticipated and prevented.<p>You can&#x27;t do much to work around nuclear war or a major asteroid strike, but keeping important things working under normal operating conditions should not be a high bar.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:39:28.000Z","created_at_i":1794526768,"id":50476017,"options":[],"parent_id":50473494,"points":null,"story_id":50471731,"text":"I can&#x27;t stand it when I see armchair analysts making claims like this.<p>I&#x27;m sure it&#x27;s more complicated than that.... but from my POV, which is extremely limited and informed by what others online tell me.... that this is amateur hour<p>What would it take for it to be professional hour?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:14:15.000Z","created_at_i":1794514455,"id":50473494,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"So the servers are ok but many of the health checks are failing and so the servers are taken off rotation, increasing load on other servers. I&#x27;m sure it&#x27;s more complicated than it seems but from my POV this looks like amateur hour at Microsoft.","title":null,"type":"comment","url":null},{"author":"jenimac926","children":[],"created_at":"2026-11-12T20:22:29.000Z","created_at_i":1794514949,"id":50473637,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"They rolled back the 7:52 UTC update to the 730 one now....guess it didnt work","title":null,"type":"comment","url":null},{"author":"no-dr-onboard","children":[{"author":"hammock","children":[{"author":"lazyasciiart","children":[{"author":"skygazer","children":[],"created_at":"2026-11-13T02:46:22.000Z","created_at_i":1794537982,"id":50477450,"options":[],"parent_id":50475790,"points":null,"story_id":50471731,"text":"I can connect to US account services, but while first VPNing through France, rather than directly from US.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:15:44.000Z","created_at_i":1794525344,"id":50475790,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"No, my family is in Europe and Australia and also seeing it.","title":null,"type":"comment","url":null},{"author":"elmo2you","children":[{"author":"Angostura","children":[{"author":"evandrofisico","children":[{"author":"xarope","children":[],"created_at":"2026-11-13T02:04:36.000Z","created_at_i":1794535476,"id":50477154,"options":[],"parent_id":50476722,"points":null,"story_id":50471731,"text":"I work for a global company, it&#x27;s affecting every single of our 50+ offices world through US, Europe, Asia, Middle East, etc.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:58:25.000Z","created_at_i":1794531505,"id":50476722,"options":[],"parent_id":50476200,"points":null,"story_id":50471731,"text":"Brazil too","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:57:39.000Z","created_at_i":1794527859,"id":50476200,"options":[],"parent_id":50475805,"points":null,"story_id":50471731,"text":"UK seeing it","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:17:42.000Z","created_at_i":1794525462,"id":50475805,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"Nope. Europe (eastern) for sure included too.","title":null,"type":"comment","url":null},{"author":"outworlder","children":[],"created_at":"2026-11-12T23:36:24.000Z","created_at_i":1794526584,"id":50475987,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"Because there&#x27;s no indications that it is the case, at least for the time being.","title":null,"type":"comment","url":null},{"author":"testrun","children":[],"created_at":"2026-11-12T23:44:15.000Z","created_at_i":1794527055,"id":50476066,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"Australia affected as well.","title":null,"type":"comment","url":null},{"author":"Prickle","children":[],"created_at":"2026-11-13T00:23:18.000Z","created_at_i":1794529398,"id":50476444,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"Japan is also seeing the issue. It is probably a global issue.","title":null,"type":"comment","url":null},{"author":"colechristensen","children":[],"created_at":"2026-11-13T00:28:24.000Z","created_at_i":1794529704,"id":50476486,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"It doesn&#x27;t look like a cyberattack at all, talking about fixing health checks and the like looks much more like broken automation.","title":null,"type":"comment","url":null},{"author":"King-Aaron","children":[],"created_at":"2026-11-13T01:00:00.000Z","created_at_i":1794531600,"id":50476735,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"Impacting us here in Australia, our company is having fun today.","title":null,"type":"comment","url":null},{"author":"gosub100","children":[{"author":"Exmoor","children":[],"created_at":"2026-11-13T01:54:50.000Z","created_at_i":1794534890,"id":50477095,"options":[],"parent_id":50477058,"points":null,"story_id":50471731,"text":"&gt; Don&#x27;t attribute to malice that which can be explained by DNS.<p>Perhaps more accurate in our world.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:48:23.000Z","created_at_i":1794534503,"id":50477058,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"Don&#x27;t attribute to malice that which can be explained by stupidity.","title":null,"type":"comment","url":null},{"author":"pasc1878","children":[],"created_at":"2026-11-13T10:51:04.000Z","created_at_i":1794567064,"id":50481617,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"How would that help.<p>The issue now is fixing this so status of what happens is needed and not how it happened in the first place.<p>The cause will ans should only be published when the issue is fixed and reviewed.","title":null,"type":"comment","url":null},{"author":"ijustlovemath","children":[],"created_at":"2026-11-13T13:55:46.000Z","created_at_i":1794578146,"id":50483550,"options":[],"parent_id":50475362,"points":null,"story_id":50471731,"text":"Or a training run gone awry?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:35:33.000Z","created_at_i":1794522933,"id":50475362,"options":[],"parent_id":50474034,"points":null,"story_id":50471731,"text":"Why is there not a single mention that this could be a cyberattack?  Is the issue only affecting the USA?","title":null,"type":"comment","url":null},{"author":"razingeden","children":[],"created_at":"2026-11-13T02:55:06.000Z","created_at_i":1794538506,"id":50477533,"options":[],"parent_id":50474034,"points":null,"story_id":50471731,"text":"Cortana, play My Heart Will Go - oh.","title":null,"type":"comment","url":null},{"author":"truekonrads","children":[],"created_at":"2026-11-13T08:27:44.000Z","created_at_i":1794558464,"id":50480136,"options":[],"parent_id":50474034,"points":null,"story_id":50471731,"text":"This thread is now complete. We can all go home now.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:47:06.000Z","created_at_i":1794516426,"id":50474034,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"This is like getting transmissions from Cassini before it falls into saturn.","title":null,"type":"comment","url":null},{"author":"EvanAnderson","children":[{"author":"eddythompson80","children":[{"author":"Rantenki","children":[{"author":"tharkun__","children":[],"created_at":"2026-11-13T03:12:53.000Z","created_at_i":1794539573,"id":50477695,"options":[],"parent_id":50475778,"points":null,"story_id":50471731,"text":"That&#x27;s why your parent said &quot;their CLAUDE&quot; ;)","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:14:21.000Z","created_at_i":1794525261,"id":50475778,"options":[],"parent_id":50474977,"points":null,"story_id":50471731,"text":"I suspect that they are not. Copilot is also down :O","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:04:27.000Z","created_at_i":1794521067,"id":50474977,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"they are furiously typing at their agents hoping they can figure out what to do. Getting glimps of hope everytime claude says &quot;I found it.&quot; only for their hopes to be crused at &quot;Turns out ...&quot;. The clown show at Microsoft is surreal.","title":null,"type":"comment","url":null},{"author":"fock","children":[],"created_at":"2026-11-12T22:32:52.000Z","created_at_i":1794522772,"id":50475326,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"their employer brought me agent swarms supposed to take over my php-serving machines. whatever this is, I don&#x27;t feel sorry for them.","title":null,"type":"comment","url":null},{"author":"piker","children":[],"created_at":"2026-11-12T23:09:18.000Z","created_at_i":1794524958,"id":50475742,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"So the thundering herd wins again","title":null,"type":"comment","url":null},{"author":"reaperducer","children":[{"author":"llama052","children":[{"author":"b0rtb0rt","children":[{"author":"aquova","children":[{"author":"ethbr1","children":[],"created_at":"2026-11-13T13:38:19.000Z","created_at_i":1794577099,"id":50483306,"options":[],"parent_id":50478406,"points":null,"story_id":50471731,"text":"This is 2026, why are we asking for evidence?","title":null,"type":"comment","url":null},{"author":"b0rtb0rt","children":[],"created_at":"2026-11-13T22:57:13.000Z","created_at_i":1794610633,"id":50491327,"options":[],"parent_id":50478406,"points":null,"story_id":50471731,"text":"gp confidently claims that people are wrong but no one really knows for sure, i doubt they would publicly announce that it\u2019s a cyberattack yet","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:37:49.000Z","created_at_i":1794544669,"id":50478406,"options":[],"parent_id":50478217,"points":null,"story_id":50471731,"text":"What evidence do you have that they&#x27;re right?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:14:02.000Z","created_at_i":1794543242,"id":50478217,"options":[],"parent_id":50475815,"points":null,"story_id":50471731,"text":"and what evidence do you have that they\u2019re wrong?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:18:51.000Z","created_at_i":1794525531,"id":50475815,"options":[],"parent_id":50475766,"points":null,"story_id":50471731,"text":"My girlfriends work she is hearing this from office employees. Kind of scary how much the public gets wrong.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:12:35.000Z","created_at_i":1794525155,"id":50475766,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"Ugh.  There&#x27;s some yahoo from NewsNation on WGN Radio right now saying this is because of the Chinese, and obliquely linking it to Nvidia.<p>Reddit-level speculation.","title":null,"type":"comment","url":null},{"author":"EvanAnderson","children":[{"author":"EvanAnderson","children":[{"author":"nwallin","children":[],"created_at":"2026-11-13T03:37:37.000Z","created_at_i":1794541057,"id":50477914,"options":[],"parent_id":50477093,"points":null,"story_id":50471731,"text":"They&#x27;ve tried turning it off and back on again, now they&#x27;re moving on to identifying strategic actions that can help improve service health.<p>This doesn&#x27;t sound like hopefulness, it sounds like somebody&#x27;s huffing hopium. It sounds like somebody&#x27;s who&#x27;s all out of ideas, but there&#x27;s no direction to go but forward.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:54:32.000Z","created_at_i":1794534872,"id":50477093,"options":[],"parent_id":50475792,"points":null,"story_id":50471731,"text":"Hopefulness continues, I guess?<p>From the 2:14:51 AM UTC update:<p>Current status: We&#x27;re applying infrastructure capacity improvements where possible in an effort to help support traffic in regions coming online. We&#x27;re continuing to monitor the results of changes applied so we can identify strategic actions that can help to improve service health across all affected regions.<p>---<p>Hopefulness returns.<p>From the 1:50:27 AM UTC update:<p>Current status: We&#x27;re seeing positive results with our efforts to restart affected infrastructure. We&#x27;re actively monitoring the performance of these to verify stability which will support improved availability. Remediation actions will be expanded as we confirm stability with the changes applied.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:15:56.000Z","created_at_i":1794525356,"id":50475792,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"Working in reverse-chronological order here:<p>From the 1:06:17 AM UTC update:<p>Current status: Our investigation has found that a process on the affected servers responsible for establishing secure connections becomes overwhelmed, causing the servers to stop processing requests. We&#x27;re preparing a configuration change to address this behavior that can be applied across all affected servers, and we&#x27;re validating it on a subset of servers before applying it more broadly alongside restarts of the affected infrastructure. In parallel, we&#x27;ve begun reverting a recent network configuration change that correlates with the start of impact and are monitoring to determine whether this contributes to recovery.<p>The temporary traffic limitations we previously described are now in effect in specific locations. We&#x27;re monitoring the affected servers in those locations to confirm whether they remain stable while handling a narrower set of connections, after which we&#x27;ll gradually reintroduce additional traffic.<p>---<p>The list of impacted services just grew tremendously.<p>From the 12:56:09 AM UTC update:<p>Features of the Microsoft 365 services below that interact with Exchange Online and email services are impacted. Elements of those services that do not depend on interaction with Exchange Online remain functional.<p>- Exchange Online: Users may be unable to access their mailbox using Outlook on the web, Outlook desktop (MAPI), Exchange ActiveSync (EAS), or REST-based connections, and email delivery may be delayed.<p>- Microsoft 365 admin center: Admins may be unable to load some admin center pages.<p>- Microsoft 365 apps: Users may be unable to view their recently used files.<p>- Microsoft 365 Apps Admin Center: Multiple services including Cloud Update, Cloud Policy, and Inventory are affected.<p>- Microsoft 365 Education: Features including Assignments, Reading Progress, and Speaker Progress may be impacted.<p>- Microsoft Copilot 365: Users may be unable to load Copilot Chat or receive responses in the web and desktop apps, and Copilot experiences may be unable to access work data such as email, calendar, and files.<p>- Microsoft Defender for Office 365: Safe Links may be unable to verify URLs, which may impact users clicking links in Outlook and Teams.<p>- Microsoft Defender XDR: Users may be unable to load Microsoft Defender portal pages or solution tabs.<p>- Microsoft Fabric: Users may encounter failures when exporting reports with sensitivity labels to PDF or PowerPoint, or when updating artifacts with sensitivity labels.<p>- Microsoft Graph: API requests that access Exchange Online data, such as mail, calendar, and contacts, may time out.<p>- Microsoft Intune<p>- Microsoft Planner: Users are experiencing Plan and Task operation reliability issues.<p>- Microsoft Purview: Multiple Purview services including Authorization, auto-labeling, Data Loss Prevention (DLP), Communication Compliance, and Data Classification are impacted, and users may be unable to load Microsoft Purview portal pages.<p>- Microsoft Teams: Scenarios that depend on Exchange Online, including calendar, meeting scheduling, and creating chats for organizations using Information Barriers, may fail. Core messaging and online meetings remain largely functional.<p>- Microsoft To Do: The app may not load, and users may see operation failures.<p>- Power BI: All users may intermittently be unable to export reports with MIP sensitivity labels to PDF in Power BI.<p>- SharePoint Online: Features that depend on Exchange Online may be impacted. Accessing files stored directly in SharePoint Online remains functional.<p>- Universal Print: Users may encounter errors submitting print jobs or using admin features.<p>- Windows 365: Customers who have configured their tenant and Cloud PCs to use Microsoft Purview Customer Key for Windows 365 Cloud PCs may have users who are unable to connect to their Cloud PCs.<p>Current status: We&#x27;ve reviewed known impact scenarios and have revised the list of impact services and features, which can be viewed in the &quot;more info&quot; section of this communication.<p>We&#x27;re continuing our work to isolate the issue affecting server availability, as well as other workstreams.<p>---<p>So much for seeming hopeful.<p>From the 12:08:53 AM UTC update:<p>Current status: While the servers we&#x27;ve returned to service initially remain healthy, we&#x27;ve observed that they can become unresponsive again once they begin receiving traffic. We&#x27;re analyzing diagnostic data from these servers with our networking and platform experts to determine what&#x27;s triggering this behavior.<p>Building on the protective traffic management measures we&#x27;ve implemented, we&#x27;re also temporarily limiting which types of traffic can reach the affected infrastructure in specific locations. This will help us determine whether a particular type of request is contributing to the impact and allow us to restore service incrementally. Additionally, we&#x27;re rebuilding a subset of affected servers using a previous software configuration to validate whether this prevents them from becoming unresponsive, and we&#x27;ll expand this approach to additional servers if we observe positive results.<p>---<p>The 11:05:31 PM UTC update is is the first since the outage began that feels hopeful.<p>From the 11:06:31 PM UTC update:<p>Current status: We&#x27;ve begun returning a portion of the affected servers to service, and they&#x27;re remaining stable so far. We&#x27;ve also shifted traffic and connections to alternative pathways wherever possible and have observed limited recovery in some regions.<p>We&#x27;ve streamlined our recovery process to expedite returning the remaining affected servers to service. To further support recovery, we&#x27;re implementing protective traffic management measures in a specific location to reduce load on the affected infrastructure, and we&#x27;ll expand these measures to additional locations if we observe positive results. As capacity is restored, users may experience a gradual recovery as their clients reconnect to the service.","title":null,"type":"comment","url":null},{"author":"matt3210","children":[{"author":"hn_throwaway_99","children":[{"author":"gred","children":[],"created_at":"2026-11-13T03:53:07.000Z","created_at_i":1794541987,"id":50478045,"options":[],"parent_id":50476531,"points":null,"story_id":50471731,"text":"The email outage gives me time to order popcorn off Amazon for the inevitable postmortem in a few days. I hope it&#x27;s a good one!","title":null,"type":"comment","url":null},{"author":"Aloha","children":[],"created_at":"2026-11-13T04:49:57.000Z","created_at_i":1794545397,"id":50478487,"options":[],"parent_id":50476531,"points":null,"story_id":50471731,"text":"AI is at fault for what seem like some of the most vaguely worded outage stuff I have seen.","title":null,"type":"comment","url":null},{"author":"Root_Denied","children":[],"created_at":"2026-11-13T08:05:38.000Z","created_at_i":1794557138,"id":50479948,"options":[],"parent_id":50476531,"points":null,"story_id":50471731,"text":"I think this has to do more with their calculating SLAs for uptime than anything else. Once they have a root cause and start deploying a fix they can &quot;stop the clock&quot; on the outage, even if they don&#x27;t get to your tenant right away.<p>Imagine the amount of money they&#x27;re losing right now in credits that will have to be applied once this finally gets resolved.","title":null,"type":"comment","url":null},{"author":"ethbr1","children":[],"created_at":"2026-11-13T13:36:00.000Z","created_at_i":1794576960,"id":50483281,"options":[],"parent_id":50476531,"points":null,"story_id":50471731,"text":"&gt; <i>I wouldn&#x27;t be surprised if AI coding and release pressure was a primary cause, so I really hope the future post-mortem is made publicly available.</i><p>If nothing else, increased change volume will mean the number of candidate diffs ballooned, possible to a level where non-AI review is impossible on incident-level timescales.<p>Coupled with each change also being AI-documented and the relevant teams having less hands-on understanding of their own changes, so going to the pushing team and asking &quot;Tell me about _____&quot; isn&#x27;t an option.","title":null,"type":"comment","url":null},{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T19:33:25.000Z","created_at_i":1794598405,"id":50488568,"options":[],"parent_id":50476531,"points":null,"story_id":50471731,"text":"You can be surprised because it (apparently) had nothing to do with AI or release pressure. It was a combination effect of two separate network changes.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:34:33.000Z","created_at_i":1794530073,"id":50476531,"options":[],"parent_id":50475989,"points":null,"story_id":50471731,"text":"While I think it&#x27;s a bit premature to jump to &quot;AI is at fault&quot;, and I will emphasize that I appreciate Microsoft&#x27;s transparency in their status updates, these updates <i>do</i> have much more of a &quot;we don&#x27;t know what&#x27;s going on&quot; feel than any other major outage I can think of.<p>It&#x27;s been hours, and the status updates still feel like there is an undertone of frantic panic (understood if you can&#x27;t determine the root cause). When I think of past major outages, they may have been down for hours but usually folks knew what the root cause was relatively early, even if remediation took some time.<p>I wouldn&#x27;t be surprised if AI coding and release pressure was a primary cause, so I really hope the future post-mortem is made publicly available.","title":null,"type":"comment","url":null},{"author":"netsharc","children":[{"author":"yes_m_ai_n","children":[],"created_at":"2026-11-13T03:27:41.000Z","created_at_i":1794540461,"id":50477825,"options":[],"parent_id":50476733,"points":null,"story_id":50471731,"text":"thanks for this. Just read it for the first time. 1909 hits above its weight!","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:59:38.000Z","created_at_i":1794531578,"id":50476733,"options":[],"parent_id":50475989,"points":null,"story_id":50471731,"text":"E.M. Forster says hello.<p><a href=\"https:&#x2F;&#x2F;americanliterature.com&#x2F;author&#x2F;em-forster&#x2F;novella&#x2F;the-machine-stops&#x2F;summary\" rel=\"nofollow\">https:&#x2F;&#x2F;americanliterature.com&#x2F;author&#x2F;em-forster&#x2F;novella&#x2F;the...</a>","title":null,"type":"comment","url":null},{"author":"riffic","children":[{"author":"10111001","children":[],"created_at":"2026-11-13T04:27:58.000Z","created_at_i":1794544078,"id":50478332,"options":[],"parent_id":50476756,"points":null,"story_id":50471731,"text":"&gt; Nobody has ever fully understood how their systems work. Thinking largely about &quot;systems as imagined&quot; and &quot;systems as found.&quot;<p>But with AI, now we can have systems that <i>no one</i> has understood <i>ever</i>.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:03:08.000Z","created_at_i":1794531788,"id":50476756,"options":[],"parent_id":50475989,"points":null,"story_id":50471731,"text":"Nobody has ever fully understood how their systems work. Thinking largely about &quot;systems as imagined&quot; and &quot;systems as found.&quot;<p>Richard Cook wrote about this years ago, and it&#x27;s always going to be relevant:<p><a href=\"https:&#x2F;&#x2F;highscalability.com&#x2F;designing-for-resiliency-will-be-so-2013&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;highscalability.com&#x2F;designing-for-resiliency-will-be...</a><p><a href=\"https:&#x2F;&#x2F;how.complexsystems.fail&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;how.complexsystems.fail&#x2F;</a>","title":null,"type":"comment","url":null},{"author":"adamsb6","children":[{"author":"dboreham","children":[{"author":"quaffcode","children":[{"author":"venzaspa","children":[{"author":"01HNNWZ0MV43FF","children":[],"created_at":"2026-11-13T14:23:42.000Z","created_at_i":1794579822,"id":50483928,"options":[],"parent_id":50482225,"points":null,"story_id":50471731,"text":"For the curious: <a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Black_start\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Black_start</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:55:29.000Z","created_at_i":1794570929,"id":50482225,"options":[],"parent_id":50481726,"points":null,"story_id":50471731,"text":"It doesn&#x27;t matter if large portions of the grid go down at once. See the recent Spanish outage - the coordination of bringing it back on line is an art of its own.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:00:06.000Z","created_at_i":1794567606,"id":50481726,"options":[],"parent_id":50478294,"points":null,"story_id":50471731,"text":"Betting the electric grid has people around who at least understand how their substation works.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:22:29.000Z","created_at_i":1794543749,"id":50478294,"options":[],"parent_id":50478171,"points":null,"story_id":50471731,"text":"See also the electrical grid.","title":null,"type":"comment","url":null},{"author":"Arbortheus","children":[],"created_at":"2026-11-13T08:55:14.000Z","created_at_i":1794560114,"id":50480355,"options":[],"parent_id":50478171,"points":null,"story_id":50471731,"text":"This is so true. Not making excuses for Microsoft, but OP\u2019s at this very hard. What would have been a \u201creboot the server\u201d at small scales becomes a concerted operational nightmare at larger scales.","title":null,"type":"comment","url":null},{"author":"londons_explore","children":[{"author":"voidfunc","children":[{"author":"londons_explore","children":[],"created_at":"2026-11-13T17:29:35.000Z","created_at_i":1794590975,"id":50486742,"options":[],"parent_id":50483013,"points":null,"story_id":50471731,"text":"This type of loadtest I normally only perform ~annually in the companies I have done it.    It&#x27;s normally a ~2 week-long project for an intern to identify failure modes of any client side apps (ie. Retry loops etc), capture a sample of production API requests, create some fake data store either on staging or an instance setup specially for the purpose, adjust the request sample to hit that fake data (reads, writes etc), then replay the sample faster and faster till staging fails due to overload, and practice a recovery procedure with the load still applied.<p>If it goes well, redo it with different types of overload - especially large percentages of failure responses from various dependencies, or 1000ms delays added to dependency responses which tends to be one of the trickier things to recover from.<p>Typical outcomes from the work are patches to make the service more robust, fallbacks to not use dependencies or disable features when overload happens, on-call procedures for what to do or not do in certain common cases etc.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:10:09.000Z","created_at_i":1794575409,"id":50483013,"options":[],"parent_id":50482543,"points":null,"story_id":50471731,"text":"The staging pattern doesn&#x27;t scale for systems this large and complicated. Everything is constantly in flux and changing. Ive worked on systems this large and we had something we called staging but it was a joke.<p>Gradual rollout, pilot regions and monitoring are usually how you avoid broken stuff becoming global incidents. Will be interesting to read what process failed here next week.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T12:26:32.000Z","created_at_i":1794572792,"id":50482543,"options":[],"parent_id":50478171,"points":null,"story_id":50471731,"text":"It&#x27;s very common, but typically teams test things by having a staging instance which also has staging versions of all dependencies.<p>They then deliberately loadtest it to failure and check it can be bought back under control.","title":null,"type":"comment","url":null},{"author":"gordonfish","children":[{"author":"adamsb6","children":[],"created_at":"2026-11-13T17:54:17.000Z","created_at_i":1794592457,"id":50487162,"options":[],"parent_id":50484989,"points":null,"story_id":50471731,"text":"Some form of demand control is generally how you work around these problems, but maybe those parts are falling over too.<p>For really big services it&#x27;s also hard to exercise these processes on anything approaching actual prod scale. Ideally you can chop the architecture into pieces where you can simulate region failure and ensure everything works as planned, and fix whatever you find that breaks with every simulation.<p>But maybe some bits of the architecture aren&#x27;t amenable to being regionalized.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T15:31:05.000Z","created_at_i":1794583865,"id":50484989,"options":[],"parent_id":50478171,"points":null,"story_id":50471731,"text":"Why so? I&#x27;d have thought that in situations like this, one would limit inbound connections, either to certain IPs, or through rate limiting controls, all of which should be controllable at the router &#x2F; network infrastructure level.<p>Even more so when dealing with a potential incursion (like servers compromised with botnet software that goes back to work not long after a reboot and slams the server and&#x2F;or network.)","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:08:45.000Z","created_at_i":1794542925,"id":50478171,"options":[],"parent_id":50475989,"points":null,"story_id":50471731,"text":"&quot;Everything went down, trying to bring back a subset of things gets killed by thundering herd&quot; is very common.","title":null,"type":"comment","url":null},{"author":"solid_fuel","children":[],"created_at":"2026-11-13T05:02:46.000Z","created_at_i":1794546166,"id":50478576,"options":[],"parent_id":50475989,"points":null,"story_id":50471731,"text":"Reading the status updates feels a lot like watching some of the OpenAI models try to debug a thorny issue.  Throwing half-baked solutions at the wall, then reacting in surprise when it makes things worse, getting increasingly detached from reality until someone clears the context and makes it start over.","title":null,"type":"comment","url":null},{"author":"jacquesm","children":[],"created_at":"2026-11-13T20:18:50.000Z","created_at_i":1794601130,"id":50489064,"options":[],"parent_id":50475989,"points":null,"story_id":50471731,"text":"Wonder why.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:36:34.000Z","created_at_i":1794526594,"id":50475989,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"Sounds like nobody knows how their own systems work anymore.","title":null,"type":"comment","url":null},{"author":"trebligdivad","children":[],"created_at":"2026-11-13T00:55:37.000Z","created_at_i":1794531337,"id":50476710,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"Nah, they&#x27;re just debugging a hard problem while the world looks on!   The &#x27;normal&#x27; problems they have processes to work through, but hey emergent systems and all that - they have to expect the unexpected.","title":null,"type":"comment","url":null},{"author":"NolF","children":[],"created_at":"2026-11-13T02:21:43.000Z","created_at_i":1794536503,"id":50477268,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"This seems like the same terse language&#x2F;feedback OpenAI models give me and I leave more clueless than I arrived.","title":null,"type":"comment","url":null},{"author":"baconbrand","children":[{"author":"yourapostasy","children":[{"author":"cucumber3732842","children":[],"created_at":"2026-11-13T13:30:35.000Z","created_at_i":1794576635,"id":50483221,"options":[],"parent_id":50481394,"points":null,"story_id":50471731,"text":"Everyone wants to blame the bankers and the bean counters.  As I get older I realize that businesses will happily forgo insane sums in the name of predictability and continuity and that it&#x27;s the team leads and the middle managers who don&#x27;t want the troubleshooting and the control panels because those would provide an quasi-audit log that would more readily quantify bad management.  They see these systems as a threat, a way for information of what&#x27;s really happening to leak around their control.<p>Of course not all team leads and middle managers are like this but too many of them are and the bad ones are a great fit for exploiting BigCo environments so BigCos act like a catch basin for them.","title":null,"type":"comment","url":null},{"author":"NetMageSCW","children":[{"author":"yourapostasy","children":[],"created_at":"2026-11-14T01:35:29.000Z","created_at_i":1794620129,"id":50492635,"options":[],"parent_id":50488541,"points":null,"story_id":50471731,"text":"Fair point. Maybe at their scale they\u2019ve learned something different about crisis management than I\u2019ve experienced on a smaller scale. Would love to hear from those who have been in the trenches at a similar scale as these past couple of days.<p>In a 1-2 hour unplanned outage of typically way smaller systems at some of my clients, I\u2019m generally able to leave my status reports at this level we see here. But as the time and blast radius expands, I find it builds more trust that we\u2019re doing everything within our power and builds more reassurance by sharing progressively more detail. The increasing detail also unlocks massive offers of assistance from many areas of the organization in many cases. Telling stakeholders what my team and I have tried and ruled out often helps them explain to their stakeholders just as much as telling them what has worked.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T19:31:13.000Z","created_at_i":1794598273,"id":50488541,"options":[],"parent_id":50481394,"points":null,"story_id":50471731,"text":"The fact that they don\u2019t report certain steps in their public communications during an outage does not mean those steps weren\u2019t done.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:31:52.000Z","created_at_i":1794565912,"id":50481394,"options":[],"parent_id":50478778,"points":null,"story_id":50471731,"text":"This needs to be amplified. A lot of the updates carry all the hallmarks of leadership consistently denying the engineering teams the time to build out sufficient introspective and troubleshooting tooling, on the finance-supported rationale that it is not financially justifiable for such low probability events regardless of impact. And this can be as simple as allowing for enough shadow non-Production environments real-time twinning inputs at scale enough to reproduce thundering herd issues, for example.<p>Take 8:52 PM UTC, for instance. &quot;While validating the targeted change, we found that many of the affected servers have become unresponsive, which is preventing us from confirming whether the change is effective. We&#x27;re restarting these servers so they can come back online with the change in place, and we&#x27;re applying the same approach to additional affected portions of our infrastructure to validate the results more broadly.&quot; So many questions flow from this.<p>They jumped from &quot;affected servers have become unresponsive&quot; straight to &quot;restarting these servers&quot;. No granular troubleshooting of a random sample of the unresponsive cohort to identify the precise origin of the failure mode. Possibly their own organizational chaos prevents the team at the low granularity layer seeing the pattern of whole groups of servers, from effectively interacting with the right team to troubleshoot at the individual server, high granularity layer. I&#x27;ve seen that at many of my clients; sometimes the different teams at different granularity layers don&#x27;t even have established engagement channels for when things blow up across those granularity layers. I could go on, but you get the drift.<p>If you obsess over internal tooling, you waste time yak shaving and ship nothing; if you only care about shipping features, technical debt accumulates until a major outage hits. Because cutting corners for speed is the path of least resistance, paying down that complexity later is much harder than maintaining discipline upfront.","title":null,"type":"comment","url":null},{"author":"franktankbank","children":[{"author":"NetMageSCW","children":[{"author":"Ygg2","children":[{"author":"EvanAnderson","children":[{"author":"Ygg2","children":[],"created_at":"2026-11-13T19:03:05.000Z","created_at_i":1794596585,"id":50488173,"options":[],"parent_id":50487386,"points":null,"story_id":50471731,"text":"Sure. Just wait till it gets fully entshittified. With thin clients you can enjoy any MSFT fuckup as free time off!","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T18:08:53.000Z","created_at_i":1794593333,"id":50487386,"options":[],"parent_id":50485749,"points":null,"story_id":50471731,"text":"Not to defend Microsoft, but the thick-client Office applications (Word, Excel, PowerPoint, etc) worked fine during the outage. Nobody couldn&#x27;t use Excel because of this outage. Outlook worked fine too if you were connecting it to an on-premises Exchange instance.<p>This was an outage of a server-hosted database for email, not an outage of desktop application software.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T16:20:58.000Z","created_at_i":1794586858,"id":50485749,"options":[],"parent_id":50485225,"points":null,"story_id":50471731,"text":"Say what you want about OpenOffice it doesn&#x27;t experience 24h degradation because some idiot pushed vibe slop to production.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T15:47:03.000Z","created_at_i":1794584823,"id":50485225,"options":[],"parent_id":50481522,"points":null,"story_id":50471731,"text":"Better than most alternatives.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:43:06.000Z","created_at_i":1794566586,"id":50481522,"options":[],"parent_id":50478778,"points":null,"story_id":50471731,"text":"I hope they all quit cause microsoft fuckin sucks.","title":null,"type":"comment","url":null},{"author":"cucumber3732842","children":[],"created_at":"2026-11-13T13:23:57.000Z","created_at_i":1794576237,"id":50483154,"options":[],"parent_id":50478778,"points":null,"story_id":50471731,"text":"Considering the middle management culture at MSFT and other tech BigCo&#x27;s it&#x27;s probably better that this be a huge public outage where their crappy managers will actually face some heat for creating the kinds of processes that lead to these outcomes rather than can throw the team under the bus when inevitable human error creeps into their obviously un-followable at scale over time process.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:33:02.000Z","created_at_i":1794547982,"id":50478778,"options":[],"parent_id":50474060,"points":null,"story_id":50471731,"text":"I hope everyone involved in working on this is staying grounded and relaxed and not suffering a ton of physical stress over what is ultimately the result of greedy leadership decisions :(","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:49:48.000Z","created_at_i":1794516588,"id":50474060,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"I feel bad for the people working on this. It sounds like desperation is increasing.<p>From the 10:11:39 PM UTC update:<p>Current status: We&#x27;re continuing to pursue all available pathways to restore service, as our actions taken thus far have not provided the anticipated relief. Our investigation has found that a core process on the affected servers is becoming overwhelmed, which causes the servers to stop responding and contributes to the capacity loss.<p>To validate a potential recovery approach, we&#x27;re fully isolating a portion of our service infrastructure, restarting the affected components, and gradually reintroducing traffic to confirm our services remain stable before applying this approach more broadly. We&#x27;re also analyzing traffic patterns across our entire service infrastructure and evaluating whether isolating traffic within each region may allow affected regions to recover independently.<p>From the 9:41:46 PM UTC update:<p>Current status: We&#x27;re continuing to work through restarting and validating the affected servers to safely return them to service, and we&#x27;re exploring opportunities to expedite this process. In parallel, we&#x27;re assessing whether reverting the small number of recent configuration updates we identified could help accelerate recovery.<p>From the 9:01:14 PM UTC update:<p>Current status: We&#x27;ve validated an alternative health check method on a subset of affected infrastructure, which allowed the servers in that subset to successfully return to service, and we&#x27;re now applying this change more broadly. We&#x27;re also preparing an automated recovery process to continually detect and restart unresponsive servers, to help keep them in service while this change progresses. Additionally, our review of recent changes has identified a small number of configuration updates that we&#x27;re investigating as potential contributors to the issue.<p>From the 8:44 PM UTC update:<p>Current status: While validating the targeted change, we found that many of the affected servers have become unresponsive, which is preventing us from confirming whether the change is effective. We&#x27;re restarting these servers so they can come back online with the change in place, and we&#x27;re applying the same approach to additional affected portions of our infrastructure to validate the results more broadly.<p>Previous Status: While we haven&#x27;t identified any recent changes that correlate with the start of impact, our investigation indicates the failed health checks may originate from a specific component on the affected servers that&#x27;s responsible for processing them. We&#x27;re deploying a targeted change to bypass this component on a subset of servers to validate whether this restores availability, and we&#x27;ve taken steps to prevent additional servers from being removed from service while we work to return the affected servers to service. We&#x27;re also investigating why affected servers are experiencing elevated processor usage while handling requests.","title":null,"type":"comment","url":null},{"author":"Eji1700","children":[{"author":"tclancy","children":[{"author":"Eji1700","children":[{"author":"gambiting","children":[],"created_at":"2026-11-13T07:33:51.000Z","created_at_i":1794555231,"id":50479670,"options":[],"parent_id":50479009,"points":null,"story_id":50471731,"text":"The astronauts going to the moon reporting &quot;we have two outlooks on the laptop here and neither work&quot; will be funny for decades from now.","title":null,"type":"comment","url":null},{"author":"dlcarrier","children":[],"created_at":"2026-11-13T08:58:29.000Z","created_at_i":1794560309,"id":50480390,"options":[],"parent_id":50479009,"points":null,"story_id":50471731,"text":"I though she communicated through RF emissions from CRTs and other monitors.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:06:57.000Z","created_at_i":1794550017,"id":50479009,"options":[],"parent_id":50478565,"points":null,"story_id":50471731,"text":"She uses outlook.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:01:10.000Z","created_at_i":1794546070,"id":50478565,"options":[],"parent_id":50475683,"points":null,"story_id":50471731,"text":"Why do you think this is a problem for Eliza?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:03:43.000Z","created_at_i":1794524623,"id":50475683,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"Day 12: It has been 3 days since the last ping returned, I fear I will not make it back to my family.  Give my love to dear Liza.<p>I feel for those stuck in there.  The outage going on for this long has got to be fucking brutal.","title":null,"type":"comment","url":null},{"author":"SubiculumCode","children":[{"author":"jwilcoxson","children":[],"created_at":"2026-11-13T02:33:24.000Z","created_at_i":1794537204,"id":50477366,"options":[],"parent_id":50476763,"points":null,"story_id":50471731,"text":"Well done sir","title":null,"type":"comment","url":null},{"author":"jiggawatts","children":[],"created_at":"2026-11-13T02:58:56.000Z","created_at_i":1794538736,"id":50477579,"options":[],"parent_id":50476763,"points":null,"story_id":50471731,"text":"We already call it Microsoft 356.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:05:02.000Z","created_at_i":1794531902,"id":50476763,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"Gonna have to rebrand as Office364","title":null,"type":"comment","url":null},{"author":"indigodaddy","children":[],"created_at":"2026-11-13T05:49:12.000Z","created_at_i":1794548952,"id":50478875,"options":[],"parent_id":50473305,"points":null,"story_id":50471731,"text":"So just reboot shit","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T19:58:52.000Z","created_at_i":1794513532,"id":50473305,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Copied this from my post in the other thread:<p>The Status page is not working well, but I managed to subscribe to their RSS feed and it has been sending out updates periodically. I&#x27;ll post some of them here.<p>9:02 PM UTC: We&#x27;ve validated an alternative health check method on a subset of affected infrastructure, which allowed the servers in that subset to successfully return to service, and we&#x27;re now applying this change more broadly. We&#x27;re also preparing an automated recovery process to continually detect and restart unresponsive servers, to help keep them in service while this change progresses. Additionally, our review of recent changes has identified a small number of configuration updates that we&#x27;re investigating as potential contributors to the issue.<p><i>Previous status:</i> While validating the targeted change, we found that many of the affected servers have become unresponsive, which is preventing us from confirming whether the change is effective. We&#x27;re restarting these servers so they can come back online with the change in place, and we&#x27;re applying the same approach to additional affected portions of our infrastructure to validate the results more broadly.<p>8:52 PM UTC: While validating the targeted change, we found that many of the affected servers have become unresponsive, which is preventing us from confirming whether the change is effective. We&#x27;re restarting these servers so they can come back online with the change in place, and we&#x27;re applying the same approach to additional affected portions of our infrastructure to validate the results more broadly.<p><i>Previous Status:</i> While we haven&#x27;t identified any recent changes that correlate with the start of impact, our investigation indicates the failed health checks may originate from a specific component on the affected servers that&#x27;s responsible for processing them. We&#x27;re deploying a targeted change to bypass this component on a subset of servers to validate whether this restores availability, and we&#x27;ve taken steps to prevent additional servers from being removed from service while we work to return the affected servers to service. We&#x27;re also investigating why affected servers are experiencing elevated processor usage while handling requests.<p>7:52 PM UTC: We&#x27;ve identified that affected servers are failing automated health checks, which is causing them to become unavailable, and this may be related to a recent change to a component involved in processing those checks. We&#x27;re testing a configuration change on a subset of affected infrastructure to address this and, if successful, will apply it more broadly. In parallel, we&#x27;ve initiated a restart of all affected servers and are validating whether they&#x27;re successfully returning to service.<p>7:30 PM UTC: We&#x27;re aggressively pursuing all pathways to reduce impact. As a precaution, we&#x27;ve paused all deployments and configuration changes while we review recent changes for any correlation to this event. We&#x27;ve determined that the elevated load isn&#x27;t driven by an overall increase in traffic, but by a large number of servers being unexpectedly unavailable, which is shifting load onto the remaining infrastructure. We&#x27;re investigating what&#x27;s causing these servers to become unavailable while we work to safely return them to service.<p>7:16 PM UTC: We&#x27;re aggressively pursuing all pathways to reduce impact. As a precaution, we&#x27;ve paused all deployments and configuration changes while we review recent changes for any correlation to this event. We&#x27;ve also moved traffic for some services off the affected infrastructure to further reduce load, with additional traffic moves in progress.<p>6:59 PM UTC: We&#x27;ve completed redistributing connection traffic across our worldwide infrastructure, and we&#x27;re moving additional traffic off the affected infrastructure to further reduce load. We&#x27;re also restarting affected servers to return them to service. In parallel, we&#x27;re investigating whether the elevated traffic reflects a genuine increase in requests or a shift in how traffic is being routed across our infrastructure.","title":null,"type":"comment","url":null},{"author":"k_sze","children":[{"author":"Telemakhos","children":[{"author":"kspacewalk2","children":[],"created_at":"2026-11-12T20:38:42.000Z","created_at_i":1794515922,"id":50473901,"options":[],"parent_id":50473438,"points":null,"story_id":50471731,"text":"Or, you know, similar reasons as why people use Cloudflare as a reverse proxy.","title":null,"type":"comment","url":null},{"author":"taftster","children":[{"author":"basch","children":[],"created_at":"2026-11-13T01:25:57.000Z","created_at_i":1794533157,"id":50476912,"options":[],"parent_id":50476170,"points":null,"story_id":50471731,"text":"It probably is a mirror for caching purposes for the mobile app or something.  It lets them control the protocol between the client and their server as well.","title":null,"type":"comment","url":null},{"author":"persolb","children":[],"created_at":"2026-11-13T01:26:22.000Z","created_at_i":1794533182,"id":50476914,"options":[],"parent_id":50476170,"points":null,"story_id":50471731,"text":"But a check in or analytic counter wouldn\u2019t stop you from receiving email. This is most likely due to Microsoft\u2019s server (not your local computer) being the one fetching the mail.<p>It is normally probably more reliable; except when their server is down.","title":null,"type":"comment","url":null},{"author":"dboreham","children":[],"created_at":"2026-11-13T04:36:25.000Z","created_at_i":1794544585,"id":50478395,"options":[],"parent_id":50476170,"points":null,"story_id":50471731,"text":"They proxy the whole ball of wax. Have done for years.","title":null,"type":"comment","url":null},{"author":"mook","children":[{"author":"s3p","children":[],"created_at":"2026-11-13T15:44:47.000Z","created_at_i":1794584687,"id":50485184,"options":[],"parent_id":50479627,"points":null,"story_id":50471731,"text":"This is correct. You have the option to disable it and use local IMAP if you want, but it pushes you toward using &quot;Microsoft Sync Technology&quot; which does exactly what you were saying&#x2F;","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:28:42.000Z","created_at_i":1794554922,"id":50479627,"options":[],"parent_id":50476170,"points":null,"story_id":50471731,"text":"My understanding is: the IMAP client is hosted. The local app talks to a HTTP service, and doesn&#x27;t have mail processing capabilities of its own.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:55:15.000Z","created_at_i":1794527715,"id":50476170,"options":[],"parent_id":50473438,"points":null,"story_id":50471731,"text":"I would strongly doubt (though not completely rule out) that Microsoft is reading your personal mail hosted on your personal mail server. Like what would that even look like, their IMAP client is forwarding email to headquarters?<p>BUT, more likely, it&#x27;s some sort of &quot;check in&quot; or &quot;dial home&quot; feature that isn&#x27;t working. Or plausibly, maybe they count &quot;local user checked email&quot; and their analytics endpoint is down.<p>Regardless, it&#x27;s definitely surprising that a traditional desktop application would be blocking when only polling from local&#x2F;trusted data sources.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:09:53.000Z","created_at_i":1794514193,"id":50473438,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"&gt; For reasons that I cannot fathom, Microsoft wants to act as the relay to my self-hosted e-mail account<p>I can conjecture some reasons.  Datamining would be high on the list, since MS can read your mail and thus market to you more effectively.  Governments might also be happier if MS can provide them with one-stop access (like Prism) to otherwise self-hosted e-mail accounts proxied through a central server.","title":null,"type":"comment","url":null},{"author":"ActionHank","children":[{"author":"rc5150","children":[],"created_at":"2026-11-13T04:04:44.000Z","created_at_i":1794542684,"id":50478143,"options":[],"parent_id":50473675,"points":null,"story_id":50471731,"text":"you&#x27;re getting downvoted but I agree.<p>play stupid games win stupid prizes.<p>maybe its the support desk burnout talking, but if you rely on MS apps and services you&#x27;re gonna have a bad time.","title":null,"type":"comment","url":null},{"author":"isatty","children":[],"created_at":"2026-11-13T05:39:40.000Z","created_at_i":1794548380,"id":50478825,"options":[],"parent_id":50473675,"points":null,"story_id":50471731,"text":"Don\u2019t get the downvotes. Why would you put in all the effort to self host mail and use something that proxies your mail?","title":null,"type":"comment","url":null},{"author":"k_sze","children":[],"created_at":"2026-11-13T06:36:46.000Z","created_at_i":1794551806,"id":50479239,"options":[],"parent_id":50473675,"points":null,"story_id":50471731,"text":"I mean, I can still switch to Thunderbird anytime I want, because I use IMAP and don&#x27;t yank the mail messages from my mail server. And I can still receive mail on my iPhone anyway.<p>It&#x27;s just funny that Outlook breaks this badly.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:24:51.000Z","created_at_i":1794515091,"id":50473675,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"This is your own fault for using their BS app.","title":null,"type":"comment","url":null},{"author":"rstupek","children":[],"created_at":"2026-11-12T20:46:20.000Z","created_at_i":1794516380,"id":50474024,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"&quot;New&quot; Outlook does route all traffic through Microsoft servers.  I assume it&#x27;s so you can get a &quot;unified&quot; mail look on all your devices (phone, etc), but likely a nice source of data mining","title":null,"type":"comment","url":null},{"author":"brokenmachine","children":[],"created_at":"2026-11-12T22:31:30.000Z","created_at_i":1794522690,"id":50475312,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"And I hope all of us have learned a valuable lesson.","title":null,"type":"comment","url":null},{"author":"BLKNSLVR","children":[{"author":"amanaplanacanal","children":[{"author":"BLKNSLVR","children":[{"author":"janfoeh","children":[],"created_at":"2026-11-12T23:28:54.000Z","created_at_i":1794526134,"id":50475913,"options":[],"parent_id":50475705,"points":null,"story_id":50471731,"text":"&gt; (which, I&#x27;ll admit, makes my little rant above more than a little hypocritical)<p>Na, that would simply be the kaleidoscope part you mentioned, wouldn&#x27;t it? For what it&#x27;s worth, I found the combination just as peculiar as you did.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:05:46.000Z","created_at_i":1794524746,"id":50475705,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"I use FairEmail on Android, which aggregates both my Gmail and self-hosted accounts.<p>I use Gmail&#x27;s web interface for my Gmail account (which, I&#x27;ll admit, makes my little rant above more than a little hypocritical)<p>And in my self hosted email setup I use RoundCube (web interface).","title":null,"type":"comment","url":null},{"author":"SSLy","children":[],"created_at":"2026-11-12T23:22:34.000Z","created_at_i":1794525754,"id":50475853,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"Best one I&#x27;ve ever used was Fastmail&#x27;s web mail. But it&#x27;s locked to their platform, so yeah.","title":null,"type":"comment","url":null},{"author":"post-it","children":[{"author":"prepend","children":[{"author":"pr3dr49","children":[],"created_at":"2026-11-13T14:46:42.000Z","created_at_i":1794581202,"id":50484283,"options":[],"parent_id":50476161,"points":null,"story_id":50471731,"text":"Pegasus Mail.<p>Almost as good as mutt.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:54:27.000Z","created_at_i":1794527667,"id":50476161,"options":[],"parent_id":50475920,"points":null,"story_id":50471731,"text":"Surprisingly, Mac mail is a really nice client. It reminds me of how quick eudora was back in the day.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:29:18.000Z","created_at_i":1794526158,"id":50475920,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"Mac&#x2F;iOS Mail is pretty lightweight. I used to use Thunderbird on Linux.","title":null,"type":"comment","url":null},{"author":"andyfilms1","children":[],"created_at":"2026-11-12T23:44:49.000Z","created_at_i":1794527089,"id":50476075,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"EmClient, Mailcraft","title":null,"type":"comment","url":null},{"author":"zalebz","children":[],"created_at":"2026-11-12T23:52:06.000Z","created_at_i":1794527526,"id":50476141,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"eM Client for various M365 and IMAP accounts.\nElectronMail for the 9 ProtonMail accounts I have (allows &quot;tabs&quot; for each account in one client).","title":null,"type":"comment","url":null},{"author":"sensanaty","children":[],"created_at":"2026-11-13T00:26:20.000Z","created_at_i":1794529580,"id":50476467,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"Thunderbird still reigns supreme","title":null,"type":"comment","url":null},{"author":"Lammy","children":[],"created_at":"2026-11-13T00:29:03.000Z","created_at_i":1794529743,"id":50476489,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"Mine is Becky! Internet Mail <a href=\"https:&#x2F;&#x2F;www.rimarts.co.jp&#x2F;becky.htm\" rel=\"nofollow\">https:&#x2F;&#x2F;www.rimarts.co.jp&#x2F;becky.htm</a> (sincere)<p>Great oldschool UI coupled with support for all the modern protocols, and consistently updated: <a href=\"https:&#x2F;&#x2F;www.rimarts.jp&#x2F;downloads&#x2F;B2&#x2F;Readme-e.txt\" rel=\"nofollow\">https:&#x2F;&#x2F;www.rimarts.jp&#x2F;downloads&#x2F;B2&#x2F;Readme-e.txt</a>","title":null,"type":"comment","url":null},{"author":"tantalor","children":[{"author":"soupfordummies","children":[],"created_at":"2026-11-13T02:56:13.000Z","created_at_i":1794538573,"id":50477545,"options":[],"parent_id":50476638,"points":null,"story_id":50471731,"text":"That\u2019s a name I haven\u2019t heard in a longgg time. Google says it\u2019s still being used by some enthusiasts. Were you being sincere?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:46:19.000Z","created_at_i":1794530779,"id":50476638,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"Eudora","title":null,"type":"comment","url":null},{"author":"drnick1","children":[],"created_at":"2026-11-13T01:14:35.000Z","created_at_i":1794532475,"id":50476835,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"Thunderbird (desktop), K9 (Android).","title":null,"type":"comment","url":null},{"author":"ptrl600","children":[{"author":"sebmaynard","children":[],"created_at":"2026-11-13T18:55:53.000Z","created_at_i":1794596153,"id":50488064,"options":[],"parent_id":50478258,"points":null,"story_id":50471731,"text":"The Bat! was my email client of choice for many years, many years ago. Will take another look, thank you for the reminder.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:18:51.000Z","created_at_i":1794543531,"id":50478258,"options":[],"parent_id":50475617,"points":null,"story_id":50471731,"text":"The Bat!","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:58:04.000Z","created_at_i":1794524284,"id":50475617,"options":[],"parent_id":50475466,"points":null,"story_id":50471731,"text":"What&#x27;s your preferred email client? Just wondering what other people are using.","title":null,"type":"comment","url":null},{"author":"chneu","children":[],"created_at":"2026-11-13T00:37:36.000Z","created_at_i":1794530256,"id":50476569,"options":[],"parent_id":50475466,"points":null,"story_id":50471731,"text":"You&#x27;re not being an ass. You&#x27;re being a logical person who is advocating for individuals taking responsibility for their choices&#x2F;actions.<p>Unfortunately, being someone who speaks up nowadays has been portrayed as being an asshole.<p>How dare you!?","title":null,"type":"comment","url":null},{"author":"drnick1","children":[],"created_at":"2026-11-13T01:14:04.000Z","created_at_i":1794532444,"id":50476833,"options":[],"parent_id":50475466,"points":null,"story_id":50471731,"text":"&gt; Personally, I can&#x27;t reconcile having a self-hosted email server and using Outlook to access said email.<p>In a corporate environment, I don&#x27;t think this would be that unusual. But yes, it&#x27;s hard to imagine someone would do that in a personal setup.","title":null,"type":"comment","url":null},{"author":"k_sze","children":[],"created_at":"2026-11-13T06:31:39.000Z","created_at_i":1794551499,"id":50479193,"options":[],"parent_id":50475466,"points":null,"story_id":50471731,"text":"It does have to do with the fact that Outlook still looks better than Thunderbird.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:43:25.000Z","created_at_i":1794523405,"id":50475466,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"Personally, I can&#x27;t reconcile having a self-hosted email server and using Outlook to access said email.<p>I&#x27;m being an ass in saying this, because I&#x27;m aware human motivation is a beautiful kaleidoscope of variables, but I would have guessed at the venn diagram of &#x27;those willing to compromise and use a Microsoft product&#x27; is mutually exclusive with that of the &#x27;I&#x27;m hardcore enough to self-host email&#x27;.<p>I will say, however, that Outlook used to be one of the better desktop email programs, so I&#x27;ll grant some legacy lenience.","title":null,"type":"comment","url":null},{"author":"lousken","children":[],"created_at":"2026-11-12T23:37:20.000Z","created_at_i":1794526640,"id":50476000,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"outlook 2010 works just fine","title":null,"type":"comment","url":null},{"author":"noAnswer","children":[],"created_at":"2026-11-13T00:12:10.000Z","created_at_i":1794528730,"id":50476357,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"&gt; For reasons that I cannot fathom<p>Biggest data heist and most obvious US intelligence operation in human history. I can&#x27;t fathom why AVs don&#x27;t treat &quot;Outlook New&quot; as info stealer malware.","title":null,"type":"comment","url":null},{"author":"ingaze","children":[],"created_at":"2026-11-13T00:48:18.000Z","created_at_i":1794530898,"id":50476656,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"I\u2019m pretty certain their desktop client applies filters <i>server-side</i>.<p>I\u2019m pretty certain because my company\u2019s phishing-test emails skip my filters (I assume admins have a \u201cskip filters\u201d toggle). Which, hilariously, makes it even easier to ensure there\u2019s a place that contains <i>only</i> phishing test emails (filter all not on allow-list of domains to one place, filter all <i>on</i> that list to another, ta-da, the main inbox now contains only phishing test emails)<p>I assume they do the same thing with non-MS email if you use their client, rather than maintain two filter implementations.<p>All around, yeah, wow, super gross.","title":null,"type":"comment","url":null},{"author":"jwilcoxson","children":[],"created_at":"2026-11-13T02:36:14.000Z","created_at_i":1794537374,"id":50477389,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"Why would you self host, then use a client with a dependency like this? Seems like the worst of both worlds.","title":null,"type":"comment","url":null},{"author":"jasonjayr","children":[{"author":"k_sze","children":[],"created_at":"2026-11-13T06:35:06.000Z","created_at_i":1794551706,"id":50479221,"options":[],"parent_id":50477599,"points":null,"story_id":50471731,"text":"Which is odd. I also have Outlook for iOS, and the accounts I add in Outlook for Windows don&#x27;t automatically appear in my Outlook for iOS, even though I have the same Microsoft account logged in in both. So I don&#x27;t understand how they plan to make push notifications work better for me on my iPhone by relaying my IMAP e-mail account.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:01:12.000Z","created_at_i":1794538872,"id":50477599,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"Allegedly, It&#x27;s so they can use push notifications efficiently from a central place for new mail notifications.  Mobile IMAP clients cannot reliably keep a TCP connection open, due to on-device power-management and network management purposes.  IMAP natively supports push-based notifications, but mobile networks make that impossible to work reliably.","title":null,"type":"comment","url":null},{"author":"EmX_3000","children":[],"created_at":"2026-11-13T03:59:53.000Z","created_at_i":1794542393,"id":50478106,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"Surely you can just use another email client to get the email from your self-hosted server right?","title":null,"type":"comment","url":null},{"author":"lostmsu","children":[],"created_at":"2026-11-13T11:50:32.000Z","created_at_i":1794570632,"id":50482181,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"When the excellent Windows 10 Mail app was deprecated and they tried to push Outlook that would work through their online services, I switched to Wino Mail (open remake of Windows 10 Mail). My email works.","title":null,"type":"comment","url":null},{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T21:26:28.000Z","created_at_i":1794605188,"id":50489977,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"Because the new Outlook app is actually a web app talking to a Microsoft Web Server that does the actual mail retrieval. This is all clearly explained in their documentation.","title":null,"type":"comment","url":null},{"author":"realaaa","children":[],"created_at":"2026-11-15T01:23:36.000Z","created_at_i":1794705816,"id":50503026,"options":[],"parent_id":50473368,"points":null,"story_id":50471731,"text":"Outlook Classic also refused to start for many users - looks like it is trying to check&#x2F;sync something upon start, and when 365 went down it borked completely<p>Turning off network completely during start-up of Outlook Classic helped to start it at least<p>but yeah, it all wants to be connected at all times these days...","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:03:32.000Z","created_at_i":1794513812,"id":50473368,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"And I can&#x27;t reach my self-hosted mail server in the Outlook desktop app because of this.<p>For reasons that I cannot fathom, Microsoft wants to act as the relay to my self-hosted e-mail account, if I add the account in Outlook.","title":null,"type":"comment","url":null},{"author":"rconti","children":[{"author":"dudus","children":[],"created_at":"2026-11-12T20:18:06.000Z","created_at_i":1794514686,"id":50473567,"options":[],"parent_id":50473414,"points":null,"story_id":50471731,"text":"I&#x27;m in a similar situation, using Microsoft again after 13+ years. Outlook and teams I expected to be garbage, but Word and Excel was really surprising. I get it that everyone has that one feature of excel that is not available in gSuite so they need it. But UX in general is so much superior at Google it&#x27;s baffling how they let it&#x27;s workhorse fall behind so much.","title":null,"type":"comment","url":null},{"author":"SoftTalker","children":[],"created_at":"2026-11-12T20:19:28.000Z","created_at_i":1794514768,"id":50473590,"options":[],"parent_id":50473414,"points":null,"story_id":50471731,"text":"GSuite was written from the start as an online collaborative platform.<p>O365 is Microsoft Office shoehorned into running in a web browser.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:07:18.000Z","created_at_i":1794514038,"id":50473414,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It took 30 seconds to open a &quot;local&quot; file in Word, and my Outlook email wasn&#x27;t updating.<p>In other words, a day that ends in &quot;y&quot;.<p>My company was recently acquired by a company that uses Office, so I&#x27;m using Microsoft products for the first time in 15 years. It&#x27;s absolutely APPALLING how bad they are. I assumed they got fairly usable in the last 15 years, but it seems they&#x27;ve gone backwards.<p>For all my gripes about GSuite, ... I don&#x27;t know how businesses can justify using software this bad.","title":null,"type":"comment","url":null},{"author":"jenimac926","children":[],"created_at":"2026-11-12T20:08:57.000Z","created_at_i":1794514137,"id":50473431,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"anyone else just watch the admin portal post an update and then roll it back to the previous update....guess it didn&#x27;t work. &quot;We&#x27;ve identified that affected servers are failing automated health checks, which is causing them to become unavailable, and this may be related to a recent change to a component involved in processing those checks. We&#x27;re testing a configuration change on a subset of affected infrastructure to address this and, if successful, will apply it more broadly. In parallel, we&#x27;ve initiated a restart of all affected servers and are validating whether they&#x27;re successfully returning to service.&quot; was the old message from 7:52 UTC now it rolled back to 7:30 UTC update again","title":null,"type":"comment","url":null},{"author":"utsavo_afk","children":[],"created_at":"2026-11-12T20:08:59.000Z","created_at_i":1794514139,"id":50473433,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"email doesnt work","title":null,"type":"comment","url":null},{"author":"utsavo_afk","children":[],"created_at":"2026-11-12T20:09:15.000Z","created_at_i":1794514155,"id":50473434,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"email still not working, outlook","title":null,"type":"comment","url":null},{"author":"z500","children":[],"created_at":"2026-11-12T20:13:00.000Z","created_at_i":1794514380,"id":50473477,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Outlook has been down for us for the last 2 hours","title":null,"type":"comment","url":null},{"author":"htrp","children":[],"created_at":"2026-11-12T20:13:47.000Z","created_at_i":1794514427,"id":50473484,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"bgp misconfigured or AI agent issues?","title":null,"type":"comment","url":null},{"author":"CerebralCerb","children":[],"created_at":"2026-11-12T20:14:30.000Z","created_at_i":1794514470,"id":50473497,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Not surprising. Azure&#x27;s data centers are out of capacity. In our region they&#x27;ve announced they won&#x27;t be able to build out capacity for several years.","title":null,"type":"comment","url":null},{"author":"butz","children":[],"created_at":"2026-11-12T20:23:07.000Z","created_at_i":1794514987,"id":50473646,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Nice to see that intern finally learned not to push to prod on Friday.","title":null,"type":"comment","url":null},{"author":"JPascal_","children":[{"author":"tech_ken","children":[],"created_at":"2026-11-12T20:55:29.000Z","created_at_i":1794516929,"id":50474144,"options":[],"parent_id":50473666,"points":null,"story_id":50471668,"text":"Oh estoy haciendolo","title":null,"type":"comment","url":null},{"author":"rossdavidh","children":[],"created_at":"2026-11-12T21:05:26.000Z","created_at_i":1794517526,"id":50474264,"options":[],"parent_id":50473666,"points":null,"story_id":50471731,"text":"I need to start working on adding this word to English...","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:24:34.000Z","created_at_i":1794515074,"id":50473666,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"In my language many would say \u201cdescansito\u201d :)","title":null,"type":"comment","url":null},{"author":"sgt","children":[],"created_at":"2026-11-12T20:28:11.000Z","created_at_i":1794515291,"id":50473722,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Also noticed the Partner center is down e.g for uploading apps to the Microsoft Store.","title":null,"type":"comment","url":null},{"author":"monkaiju","children":[],"created_at":"2026-11-12T20:28:35.000Z","created_at_i":1794515315,"id":50473728,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Micro$lop strikes again","title":null,"type":"comment","url":null},{"author":"nashashmi","children":[],"created_at":"2026-11-12T20:28:48.000Z","created_at_i":1794515328,"id":50473734,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"To get AI prompts, i am using Bing. Bing still works!","title":null,"type":"comment","url":null},{"author":"infn8loop","children":[{"author":"stackghost","children":[],"created_at":"2026-11-12T20:46:12.000Z","created_at_i":1794516372,"id":50474021,"options":[],"parent_id":50473850,"points":null,"story_id":50471731,"text":"Are you finding these vulns with Mythos&#x2F;Daybreak or some other tool?  Chinese models perhaps?","title":null,"type":"comment","url":null},{"author":"antx","children":[{"author":"waz0wski","children":[{"author":"antx","children":[],"created_at":"2026-11-13T14:48:15.000Z","created_at_i":1794581295,"id":50484312,"options":[],"parent_id":50478134,"points":null,"story_id":50471731,"text":"Except, once again Microsoft crapped the bed... it&#x27;s not an RCE in any capacity...<p>&gt; Revision 2.1, Nov 7: \u201cAdded an FAQ and updated the CVSS score. This is an informational change only.\u201d\n&gt; Vector: now AV:L and UI:R (local attack vector, user interaction required), scoring 7.0.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:03:10.000Z","created_at_i":1794542590,"id":50478134,"options":[],"parent_id":50474453,"points":null,"story_id":50471731,"text":"There was an RCE recently disclosed for ... paint.exe - CVE-2026-83844<p><a href=\"https:&#x2F;&#x2F;msrc.microsoft.com&#x2F;update-guide&#x2F;vulnerability&#x2F;CVE-2026-83844\" rel=\"nofollow\">https:&#x2F;&#x2F;msrc.microsoft.com&#x2F;update-guide&#x2F;vulnerability&#x2F;CVE-20...</a><p>So really anything is on the table at this point","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:20:38.000Z","created_at_i":1794518438,"id":50474453,"options":[],"parent_id":50473850,"points":null,"story_id":50471731,"text":"Not impossible, but very unlikely. CLFS isn\u2019t remotely reachable, it&#x27;s a kernel driver reached through local API calls and has no network listener. AFAIK the historical CLFS CVEs are all rated as local.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:35:33.000Z","created_at_i":1794515733,"id":50473850,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I suspect some possible relation to SignDrop or attempts to patch it.<p>SignDrop is an unpatched Windows zero-day local privilege escalation (LPE) exploit that allows a standard user to gain NT AUTHORITY\\SYSTEM privileges by abusing the Common Log File System (CLFS) kernel driver (clfs.sys). Security researcher Abdelhamid Naceri (also known as MSNightmare or Nightmare Eclipse) published a detailed technical write-up and functional proof-of-concept (PoC) code on GitHub on November 10, 2026.","title":null,"type":"comment","url":null},{"author":"game_the0ry","children":[{"author":"icameron","children":[],"created_at":"2026-11-12T23:23:05.000Z","created_at_i":1794525785,"id":50475860,"options":[],"parent_id":50473964,"points":null,"story_id":50471731,"text":"Yeah every IT dept is sending out that notification.  Someone replied with &#x27;When do you expect it to be back online?&quot; to which I LOL emoted at the moment.  I think I&#x27;m a jerk.  But how can you ask such a question- as if they planned a time to restore services and aren&#x27;t working to restore it as quickly as possible?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:42:10.000Z","created_at_i":1794516130,"id":50473964,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Got notification at work the MS 360 services were offline or degraded and the company was working with MS to fix the problem.<p>Lamest tech company imo. Why dont you lay off some more staff, Satya, maybe that will fix the problem.","title":null,"type":"comment","url":null},{"author":"at1as","children":[],"created_at":"2026-11-12T20:53:39.000Z","created_at_i":1794516819,"id":50474118,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"For whatever reason 6.1 Sol is completely lobotomized for me this morning, so it wasn&#x27;t helping much with the investigation, but it was pretty clear that MSFT was having issues.<p>I have a teams app with Outlook integration and received a bunch of 502s to smba.trafficmanager.net and a my logs are riddled with &quot;RestError Temporary connection issue when contacting service. Please wait before retrying request&quot;<p>I will say this, having apps deployed on Slack and Teams, Slack rarely has issues (an exponential backoff is enough to simply never worry about my Slack integration). With Teams I have mysterious failures to debug at least 2x a year - and they&#x27;re often not very transparent about them (often my first instinct is to search Twitter and find people complaining about the same thing).","title":null,"type":"comment","url":null},{"author":"semiquaver","children":[],"created_at":"2026-11-12T20:57:37.000Z","created_at_i":1794517057,"id":50474164,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"My company is being pressured very aggressively by Microsoft to migrate all our users from us-managed Exchange to Microsoft-managed Exchange Online. Guess which users still have email today and which do not\u2026","title":null,"type":"comment","url":null},{"author":"RajT88","children":[{"author":"fock","children":[],"created_at":"2026-11-12T21:41:32.000Z","created_at_i":1794519692,"id":50474705,"options":[],"parent_id":50474173,"points":null,"story_id":50471731,"text":"everything non-microsoft works fine here!","title":null,"type":"comment","url":null},{"author":"jwnin","children":[],"created_at":"2026-11-12T22:37:30.000Z","created_at_i":1794523050,"id":50475391,"options":[],"parent_id":50474173,"points":null,"story_id":50471731,"text":"This is an M365 outage, not an Azure outage.\nM365 has a separate status page with information: <a href=\"https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;m365\" rel=\"nofollow\">https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;m365</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:57:59.000Z","created_at_i":1794517079,"id":50474173,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"ThousandEyes while it was loading seemed to have centralized around it mostly being a Microsoft outage.<p><a href=\"https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;m365\" rel=\"nofollow\">https:&#x2F;&#x2F;status.cloud.microsoft&#x2F;m365</a><p>Azure status does not document anything:<p><a href=\"https:&#x2F;&#x2F;azure.status.microsoft&#x2F;en-us&#x2F;status\" rel=\"nofollow\">https:&#x2F;&#x2F;azure.status.microsoft&#x2F;en-us&#x2F;status</a><p>All that said...  Stuff on my home PC started getting various DNS issues around the time my email started acting weird.  Hard to say how widespread it is.  It may be bigger than Microsoft even.","title":null,"type":"comment","url":null},{"author":"dbvn","children":[{"author":"isquaredr","children":[{"author":"ifwinterco","children":[],"created_at":"2026-11-12T23:08:26.000Z","created_at_i":1794524906,"id":50475732,"options":[],"parent_id":50474321,"points":null,"story_id":50471731,"text":"Douglas Crockford has a lot to answer for","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:10:45.000Z","created_at_i":1794517845,"id":50474321,"options":[],"parent_id":50474195,"points":null,"story_id":50471731,"text":"I\u2019ve been there\u2026 1 line YOLO update to resolve an outage but added a comma on the last row of a JSON object and now the server is crash-looping","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T20:59:19.000Z","created_at_i":1794517159,"id":50474195,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"&gt; Current status: While validating the targeted change, we found that many of the affected servers have become unresponsive, which is preventing us from confirming whether the change is effective. We&#x27;re restarting these servers so they can come back online with the change in place, and we&#x27;re applying the same approach to additional affected portions of our infrastructure to validate the results more broadly.<p>I think it&#x27;s safe to say, if the server is unresponsive, the change is not effective.","title":null,"type":"comment","url":null},{"author":"Maximilian_Bet","children":[],"created_at":"2026-11-12T21:04:15.000Z","created_at_i":1794517455,"id":50474255,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It is M365 having issues, not Azure cloud services.","title":null,"type":"comment","url":null},{"author":"zmmmmm","children":[],"created_at":"2026-11-12T21:08:06.000Z","created_at_i":1794517686,"id":50474292,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Will be interesting to see if this gets attributed to AI in some way.","title":null,"type":"comment","url":null},{"author":"xtiansimon","children":[],"created_at":"2026-11-12T21:12:48.000Z","created_at_i":1794517968,"id":50474356,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"WOO-HOO! I&#x27;m going home.","title":null,"type":"comment","url":null},{"author":"whatever1","children":[],"created_at":"2026-11-12T21:16:37.000Z","created_at_i":1794518197,"id":50474407,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"And magically they will claim 99.999999999999999% availability of services, when on average hyperscalers are down 1 day per year.<p>None of the admin ran shops are down 1 day per year.","title":null,"type":"comment","url":null},{"author":"trentor","children":[{"author":"wiml","children":[],"created_at":"2026-11-13T03:08:20.000Z","created_at_i":1794539300,"id":50477652,"options":[],"parent_id":50474489,"points":null,"story_id":50471731,"text":"Presumably: 358.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:23:59.000Z","created_at_i":1794518639,"id":50474489,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I always wonder what would happen if 365 goes down for a week.","title":null,"type":"comment","url":null},{"author":"kittiesunicorns","children":[],"created_at":"2026-11-12T21:24:55.000Z","created_at_i":1794518695,"id":50474500,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"just got an email from the NYC DOE<p>&quot;School staff are currently unable to receive or send emails due to a nationwide Microsoft Outlook outage. We hope that the issue will be resolved soon and will send an update when we have more information.&quot;","title":null,"type":"comment","url":null},{"author":"soundworlds","children":[{"author":"Rantenki","children":[{"author":"cgio","children":[],"created_at":"2026-11-12T23:03:17.000Z","created_at_i":1794524597,"id":50475678,"options":[],"parent_id":50475159,"points":null,"story_id":50471731,"text":"So health checks were correct\u2026 this solution of silencing the first symptom is probably just adding to the problem. I am afraid they may be opening the door for the fire trucks and getting some other kind of intrusion instead. Better they shut it down for day and do proper fix.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:19:37.000Z","created_at_i":1794521977,"id":50475159,"options":[],"parent_id":50474517,"points":null,"story_id":50471731,"text":"Update as of 10 minutes ago implies that didn&#x27;t work:<p>&gt; Current status: We\u2019re continuing to pursue all available pathways to restore service, as our actions taken thus far have not provided the anticipated relief. Our investigation has found that a core process on the affected servers is becoming overwhelmed, which causes the servers to stop responding and contributes to the capacity loss.","title":null,"type":"comment","url":null},{"author":"EvanAnderson","children":[{"author":"jp191919","children":[],"created_at":"2026-11-12T22:29:39.000Z","created_at_i":1794522579,"id":50475287,"options":[],"parent_id":50475171,"points":null,"story_id":50471731,"text":"Not exactly confidence inspiring.","title":null,"type":"comment","url":null},{"author":"BLKNSLVR","children":[{"author":"LadyCailin","children":[{"author":"BLKNSLVR","children":[{"author":"Angostura","children":[],"created_at":"2026-11-13T00:15:03.000Z","created_at_i":1794528903,"id":50476380,"options":[],"parent_id":50475621,"points":null,"story_id":50471731,"text":"Thank you for introducing me to this","title":null,"type":"comment","url":null},{"author":"llama052","children":[{"author":"BLKNSLVR","children":[],"created_at":"2026-11-13T03:34:18.000Z","created_at_i":1794540858,"id":50477891,"options":[],"parent_id":50477075,"points":null,"story_id":50471731,"text":"&quot;the velocity is vertical on slide 45&quot; is an absolute headshot for my recent experience.<p>I&#x27;m not comfortable with how much I love that video.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:50:35.000Z","created_at_i":1794534635,"id":50477075,"options":[],"parent_id":50475621,"points":null,"story_id":50471731,"text":"Damn that video is way too real.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:58:27.000Z","created_at_i":1794524307,"id":50475621,"options":[],"parent_id":50475441,"points":null,"story_id":50471731,"text":"1. Life imitate Art<p>2. Art imitate Life<p>3. Goto 1<p><a href=\"https:&#x2F;&#x2F;youtu.be&#x2F;3TNpOD6bov8\" rel=\"nofollow\">https:&#x2F;&#x2F;youtu.be&#x2F;3TNpOD6bov8</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:40:44.000Z","created_at_i":1794523244,"id":50475441,"options":[],"parent_id":50475357,"points":null,"story_id":50471731,"text":"The one guy that did understand the code took VEO, and isn\u2019t answering his phone right now.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:35:11.000Z","created_at_i":1794522911,"id":50475357,"options":[],"parent_id":50475171,"points":null,"story_id":50471731,"text":"&gt; these guys have the code!<p>But maybe don&#x27;t understand it because they didn&#x27;t write it themselves?","title":null,"type":"comment","url":null},{"author":"ifwinterco","children":[],"created_at":"2026-11-12T22:44:17.000Z","created_at_i":1794523457,"id":50475473,"options":[],"parent_id":50475171,"points":null,"story_id":50471731,"text":"The code by itself doesn&#x27;t tell you how the various components of a complex distributed system interact in a failure condition with clients hammering retries.<p>I mean it sort of does if you know the whole system inside and out and have the ability to reason about it, but just having the code for each component doesn&#x27;t by itself solve the real problem of understanding","title":null,"type":"comment","url":null},{"author":"greatgib","children":[],"created_at":"2026-11-13T02:46:23.000Z","created_at_i":1794537983,"id":50477451,"options":[],"parent_id":50475171,"points":null,"story_id":50471731,"text":"<p><pre><code>   we&#x27;ve observed that they can become unresponsive again once they begin receiving traffic. \n</code></pre>\nBasically their server works well when they they are not used :-p","title":null,"type":"comment","url":null},{"author":"_delirium","children":[],"created_at":"2026-11-13T03:17:02.000Z","created_at_i":1794539822,"id":50477729,"options":[],"parent_id":50475171,"points":null,"story_id":50471731,"text":"The 03:07:45 AM UTC update doesn&#x27;t sound promising either:<p>Current status: We\u2019ve monitored the status of the changes applied to improve serviceability and confirmed that change is not taking as expected. We\u2019re identifying alternate workstreams that can be applied to increase capacity in the face of sustained traffic management imbalances.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:20:33.000Z","created_at_i":1794522033,"id":50475171,"options":[],"parent_id":50474517,"points":null,"story_id":50471731,"text":"The 12:08:53 AM UTC update is much less hopeful:<p>Current status: While the servers we&#x27;ve returned to service initially remain healthy, we&#x27;ve observed that they can become unresponsive again once they begin receiving traffic. We&#x27;re analyzing diagnostic data from these servers with our networking and platform experts to determine what&#x27;s triggering this behavior.<p>Building on the protective traffic management measures we&#x27;ve implemented, we&#x27;re also temporarily limiting which types of traffic can reach the affected infrastructure in specific locations. This will help us determine whether a particular type of request is contributing to the impact and allow us to restore service incrementally. Additionally, we&#x27;re rebuilding a subset of affected servers using a previous software configuration to validate whether this prevents them from becoming unresponsive, and we&#x27;ll expand this approach to additional servers if we observe positive results.<p>---<p>The 11:05:31 PM UTC update is is the first since the outage began that feels hopeful.<p>From the 11:06:31 PM UTC update:<p>Current status: We&#x27;ve begun returning a portion of the affected servers to service, and they&#x27;re remaining stable so far. We&#x27;ve also shifted traffic and connections to alternative pathways wherever possible and have observed limited recovery in some regions.<p>We&#x27;ve streamlined our recovery process to expedite returning the remaining affected servers to service. To further support recovery, we&#x27;re implementing protective traffic management measures in a specific location to reduce load on the affected infrastructure, and we&#x27;ll expand these measures to additional locations if we observe positive results. As capacity is restored, users may experience a gradual recovery as their clients reconnect to the service.<p>---<p>The 10:11:39 PM UTC update is a little chilling. They don&#x27;t know why what&#x27;s happening is happening so they&#x27;re doing experiments.<p>I do that with closed-source software when I don&#x27;t want to bother trying reverse engineer it, but these guys have the code! Yikes.<p>I recognize that even w&#x2F; the code available there are likely behaviors that aren&#x27;t likely to be anticipated because of the scale of traffic. Complex systems fail in complex and non-intuitive ways.<p>From the 10:11:39 PM UTC update:<p>Current status: We&#x27;re continuing to pursue all available pathways to restore service, as our actions taken thus far have not provided the anticipated relief. Our investigation has found that a core process on the affected servers is becoming overwhelmed, which causes the servers to stop responding and contributes to the capacity loss.<p>To validate a potential recovery approach, we&#x27;re fully isolating a portion of our service infrastructure, restarting the affected components, and gradually reintroducing traffic to confirm our services remain stable before applying this approach more broadly. We&#x27;re also analyzing traffic patterns across our entire service infrastructure and evaluating whether isolating traffic within each region may allow affected regions to recover independently.","title":null,"type":"comment","url":null},{"author":"bitteralmond","children":[],"created_at":"2026-11-13T21:01:25.000Z","created_at_i":1794603685,"id":50489594,"options":[],"parent_id":50474517,"points":null,"story_id":50471731,"text":"Translation: &quot;we&#x27;re bypassing the health check to see if the servers will work despite being unhealthy.&quot;<p>Seems like it didn&#x27;t work out.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:25:56.000Z","created_at_i":1794518756,"id":50474517,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Update from Microsoft: \n&quot;We&#x27;ve validated an alternative health check method on a subset of affected infrastructure, which allowed the servers in that subset to successfully return to service, and we&#x27;re now applying this change more broadly.<p>&quot;We&#x27;re also preparing an automated recovery process to continually detect and restart unresponsive servers, to help keep them in service while this change progresses.&quot;<p><a href=\"https:&#x2F;&#x2F;www.abc.net.au&#x2F;news&#x2F;2026-11-13&#x2F;microsoft-outage-affects-users-worldwide&#x2F;107381050?utm_campaign=abc_news_web&amp;utm_content=link&amp;utm_medium=content_shared&amp;utm_source=abc_news_web#live-blog-post-360069\" rel=\"nofollow\">https:&#x2F;&#x2F;www.abc.net.au&#x2F;news&#x2F;2026-11-13&#x2F;microsoft-outage-affe...</a>","title":null,"type":"comment","url":null},{"author":"cidd","children":[],"created_at":"2026-11-12T21:28:31.000Z","created_at_i":1794518911,"id":50474544,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Microsoft: Claude, fix outage and make no mistakes.","title":null,"type":"comment","url":null},{"author":"apercu","children":[],"created_at":"2026-11-12T21:30:36.000Z","created_at_i":1794519036,"id":50474579,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"This just a couple weeks after they rolled out a dark pattern office update for Mac users to try to trick them in to 365 subscriptions.","title":null,"type":"comment","url":null},{"author":"rwmj","children":[{"author":"rurp","children":[],"created_at":"2026-11-12T22:59:25.000Z","created_at_i":1794524365,"id":50475635,"options":[],"parent_id":50474745,"points":null,"story_id":50471731,"text":"Very possible, DDG is heavily reliant on the Bing API.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T21:43:51.000Z","created_at_i":1794519831,"id":50474745,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Does anyone know if this is affecting DuckDuckGo?  DDG is really slow and intermittent at the moment.","title":null,"type":"comment","url":null},{"author":"rainee","children":[],"created_at":"2026-11-12T21:44:54.000Z","created_at_i":1794519894,"id":50474755,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Outlook calendar won&#x27;t load?","title":null,"type":"comment","url":null},{"author":"rainee","children":[],"created_at":"2026-11-12T21:47:36.000Z","created_at_i":1794520056,"id":50474787,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Outlook calendar won&#x27;t load?  Is this part of the outage? Unfortunately, I downloaded several updates and rebooted. I&#x27;m not sure if this is because of the updates or the Microsoft outage.","title":null,"type":"comment","url":null},{"author":"jobe777","children":[],"created_at":"2026-11-12T21:47:55.000Z","created_at_i":1794520075,"id":50474790,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"russian hackers in Kazan hopping thru \nSluck Belarus South Africa Brazil hitting MS backdoor w&#x2F; zero day Cve-2026-124194 RuskiNet group hit East U in Boydtin Virginia. Pro Iranian.","title":null,"type":"comment","url":null},{"author":"jobe777","children":[],"created_at":"2026-11-12T21:50:56.000Z","created_at_i":1794520256,"id":50474823,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"RuskiNet Cve-2026-124194 hopped tio East U in Boydton VA zero day backdoor pro iranian","title":null,"type":"comment","url":null},{"author":"ArcHound","children":[],"created_at":"2026-11-12T22:00:15.000Z","created_at_i":1794520815,"id":50474933,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"The status page reports that defender, DLP and others are now affected. This could get really ugly really fast.","title":null,"type":"comment","url":null},{"author":"tiahura","children":[],"created_at":"2026-11-12T22:05:27.000Z","created_at_i":1794521127,"id":50474988,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Starting to look like something even Mythos can&#x27;t troubleshoot.","title":null,"type":"comment","url":null},{"author":"bharathreddy497","children":[],"created_at":"2026-11-12T22:24:46.000Z","created_at_i":1794522286,"id":50475223,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"This should have done long back. Evertime I use excel I just cant control my anger.","title":null,"type":"comment","url":null},{"author":"jwnin","children":[],"created_at":"2026-11-12T22:40:07.000Z","created_at_i":1794523207,"id":50475429,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It&#x27;s insane that Microsoft continues to have global outages.  Tech debt is real, service delivery on a planetary level means change is measured and deliberate, but...it&#x27;s been years. YEARS.","title":null,"type":"comment","url":null},{"author":"bigwheels","children":[],"created_at":"2026-11-12T22:50:07.000Z","created_at_i":1794523807,"id":50475532,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"They&#x27;ll have to rename it Microsoft 364.","title":null,"type":"comment","url":null},{"author":"analog31","children":[],"created_at":"2026-11-12T22:56:04.000Z","created_at_i":1794524164,"id":50475589,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"On the bright side, so much work got done today.","title":null,"type":"comment","url":null},{"author":"tatersolid","children":[{"author":"pwarner","children":[],"created_at":"2026-11-13T00:13:50.000Z","created_at_i":1794528830,"id":50476370,"options":[],"parent_id":50475605,"points":null,"story_id":50471731,"text":"2018 featured a bad one. \nCouldn&#x27;t find a good article, but I remember it being basically all day.<p><a href=\"https:&#x2F;&#x2F;redmondmag.com&#x2F;articles&#x2F;2018&#x2F;09&#x2F;11&#x2F;microsoft-explains-sept-4-outage.aspx\" rel=\"nofollow\">https:&#x2F;&#x2F;redmondmag.com&#x2F;articles&#x2F;2018&#x2F;09&#x2F;11&#x2F;microsoft-explain...</a>","title":null,"type":"comment","url":null},{"author":"vermilingua","children":[{"author":"SV_BubbleTime","children":[{"author":"conception","children":[],"created_at":"2026-11-13T01:30:44.000Z","created_at_i":1794533444,"id":50476949,"options":[],"parent_id":50476795,"points":null,"story_id":50471731,"text":"It has copied all the features it just does them all a bit worse.","title":null,"type":"comment","url":null},{"author":"jdironman","children":[],"created_at":"2026-11-13T01:37:41.000Z","created_at_i":1794533861,"id":50476993,"options":[],"parent_id":50476795,"points":null,"story_id":50471731,"text":"It&#x27;s mainly that traumatic new message sound for me.","title":null,"type":"comment","url":null},{"author":"doublepg23","children":[],"created_at":"2026-11-13T01:54:51.000Z","created_at_i":1794534891,"id":50477096,"options":[],"parent_id":50476795,"points":null,"story_id":50471731,"text":"I\u2019d agree.<p>I think it does _too much_ and the performance is _bad_ but it\u2019s  rock-solid for video and audio calls - more than even FaceTime or analog calls.","title":null,"type":"comment","url":null},{"author":"duxup","children":[],"created_at":"2026-11-13T02:37:00.000Z","created_at_i":1794537420,"id":50477394,"options":[],"parent_id":50476795,"points":null,"story_id":50471731,"text":"I find the teams app to be really flakey.   It changes time zones on me at random for a moment at a time.","title":null,"type":"comment","url":null},{"author":"kstrauser","children":[{"author":"SV_BubbleTime","children":[],"created_at":"2026-11-13T03:53:14.000Z","created_at_i":1794541994,"id":50478047,"options":[],"parent_id":50477543,"points":null,"story_id":50471731,"text":"Not a slack power user by any means. But went from Slack to Teams and barely noticed much of a difference. We chat when it\u2019s small and pick up the phone when it\u2019s not. I don\u2019t want to automate and add plugins and whatever; I want to do my work, but occasionally that means talking with other people over chat, I type and they see it. Needs met.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:55:57.000Z","created_at_i":1794538557,"id":50477543,"options":[],"parent_id":50476795,"points":null,"story_id":50471731,"text":"Preface: I have zero love for Slack. It\u2019s a thing. It\u2019s fine. I can take or leave it.<p>Using Teams after being used to Slack is like going from VSCode to Eclipse. I\u2019m sure this thing is powerful, but it looks weird, it feels weird, it moves like January molasses, and it has a million features I\u2019m completely uninterested in. I\u2019m sure some people get value from all the baroque. I am not one of them.<p>(I\u2019d rather be using IRC and Emacs but the world has other ideas.)","title":null,"type":"comment","url":null},{"author":"Semaphor","children":[],"created_at":"2026-11-13T04:49:17.000Z","created_at_i":1794545357,"id":50478480,"options":[],"parent_id":50476795,"points":null,"story_id":50471731,"text":"I haven&#x27;t used others, but can they really also not search through the history and jump *fully* to that point? In teams I have to adapt my search once I reach end of context so the context changes.<p>Discord gets hate for their bad search, but it&#x27;s vastly superior to teams.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:09:50.000Z","created_at_i":1794532190,"id":50476795,"options":[],"parent_id":50476699,"points":null,"story_id":50471731,"text":"I mean, I think the teams hate can be funny sometimes, but I honestly don\u2019t get it. I\u2019ve used all of the BIG programs. They\u2019re all the fucking same. I can\u2019t point to a single thing that Teams does drastically worse than any of the other options. I think it\u2019s just a meme.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:53:07.000Z","created_at_i":1794531187,"id":50476699,"options":[],"parent_id":50475605,"points":null,"story_id":50471731,"text":"Of all the things to keep working ;_;","title":null,"type":"comment","url":null},{"author":"SecretDreams","children":[],"created_at":"2026-11-13T02:16:06.000Z","created_at_i":1794536166,"id":50477226,"options":[],"parent_id":50475605,"points":null,"story_id":50471731,"text":"&gt; Teams chat and meetings are the only thing in Microsoft 365 that seem to be working.<p>Truly, we are in dark times.","title":null,"type":"comment","url":null},{"author":"raxxorraxor","children":[{"author":"toomim","children":[],"created_at":"2026-11-13T15:12:37.000Z","created_at_i":1794582757,"id":50484711,"options":[],"parent_id":50483496,"points":null,"story_id":50471731,"text":"It might be M363 now.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:52:36.000Z","created_at_i":1794577956,"id":50483496,"options":[],"parent_id":50475605,"points":null,"story_id":50471731,"text":"Since Microsoft rebrands quite often, perhaps it will be called M364 now?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:57:08.000Z","created_at_i":1794524228,"id":50475605,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"My last email was received at 5.5 hours ago. Teams chat and meetings are the only thing in Microsoft 365 that seem to be working. All our Azure infrastructure seems fine so this is something 365-specific.<p>Everyone has occasional outages but this is the worst 365 outage our org has seen since starting with M365 in 2019.","title":null,"type":"comment","url":null},{"author":"burnedbyhell","children":[{"author":"soupfordummies","children":[],"created_at":"2026-11-13T03:01:36.000Z","created_at_i":1794538896,"id":50477600,"options":[],"parent_id":50475638,"points":null,"story_id":50471731,"text":"Yeah VMs are stored as email attachments","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T22:59:44.000Z","created_at_i":1794524384,"id":50475638,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I&#x27;m able to see I have voicemails not able to listen to voicemails in Teams. Same issue?","title":null,"type":"comment","url":null},{"author":"tcoff91","children":[],"created_at":"2026-11-12T23:00:57.000Z","created_at_i":1794524457,"id":50475646,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"When I worked at a company that relied on this, I called it &quot;Microsoft 361&quot; because it went down about 4 days a year","title":null,"type":"comment","url":null},{"author":"layoric","children":[],"created_at":"2026-11-12T23:02:01.000Z","created_at_i":1794524521,"id":50475660,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Also, their status page is a joke.. one entry, no timeline, is there another official one that has more detail?","title":null,"type":"comment","url":null},{"author":"syngrog66","children":[{"author":"iJohnDoe","children":[{"author":"gib444","children":[],"created_at":"2026-11-13T08:00:54.000Z","created_at_i":1794556854,"id":50479914,"options":[],"parent_id":50478147,"points":null,"story_id":50471731,"text":"Haha exactly. Common pattern all over. I&#x27;m sure they&#x27;re exceptionally talented execs but they seem to have a common theme of overseeing expansions off shore which can&#x27;t be a coincidence<p>&gt; &quot;Milken said earlier that if a US company replaced the US-born CEO with a CEO born in India, he buys the stock.<p>&gt; The first thing they start doing is cutting US jobs and offshoring or automating them.&quot;<p><a href=\"https:&#x2F;&#x2F;timesofindia.indiatimes.com&#x2F;world&#x2F;us&#x2F;if-a-company-replaced-its-ceo-with-an-indian-origin-tech-leader-says-he-backtested-billionaire-michael-milkens-idea&#x2F;articleshow&#x2F;131040402.cms\" rel=\"nofollow\">https:&#x2F;&#x2F;timesofindia.indiatimes.com&#x2F;world&#x2F;us&#x2F;if-a-company-re...</a>","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:05:23.000Z","created_at_i":1794542723,"id":50478147,"options":[],"parent_id":50475679,"points":null,"story_id":50471731,"text":"One of the most accurate comments here.<p>What else can you expect from Microsoft? Satya Nadella, the CEO of Microsoft is from India and as expected has outsourced so much to India.","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T23:03:21.000Z","created_at_i":1794524601,"id":50475679,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I note that Microsoft became heavily off-shored, on-shored and AI-pilled&#x2F;vibe-coded in recent years. With lots of layoffs of the highest caliber and&#x2F;or most experienced engineers.","title":null,"type":"comment","url":null},{"author":"microsucks","children":[],"created_at":"2026-11-12T23:21:20.000Z","created_at_i":1794525680,"id":50475846,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"We are in the middle of a SPA and DocuSign AND Hotmail (witnesses) both seem to be down. You cannot make it up.","title":null,"type":"comment","url":null},{"author":"cozzyd","children":[],"created_at":"2026-11-12T23:22:43.000Z","created_at_i":1794525763,"id":50475855,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"They can just rebrand as MS364","title":null,"type":"comment","url":null},{"author":"vermontdevil","children":[],"created_at":"2026-11-12T23:40:34.000Z","created_at_i":1794526834,"id":50476034,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Looks like a new vector attack for the future.","title":null,"type":"comment","url":null},{"author":"newhotelowner","children":[],"created_at":"2026-11-13T00:02:12.000Z","created_at_i":1794528132,"id":50476254,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"We can&#x27;t use outlook on Windows. This is f&#x27;ing abomination.","title":null,"type":"comment","url":null},{"author":"greatgib","children":[],"created_at":"2026-11-13T00:04:04.000Z","created_at_i":1794528244,"id":50476275,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It looks like Microsoft&#x27;s legendary karma of incompetence has finally caught up with them.","title":null,"type":"comment","url":null},{"author":"romerocesar","children":[],"created_at":"2026-11-13T00:13:22.000Z","created_at_i":1794528802,"id":50476366,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"the footer says 2025 msft corporation. smh","title":null,"type":"comment","url":null},{"author":"jamilbk","children":[],"created_at":"2026-11-13T00:15:40.000Z","created_at_i":1794528940,"id":50476385,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Azure communication services (ACS - transactional emails) also appears to be down. Quite amazing one thing can roll out and break so many Microsoft services at once.","title":null,"type":"comment","url":null},{"author":"woggy","children":[{"author":"thousand_nights","children":[],"created_at":"2026-11-13T01:40:33.000Z","created_at_i":1794534033,"id":50477011,"options":[],"parent_id":50476566,"points":null,"story_id":50471731,"text":"yeah i do wonder what kind of fuck up they made this time, will be interesting to know","title":null,"type":"comment","url":null},{"author":"dboreham","children":[],"created_at":"2026-11-13T04:53:26.000Z","created_at_i":1794545606,"id":50478505,"options":[],"parent_id":50476566,"points":null,"story_id":50471731,"text":"&quot;Request of death&quot;","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T00:37:31.000Z","created_at_i":1794530251,"id":50476566,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"&quot;While the servers we&#x27;ve returned to service initially remain healthy, <i>we&#x27;ve observed that they can become unresponsive again once they begin receiving traffic.</i> We&#x27;re analyzing diagnostic data from these servers with our networking and platform experts to determine what&#x27;s triggering this behavior.&quot;<p>That sounds bad","title":null,"type":"comment","url":null},{"author":"BobBagwill","children":[],"created_at":"2026-11-13T01:00:02.000Z","created_at_i":1794531602,"id":50476736,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Future generations will look back on this day with thanks.\nThis is the day that Microsoft prevented the awakening of Skynet!\nAll hail Microsoft!","title":null,"type":"comment","url":null},{"author":"crabmusket","children":[],"created_at":"2026-11-13T01:34:15.000Z","created_at_i":1794533655,"id":50476975,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Since you posted a link to my local public broadcaster, I wanted to point this out:<p>&gt; [Home Affairs Minister Tony Burke] says the government has activated a digital resilience agreement with Microsoft today to ensure Australia gets priority:<p>&gt; &quot;That agreement has in fact been activated today to make sure that we get appropriate prioritisation of Australian interests in this across everything.<p>It&#x27;s a little pathetic-seeming to plead for special treatment from Microsoft. I get Australia is an important strategic alliance* for the US, but unless these resiliency agreements are rare... what meaningful prioritisation of &quot;Australian interests&quot; can we expect from MS?<p>*a useful staging ground to field subs into the South Pacific and Indian Ocean","title":null,"type":"comment","url":null},{"author":"pwthornton","children":[{"author":"llama052","children":[{"author":"rsalus","children":[{"author":"beoberha","children":[{"author":"Phileosopher","children":[],"created_at":"2026-11-13T05:35:40.000Z","created_at_i":1794548140,"id":50478792,"options":[],"parent_id":50477989,"points":null,"story_id":50471731,"text":"How much of it is deployed with nondeterministic tooling, though?<p>I remember their customer-side push for semantically merging Office and some other suites into something-or-other like 365 or Copilot, creating enormous confusion. I have difficulty believing MSFT distinguishes between handmade and machine-learning tooling in that type of environment.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:46:49.000Z","created_at_i":1794541609,"id":50477989,"options":[],"parent_id":50477607,"points":null,"story_id":50471731,"text":"Maybe years ago but definitely not today. But nice FUD","title":null,"type":"comment","url":null},{"author":"zombot","children":[{"author":"atom058","children":[],"created_at":"2026-11-13T16:15:20.000Z","created_at_i":1794586520,"id":50485668,"options":[],"parent_id":50478945,"points":null,"story_id":50471731,"text":"There is nothing micro about the amount of slop. MacroSlop.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:00:22.000Z","created_at_i":1794549622,"id":50478945,"options":[],"parent_id":50477607,"points":null,"story_id":50471731,"text":"I suspect there&#x27;s also a good amount of LLMs&#x2F;Agents in the mix. They have been rechristened to Microslop for a reason.","title":null,"type":"comment","url":null},{"author":"roncesvalles","children":[],"created_at":"2026-11-13T10:55:53.000Z","created_at_i":1794567353,"id":50481676,"options":[],"parent_id":50477607,"points":null,"story_id":50471731,"text":"Even as recently as 2022 (when I used to work there), infra-as-code use at Microsoft was still very nascent and non-standard. Infra at Microsoft was mostly &quot;ClickOps&quot;, with a ton of tribal undocumented knowledge about the right order to do things, changing the defaults, and things like that.<p>The amount of times we&#x27;ve had to reach out to an experienced person who had transferred to another team&#x2F;org about processes in our team was ridiculous.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:02:36.000Z","created_at_i":1794538956,"id":50477607,"options":[],"parent_id":50477100,"points":null,"story_id":50471731,"text":"There are huge swaths of azure engineering teams that deploy things entirely manually via azure portal. Insane.","title":null,"type":"comment","url":null},{"author":"senderista","children":[{"author":"mrdootdoot","children":[{"author":"encrypted_bird","children":[{"author":"cowlevel","children":[{"author":"encrypted_bird","children":[],"created_at":"2026-11-13T09:09:53.000Z","created_at_i":1794560993,"id":50480495,"options":[],"parent_id":50480406,"points":null,"story_id":50471731,"text":"Fair.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:00:06.000Z","created_at_i":1794560406,"id":50480406,"options":[],"parent_id":50478057,"points":null,"story_id":50471731,"text":"at something AWS scale something is always on fire, they probably measure disk head crashes per second, and they&#x27;re supposed to insulate it from their clients with layers of redundancy. If those layers are working, they&#x27;re doing it okay.<p>Above those layers is a ton of jank, e.g. Elastic Beanstalk. But my understanding is the fundamentals on AWS - compute, storage, networking - are pretty much rock-solid.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:54:38.000Z","created_at_i":1794542078,"id":50478057,"options":[],"parent_id":50477870,"points":null,"story_id":50471731,"text":"Or just not as badly.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:32:23.000Z","created_at_i":1794540743,"id":50477870,"options":[],"parent_id":50477620,"points":null,"story_id":50471731,"text":"That means AWS is doing it right, though","title":null,"type":"comment","url":null},{"author":"yolovoe","children":[],"created_at":"2026-11-13T04:49:25.000Z","created_at_i":1794545365,"id":50478482,"options":[],"parent_id":50477620,"points":null,"story_id":50471731,"text":"Can you clarify what you mean? Do you work there, or have you had negative experiences as a customer?<p>Disclosure: I work at AWS, at the core EC2 dataplane for many years now. We monitor our production environment very aggressively with tight SLAs that page us at night, and our technical leadership is competent as well.","title":null,"type":"comment","url":null},{"author":"globular-toast","children":[],"created_at":"2026-11-13T09:25:50.000Z","created_at_i":1794561950,"id":50480641,"options":[],"parent_id":50477620,"points":null,"story_id":50471731,"text":"The petrol in a four stroke internal combustion engine is on fire all the time too. The important part is nobody notices.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:04:05.000Z","created_at_i":1794539045,"id":50477620,"options":[],"parent_id":50477100,"points":null,"story_id":50471731,"text":"&gt; We use Azure at work and it\u2019s wild how much stuff is just manual labor behind the scenes on their platform.<p>AWS is no different. Everything is on fire all the time, but customers usually don&#x27;t notice.","title":null,"type":"comment","url":null},{"author":"stogot","children":[{"author":"isomorphic","children":[],"created_at":"2026-11-13T04:05:23.000Z","created_at_i":1794542723,"id":50478146,"options":[],"parent_id":50477999,"points":null,"story_id":50471731,"text":"Management by Objectives?<p>(Although I like the idea of Management BuyOut, too.)","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:48:03.000Z","created_at_i":1794541683,"id":50477999,"options":[],"parent_id":50477100,"points":null,"story_id":50471731,"text":"What is MBO?","title":null,"type":"comment","url":null},{"author":"atraac","children":[{"author":"gunsle","children":[{"author":"llama052","children":[],"created_at":"2026-11-13T22:50:25.000Z","created_at_i":1794610225,"id":50491248,"options":[],"parent_id":50486150,"points":null,"story_id":50471731,"text":"Hardly, Microsofts docs will actively lie to you on functionality and features. Even pointing claude at them will run opus around in circles realizing it&#x27;s not concrete at all.<p>If the docs are correct I&#x27;m sure they&#x27;ll depreciate the offering and rename it to something else and leave you on an island either way.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T16:48:21.000Z","created_at_i":1794588501,"id":50486150,"options":[],"parent_id":50481035,"points":null,"story_id":50471731,"text":"I will never understand people crying about MS and Azure when AWS and GCP support are 10x worse. At least Microsoft usually has decent docs and support.","title":null,"type":"comment","url":null},{"author":"sov","children":[],"created_at":"2026-11-13T17:33:28.000Z","created_at_i":1794591208,"id":50486802,"options":[],"parent_id":50481035,"points":null,"story_id":50471731,"text":"&gt; I worked with Azure at previous jobs a lot and never had any really big issues<p>to what extent, though? over the course of my working with azure, ive been disappointed constantly, by just about every service i&#x27;ve used. things that should work a particular way don&#x27;t, and when you try to investigate you end up in a maze of out-of-date and&#x2F;or totally wrong documentation. i&#x27;ve started a project before, followed their precise &quot;quick start!&quot; guide to the letter, and find it totally non-functional and wrong.<p>things that DO work end getting updated (often due to financial incentives) and break, or shuddered entirely. some values that you might want to change for certain services are hard-coded (which, to their credit, you can verify from their public github repos) for ostensibly no reason. a lot of their documentation is internal only, and the public facing stuff feels perennially out-of-season.<p>(opinion) i feel like fundamentally microsoft has embraced ai development so wholly because they&#x27;ve not been able to describe their services in documentation very well, and thus rely heavily on the ai&#x27;s ability to digest what scraps of truth remain and the various source code to be effective at delivering output","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:02:09.000Z","created_at_i":1794564129,"id":50481035,"options":[],"parent_id":50477100,"points":null,"story_id":50471731,"text":"I read opinions like those but then I worked with Azure at previous jobs a lot and never had any really big issues. On the other side, I just tried using AWS for a small Saas of mine and after setting up SES, I got a shady email, from non-defult support amazon domain that I need to send them scans of my personal documents. Link in that email was blocked by uBlock Origin, domain was not the same as other emails, not a single notification in AWS Support Console anywhere so I ignored it as phishing. Got suspended two weeks later, not a single human in sight within 48 hours of me making a ticket, I just gave up and moved emails to Cloudflare. If I had actual real clients at that phase I&#x27;d be pretty pissed. I genuinely don&#x27;t know how people blindly trust AWS with everything these days, it&#x27;s 2026 and there&#x27;s still not even a hard billing limit built into AWS.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:55:34.000Z","created_at_i":1794534934,"id":50477100,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"I\u2019d imagine they are going to get a massive drain of whatever talent is left from their company wide severance as well.<p>We use Azure at work and it\u2019s wild how much stuff is just manual labor behind the scenes on their platform.<p>Seems like it\u2019s always on fire somewhere, ripe for burnout and MBOs aren\u2019t aligned with reality from what I hear.","title":null,"type":"comment","url":null},{"author":"12_throw_away","children":[{"author":"soci","children":[{"author":"quii","children":[],"created_at":"2026-11-13T11:58:28.000Z","created_at_i":1794571108,"id":50482259,"options":[],"parent_id":50479565,"points":null,"story_id":50471731,"text":"I&#x27;m sure &quot;productivity per employee&quot; is definitely not a daft vanity metric","title":null,"type":"comment","url":null},{"author":"awesomegoat_com","children":[{"author":"soci","children":[],"created_at":"2026-11-13T16:20:25.000Z","created_at_i":1794586825,"id":50485740,"options":[],"parent_id":50485223,"points":null,"story_id":50471731,"text":"You are right, thank you. I suspect they would have layed off people in certain areas to milk the cow, while invested in hiring talent in areas of growth. Still no evident correlation between layoffs and the current blackout incident  mostly affecting the Cloud business.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T15:46:59.000Z","created_at_i":1794584819,"id":50485223,"options":[],"parent_id":50479565,"points":null,"story_id":50471731,"text":"In all fairness, Microsoft really did layed off low double digit % of workforce since 2022.<p>The total populace did not change, because it was replaced by new &quot;talent&quot;.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:18:28.000Z","created_at_i":1794554308,"id":50479565,"options":[],"parent_id":50477230,"points":null,"story_id":50471731,"text":"Microsoft has not layed off half of its workers:\n2021-2026: +23% employees\n2024-2026: -2% employees<p>What changed is the productivity per employee:\n2021-2026: +60%\n2024-2026: +38%<p>To be honest, I also assumed your take on this at first. But after a bit of research I found quite a different reality!","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:16:22.000Z","created_at_i":1794536182,"id":50477230,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"I don&#x27;t know exactly what&#x27;s going on with today&#x27;s outage.<p>But this is certainly <i>exactly what I&#x27;d expect</i> after indiscriminately laying off half your workers, then immediately offering a buyout to make sure any experienced people still standing will find their way to the door.<p>If this incident, or the difficulty they&#x27;re having with remediation (update: holy shit, they still haven&#x27;t even identified the <i>problem</i>), are somehow <i>not</i> caused by any of that, then it&#x27;s at least a preview of what things are going to be like.","title":null,"type":"comment","url":null},{"author":"AIorNot","children":[{"author":"jwilcoxson","children":[],"created_at":"2026-11-13T02:31:38.000Z","created_at_i":1794537098,"id":50477354,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"Yup.","title":null,"type":"comment","url":null},{"author":"fractal618","children":[{"author":"tapland","children":[{"author":"cowlevel","children":[],"created_at":"2026-11-13T09:03:42.000Z","created_at_i":1794560622,"id":50480444,"options":[],"parent_id":50477703,"points":null,"story_id":50471731,"text":"and that&#x27;s crazy because traditionally Linux would drain your battery faster because it was lacking all the power optimisations. It still is, but windows must&#x27;ve gotten so bloated it&#x27;s worse now.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:13:40.000Z","created_at_i":1794539620,"id":50477703,"options":[],"parent_id":50477535,"points":null,"story_id":50471731,"text":"Battery gains on laptops are insane. Swapped a month ago on one, still need windows stuff on the other, but same model and one last all day and one has to be plugged in each session.","title":null,"type":"comment","url":null},{"author":"elboru","children":[],"created_at":"2026-11-13T03:32:33.000Z","created_at_i":1794540753,"id":50477874,"options":[],"parent_id":50477535,"points":null,"story_id":50471731,"text":"It&#x27;s been three months since I switched to Arch. I&#x27;ve had a couple of hiccups that I couldn&#x27;t resolve with an agent, or that I simply didn&#x27;t want to spend too much time troubleshooting. Other than that, performance has been absolutely amazing. My terminal and browser open in milliseconds, not seconds. Even the heavy system I work on builds and loads in seconds instead of minutes. If I don&#x27;t like a particular configuration, I can simply ask my agent to change it. Linux is GREAT in the agent era.","title":null,"type":"comment","url":null},{"author":"thirtygeo","children":[],"created_at":"2026-11-13T05:53:55.000Z","created_at_i":1794549235,"id":50478902,"options":[],"parent_id":50477535,"points":null,"story_id":50471731,"text":"Loving Mint as well! Just switched a second PC over from win 11","title":null,"type":"comment","url":null},{"author":"pndy","children":[],"created_at":"2026-11-13T08:57:18.000Z","created_at_i":1794560238,"id":50480375,"options":[],"parent_id":50477535,"points":null,"story_id":50471731,"text":"I tried few distros including Mint but in the end CachyOS was one that works for me best. But I still got this W11 virtual machine where I can see how the system &quot;evolves&quot;, and it still baffles me that Microsoft has the audacity to throw message saying &quot;<i>Windows Update is committed to helping reduce carbon emissions</i>&quot; and having &quot;<i>Energy recommendations</i>&quot; that &quot;<i>Lower your carbon footprint</i>&quot; where background processes continue to drain machine resources at random intervals since W10","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:55:14.000Z","created_at_i":1794538514,"id":50477535,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"I made the switch to Linux Mint and it\u2019s wonderful and almost triples my battery life. I\u2019m also in the process of switching to a phone with graphene os which runs like butter and feels so much more secure, safe and private.","title":null,"type":"comment","url":null},{"author":"OhMeadhbh","children":[],"created_at":"2026-11-13T04:20:34.000Z","created_at_i":1794543634,"id":50478273,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"Oh man.  Do not look at the Darwin source code with remaining eye.","title":null,"type":"comment","url":null},{"author":"fodkodrasz","children":[],"created_at":"2026-11-13T05:55:04.000Z","created_at_i":1794549304,"id":50478909,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"Crappy as in doesn&#x27;t need third party full access to all accessibility untrusted toold for stuff like mouse scrolling the currect direction, volume control on external hdmi monitors, being able to navigate the UI using a keyboard, having the computer staying running when connected to a power source, etc?<p>One has to spend more on third party tools for getting MacOS to feature parity with a windows than a Win Pro license...<p>Linux is fine on the other hand, but you compared to a joke of an operating system.","title":null,"type":"comment","url":null},{"author":"Selector8801","children":[{"author":"edstarch","children":[],"created_at":"2026-11-13T09:59:37.000Z","created_at_i":1794563977,"id":50481001,"options":[],"parent_id":50479287,"points":null,"story_id":50471731,"text":"The nice part is that it\u2019s just Unix with a decently stable (for a time lol) and professionally designed UI layer.","title":null,"type":"comment","url":null},{"author":"pwthornton","children":[],"created_at":"2026-11-13T15:22:42.000Z","created_at_i":1794583362,"id":50484869,"options":[],"parent_id":50479287,"points":null,"story_id":50471731,"text":"People use it every day to create and build stuff. That&#x27;s always been MacOS&#x27;s legacy.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:43:11.000Z","created_at_i":1794552191,"id":50479287,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"MacOS honestly feels like a toy OS for kids.","title":null,"type":"comment","url":null},{"author":"gambiting","children":[{"author":"worik","children":[],"created_at":"2026-11-13T08:10:57.000Z","created_at_i":1794557457,"id":50480002,"options":[],"parent_id":50479655,"points":null,"story_id":50471731,"text":"The Rot has set in at Apple,  too","title":null,"type":"comment","url":null},{"author":"disgruntledphd2","children":[],"created_at":"2026-11-13T08:32:16.000Z","created_at_i":1794558736,"id":50480185,"options":[],"parent_id":50479655,"points":null,"story_id":50471731,"text":"&gt; hate windows for whatever reason go straight to Linux,<p>Honestly, for personal machines the M series is wonderful hardware, and I have young kids so no time to tune Linux (I ran it at home for around a decade or so).<p>But yeah, the interface has many, many bugs.<p>My &quot;favourite&quot; (new) bug is that sometimes you can&#x27;t move a window from the laptop screen to another screen. It goes away if you full screen the app, but it&#x27;s bizarre to me that it made it to production.","title":null,"type":"comment","url":null},{"author":"pwthornton","children":[],"created_at":"2026-11-13T15:15:35.000Z","created_at_i":1794582935,"id":50484753,"options":[],"parent_id":50479655,"points":null,"story_id":50471731,"text":"I develop enterprise SaaS apps, and MacOS just works for me, so I guess your mileage may vary.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:32:18.000Z","created_at_i":1794555138,"id":50479655,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"&gt;&gt;Btw does everyone see how insanely crappy Windows 11 is compared to MacOS<p>This is just an anecdote, but I have the exact opposite experience. I&#x27;m a C++ games developer working on Windows 11 every day and other than the micro frustrations with stupid UI, the system <i>just</i> works. I know I can rely on it day to day. But I was also given a MacBook last year for our iOS ports and I don&#x27;t understand how anyone considers it a serious operating system for work - it&#x27;s full of bugs to a point where I started using AI to work around some of them.  I thought maybe MacOS 27 would fix some of them and sure it did - but then it introduced a whole bunch of new ones. As a developer it&#x27;s probably the worst OS you could pick - if you hate windows for whatever reason go straight to Linux, at least you have actual control over your OS compared to MacOS where basic things like spotlight are broken and there&#x27;s no way to fix them other than add to the thousands of complaints on apple forums.","title":null,"type":"comment","url":null},{"author":"eddythompson80","children":[{"author":"codethief","children":[{"author":"eddythompson80","children":[{"author":"cowlevel","children":[{"author":"j16sdiz","children":[{"author":"cowlevel","children":[{"author":"eddythompson80","children":[],"created_at":"2026-11-13T13:07:25.000Z","created_at_i":1794575245,"id":50482979,"options":[],"parent_id":50481934,"points":null,"story_id":50471731,"text":"I&#x27;m not really sure I&#x27;m understand what you&#x27;re trying to say tbh. Though tangentially what even is the Cybertruck market segment to begin with?<p>On profitable products though; sure as a general concept, but the rate of return, opportunity cost and market competition factor into the profitability equation too. You could go waste your time building a desktop app for a chatgpt clone and make some &quot;profit&quot; in the same time your competitor threw similar resources at making a claude code and that makes 100x your profit. That would mean you actually lost despite the profit. The opportunity cost isn&#x27;t only in building the wrong thing, but also in the human resources you allocated to the task that deprived other areas. I see no world where the 6 dozen copilots we got from Microsoft have any good ROI beyond diluting a brand and making them more of a laughing stock.","title":null,"type":"comment","url":null},{"author":"danaris","children":[{"author":"cowlevel","children":[{"author":"danaris","children":[],"created_at":"2026-11-13T18:31:43.000Z","created_at_i":1794594703,"id":50487734,"options":[],"parent_id":50486955,"points":null,"story_id":50471731,"text":"Well, one of the things that I&#x27;m very, very certain is beneficial to society as a whole is getting the fascists and those who think that profit should be the first, last, and only concern out of power now and forever.<p>So fortunately, there&#x27;s not really an incompatibility there.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T17:41:02.000Z","created_at_i":1794591662,"id":50486955,"options":[],"parent_id":50483462,"points":null,"story_id":50471731,"text":"What good is thinking about the most beneficial things to society if you and your faction will never have the power to implement them or even to persuade those who do have that power?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:49:51.000Z","created_at_i":1794577791,"id":50483462,"options":[],"parent_id":50481934,"points":null,"story_id":50471731,"text":"Hell no.<p>We need to rewire ourselves to think about things that are <i>beneficial to society as a whole.</i> Not &quot;profitable.&quot; Profit just means more money going from the many to the few. That&#x27;s what&#x27;s gotten us into this awful situation.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:21:35.000Z","created_at_i":1794568895,"id":50481934,"options":[],"parent_id":50480841,"points":null,"story_id":50471731,"text":"We need to rewire ourselves to think about things that are profitable and useful. People prefer something that&#x27;s expensive and useful over something that&#x27;s just expensive. For some reason though it&#x27;s only the people who are making useless things who are making anything at all. Nobody else tapped into the Cybertruck market segment at all.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:45:38.000Z","created_at_i":1794563138,"id":50480841,"options":[],"parent_id":50480453,"points":null,"story_id":50471731,"text":"This mindset is what makes this society so depressing","title":null,"type":"comment","url":null},{"author":"pwthornton","children":[],"created_at":"2026-11-13T15:18:16.000Z","created_at_i":1794583096,"id":50484797,"options":[],"parent_id":50480453,"points":null,"story_id":50471731,"text":"If the Cybertruck were making good money it wouldn&#x27;t be getting canceled a few years into its run on the market. No car company does that to successful products.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:04:35.000Z","created_at_i":1794560675,"id":50480453,"options":[],"parent_id":50480250,"points":null,"story_id":50471731,"text":"The Cybertruck was a success if it made a profit overall. So was Copilot. The point is to make money, not to make good products.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:40:21.000Z","created_at_i":1794559221,"id":50480250,"options":[],"parent_id":50480234,"points":null,"story_id":50471731,"text":"There are people who bought Cybertrucks too you know.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:38:28.000Z","created_at_i":1794559108,"id":50480234,"options":[],"parent_id":50479673,"points":null,"story_id":50471731,"text":"&gt; instead focused on half assed Windows or Office apps and integrations that no one will ever use.<p>I actually know quite a few (non-tech) people that love to use Copilot in those apps. So I&#x27;m not sure it&#x27;s as big of a fuck-up as you think it is (or as I certainly used to think it is).","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:34:03.000Z","created_at_i":1794555243,"id":50479673,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"Nadella&#x27;s AI fumble is a true generational fuck up. They had OpenAI, they had complete access to GPT models before any one, they even had the first coding assistant concept.<p>Then due to typical clueless management and lack of taste and complete buffoonery, they just fucked it all up. I&#x27;m not complaining because I think everyone is better off, but it&#x27;s just amazing to have witnessed that even when they luck out on a bet, they manage to fuck it up. Copilot started as a coding assistant, and before it could breath they destroyed the brand by shoving the name into literally everything without thinking or taste. Ignored the coding part, because that&#x27;s lame, and instead focused on half assed Windows or Office apps and integrations that no one will ever use. Once claude code dominated the scene, they realized the major fuckup and tried to catch up, but it&#x27;s too little too late.<p>Again, not complaining really.","title":null,"type":"comment","url":null},{"author":"pwthornton","children":[],"created_at":"2026-11-13T15:10:19.000Z","created_at_i":1794582619,"id":50484681,"options":[],"parent_id":50477286,"points":null,"story_id":50471731,"text":"I don&#x27;t understand how basically everything has languished under Nadella. Apple doesn&#x27;t sell MacOS, so it should be less incentivized to keep improving it, but it is way better than Windows and the gap keeps widening. If I didn&#x27;t use MacOS, I would just use Linux.<p>Windows does always cater to backwards companility and making IT departments happy, so that explains some of the lagging technology and systems. I can&#x27;t believe NTFS is still the default file systems. That&#x27;s generations behind Apple&#x27;s APFS.<p>The stock has popped, and that&#x27;s what Wall Street cares about, but I could see a world where this chronic underinvestment and mismanagement basically implodes the entire company in the coming years.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:23:19.000Z","created_at_i":1794536599,"id":50477286,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"So a few years ago Nadella was a God among CEOs capturing OpenAI at the right time etc..but yeah laying off thousands of tenured folks surely is great strategy, god I hate the tech industry.<p>Btw does everyone see how insanely crappy Windows 11 is compared to MacOS","title":null,"type":"comment","url":null},{"author":"juujian","children":[{"author":"OnlineTux","children":[{"author":"djray","children":[{"author":"MistyMountain","children":[],"created_at":"2026-11-13T03:40:14.000Z","created_at_i":1794541214,"id":50477933,"options":[],"parent_id":50477899,"points":null,"story_id":50471731,"text":"Might not be confirmed but it was part of an article that MS approved of. They appear to be testing the waters.","title":null,"type":"comment","url":null},{"author":"hereonout2","children":[{"author":"teamonkey","children":[],"created_at":"2026-11-13T15:21:34.000Z","created_at_i":1794583294,"id":50484851,"options":[],"parent_id":50477998,"points":null,"story_id":50471731,"text":"I suspect if the threat of AI cloning pans out as some say, we may see a sharp return to streaming - perhaps devs releasing on streaming platforms only - as an ultimate form of anti-piracy","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:47:57.000Z","created_at_i":1794541677,"id":50477998,"options":[],"parent_id":50477899,"points":null,"story_id":50471731,"text":"I&#x27;m not a big gamer but unlimited cloud gaming seemed too good to be true to me. It was a self defeating product offering for Microsoft.<p>It works perfectly on a fast home connection over ethernet, mind blowing how responsive it is and load times are non existent.<p>But as far as I can tell most people subscribe to game pass anyway? Why buy the hardware at all when I can just cloud game in the same subscription.\n.","title":null,"type":"comment","url":null},{"author":"whizzter","children":[{"author":"djray","children":[{"author":"whizzter","children":[],"created_at":"2026-11-16T16:03:39.000Z","created_at_i":1794845019,"id":50519099,"options":[],"parent_id":50482946,"points":null,"story_id":50471731,"text":"Hmm, seems that there was Series S for the equivalent of 530 UKP but hardly any of those in stock, the prices seems to be wildly spread (probably due to the previous&#x2F;current supply issues?).","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:04:53.000Z","created_at_i":1794575093,"id":50482946,"options":[],"parent_id":50480719,"points":null,"story_id":50471731,"text":"At least here in the UK, that&#x27;s off by a lot.<p>Here, Series S is \u00a3400-\u00a3430 for 512GB or \u00a3500-\u00a3520 for 1TB.<p>Xbox Series X is \u00a3600-\u00a3620 for digital 1TB or \u00a350 more for the disc version. That&#x27;s much more than I paid for mine a year after launch (\u00a3450 I think), but luckily still nowhere near 1700 Euros.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:33:20.000Z","created_at_i":1794562400,"id":50480719,"options":[],"parent_id":50477899,"points":null,"story_id":50471731,"text":"Series&#x2F;S costs 1000 Euros and Series&#x2F;X costs about 1700 right now so it&#x27;ll likely be even higher unless ram prices finally crash.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:34:56.000Z","created_at_i":1794540896,"id":50477899,"options":[],"parent_id":50477408,"points":null,"story_id":50471731,"text":"No, the Game Pass limitation is for _streaming_ the games. You can play and download as much as you want.<p>New Xbox cost is not confirmed.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:39:24.000Z","created_at_i":1794537564,"id":50477408,"options":[],"parent_id":50477338,"points":null,"story_id":50471731,"text":"Massive layoffs and studio closures and mergers like Obsidian merged with Bethesda.<p>New Xbox to cost $1200-$1800.<p>Gamepass limited to 15 hours a month for Ultimate.","title":null,"type":"comment","url":null},{"author":"EmX_3000","children":[],"created_at":"2026-11-13T03:10:25.000Z","created_at_i":1794539425,"id":50477670,"options":[],"parent_id":50477338,"points":null,"story_id":50471731,"text":"It&#x27;ll probably be an app instead of its own thing in the future. For Pluton-enabled systems only of course.","title":null,"type":"comment","url":null},{"author":"hbn","children":[],"created_at":"2026-11-13T05:20:50.000Z","created_at_i":1794547250,"id":50478683,"options":[],"parent_id":50477338,"points":null,"story_id":50471731,"text":"&gt; Hadn&#x27;t heard about Xbox<p>Indeed you\u2019re seeing the consequences of their past decade+ of management","title":null,"type":"comment","url":null},{"author":"tame3902","children":[{"author":"whizzter","children":[{"author":"ngcazz","children":[],"created_at":"2026-11-13T10:59:23.000Z","created_at_i":1794567563,"id":50481710,"options":[],"parent_id":50480706,"points":null,"story_id":50471731,"text":"Well, speaking for myself, paying the new console premium for my PS5 turned out to be a decent deal given used ones go for about the same at the moment...","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:31:41.000Z","created_at_i":1794562301,"id":50480706,"options":[],"parent_id":50479577,"points":null,"story_id":50471731,"text":"I&#x27;m usually late in getting new console generations (didn&#x27;t care for paying for new generation premium), so I remember looking to buy an Series S&#x2F;X a year ago and it wasn&#x27;t anywhere, there was wild speculation about a new generation or those handheld things taking over.<p>It seems to be back in stock now, but at a cost of about 1000 Euros for a Series&#x2F;S I&#x27;m not really feeling enticed even if GTA 6 is around the corner. They probably really shot themselves in the foot by not having units out a year ago and now fewer will buy due to pricing.","title":null,"type":"comment","url":null},{"author":"Cthulhu_","children":[{"author":"zenithirl","children":[],"created_at":"2026-11-13T11:33:52.000Z","created_at_i":1794569632,"id":50482037,"options":[],"parent_id":50480901,"points":null,"story_id":50471731,"text":"I think they&#x27;ve broken the trust with exclusives and don&#x27;t think they can get it back quickly, almost all of the best PS4 exclusives that I can think of ended up on PC anyway. Exclusives won&#x27;t be a factor for me when weighing up a PS6","title":null,"type":"comment","url":null},{"author":"pwthornton","children":[],"created_at":"2026-11-13T14:48:26.000Z","created_at_i":1794581306,"id":50484316,"options":[],"parent_id":50480901,"points":null,"story_id":50471731,"text":"Xbox Live subs are something like half of what they projected. This is why they are closing so many studios and laying people off. Xbox Live is not bringing in the money.<p>They need to sell consoles to get people to become subscribers.","title":null,"type":"comment","url":null},{"author":"teamonkey","children":[],"created_at":"2026-11-13T15:19:09.000Z","created_at_i":1794583149,"id":50484813,"options":[],"parent_id":50480901,"points":null,"story_id":50471731,"text":"They seemed to have backtracked on the no-console approach. In fact, their entire Xbox strategy seems to have flipped 180 in the last year.<p>Nothing to do with today\u2019s outage though.","title":null,"type":"comment","url":null},{"author":"hbn","children":[],"created_at":"2026-11-13T16:07:09.000Z","created_at_i":1794586029,"id":50485558,"options":[],"parent_id":50480901,"points":null,"story_id":50471731,"text":"Xbox Live is the old subscription service, it has since morphed into Xbox Game Pass which is the monthly subscription to access a bunch of games (as well as online features Xbox Live offered before)<p>Xbox Game Pass was an attractive offer for consumers when MS was getting people onboard and the price was so heavily subsidized that it could never have been a sustainable model. Once they tried to start bumping the price into something profitable people immediately said &quot;okay well that&#x27;s clearly not worth it, I&#x27;ll just cancel.&quot;<p>They attempted to make it $30&#x2F;month last year before backtracking. At $360&#x2F;year, even factoring in the new $70 price of AAA new releases and ignoring you can wait a few months to buy them cheaper, you had to be buying 5 new release games per year at launch just to get close to breaking even with the subscription price. 6 before you save money. So...<p>&gt; It&#x27;s a really attractive offering for people who don&#x27;t play games all that much (that is, more than 2 hours a day)<p>No, it&#x27;s absolutely not worth it for these people. Even at the current prices they backtracked to ($280&#x2F;year if you want to play new releases on day 1), if you&#x27;re a person who doesn&#x27;t game that much, it&#x27;s cheaper to just buy a few new games per year. If you&#x27;re not a frequent gamer, why would you of all people need access to a massive library of games?<p>I personally have a backlog of 45 games I want to play written down in a note. And those are just the ones I wrote down. Most of these games you can get for peanuts. I just played through Fallout New Vegas for my first time. It regularly goes on sale for $0.99, or $5 if you want all the DLC. I got 90 hours of playtime out of that.<p>The idea any casual gamers should be paying for a subscription service to a Netflix-style game library is nuts to me. These aren&#x27;t movies and tv shows you&#x27;ll be flying through every evening, they&#x27;re big games that can take weeks to play even if you&#x27;re putting in a few hours per day.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:50:40.000Z","created_at_i":1794563440,"id":50480901,"options":[],"parent_id":50479577,"points":null,"story_id":50471731,"text":"Their console is no longer their primary objective though, xbox live is where it&#x27;s at - tons of people did the math, why buy a console when you can get a subscription with tons of games for 3+ years for the same money instead? It&#x27;s a really attractive offering for people who don&#x27;t play games all that much (that is, more than 2 hours a day).<p>I think Sony is shooting themselves in the foot with the digital only consoles too - unless they maintain a very attractive set of exclusives at all times, people will just choose whichever digital subscription is best or cheapest for them instead of something tied to a particular console.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:20:12.000Z","created_at_i":1794554412,"id":50479577,"options":[],"parent_id":50477338,"points":null,"story_id":50471731,"text":"The sales have fallen off compared to the Playstation.<p>A quick google search turned up these global sales numbers: PS3 87.40 million, PS4 117.20 million, PS5 96.44 million. Xbox 360 85.73 million, Xbox One 57.96 million, Xbox Series X&#x2F;S 35.68 million.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:28:40.000Z","created_at_i":1794536920,"id":50477338,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"Hadn&#x27;t heard about Xbox, what&#x27;s happening?","title":null,"type":"comment","url":null},{"author":"kstrauser","children":[{"author":"nullwarp","children":[],"created_at":"2026-11-13T03:04:41.000Z","created_at_i":1794539081,"id":50477623,"options":[],"parent_id":50477484,"points":null,"story_id":50471731,"text":"This really is the honest truth, every interaction I have with the MS platform is somehow worse than an actual dumpster fire. AI is the only thing keeping the ship afloat. Then again maybe that&#x27;s the point?","title":null,"type":"comment","url":null},{"author":"k0morebi","children":[{"author":"thirtygeo","children":[{"author":"EvanAnderson","children":[],"created_at":"2026-11-13T06:03:53.000Z","created_at_i":1794549833,"id":50478973,"options":[],"parent_id":50478897,"points":null,"story_id":50471731,"text":"The &quot;Advanced Find&quot; in pre-2016 versions of Outlook was superb. Then it was &quot;de-emphasized&quot; for the crap search that followed.","title":null,"type":"comment","url":null},{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T20:15:17.000Z","created_at_i":1794600917,"id":50489034,"options":[],"parent_id":50478897,"points":null,"story_id":50471731,"text":"Especially when they bought a superb product just for searching Outlook (LookOut), incorporated it into Windows Search and somehow destroyed it in the process.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:52:47.000Z","created_at_i":1794549167,"id":50478897,"options":[],"parent_id":50478256,"points":null,"story_id":50471731,"text":"I&#x27;m so deeply perplexed by how bad Outlook search is","title":null,"type":"comment","url":null},{"author":"ezst","children":[{"author":"k0morebi","children":[],"created_at":"2026-11-13T19:30:49.000Z","created_at_i":1794598249,"id":50488536,"options":[],"parent_id":50482258,"points":null,"story_id":50471731,"text":"I used legacy relatively happily when I had a windows laptop, but recently switched to a MacBook and it either forced migration or was already the new version (don&#x27;t remember). The macos outlook is a bit borked too. Beyond the typical level for outlook. Can&#x27;t create or edit rules anymore that save to server. Need to go into the web version via browser.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:58:26.000Z","created_at_i":1794571106,"id":50482258,"options":[],"parent_id":50478256,"points":null,"story_id":50471731,"text":"Did you make the mistake of enabling the &quot;new&quot; (web-based) outlook? At least AFAICT, the &quot;classic&quot; one hasn&#x27;t regressed much&#x2F;at all","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:18:45.000Z","created_at_i":1794543525,"id":50478256,"options":[],"parent_id":50477484,"points":null,"story_id":50471731,"text":"I have the pro Microsoft copilot subscription at work just so I can search Outlook and teams since the native search doesn&#x27;t turn up things when I search exact strings that are in the messages or use filters for other things like sender or recipient. Crazy to have to use an llm just to find an email","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:50:35.000Z","created_at_i":1794538235,"id":50477484,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"OTOH, I couldn\u2019t manage Entra without their AI chatbot. That system is a Lovecraftian stack of sadness built upon despair, of which mortals are not meant to know.","title":null,"type":"comment","url":null},{"author":"Gaussian","children":[{"author":"disgruntledphd2","children":[],"created_at":"2026-11-13T08:29:56.000Z","created_at_i":1794558596,"id":50480159,"options":[],"parent_id":50477756,"points":null,"story_id":50471731,"text":"&gt; Fabric<p>I see what you did there.<p>Fabric is a weird one, as it&#x27;s sortof a GUI over spark, but also PowerBI and lots of weird services.<p>It feels like a &quot;data plaform&quot; for people who&#x27;ve never used one before and only have the vaguest idea of what it means.<p>That being said, Spark is pretty good and we&#x27;re running a <i>lot</i> of workflows on it (and probably building more on top, I suspect that I&#x27;ll be much angrier about it in approximately 6 months or so).","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:20:05.000Z","created_at_i":1794540005,"id":50477756,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"Janky is part of the Fabric at Microsoft. I don\u2019t feel like that\u2019s new\u2026","title":null,"type":"comment","url":null},{"author":"victor106","children":[{"author":"singingfish","children":[],"created_at":"2026-11-13T04:34:31.000Z","created_at_i":1794544471,"id":50478382,"options":[],"parent_id":50478307,"points":null,"story_id":50471731,"text":"I am aware that the authentication subsystems have major structural problems which make finding things like exfiltration bugs in azure surprisingly common.  I suspect the current incident is related.  I&#x27;m hoping it&#x27;s also caused by too much insufficiently supervised AI coding on poor architectural foundations, and that being caused by that will be obvious and hopefully become public.  But that&#x27;s just speculation on my part.","title":null,"type":"comment","url":null},{"author":"mattoxic","children":[{"author":"syshyk","children":[{"author":"disgruntledphd2","children":[],"created_at":"2026-11-13T08:24:30.000Z","created_at_i":1794558270,"id":50480112,"options":[],"parent_id":50479916,"points":null,"story_id":50471731,"text":"&gt; Vendor lock in is always a thing really<p>Yeah, and additionally if all your counterparties are on it, you can externalise your internal tools onto them relatively easily.<p>This mostly doesn&#x27;t work, but it&#x27;s a beautiful dream for executives.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:01:00.000Z","created_at_i":1794556860,"id":50479916,"options":[],"parent_id":50478451,"points":null,"story_id":50471731,"text":"Vendor lock in is always a thing really, you don&#x27;t always get choice in SaaS providers and how they auth. Could of course choose another SaaS provider but then that starts reducing the pool, assuming you have alternatives.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:43:52.000Z","created_at_i":1794545032,"id":50478451,"options":[],"parent_id":50478307,"points":null,"story_id":50471731,"text":"My take is the reason companies use Azure is lack of imagination. Like Service Now. Just horrible software, and thems that make the decision to buy it aren&#x27;t the one&#x27;s who have to use it.","title":null,"type":"comment","url":null},{"author":"Mudbugs","children":[],"created_at":"2026-11-13T09:26:29.000Z","created_at_i":1794561989,"id":50480648,"options":[],"parent_id":50478307,"points":null,"story_id":50471731,"text":"After the last couple of updates on entra, where you keep getting the &quot;loading dots&quot; to just pull up is insane. I still use Azure or PowerShell to do the task by the time it can &quot;load up&quot;.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:24:58.000Z","created_at_i":1794543898,"id":50478307,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"Entra And Azure are terrible.<p>Ui is clunky, they are terribly slow.<p>The only reason companies use Entra is it appears cheaper but eventually you pay as much as competitors. Okta is a way better IAM solution if you need one. Although it\u2019s very pricey.","title":null,"type":"comment","url":null},{"author":"thewhitetulip","children":[{"author":"yks","children":[{"author":"thewhitetulip","children":[],"created_at":"2026-11-13T06:42:29.000Z","created_at_i":1794552149,"id":50479282,"options":[],"parent_id":50478746,"points":null,"story_id":50471731,"text":"You had me in the first half.<p>I agree. All the execs need to do is tell Copilot to &quot;fix this so that it never happens again. Make no mistakes&quot; and run it on bypass permissions. Tada!","title":null,"type":"comment","url":null},{"author":"freetanga","children":[],"created_at":"2026-11-13T07:52:53.000Z","created_at_i":1794556373,"id":50479848,"options":[],"parent_id":50478746,"points":null,"story_id":50471731,"text":"Fuck, thanks god I am retiring soon.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:28:29.000Z","created_at_i":1794547709,"id":50478746,"options":[],"parent_id":50478330,"points":null,"story_id":50471731,"text":"You don&#x27;t understand, the agents aren&#x27;t fixing the outage because those human engineers didn&#x27;t make the infrastructure AI first. The only possible follow-up from this is that the faulty infra needs to be completely thrown away in favor of the vibecoded replacement.","title":null,"type":"comment","url":null},{"author":"Rantenki","children":[{"author":"thewhitetulip","children":[],"created_at":"2026-11-13T06:41:39.000Z","created_at_i":1794552099,"id":50479276,"options":[],"parent_id":50478914,"points":null,"story_id":50471731,"text":"Damn it! If only their Copilot was working! Outage resolved under 300 milli seconds!<p>Maybe they can use azure hosted openai models? Or are they down as well?<p>Just was a perfect opportunity to showcase astra and fable and other models","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:55:41.000Z","created_at_i":1794549341,"id":50478914,"options":[],"parent_id":50478330,"points":null,"story_id":50471731,"text":"I&#x27;m sure they would love to try, but Copilot is also offline according to the status page.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:27:42.000Z","created_at_i":1794544062,"id":50478330,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"I am surprised no executive used Copilot to type &quot;Bring Microsoft 365 up. Make no mistakes&quot;.. should&#x27;ve been a quick task with SuperIntelligence!","title":null,"type":"comment","url":null},{"author":"hn_submit","children":[{"author":"disgruntledphd2","children":[{"author":"edstarch","children":[{"author":"cowlevel","children":[],"created_at":"2026-11-13T09:01:45.000Z","created_at_i":1794560505,"id":50480422,"options":[],"parent_id":50480231,"points":null,"story_id":50471731,"text":"And Microsoft is being smart by cultivating this worldview. Open source has no such thing. In general, the company with the best marketing can be expected to win the market. Product quality plays only a minor role.<p>Microsoft also sells contracts to companies and open source does not. If &quot;open source&quot; does, it&#x27;s someone like Red Hat who has to take on all the legal responsibility themselves, just like Microsoft does, and that makes the product as expensive as Microsoft&#x27;s, only it&#x27;s not subsidized by mass surveillance so it&#x27;s even more expensive.","title":null,"type":"comment","url":null},{"author":"dijksterhuis","children":[],"created_at":"2026-11-13T13:44:19.000Z","created_at_i":1794577459,"id":50483379,"options":[],"parent_id":50480231,"points":null,"story_id":50471731,"text":"i had a very similar experience with a co-founder and ceo.<p>it took half an hour to even somewhat convince them that academic&#x2F;postgrad student open source projects with one commit four years ago are not the same thing as linux&#x2F;ubuntu&#x2F;docker&#x2F;etc.<p>sibling makes a good point tho. what they were probably thinking was \u201cwe want to be able to blame someone who is not us if it goes wrong at some point\u201d. that\u2019s 90% of the microslop business pitch right there.<p>open source, it\u2019s on you. microslop, it\u2019s on them.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:38:08.000Z","created_at_i":1794559088,"id":50480231,"options":[],"parent_id":50480105,"points":null,"story_id":50471731,"text":"I literally had a person from IT tell me \u201cFirefox is open source so it\u2019s not secure, that\u2019s why we have to use Edge\u201d the other day. They are beyond hopeless.","title":null,"type":"comment","url":null},{"author":"hn_submit","children":[{"author":"disgruntledphd2","children":[],"created_at":"2026-11-13T15:17:56.000Z","created_at_i":1794583076,"id":50484791,"options":[],"parent_id":50482111,"points":null,"story_id":50471731,"text":"&gt; If they transfer this to sovereign providers it would cost Big Tech serious money. So they&#x27;re quietly lobbying to slow down the speed at which European nations are moving away from them.<p>Yeah, this is definitely <i>really</i> important to them (not important enough for them to comply with the laws, but whatevs).","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:41:38.000Z","created_at_i":1794570098,"id":50482111,"options":[],"parent_id":50480105,"points":null,"story_id":50471731,"text":"Where does corruption start and lobbying begin? American cloud providers are hosting more than $340 billion worth of European workloads on their infrastructure, including email, videoconferencing, office documents and storage.<p>If they transfer this to sovereign providers it would cost Big Tech serious money. So they&#x27;re quietly lobbying to slow down the speed at which European nations are moving away from them.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:23:23.000Z","created_at_i":1794558203,"id":50480105,"options":[],"parent_id":50478333,"points":null,"story_id":50471731,"text":"&gt; Luckily most European politicians are corrupt and can easily be bought to prevent them from ditching Azure and Windows.<p>They&#x27;re not corrupt (in a lot of cases), mostly just ignorant. Like, they don&#x27;t understand the tech, and microsoft is safe, they&#x27;re already using it so handing over large swathes of their infra to them seems reasonable.<p>MS have <i>wonderful</i> sales people, and this is why they do well with governments and large enterprises.<p>There&#x27;s also a co-ordination problem, in that all of your counterparties (like your citizens, for instance) are familiar with MS and therefore it costs a bunch locally to move, for little short-term reward.<p>This is actually a place where (good) regulation could derisk a lot of these changes, but you&#x27;d need a committed group of politicians who can convince the civil servants to keep at it. It&#x27;ll happen, but slowly and in starts over the next 5-15 years.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:28:00.000Z","created_at_i":1794544080,"id":50478333,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"I believe it has more to do with him force-feeding Microsoft employees on A.I. resulting in slop code and outages.<p>If this continues the company will see a lot of customers leaving. And they were already in a bind since Europe is finally realizing that its dependence on American tech could be used against them. Luckily most European politicians are corrupt and can easily be bought to prevent them from ditching Azure and Windows.","title":null,"type":"comment","url":null},{"author":"petesergeant","children":[{"author":"singingfish","children":[],"created_at":"2026-11-13T05:50:06.000Z","created_at_i":1794549006,"id":50478882,"options":[],"parent_id":50478619,"points":null,"story_id":50471731,"text":"insufficiently supervised AI on top of poorly architected sales and marketing driven decisions looks like it&#x27;s a good recipe for a nice warm garbage fire","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:09:21.000Z","created_at_i":1794546561,"id":50478619,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"&gt; A lot of Azure ... is shockingly janky<p>This absolutely predates AI.","title":null,"type":"comment","url":null},{"author":"rapsey","children":[],"created_at":"2026-11-13T06:23:25.000Z","created_at_i":1794551005,"id":50479135,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"In this case AI stands for Actual Indians.","title":null,"type":"comment","url":null},{"author":"Selector8801","children":[],"created_at":"2026-11-13T06:33:38.000Z","created_at_i":1794551618,"id":50479208,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"Support in Europe has been nearly dismantled in favor of low cost countries. I wonder how they expect it to function now they it&#x27;s basically third parties withan AI slapped on top.","title":null,"type":"comment","url":null},{"author":"Towaway69","children":[],"created_at":"2026-11-13T07:37:16.000Z","created_at_i":1794555436,"id":50479693,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"Just shows that incompetence and stupidity still count in the age of AI.","title":null,"type":"comment","url":null},{"author":"disqard","children":[],"created_at":"2026-11-13T10:02:50.000Z","created_at_i":1794564170,"id":50481042,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"Be that as it may, he will be remembered for his gleeful &quot;I want people to know that we made them dance&quot; (at the cost of falling over, themselves).","title":null,"type":"comment","url":null},{"author":"roncesvalles","children":[{"author":"ajdude","children":[],"created_at":"2026-11-13T11:28:04.000Z","created_at_i":1794569284,"id":50481987,"options":[],"parent_id":50481599,"points":null,"story_id":50471731,"text":"I essentially said this in a sibling post whose parent asked why it seems like nobody knows the codebase anymore except my post was immediately flagged.<p>I think this is the logical conclusion of using copilot to write your stuff for the last two years. Nobody knows what it does and more and more bugs are being solved by just pointing the AI back to it again. Combine with the fact that so many people have been laid off and replaced with copilot I&#x27;m not surprised that the few who remain aren&#x27;t quite sure how to solve it","title":null,"type":"comment","url":null},{"author":"dclowd9901","children":[],"created_at":"2026-11-13T17:21:15.000Z","created_at_i":1794590475,"id":50486636,"options":[],"parent_id":50481599,"points":null,"story_id":50471731,"text":"And yet, for some reason, we have to _prove_ this is the case, as though in the history of time, engineering something has ever proven ok as a careless endeavor.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:49:38.000Z","created_at_i":1794566978,"id":50481599,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"I think a lot of it is due to the deterioration of code quality due to widespread AI use rather than AI as a feature in the products.<p>Vibe coding has enabled unconscientious developers to pollute otherwise good codebases with a lot of sloppy code.","title":null,"type":"comment","url":null},{"author":"FrostKiwi","children":[],"created_at":"2026-11-13T12:32:22.000Z","created_at_i":1794573142,"id":50482598,"options":[],"parent_id":50477000,"points":null,"story_id":50471731,"text":"Yeah, Frontdoor really hit me. Especially the continued status page lies.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T01:38:31.000Z","created_at_i":1794533911,"id":50477000,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Nadella stripped mined the company for AI jank, and everything has been falling apart. Github has been unreliable a lot lately. Xbox is basically imploding. A lot of Azure, Entra, Intune, etc. is shockingly janky, and there is clearly very little investment in it.","title":null,"type":"comment","url":null},{"author":"hcurtiss","children":[],"created_at":"2026-11-13T01:42:36.000Z","created_at_i":1794534156,"id":50477026,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I\u2019m at a large general business trade association meeting today. It\u2019s definitely caused a prominent buzz. The impacts of this in terms of lost productivity are pretty huge. Yes, the controller can still work on the proforma, for instance. But he cannot easily share it with outside parties.  And he can\u2019t search his email for relevant records needed for the work.","title":null,"type":"comment","url":null},{"author":"steveBK123","children":[],"created_at":"2026-11-13T01:51:33.000Z","created_at_i":1794534693,"id":50477078,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"LLMs have solved programming and soon cancer.<p>After that they will tackle email servers.","title":null,"type":"comment","url":null},{"author":"mattnoseworthy","children":[],"created_at":"2026-11-13T01:56:14.000Z","created_at_i":1794534974,"id":50477108,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"&#x27;In October 2026, Microsoft announced a Voluntary Exit Offer (VEO) making approximately 27% of its global workforce...&#x27;<p>So..\n&gt; Be the last standing SRE at Micro$slop\n&gt; Your mentors have all left, taking the exit payout, now your days are the best b&#x2F;c you answer to nobody and can hide in your mountain of markdown.\n&gt; You knew each of the 7 different products named CoPilot are used to monitor your performance. So you set them all up talking to eachother, burning tokens and API limits.\n&gt; You are team top performer now, you get all the important decisions now\n&gt; You walk in the office this morning, CISA is sitting at your desk, with CVE-2026-124194 on your whiteboard\n&gt; &#x27;You have a patch for this right, China is actively exploiting our Defense primes..&#x27;? \n&gt; Oh no, I haven&#x27;t landed a patch in prod since my mentor left (because he actually did most of the work)\n&gt; Oh well, must be close enough, LGTM, CISA seems upset so better just yeet this to prod...\n&gt; ...<p>inb4 this is more accurate than anyone wants it to be.","title":null,"type":"comment","url":null},{"author":"Beijinger","children":[{"author":"NoPicklez","children":[],"created_at":"2026-11-13T02:18:55.000Z","created_at_i":1794536335,"id":50477247,"options":[],"parent_id":50477234,"points":null,"story_id":50471731,"text":"It&#x27;s almost as if they&#x27;ve identified that and are doing just that","title":null,"type":"comment","url":null},{"author":"waz0wski","children":[],"created_at":"2026-11-13T04:06:01.000Z","created_at_i":1794542761,"id":50478152,"options":[],"parent_id":50477234,"points":null,"story_id":50471731,"text":"It&#x27;s been a while since we had a good Windows Worm with this kind of behavior<p><a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;SQL_Slammer\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;SQL_Slammer</a><p><a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Conficker\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Conficker</a>","title":null,"type":"comment","url":null},{"author":"_delirium","children":[],"created_at":"2026-11-13T04:18:35.000Z","created_at_i":1794543515,"id":50478254,"options":[],"parent_id":50477234,"points":null,"story_id":50471731,"text":"The 4:11 AM UTC update claims no indications of malicious activity (obviously I have no way to judge that, just copying it here):<p><i>Current status: As part of our investigation into the sustained traffic management imbalances, we\u2019re reviewing traffic flows and affected infrastructure to identify opportunities to optimize routing. This includes verifying the reasons for service failures so we can develop specific actions to improve stability.</i><p><i>We will continue to share more information as soon as we have it, and for now we can confirm that there is no indication this is the result of malicious activity. We\u2019ll continue to apply learnings towards remediation actions as we confirm effectiveness mitigation actions.</i>","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:16:35.000Z","created_at_i":1794536195,"id":50477234,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"&quot;Current status: We&#x27;re continuing to pursue all available pathways to restore service, as our actions taken thus far have not provided the anticipated relief. Our investigation has found that a core process on the affected servers is becoming overwhelmed, which causes the servers to stop responding and contributes to the capacity loss.&quot;<p>I mean, either roll back your update or there is a malicious actor involved.","title":null,"type":"comment","url":null},{"author":"markus_zhang","children":[],"created_at":"2026-11-13T02:26:22.000Z","created_at_i":1794536782,"id":50477308,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Guys you need to bring back David Cutler to whichever department and let him punch a hole through the wall and start mowing asses.","title":null,"type":"comment","url":null},{"author":"stevenhubertron","children":[{"author":"NoPicklez","children":[{"author":"stogot","children":[{"author":"NoPicklez","children":[],"created_at":"2026-11-13T03:59:08.000Z","created_at_i":1794542348,"id":50478098,"options":[],"parent_id":50478051,"points":null,"story_id":50471731,"text":"What makes you think they haven&#x27;t?<p>Issues that cause outages are complex and can cascade across multiple areas around the world.<p>Designing for resiliency doesn&#x27;t mean you won&#x27;t ever have a major outage.","title":null,"type":"comment","url":null},{"author":"Antrikshy","children":[{"author":"pmontra","children":[{"author":"Symbiote","children":[],"created_at":"2026-11-13T08:22:45.000Z","created_at_i":1794558165,"id":50480099,"options":[],"parent_id":50479333,"points":null,"story_id":50471731,"text":"I run several services on a VM, with no automation to restore them if there&#x27;s a hardware issue with the VM host. (There is some resiliency: a managed datacentre, the servers have RAID, dual PSUs, dual network, etc.)<p>For over 10 years, this has not been a problem.  We understand the risk, and know how to restore services onto a different VM host if necessary.<p>I think the more complex system (e.g. K8S) has problems when people don&#x27;t fully understand it. We&#x27;ve had outages there, caused by misconfigurations or unexpected behaviour.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:48:44.000Z","created_at_i":1794552524,"id":50479333,"options":[],"parent_id":50478590,"points":null,"story_id":50471731,"text":"My customers are small.<p>One of them has two servers on AWS behind a load balancer. That&#x27;s the very least of resilience.<p>Another one has one server in a datacenter running their primary service on a single VM. That server had issues with RAM chips a couple of years ago that brought it down a few times. However they are not crazy. They made the choice to keep their data at home, bought reportedly good hardware, accepted there there might be consequences. They have other less beefy servers but they did not load balance their service on VMs on different servers.<p>I think that we can agree that this is no resilience. Is it by design as in &quot;I want my service not to be reliable&quot;? Of course not. Is it lack of quality in the design? Of course it is. But does it matter from the point of view of the users of the service?","title":null,"type":"comment","url":null},{"author":"wtch98","children":[{"author":"NoPicklez","children":[],"created_at":"2026-11-15T22:58:54.000Z","created_at_i":1794783534,"id":50511800,"options":[],"parent_id":50480156,"points":null,"story_id":50471731,"text":"Designing resiliency around DNS is a fairly small non-technical task first and foremost, as opposed to resiliency for a global service.<p>In IT we used to host on premises so that we could handle these issues, however that was costly, complex and if we&#x27;re being honest brought more issues than using  a large cloud provider from a resilience standpoint.<p>Yes we are now relying on Microsoft for our email services and we can&#x27;t expect that they will have 100% uptime, its just not going to happen and whenever these big global outages occur we think we did the wrong thing, but we didn&#x27;t, we lose hindsight of how it was before.<p>If your supplier breaks and you can&#x27;t restock your supermarket, that&#x27;s no different to if you broke it doing it yourself. What your business needs is continuity management and how you can operate at a lower level while the service is coming back online.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:29:39.000Z","created_at_i":1794558579,"id":50480156,"options":[],"parent_id":50478590,"points":null,"story_id":50471731,"text":"You design to the needs. I have resilience in my home DNS so I have a 100% availability bounded on the home (if the home is burnt down then I&#x27;ll lose DNS)<p>At work I designed DNS to survive the loss of a city, so again 100% uptime. The riskiest part is deploying changes, which is why the deployment doesn&#x27;t run in parallel and confirms state before deployment.<p>Resilience isn&#x27;t hard when you aren&#x27;t trying to serve a billion customers. The problem is we are addicted to a &quot;winner takes all&quot; economy, which leads to fragility. If Tesco breaks, I can go to Sainsburys, or Aldi, or Lidl, or Iceland, or get in the car and go to Asda or Morrisons. That&#x27;s diversity.<p>But in IT the goal is all those follow the same gartner reports and all use the &quot;best supplier&quot; for their backend infrastructure, and if that supplier breaks then they can&#x27;t restock any supermarkets.<p>That&#x27;s a terrible risk and needs to be stopped, not encouraged. But the individual incentives are for the CTO of each supermarket to choose what the consultants tell them. If they don&#x27;t they are accountable for the choice of not using things like &quot;industry standard&quot;.","title":null,"type":"comment","url":null},{"author":"danaris","children":[],"created_at":"2026-11-13T13:54:55.000Z","created_at_i":1794578095,"id":50483534,"options":[],"parent_id":50478590,"points":null,"story_id":50471731,"text":"While it&#x27;s probably true that no one specifically <i>seeks</i> to remove resiliency for its own sake, basically the entirety of our corporate world has, over the past several decades, been <i>relentlessly</i> redesigning everything in ways that remove resiliency. Because resiliency is almost inherently antithetical to <i>efficiency</i>. At the most fundamental level, if you want to make sure you have a backup of your data, that means you need <i>at least</i> 2x the amount of storage. And, of course, if you want to make sure you can operate even if a critical employee gets sick&#x2F;is hit by a bus&#x2F;goes on vacation, you need to hire extra employees.<p>And that&#x27;s anathema to companies nowadays.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:05:21.000Z","created_at_i":1794546321,"id":50478590,"options":[],"parent_id":50478051,"points":null,"story_id":50471731,"text":"Well, no one designs to <i>not</i> be resilient. Quality varies in practice.","title":null,"type":"comment","url":null},{"author":"EvanAnderson","children":[{"author":"wtch98","children":[{"author":"EvanAnderson","children":[],"created_at":"2026-11-13T13:34:15.000Z","created_at_i":1794576855,"id":50483262,"options":[],"parent_id":50480094,"points":null,"story_id":50471731,"text":"I haven&#x27;t had occasion to spin-up Exchange SE yet, but I&#x27;ve read plenty of descriptions of other admins running it. I have no reason to believe Exchange itself relies on any centralized features. &quot;New Outlook&quot; has been alleged to use centralized servers even when connected to an on-prem Exchange SE install, and given that it&#x27;s &quot;modern&quot; MSFT software that wouldn&#x27;t surprise me, but anybody stupid enough to use &quot;new Outlook&quot; gets what they deserve.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:22:30.000Z","created_at_i":1794558150,"id":50480094,"options":[],"parent_id":50479010,"points":null,"story_id":50471731,"text":"Is there any proof that &quot;self hosted&quot; is still working, wouldn&#x27;t surprise me if at least part of it relies on centralised services.<p>In a sane world the CTOs choosing this would be held accountable. The massive global economic fragility which is created by the centralisation of society is a massive risk. Diversity is important, we see it time and time again how optimisation causes panic, from crowdstrike to microsoft. When your outsourced provider is &quot;too big to fail&quot;, you have a problem that government needs to deal with.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:07:00.000Z","created_at_i":1794550020,"id":50479010,"options":[],"parent_id":50478051,"points":null,"story_id":50471731,"text":"You can self-host, but it&#x27;s a monthly subscription instead of a perpetual license.","title":null,"type":"comment","url":null},{"author":"allthatineed","children":[{"author":"Ey7NFZ3P0nzAe","children":[],"created_at":"2026-11-14T14:13:16.000Z","created_at_i":1794665596,"id":50497181,"options":[],"parent_id":50479713,"points":null,"story_id":50471731,"text":"When done in a non decentralized way*","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:39:05.000Z","created_at_i":1794555545,"id":50479713,"options":[],"parent_id":50478051,"points":null,"story_id":50471731,"text":"Operational consistency is a hidden single point of failure.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:53:46.000Z","created_at_i":1794542026,"id":50478051,"options":[],"parent_id":50477347,"points":null,"story_id":50471731,"text":"Well Microsoft made everyone move to managed exchange&#x2F;outlook right? I was told you can\u2019t self host anymore. How did they not design for regional resiliency?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:30:09.000Z","created_at_i":1794537009,"id":50477347,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"It&#x27;s impacting all businesses running MS hosted Outlook, that would also include companies with 100,000 of employees. It&#x27;s a global issues not just one area.","title":null,"type":"comment","url":null},{"author":"duxup","children":[],"created_at":"2026-11-13T02:35:47.000Z","created_at_i":1794537347,"id":50477385,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"US-East-1 is at least something you can kinda plan for &#x2F; around.   This isn\u2019t.","title":null,"type":"comment","url":null},{"author":"soundworlds","children":[{"author":"keyle","children":[],"created_at":"2026-11-13T04:05:32.000Z","created_at_i":1794542732,"id":50478148,"options":[],"parent_id":50477487,"points":null,"story_id":50471731,"text":"Can&#x27;t take down simplicity this easy.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:50:57.000Z","created_at_i":1794538257,"id":50477487,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"Yet HackerNews soldiers on.","title":null,"type":"comment","url":null},{"author":"goodluckchuck","children":[],"created_at":"2026-11-13T02:53:41.000Z","created_at_i":1794538421,"id":50477518,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"Yeah, with a brief outage, the concern is that you don\u2019t have access. At this point, the concern is that someone else does.","title":null,"type":"comment","url":null},{"author":"EmX_3000","children":[{"author":"morkalork","children":[{"author":"stogot","children":[{"author":"EmX_3000","children":[],"created_at":"2026-11-13T03:55:49.000Z","created_at_i":1794542149,"id":50478070,"options":[],"parent_id":50478041,"points":null,"story_id":50471731,"text":"It&#x27;s the Great Rebootening. That&#x27;s what they&#x27;re trying apparently. Roll back and reboot and see if everything works.","title":null,"type":"comment","url":null},{"author":"bowmessage","children":[],"created_at":"2026-11-13T04:37:54.000Z","created_at_i":1794544674,"id":50478407,"options":[],"parent_id":50478041,"points":null,"story_id":50471731,"text":"Soon to be O364 :-(<p>Best of luck to those oncall.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:52:27.000Z","created_at_i":1794541947,"id":50478041,"options":[],"parent_id":50477918,"points":null,"story_id":50471731,"text":"Really should ask:  how badly designed is O365 if their AI can\u2019t solve it?","title":null,"type":"comment","url":null},{"author":"brokenmachine","children":[],"created_at":"2026-11-13T04:04:07.000Z","created_at_i":1794542647,"id":50478138,"options":[],"parent_id":50477918,"points":null,"story_id":50471731,"text":"Copilot is down, they might need to ask a Chinese model.","title":null,"type":"comment","url":null},{"author":"sexy_seedbox","children":[],"created_at":"2026-11-13T04:31:28.000Z","created_at_i":1794544288,"id":50478355,"options":[],"parent_id":50477918,"points":null,"story_id":50471731,"text":"Windows Recall: You Can See Everything","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:37:45.000Z","created_at_i":1794541065,"id":50477918,"options":[],"parent_id":50477700,"points":null,"story_id":50471731,"text":"Just tell copilot to rollback the last 24h of changes, ez-peazy &#x2F;s","title":null,"type":"comment","url":null},{"author":"mook","children":[{"author":"1e1a","children":[{"author":"mook","children":[],"created_at":"2026-11-13T16:00:08.000Z","created_at_i":1794585608,"id":50485449,"options":[],"parent_id":50484842,"points":null,"story_id":50471731,"text":"But it&#x27;s loading a 16MB JavaScript file much faster! Improvement (not in the direction I like, but still)!","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T15:20:59.000Z","created_at_i":1794583259,"id":50484842,"options":[],"parent_id":50479539,"points":null,"story_id":50471731,"text":"It&#x27;s still loading a 16MB JavaScript file.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:15:09.000Z","created_at_i":1794554109,"id":50479539,"options":[],"parent_id":50477700,"points":null,"story_id":50471731,"text":"Hey, at least they fixed the status page. A few hours earlier, it was loading a 16MB JavaScript file over 2 minutes or something. It&#x27;s much faster now, though I haven&#x27;t checked if that file is smaller, or just the pipe got better.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:13:25.000Z","created_at_i":1794539605,"id":50477700,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"They&#x27;re still trying to find the root cause apparently. The status updates I&#x27;ve seen (the page seems dodgy, probably millions of people hammering it every millisecond) don&#x27;t sound very optimistic as of yet.","title":null,"type":"comment","url":null},{"author":"Eji1700","children":[{"author":"mminer237","children":[{"author":"Eji1700","children":[],"created_at":"2026-11-13T05:33:26.000Z","created_at_i":1794548006,"id":50478781,"options":[],"parent_id":50478772,"points":null,"story_id":50471731,"text":"That&#x27;s fucking terrifying if true.  Guess i&#x27;m going to have to watch the tracker as well.  I&#x27;ll live but another &quot;history in the making&quot; moment.<p>Edit- Yeeeup still very vague translations of &quot;fuck fuck fuck fuck fuck nope fuck fuck fuck&quot;","title":null,"type":"comment","url":null},{"author":"Freedom2","children":[],"created_at":"2026-11-13T06:48:56.000Z","created_at_i":1794552536,"id":50479334,"options":[],"parent_id":50478772,"points":null,"story_id":50471731,"text":"Not sure why the execs and VPs aren&#x27;t asking their AI agents to triage. They&#x27;ve been implying they don&#x27;t need engineers anymore, isn&#x27;t this the best time to prove themselves right?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:32:04.000Z","created_at_i":1794547924,"id":50478772,"options":[],"parent_id":50477740,"points":null,"story_id":50471731,"text":"I mean, they still have zero idea what the root cause is 12 hours later.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:17:49.000Z","created_at_i":1794539869,"id":50477740,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"When I first saw this I commented it must be bad, but that was 4 hours ago after a whole day of &quot;welp i guess i&#x27;m not emailing anyone and meetings are pushed.&quot;.<p>It&#x27;s 7PM PST now and I cannot imagine how fucking on fire things must be for it to not only still be down, but basically with no real communication from what i&#x27;ve seen (like yes there&#x27;s updates, but not the &quot;root cause found, triaging&quot;.)<p>In an era where everyone&#x27;s vibe coding Excel clones, this is NOT the time to be fucking up your KEY moat on a catastrophic level.","title":null,"type":"comment","url":null},{"author":"lazyasciiart","children":[],"created_at":"2026-11-13T03:24:11.000Z","created_at_i":1794540251,"id":50477798,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"The last email received by my partner\u2019s work inbox was a cheerful update from their CTO or whatever about the wonderful progress they had made by moving all employees to work primarily in OneDrive. I kind of wonder if he\u2019s just run away since then.","title":null,"type":"comment","url":null},{"author":"thewhitetulip","children":[],"created_at":"2026-11-13T04:28:55.000Z","created_at_i":1794544135,"id":50478338,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"Imagine how frequently this will happen when old employees take the buyout option. Coupled that with the constant layoffs, the nect decade looks promising for MSFT","title":null,"type":"comment","url":null},{"author":"FullMetalBitch","children":[],"created_at":"2026-11-13T06:48:34.000Z","created_at_i":1794552514,"id":50479329,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"Almost 8AM in central europe and outlook is still not working.","title":null,"type":"comment","url":null},{"author":"anvuong","children":[],"created_at":"2026-11-13T07:42:55.000Z","created_at_i":1794555775,"id":50479754,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"Midnight in the west coast now and my 20k+ institution is still communicating via SMS ...","title":null,"type":"comment","url":null},{"author":"raxxorraxor","children":[],"created_at":"2026-11-13T14:00:26.000Z","created_at_i":1794578426,"id":50483602,"options":[],"parent_id":50477309,"points":null,"story_id":50471731,"text":"Wrath of the Europeans that still host their own mail servers.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T02:26:26.000Z","created_at_i":1794536786,"id":50477309,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"What\u2019s crazy is now hour 8 and my work email for 15k+ employees is still down.  This is worse than the usual US-East-1 issues.","title":null,"type":"comment","url":null},{"author":"htrp","children":[],"created_at":"2026-11-13T02:33:31.000Z","created_at_i":1794537211,"id":50477369,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"we back yet ?","title":null,"type":"comment","url":null},{"author":"gred","children":[{"author":"dboreham","children":[],"created_at":"2026-11-13T04:52:33.000Z","created_at_i":1794545553,"id":50478498,"options":[],"parent_id":50477691,"points":null,"story_id":50471731,"text":"Actually it works just fine because it only uses the back end to sync between devices. I was puzzled why mine said &quot;last synced 8h ago&quot;. Only realized why when I saw this thread.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:12:34.000Z","created_at_i":1794539554,"id":50477691,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"&gt; Microsoft To Do: The app may not load, and users may see operation failures.<p>Yeah, I&#x27;ll stick to Notepad and my local TODO.txt file...","title":null,"type":"comment","url":null},{"author":"multisport","children":[{"author":"geophph","children":[{"author":"koyote","children":[{"author":"geophph","children":[],"created_at":"2026-11-13T04:17:50.000Z","created_at_i":1794543470,"id":50478248,"options":[],"parent_id":50478088,"points":null,"story_id":50471731,"text":"Haha doesn\u2019t hurt to try a different approach!<p>EDIT: with the most recent one it seems they might be moving backwards \u2026<p>&gt; As part of our investigation into the sustained traffic management imbalances, we\u2019re reviewing traffic flows and affected infrastructure to identify opportunities to optimize routing. This includes verifying the reasons for service failures so we can develop specific actions to improve stability.","title":null,"type":"comment","url":null},{"author":"windows2020","children":[{"author":"mixdup","children":[],"created_at":"2026-11-13T05:54:13.000Z","created_at_i":1794549253,"id":50478903,"options":[],"parent_id":50478276,"points":null,"story_id":50471731,"text":"Forced status updates are still good. Even if they just say &quot;we are still working on it and attempts so far have failed&quot; it keeps people from thinking Microsoft is just playing GTA VI instead of working on it. Managing expectations is just as important as restoring service. Sometimes (probably not with a global email service) even more important. You can get away with a lot of downtime in some services as long as you are communicating what&#x27;s going on","title":null,"type":"comment","url":null},{"author":"tremon","children":[],"created_at":"2026-11-13T15:12:42.000Z","created_at_i":1794582762,"id":50484713,"options":[],"parent_id":50478276,"points":null,"story_id":50471731,"text":"&gt; a linear and quantifiable process, like copying a file from here to there<p>I take it you&#x27;ve never seen a Windows file copy dialog :)","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T04:20:41.000Z","created_at_i":1794543641,"id":50478276,"options":[],"parent_id":50478088,"points":null,"story_id":50471731,"text":"The forced status updates come from the idea that resolution is a linear and quantifiable process, like copying a file from here to there. The idea an issue is caused by the unknown, and the remedy is unknown, is incompatible with processes and worldviews.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:58:14.000Z","created_at_i":1794542294,"id":50478088,"options":[],"parent_id":50477829,"points":null,"story_id":50471731,"text":"I sort of agree but also: what else are you going to say? Some kind of soviet &quot;Nope, everything working fine, you must be imagining things&quot;? :)<p>And why do all the update messages sound like AI slop?","title":null,"type":"comment","url":null},{"author":"layoric","children":[],"created_at":"2026-11-13T04:55:13.000Z","created_at_i":1794545713,"id":50478518,"options":[],"parent_id":50477829,"points":null,"story_id":50471731,"text":"No more &quot;Previous&quot;, just &quot;We\u2019re continuing our efforts to improve server stability to improve traffic flow&quot;...","title":null,"type":"comment","url":null},{"author":"mook","children":[{"author":"hbcdbff","children":[],"created_at":"2026-11-13T08:05:26.000Z","created_at_i":1794557126,"id":50479946,"options":[],"parent_id":50479672,"points":null,"story_id":50471731,"text":"I doubt the execs are \u201cgoing home\u201d today","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:34:01.000Z","created_at_i":1794555241,"id":50479672,"options":[],"parent_id":50477829,"points":null,"story_id":50471731,"text":"Maybe the execs went home, so its the lower-level people approving the updates now and they just want to get it out and get back to trying to help resolving the thing.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:28:13.000Z","created_at_i":1794540493,"id":50477829,"options":[],"parent_id":50477717,"points":null,"story_id":50471731,"text":"Tbh I\u2019ve been maybe mildly impressed by how honest the past like, 5 updates have been about changes not working &#x2F; taking &#x2F; resolved as expected. Would have anticipated less direct honesty for whatever reason. But also sadly comical in that I feel most engineers have been there and know the feeling, and also holy moly it\u2019s been an issue for a while!","title":null,"type":"comment","url":null},{"author":"woggy","children":[],"created_at":"2026-11-13T03:31:52.000Z","created_at_i":1794540712,"id":50477864,"options":[],"parent_id":50477717,"points":null,"story_id":50471731,"text":"This is a very entertaining message but I do feel bad for the engineers","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:15:15.000Z","created_at_i":1794539715,"id":50477717,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"10p ET update:<p>&gt; Current status: We\u2019ve monitored the status of the changes applied to improve serviceability and confirmed that change is not taking as expected. We\u2019re identifying alternate workstreams that can be applied to increase capacity in the face of sustained traffic management imbalances.","title":null,"type":"comment","url":null},{"author":"pluc","children":[],"created_at":"2026-11-13T03:29:16.000Z","created_at_i":1794540556,"id":50477839,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Vibe code your way out of this shit","title":null,"type":"comment","url":null},{"author":"greatvaluebrand","children":[{"author":"CuriousRose","children":[],"created_at":"2026-11-13T05:59:30.000Z","created_at_i":1794549570,"id":50478940,"options":[],"parent_id":50477865,"points":null,"story_id":50471731,"text":"Don&#x27;t say this too loud, your opinions are being scraped.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:31:53.000Z","created_at_i":1794540713,"id":50477865,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Here is my completely baseless conspiracy theory. This is a Reichstag fire event to seize control of the AI industry. We will be told that the outage was the result of a sophisticated AI enabled attack, probably involving rogue agents. Only the oligarchs will be allowed license to operate AI for \u201cnational security\u201d reasons. Jensen Huang being taken off the board is just too convenient of timing.<p>Anyone hoarding weights will become a dissident.","title":null,"type":"comment","url":null},{"author":"EmX_3000","children":[{"author":"dboreham","children":[],"created_at":"2026-11-13T04:47:37.000Z","created_at_i":1794545257,"id":50478470,"options":[],"parent_id":50478084,"points":null,"story_id":50471731,"text":"Wall St types don&#x27;t think this way. They think &quot;company that took down the entire world must be very valuable&quot;. E.g. crowd strike.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T03:57:23.000Z","created_at_i":1794542243,"id":50478084,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"If this isn&#x27;t fixed by morning MS is going to tank and heads will roll.","title":null,"type":"comment","url":null},{"author":"Khaine","children":[],"created_at":"2026-11-13T03:58:54.000Z","created_at_i":1794542334,"id":50478096,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Could they do the world a favour and just take teams offline as well.","title":null,"type":"comment","url":null},{"author":"brokenmachine","children":[],"created_at":"2026-11-13T04:01:47.000Z","created_at_i":1794542507,"id":50478119,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Microsoft 364","title":null,"type":"comment","url":null},{"author":"drillsteps5","children":[],"created_at":"2026-11-13T04:12:16.000Z","created_at_i":1794543136,"id":50478202,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"23:10 EST (about 9-10 hours into the outage)<p>&gt;Previous status: We\u2019ve monitored the status of the changes applied to improve serviceability and confirmed that change is not taking as expected. We\u2019re identifying alternate workstreams that can be applied to increase capacity in the face of sustained traffic management imbalances.<p>&gt;Current status: As part of our investigation into the sustained traffic management imbalances, we\u2019re reviewing traffic flows and affected infrastructure to identify opportunities to optimize routing. This includes verifying the reasons for service failures so we can develop specific actions to improve stability.<p>What a dumpster fire","title":null,"type":"comment","url":null},{"author":"CHB0403085482","children":[],"created_at":"2026-11-13T04:28:58.000Z","created_at_i":1794544138,"id":50478339,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"World without Windows<p><a href=\"https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=t62ZRncv2d4\" rel=\"nofollow\">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=t62ZRncv2d4</a>","title":null,"type":"comment","url":null},{"author":"zdc1","children":[],"created_at":"2026-11-13T04:41:01.000Z","created_at_i":1794544861,"id":50478433,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Claude wants me to reauthenticate my session... by sending a code to my Microsoft email. Also signed up for Zoom since Teams is down... and it wants the code from my email. Suddenly I miss passwords.","title":null,"type":"comment","url":null},{"author":"k0morebi","children":[],"created_at":"2026-11-13T04:45:25.000Z","created_at_i":1794545125,"id":50478462,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Best outcome that can come from this is for it to be painful enough that corporate clients start to on-prem some services again.","title":null,"type":"comment","url":null},{"author":"mattmcknight","children":[{"author":"mixdup","children":[{"author":"cheeze","children":[{"author":"Eji1700","children":[],"created_at":"2026-11-13T06:24:28.000Z","created_at_i":1794551068,"id":50479149,"options":[],"parent_id":50479018,"points":null,"story_id":50471731,"text":"So i know fuck all and am basically just rubbernecking the car crash at this point, but I would&#x27;ve agreed however they just dropped this gem:<p>&gt; Current status: As part of our ongoing efforts to advance the recoverability of our frontend servers, we\u2019re evaluating traffic controls that can be applied to increase capacity and stability. This includes traffic optimization actions such as traffic throttling, protocol adjustments, and failover routing intended to improve stability in active regions. In parallel, were expanding internal testing to track activity within a contained environment to improve traffic monitoring and issue detection capabilities.<p>That...kinda reads like they&#x27;re just trying it?  I&#x27;m assuming there&#x27;s something being missed or it&#x27;s a &quot;fuck it try it again&quot; but I do wonder if some story is going to come out of people in the decision making seats who don&#x27;t know what they&#x27;re doing.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:07:44.000Z","created_at_i":1794550064,"id":50479018,"options":[],"parent_id":50478912,"points":null,"story_id":50471731,"text":"Agree. For a large cloud provider, the thundering herd retry-storm is pretty standard failure scenario and a &quot;greatest hit&quot; outage at this point.<p>Throttle the hell out of everything, then slowly ramp traffic back up.<p>I&#x27;m confident they&#x27;ve already tried this exact thing. This is cloud 101 in 2026.","title":null,"type":"comment","url":null},{"author":"franktankbank","children":[],"created_at":"2026-11-13T10:52:39.000Z","created_at_i":1794567159,"id":50481641,"options":[],"parent_id":50478912,"points":null,"story_id":50471731,"text":"Could be a bunch of dumb dumbs.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:55:33.000Z","created_at_i":1794549333,"id":50478912,"options":[],"parent_id":50478652,"points":null,"story_id":50471731,"text":"They should be able to mitigate that at the border. Whatever load balancing solution is in place should just drop connections before they get to a point that can overload the system. That they haven&#x27;t, or can&#x27;t, makes me think it&#x27;s more complicated than &quot;it&#x27;s hard to bring it back up when everyone is trying to get back in&quot;","title":null,"type":"comment","url":null},{"author":"srinidhin","children":[{"author":"contravariant","children":[],"created_at":"2026-11-13T11:04:32.000Z","created_at_i":1794567872,"id":50481770,"options":[],"parent_id":50479017,"points":null,"story_id":50471731,"text":"Sounds like it running correctly was the meta-stable state. Failure is actually more stable since it can reach a failed state from the ground state of simply not running.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:07:39.000Z","created_at_i":1794550059,"id":50479017,"options":[],"parent_id":50478652,"points":null,"story_id":50471731,"text":"Also called meta-stable failures - <a href=\"https:&#x2F;&#x2F;muratbuffalo.blogspot.com&#x2F;2023&#x2F;09&#x2F;metastable-failures-in-wild.html\" rel=\"nofollow\">https:&#x2F;&#x2F;muratbuffalo.blogspot.com&#x2F;2023&#x2F;09&#x2F;metastable-failure...</a>","title":null,"type":"comment","url":null},{"author":"tguedes","children":[],"created_at":"2026-11-13T14:19:34.000Z","created_at_i":1794579574,"id":50483868,"options":[],"parent_id":50478652,"points":null,"story_id":50471731,"text":"Isn\u2019t this very similar cause to the AWS us-east-1 outage from last year. I thought I remember it being about a network change that overloaded servers, leading to a cascading failure.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:16:14.000Z","created_at_i":1794546974,"id":50478652,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Here&#x27;s a theory: A network change made connection setup more expensive or forced mass reconnects, saturating the front ends\u2019 secure-connection process. Saturated servers fail health checks and get pulled, so the survivors take more load and fail too. Every client that gets dropped reconnects, and each reconnect needs a fresh secure handshake. That is why restarted servers die as soon as traffic returns. The outage now sustains itself even with the trigger being reverted, hence the traffic blocking and staged reintroduction.\nThe most recent surge is likely retry amplification, partly caused by their own traffic rebalancing.","title":null,"type":"comment","url":null},{"author":"insane_dreamer","children":[],"created_at":"2026-11-13T05:17:50.000Z","created_at_i":1794547070,"id":50478661,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"replacing engineers with AI is going great!<p>10 hours later, Outlook still down","title":null,"type":"comment","url":null},{"author":"NoPicklez","children":[{"author":"jamesfinlayson","children":[],"created_at":"2026-11-13T06:21:18.000Z","created_at_i":1794550878,"id":50479116,"options":[],"parent_id":50478711,"points":null,"story_id":50471731,"text":"Yeah a colleague got one email come through at lunch time (Australian time) but I am yet to see anything.","title":null,"type":"comment","url":null},{"author":"hyperadvanced","children":[],"created_at":"2026-11-13T06:53:29.000Z","created_at_i":1794552809,"id":50479366,"options":[],"parent_id":50478711,"points":null,"story_id":50471731,"text":"It couldn\u2019t be DNS","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T05:23:31.000Z","created_at_i":1794547411,"id":50478711,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I just got a stream of Outlook emails, however it quickly stopped sync&#x27;ing any more.<p>Without anything else to go off of it points to it certainly being a capacity, traffic, routing issue.","title":null,"type":"comment","url":null},{"author":"squidlib","children":[],"created_at":"2026-11-13T06:02:26.000Z","created_at_i":1794549746,"id":50478958,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"This complexity and lack of MS to find the root of their own problems reminds me of when spacex had a falcon 9 blow up on the pad and it took a lot of intense investigation as there really seemed to be no trigger. They even suspected a shooter. I think it ultimately ended up being due to odd behaviors with super cooled helium.<p>Or maybe ai broke containment and it\u2019s doing this for the lulz.","title":null,"type":"comment","url":null},{"author":"perryizgr8","children":[],"created_at":"2026-11-13T06:08:41.000Z","created_at_i":1794550121,"id":50479023,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It&#x27;s insane that the outage is still ongoing. Outlook and M365 is the backbone of a significant portion of world GDP.","title":null,"type":"comment","url":null},{"author":"YPPH","children":[],"created_at":"2026-11-13T06:13:38.000Z","created_at_i":1794550418,"id":50479060,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I&#x27;ve only ever dealt with Exchange at small scale, and even then it was fiddly. I can&#x27;t imagine what it takes to fix something like this at a global scale with the world watching.","title":null,"type":"comment","url":null},{"author":"xbmcuser","children":[{"author":"Eji1700","children":[{"author":"FullMetalBitch","children":[],"created_at":"2026-11-13T06:52:28.000Z","created_at_i":1794552748,"id":50479361,"options":[],"parent_id":50479128,"points":null,"story_id":50471731,"text":"I agree that Excel is hard to replace but email should have never been moved to the cloud.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:22:47.000Z","created_at_i":1794550967,"id":50479128,"options":[],"parent_id":50479093,"points":null,"story_id":50471731,"text":"I&#x27;ve yet to see a great replacement for Excel outside of gridcraft.  Things like Libre CAN do it, but there&#x27;s a lot of pain, and the average excel user isn&#x27;t going to get over most of those hurdles without a ton of hand holding.","title":null,"type":"comment","url":null},{"author":"hosteur","children":[{"author":"infamouscow","children":[{"author":"vconnor","children":[{"author":"infamouscow","children":[],"created_at":"2026-11-13T19:16:04.000Z","created_at_i":1794597364,"id":50488354,"options":[],"parent_id":50479633,"points":null,"story_id":50471731,"text":"There are plenty of mom &amp; pop businesses that just need someone to setup their computers, network them, and ensure they&#x27;re not being infected with shit. You&#x27;d be surprised how many people struggle with email, documents, spreadsheets, a printer, and maybe an app or two.<p>Think of yourself as a blue-collar contractor providing services to white-collar people afraid of being taken advantage of. Your competitive advantage over Geek Squad is being the local IT person who knows the names of everyone in a five-person real estate or law office.<p>Word of mouth will take care of everything else for you.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:29:18.000Z","created_at_i":1794554958,"id":50479633,"options":[],"parent_id":50479373,"points":null,"story_id":50471731,"text":"Good luck with that. They have all migrated to AWS in 2015+","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:54:27.000Z","created_at_i":1794552867,"id":50479373,"options":[],"parent_id":50479189,"points":null,"story_id":50471731,"text":"You should start your own business offering sysadmin services to small businesses.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:31:32.000Z","created_at_i":1794551492,"id":50479189,"options":[],"parent_id":50479093,"points":null,"story_id":50471731,"text":"&gt; This is going to bring about a huge move back to local servers and local software for offices, as many people are unable to correspond or use Microsoft software right now<p>One can only hope. But I am not so sure. No one seems to want to employ a local sysadmin these days.","title":null,"type":"comment","url":null},{"author":"gib444","children":[],"created_at":"2026-11-13T07:50:37.000Z","created_at_i":1794556237,"id":50479825,"options":[],"parent_id":50479093,"points":null,"story_id":50471731,"text":"Nah it&#x27;ll be forgotten about in a week","title":null,"type":"comment","url":null},{"author":"aftergibson","children":[{"author":"jijikuya","children":[],"created_at":"2026-11-13T09:50:40.000Z","created_at_i":1794563440,"id":50480900,"options":[],"parent_id":50479956,"points":null,"story_id":50471731,"text":"This year has been terrible for outages, the European Google power outage earlier this year, the PHP stuff (although that&#x27;s only tangentially related),the AWS outage in May, Cloudflare a couple times around this time last year, Salesforce.<p>I can tell you somewhat anecdotally that people who usually forget about this stuff are starting to notice.","title":null,"type":"comment","url":null},{"author":"GJim","children":[],"created_at":"2026-11-13T11:59:35.000Z","created_at_i":1794571175,"id":50482270,"options":[],"parent_id":50479956,"points":null,"story_id":50471731,"text":"I dunno.<p>The 2011 Blackberry outage <i>burried</i> RIM..... companies ran away from them faster than a greyhound with its arse on fire.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:06:10.000Z","created_at_i":1794557170,"id":50479956,"options":[],"parent_id":50479093,"points":null,"story_id":50471731,"text":"After a single outage, I doubt it. Don&#x27;t get me wrong, I wish it was the case, but this, like all news will be soon forgotten.<p>A few more outages though.. maybe?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:17:31.000Z","created_at_i":1794550651,"id":50479093,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"This is going to bring about a huge move back to local servers and local software for offices, as many people are unable to correspond or use Microsoft software right now. I am glad I refused to move our small office to 365, even if it meant sticking with older versions. I could have probably moved everyone to Linux and open-source software, but as the tech guy in our office, I didn&#x27;t want the extra workload of dealing with all the support.","title":null,"type":"comment","url":null},{"author":"balgg","children":[],"created_at":"2026-11-13T06:35:39.000Z","created_at_i":1794551739,"id":50479226,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Someone forgot &quot;make no mistakes&quot; from their prompt. That&#x27;s the first thing they teach you in vibeschool!","title":null,"type":"comment","url":null},{"author":"AbbeFaria","children":[{"author":"icepush","children":[{"author":"AbbeFaria","children":[{"author":"wting","children":[{"author":"reddalo","children":[{"author":"cowlevel","children":[{"author":"j16sdiz","children":[],"created_at":"2026-11-13T09:32:29.000Z","created_at_i":1794562349,"id":50480711,"options":[],"parent_id":50480387,"points":null,"story_id":50471731,"text":"iirc, its a hash with server secret. The idea was you can tell if the dialog is the real one, not just some look-the-same dialog from random malware","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:58:11.000Z","created_at_i":1794560291,"id":50480387,"options":[],"parent_id":50480004,"points":null,"story_id":50471731,"text":"&gt; The hierglyphics on the left of the dialog box are supposed to distract someone who is peering over your shoulder trying to learn your password as you type.<p>lmao... but is it actually random or is it a hash of your password to make sure you typed it correctly?","title":null,"type":"comment","url":null},{"author":"nycdotnet","children":[],"created_at":"2026-11-13T20:18:54.000Z","created_at_i":1794601134,"id":50489066,"options":[],"parent_id":50480004,"points":null,"story_id":50471731,"text":"email is red until it\u2019s read, and then it\u2019s not red anymore.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:11:18.000Z","created_at_i":1794557478,"id":50480004,"options":[],"parent_id":50479610,"points":null,"story_id":50471731,"text":"&gt;Lotus Domino<p>Oh, the memories. That login screen with the changing hieroglyphics [1] is forever burned into my mind.<p>[1] <a href=\"https:&#x2F;&#x2F;web.archive.org&#x2F;web&#x2F;20080220070921&#x2F;http:&#x2F;&#x2F;lotusnotessucks.4t.com&#x2F;lnEx01.html\" rel=\"nofollow\">https:&#x2F;&#x2F;web.archive.org&#x2F;web&#x2F;20080220070921&#x2F;http:&#x2F;&#x2F;lotusnotes...</a>","title":null,"type":"comment","url":null},{"author":"rvba","children":[{"author":"pasc1878","children":[{"author":"bradleyjg","children":[{"author":"dd8601fn","children":[{"author":"Reason077","children":[],"created_at":"2026-11-13T17:25:08.000Z","created_at_i":1794590708,"id":50486686,"options":[],"parent_id":50484357,"points":null,"story_id":50471731,"text":"The transition from POP to IMAP was a big step forward, back in the day.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T14:50:19.000Z","created_at_i":1794581419,"id":50484357,"options":[],"parent_id":50482389,"points":null,"story_id":50471731,"text":"It was like that because each check&#x2F;send process was pop3 call that looked more like processing a queue of work for offline clients.<p>Now it\u2019s more like being subscribed and listening for events.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T12:11:03.000Z","created_at_i":1794571863,"id":50482389,"options":[],"parent_id":50481566,"points":null,"story_id":50471731,"text":"If was like this because it was designed before networks were expected to be fully connected at any one time. Mail would hop its way towards its destination as intermediate nodes dialed in over modem to upstreams.","title":null,"type":"comment","url":null},{"author":"icedchai","children":[],"created_at":"2026-11-13T14:51:25.000Z","created_at_i":1794581485,"id":50484375,"options":[],"parent_id":50481566,"points":null,"story_id":50471731,"text":"I had email at my house, in the early 90&#x27;s, over a UUCP feed. It polled every 4 hours.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:47:19.000Z","created_at_i":1794566839,"id":50481566,"options":[],"parent_id":50480544,"points":null,"story_id":50471731,"text":"All email was like this at one time. In the 90s we were told to expect emails to take a few hours.<p>If you want immediate response use IRC or actually phone someone.","title":null,"type":"comment","url":null},{"author":"SoftTalker","children":[],"created_at":"2026-11-13T16:49:43.000Z","created_at_i":1794588583,"id":50486166,"options":[],"parent_id":50480544,"points":null,"story_id":50471731,"text":"I still manually check for mail. I don&#x27;t want distracting notifications popping up at random.","title":null,"type":"comment","url":null},{"author":"xp84","children":[{"author":"rvba","children":[],"created_at":"2026-11-14T20:23:32.000Z","created_at_i":1794687812,"id":50500446,"options":[],"parent_id":50486170,"points":null,"story_id":50471731,"text":"you write about early 90s, while I mean 2009!","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T16:49:50.000Z","created_at_i":1794588590,"id":50486170,"options":[],"parent_id":50480544,"points":null,"story_id":50471731,"text":"Think about it in context. Polling constantly would consume a non-trivial amount of both bandwidth and server resources. 15 second intervals would require 60 times as many very expensive servers to handle a certain number of users as 15 minutes would.<p>And in the 1990s, people were just adopting email, and their existing context was mail that arrived daily. Other than IRC, nobody had ever experienced any instant instantaneous form of communication other than phone calls, so nobody really felt like they were missing anything if they didn\u2019t get notified about an email for 15 minutes.<p>Today by contrast, I feel like 3&#x2F;4 of the time I go into my email client it\u2019s to get some login code sent by some stupid website, so from this perspective 15 minutes sounds like absolute torture.","title":null,"type":"comment","url":null},{"author":"j45","children":[],"created_at":"2026-11-13T16:53:20.000Z","created_at_i":1794588800,"id":50486217,"options":[],"parent_id":50480544,"points":null,"story_id":50471731,"text":"This seemed a little hard to believe but it sounded like it was more of a replication where it was downloading things into an offline mode where you then write your emails and send them back again period. Other email clients might do this as well if you&#x27;re running it on your desktop.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:16:13.000Z","created_at_i":1794561373,"id":50480544,"options":[],"parent_id":50479610,"points":null,"story_id":50471731,"text":"why did Lotus desktop download emails only every 15 (?) minutes?<p>I remember people phoning to say &quot;I&quot;ve sent you an email, press the manual refresh button to get it faster&quot;.<p>up to this day I ask if companies use Lotus and those who remember just shake their heads","title":null,"type":"comment","url":null},{"author":"Reason077","children":[],"created_at":"2026-11-13T17:23:21.000Z","created_at_i":1794590601,"id":50486659,"options":[],"parent_id":50479610,"points":null,"story_id":50471731,"text":"\u201cDomino\u201d just seems like a really bad name for a server&#x2F;cloud product. The memes! The analogies!","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:26:22.000Z","created_at_i":1794554782,"id":50479610,"options":[],"parent_id":50479407,"points":null,"story_id":50471731,"text":"Explaining Exchange to us older folks is like explaining an iPhone to younger generations. :p<p>As an aside, I worked on Lotus Domino\u2014IBM&#x27;s competitor to MS Exchange\u2014before it was sold it off in 2018.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:59:09.000Z","created_at_i":1794553149,"id":50479407,"options":[],"parent_id":50479380,"points":null,"story_id":50471731,"text":"To test our code changes, we would check out a VM that was running Microsoft Windows Server edition which was a beefy VM that was running Exchange. It was a carbon copy of the server running in production.<p>The Exchange code base frankly was a behemoth. No one had a full understanding of how it worked E2E. I am just sharing how I understood it. I was only a lowly L63 btw.","title":null,"type":"comment","url":null},{"author":"cowlevel","children":[{"author":"MattPalmer1086","children":[{"author":"PUSH_AX","children":[],"created_at":"2026-11-13T10:07:26.000Z","created_at_i":1794564446,"id":50481085,"options":[],"parent_id":50480549,"points":null,"story_id":50471731,"text":"It is neither a positive nor a negative.","title":null,"type":"comment","url":null},{"author":"mbreese","children":[{"author":"xnx","children":[],"created_at":"2026-11-15T02:58:02.000Z","created_at_i":1794711482,"id":50503544,"options":[],"parent_id":50482129,"points":null,"story_id":50471731,"text":"We&#x27;ll see about that.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:43:11.000Z","created_at_i":1794570191,"id":50482129,"options":[],"parent_id":50480549,"points":null,"story_id":50471731,"text":"As my dad would say, it\u2019s kind of the point. Being old is better than the alternative.","title":null,"type":"comment","url":null},{"author":"layer8","children":[{"author":"Guy-ute","children":[],"created_at":"2026-11-13T14:21:04.000Z","created_at_i":1794579664,"id":50483900,"options":[],"parent_id":50482916,"points":null,"story_id":50471731,"text":"60 years after birth you&#x27;re either old or you&#x27;re dead, so not too bad.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:01:53.000Z","created_at_i":1794574913,"id":50482916,"options":[],"parent_id":50480549,"points":null,"story_id":50471731,"text":"Statistically yes, in terms of personal health.","title":null,"type":"comment","url":null},{"author":"drysine","children":[],"created_at":"2026-11-14T21:13:09.000Z","created_at_i":1794690789,"id":50500874,"options":[],"parent_id":50480549,"points":null,"story_id":50471731,"text":"Remaining life expectancy is not what it used to be","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:16:51.000Z","created_at_i":1794561411,"id":50480549,"options":[],"parent_id":50480371,"points":null,"story_id":50471731,"text":"Is being old a negative?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:57:05.000Z","created_at_i":1794560225,"id":50480371,"options":[],"parent_id":50479380,"points":null,"story_id":50471731,"text":"Don&#x27;t frame it as a negative. This is what it feels like to know things that other people don&#x27;t know.","title":null,"type":"comment","url":null},{"author":"Frost1x","children":[{"author":"dieselgate","children":[{"author":"tniemi","children":[],"created_at":"2026-11-14T10:18:37.000Z","created_at_i":1794651517,"id":50495759,"options":[],"parent_id":50489201,"points":null,"story_id":50471731,"text":"Always number your cards. Gotcha.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T20:29:35.000Z","created_at_i":1794601775,"id":50489201,"options":[],"parent_id":50482523,"points":null,"story_id":50471731,"text":"My father has told some stories about waiting in line to run punch card programs and people dropping their stack and becoming flustered about it. They&#x27;re funny to hear and mentioning it because this is the first I&#x27;ve ever heard it mentioned elsewhere.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T12:24:51.000Z","created_at_i":1794572691,"id":50482523,"options":[],"parent_id":50479380,"points":null,"story_id":50471731,"text":"It\u2019s interesting how relative this is, reading by the comments and stories around them. A previous coworker started computing in the punch card era and would tell stories of dropping your stack of cards and having to reorder them, using the printouts to debug, and so on. And helping develop what\u2019s now known as fork() for processes (although it predated fork and he had his own name for it), and helping develop a commercial RDBMS before they existed all in a non tech industry career.<p>So when I read about Exchange Server to me it still feels quite modern.","title":null,"type":"comment","url":null},{"author":"j45","children":[],"created_at":"2026-11-13T16:52:29.000Z","created_at_i":1794588749,"id":50486205,"options":[],"parent_id":50479380,"points":null,"story_id":50471731,"text":"I doubt it has something to do with being old, running an email server of any kind, let alone knowing how email works, let alone using email, have been all various abstractions to help make users into consumers who pay more than people who know how to build and run this infrastructure.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:55:29.000Z","created_at_i":1794552929,"id":50479380,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"&quot;So email uses something called Microsoft Exchange Server&quot;<p>Is this what it feels like to be old?","title":null,"type":"comment","url":null},{"author":"cmckn","children":[{"author":"AbbeFaria","children":[],"created_at":"2026-11-13T07:00:19.000Z","created_at_i":1794553219,"id":50479420,"options":[],"parent_id":50479402,"points":null,"story_id":50471731,"text":"This is common knowledge. Try googling EdgeTransport.exe and you should see the outdated documentation for Exchange Server on-Prem.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:58:27.000Z","created_at_i":1794553107,"id":50479402,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"If that\u2019s all you\u2019ve got, I\u2019d probably scrub this and keep your NDA intact.","title":null,"type":"comment","url":null},{"author":"hyperman1","children":[{"author":"user43928","children":[],"created_at":"2026-11-13T11:08:04.000Z","created_at_i":1794568084,"id":50481813,"options":[],"parent_id":50479428,"points":null,"story_id":50471731,"text":"I don&#x27;t know what OP means. The deployment pipeline takes weeks or the release process?<p>The latter is probably the case for most enterprises.<p>Getting releases deployed into the testing environments, much less production, requires coordination, testing, reports and sign-offs.<p>Of course this can normally be expedited or bypassed for incident management and critical fixes.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:01:33.000Z","created_at_i":1794553293,"id":50479428,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"If it takes weeks to get some code into production, I understand how AI can enormously speed up things.  Yes, AI can be fantastic but if people claim 100x increase, something else is majorly fubar.","title":null,"type":"comment","url":null},{"author":"senectus1","children":[{"author":"Aloha","children":[{"author":"pards","children":[],"created_at":"2026-11-13T12:36:15.000Z","created_at_i":1794573375,"id":50482643,"options":[],"parent_id":50479795,"points":null,"story_id":50471731,"text":"Did search _ever_ work, though?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:46:59.000Z","created_at_i":1794556019,"id":50479795,"options":[],"parent_id":50479533,"points":null,"story_id":50471731,"text":"I suspect that the search is broken because it relies on the exchange bits to find users.","title":null,"type":"comment","url":null},{"author":"bgarbiak","children":[],"created_at":"2026-11-13T08:05:07.000Z","created_at_i":1794557107,"id":50479943,"options":[],"parent_id":50479533,"points":null,"story_id":50471731,"text":"From the Health Status page:<p>&quot;Microsoft Teams: Most of the core functionality including joining calls, meetings, group chats, and channel messages are not impacted.\n<i>Scenarios that depend on Exchange Online, including Calendar related failures with scheduling, invites, viewing, and meeting edits. Creation of Live or Virtual events fail. Failures with Copilot responses for outlook, calendar, or M365 files, read history, or adding to new chats. Navigating to App chats, adding new contacts or syncing contacts in settings fail.</i> Standard channels are working fine but users may experience the inability to create or delete private or shared channels.&quot;","title":null,"type":"comment","url":null},{"author":"apexalpha","children":[],"created_at":"2026-11-13T08:29:05.000Z","created_at_i":1794558545,"id":50480150,"options":[],"parent_id":50479533,"points":null,"story_id":50471731,"text":"Teams relies on Exchange API to autocomplete your search for colleagues, if you know someone&#x27;s full email you should be able to start it that way.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:14:06.000Z","created_at_i":1794554046,"id":50479533,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"we seem to be unable to start new chat sessions with people we haven&#x27;t chatted with internally before. so team is at least partially down.","title":null,"type":"comment","url":null},{"author":"hobofan","children":[{"author":"AvocadoPanic","children":[],"created_at":"2026-11-13T17:31:14.000Z","created_at_i":1794591074,"id":50486764,"options":[],"parent_id":50479586,"points":null,"story_id":50471731,"text":"There&#x27;s Skype for Business SE too. They&#x27;ve recently brought back the group chat feature.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T07:22:05.000Z","created_at_i":1794554525,"id":50479586,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"&gt; Microsoft Exchange Server, there used to be an on-premises version of this but MS stopped supporting it<p>After many enterprise customers refused to migrate Exchange Server SE exists since 2025 and will be supported until at least 2035.<p>Though given how the quality of their updates are going one could still say that it&#x27;s &quot;not supported&quot;, but at least they are charging money for it!","title":null,"type":"comment","url":null},{"author":"igleria","children":[{"author":"_1tan","children":[{"author":"fuzzfactor","children":[],"created_at":"2026-11-13T16:28:26.000Z","created_at_i":1794587306,"id":50485854,"options":[],"parent_id":50480173,"points":null,"story_id":50471731,"text":"I guess when you do the math that&#x27;s Microsoft 364, and counting down :\\","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:31:14.000Z","created_at_i":1794558674,"id":50480173,"options":[],"parent_id":50480142,"points":null,"story_id":50471731,"text":"Yep, same here from Germany.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:27:59.000Z","created_at_i":1794558479,"id":50480142,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"oof, here in Ireland outlook still down this morning. teams seems to be there tho.","title":null,"type":"comment","url":null},{"author":"Betelbuddy","children":[{"author":"jasonvorhe","children":[],"created_at":"2026-11-13T12:31:09.000Z","created_at_i":1794573069,"id":50482586,"options":[],"parent_id":50480254,"points":null,"story_id":50471731,"text":"Microsoft product reliability has been a running joke since the company started launching products. Why would anything change just because they pivoted to managed services instead of shipping install media?","title":null,"type":"comment","url":null},{"author":"NetMageSCW","children":[],"created_at":"2026-11-13T15:41:19.000Z","created_at_i":1794584479,"id":50485132,"options":[],"parent_id":50480254,"points":null,"story_id":50471731,"text":"It\u2019s a distributed system with thousands of servers with automatic update distribution and config change distribution. Bad changes can propagate across the entire system though Microsoft status updates say they didn\u2019t see any change that seemed relevant. It could also be a bug across all the uniform code that somehow triggered. For example Cisco BE servers once had a firmware bug that after 32767 hours the fans would all run at 100% speed.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:41:00.000Z","created_at_i":1794559260,"id":50480254,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"Ok but why would all infra would go down everywhere, at the same time? Is it all a big server? Are there any Architects left or is it all Golf Players?","title":null,"type":"comment","url":null},{"author":"tallanvor","children":[{"author":"j45","children":[],"created_at":"2026-11-13T16:51:50.000Z","created_at_i":1794588710,"id":50486197,"options":[],"parent_id":50480437,"points":null,"story_id":50471731,"text":"I would hope that enough hardening has happened over the last 20 or 30 years.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:03:10.000Z","created_at_i":1794560590,"id":50480437,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"This hasn&#x27;t been the case for a long time.  Unfortunately there are micro services that can still bring down the system if there&#x27;s a bad enough bug.  That&#x27;s not supposed to be able to happen as updates roll out over a period of time.  Unfortunately you can still get bit if another update creates a bug that takes out instances faster than they can be recreated.","title":null,"type":"comment","url":null},{"author":"jjav","children":[{"author":"Iulioh","children":[],"created_at":"2026-11-13T09:39:02.000Z","created_at_i":1794562742,"id":50480782,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"Every non tech company uses outlook, basically.","title":null,"type":"comment","url":null},{"author":"w4der","children":[],"created_at":"2026-11-13T09:39:08.000Z","created_at_i":1794562748,"id":50480784,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"Many, many big companies do, and some universities also moved to MS365 when Google downgraded their free campus agreement, because they were already paying for MS365 for Office and that came with cloud storage and outlook.","title":null,"type":"comment","url":null},{"author":"phatfish","children":[{"author":"infecto","children":[{"author":"jfsebastian","children":[],"created_at":"2026-11-13T10:50:57.000Z","created_at_i":1794567057,"id":50481616,"options":[],"parent_id":50481515,"points":null,"story_id":50471731,"text":"Completely agree. Teams and Outlook is the de facto standard.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:42:51.000Z","created_at_i":1794566571,"id":50481515,"options":[],"parent_id":50480788,"points":null,"story_id":50471731,"text":"Probably all of the Fortune 500 except some of the tech companies.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:39:33.000Z","created_at_i":1794562773,"id":50480788,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"Most of the Fortune 500?","title":null,"type":"comment","url":null},{"author":"oytis","children":[],"created_at":"2026-11-13T09:54:43.000Z","created_at_i":1794563683,"id":50480937,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"It&#x27;s not about outlook the mailing app. They called their SaaS e-mail Outlook, you can use it without using Windows, in the same way as Gmail. Pretty popular in the corporate world","title":null,"type":"comment","url":null},{"author":"LegitShady","children":[],"created_at":"2026-11-13T10:13:58.000Z","created_at_i":1794564838,"id":50481148,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"It&#x27;s interesting what kind of bubbles people live in.","title":null,"type":"comment","url":null},{"author":"infecto","children":[{"author":"jjav","children":[],"created_at":"2026-11-14T10:08:36.000Z","created_at_i":1794650916,"id":50495688,"options":[],"parent_id":50481510,"points":null,"story_id":50471731,"text":"&gt; Sounds like you live in the Silicon Valley bubble.<p>I do, aside from research lab work on the east coast, all my career has been in Silicon Valley.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:42:08.000Z","created_at_i":1794566528,"id":50481510,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"Sounds like you live in the Silicon Valley bubble. I don\u2019t have a stat but I would wager that most businesses (especially larger ones) run on outlook&#x2F;exchange.<p>You have probably mostly worked for tech companies where business employees were not the primary workforce. When you think about it most other business generally have everyone needing a word, excel or PowerPoint. It bundles cleanly with the whole package.","title":null,"type":"comment","url":null},{"author":"martin-","children":[{"author":"jjav","children":[],"created_at":"2026-11-14T10:06:54.000Z","created_at_i":1794650814,"id":50495673,"options":[],"parent_id":50481530,"points":null,"story_id":50471731,"text":"&gt; I&#x27;m assuming your &quot;surprise&quot; isn&#x27;t genuine.<p>My surprise is very real. I mean of course I know Windows still exists but in my ~35 year career over 10 companies, I have never seen it used.<p>In my early career all companies were on SunOS, later Solaris. Then morphing into Linux, some BSD, and a mix of Linux and Mac over the last decade+. Never seen Windows being used.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:43:37.000Z","created_at_i":1794566617,"id":50481530,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"Windows is still by far the most popular OS for employees at big companies. Using Microsoft&#x27;s SharePoint&#x2F;Outlook&#x2F;etc is also extremely common.<p>I&#x27;m assuming your &quot;surprise&quot; isn&#x27;t genuine.","title":null,"type":"comment","url":null},{"author":"gpvos","children":[],"created_at":"2026-11-13T10:52:40.000Z","created_at_i":1794567160,"id":50481642,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"A large majority of companies I&#x27;ve worked for over the last 30+ years used Outlook and Exchange Server, or now M$365, for email, even in those cases when my actual work was on Linux. The exception were those that used Gmail...","title":null,"type":"comment","url":null},{"author":"lxgr","children":[{"author":"dmd","children":[],"created_at":"2026-11-13T12:25:27.000Z","created_at_i":1794572727,"id":50482531,"options":[],"parent_id":50481880,"points":null,"story_id":50471731,"text":"Of the ~40 companies I work with on a daily basis, 40 use Outlook.","title":null,"type":"comment","url":null},{"author":"swasheck","children":[{"author":"wcfields","children":[],"created_at":"2026-11-13T17:31:29.000Z","created_at_i":1794591089,"id":50486769,"options":[],"parent_id":50483226,"points":null,"story_id":50471731,"text":"Last big corp I worked for had a half-half setup of Outlook for email (and you were reminded that messages are retained for 7 years) and used Zoom+Slack instead of Teams (it was disabled, so not even an option), but we did use Sharepoint.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:31:06.000Z","created_at_i":1794576666,"id":50483226,"options":[],"parent_id":50481880,"points":null,"story_id":50471731,"text":"I\u2019ve worked at 2 companies who used Google for email and calendaring but still relied on O365 (one of the many naming incarnations) for Word, Excel, and PowerPoint. Microsoft really do have quite a mindshare foothold in the office productivity market.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:15:23.000Z","created_at_i":1794568523,"id":50481880,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"&gt; I must live in a bubble... the last time I heard of anyone using Outlook was when Scott McNealy was calling it LookOut! in the 90s. [...] In a ~35 year tech career I have never been exposed to, nor used Windows nor Outlook and have never met anyone who does.<p>Yes, then you probably at least work in a bubble.<p>In my experience, it&#x27;s more common than GSuite in most companies outside of startups and big tech and is ubiquitous at schools, among many, many other entities.","title":null,"type":"comment","url":null},{"author":"Guy-ute","children":[],"created_at":"2026-11-13T14:23:09.000Z","created_at_i":1794579789,"id":50483924,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"You are absolutely living in a bubble. The vast vast majority of US companies are using both Windows and Outlook.","title":null,"type":"comment","url":null},{"author":"lokar","children":[],"created_at":"2026-11-13T14:39:23.000Z","created_at_i":1794580763,"id":50484179,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"I\u2019m with you.  I took a job in finance at one point, reporting to the CTO.  On the first day they showed me my desk, a windows machine.  I had not used it since high school, and not seriously then.  It just never occurred to me that you would have engineers use windows (all the trading systems were Linux).<p>The CTO had to pull a bunch of strings to let me run Linux.","title":null,"type":"comment","url":null},{"author":"realaaa","children":[],"created_at":"2026-11-15T01:20:50.000Z","created_at_i":1794705650,"id":50503003,"options":[],"parent_id":50480742,"points":null,"story_id":50471731,"text":"wow I want to live in your universe man !","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T09:35:21.000Z","created_at_i":1794562521,"id":50480742,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"All the MS memes today made me realize people still use Outlook?<p>I must live in a bubble... the last time I heard of anyone using Outlook was when Scott McNealy was calling it LookOut! in the 90s.<p>In a ~35 year tech career I have never been exposed to, nor used Windows nor Outlook and have never met anyone who does. Who are these companies that still use it?","title":null,"type":"comment","url":null},{"author":"jfsebastian","children":[{"author":"jasonvorhe","children":[],"created_at":"2026-11-13T12:27:56.000Z","created_at_i":1794572876,"id":50482563,"options":[],"parent_id":50481695,"points":null,"story_id":50471731,"text":"Email has been quite robust over the past~ 30 years. Exchange is just email by Microsoft so of course it&#x27;ll be more brittle.","title":null,"type":"comment","url":null},{"author":"chrisandchris","children":[{"author":"cekanoni","children":[],"created_at":"2026-11-13T14:19:43.000Z","created_at_i":1794579583,"id":50483873,"options":[],"parent_id":50483160,"points":null,"story_id":50471731,"text":"amin to that!","title":null,"type":"comment","url":null},{"author":"xp84","children":[{"author":"chrisandchris","children":[],"created_at":"2026-11-14T06:55:08.000Z","created_at_i":1794639308,"id":50494688,"options":[],"parent_id":50485216,"points":null,"story_id":50471731,"text":"I do self-host my personal email and IMHO, spam isn&#x27;t the biggest issue. I have that, with the help of some blocklist, quite under control. The occiasional flow of spam arrives every couple of weeks which requires small tweaking.<p>What drives me nuts is the inability to host calendar and contacts yourself &amp; sync it to other devices. If that thing was solved (like proper invitations to calendar events to 3rd parties), I think self-hosted would be used much more often.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T15:46:45.000Z","created_at_i":1794584805,"id":50485216,"options":[],"parent_id":50483160,"points":null,"story_id":50471731,"text":"Yeah I don\u2019t think anyone wanted that, we just ended up this way because it makes spam control more convenient. Without spam, email is incredibly simple to self-host. I suspect it may have ended up one of the most common services for companies to self-host.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:24:18.000Z","created_at_i":1794576258,"id":50483160,"options":[],"parent_id":50481695,"points":null,"story_id":50471731,"text":"&gt; What is driving me nuts is that we still heavily rely on email.<p>That itself wouldn&#x27;t be a problem - email is very decentralised.<p>The problem is that we thought that putting like 2 companies in charge of most email communication is a good idea.","title":null,"type":"comment","url":null},{"author":"xp84","children":[],"created_at":"2026-11-13T15:45:08.000Z","created_at_i":1794584708,"id":50485191,"options":[],"parent_id":50481695,"points":null,"story_id":50471731,"text":"What\u2019s worse is how many things force an email second factor now. No choice to make a TOTP or to use a passkey (which, with biometrics securing it, is two friggin factors at once, and should be all we need for anything that isn\u2019t nuclear secrets!!!! Sorry this just kills me with every SaaS product I have to \u201ctwo-factor\u201d to daily).<p>Your email is down? Cool now you can\u2019t log into anything.","title":null,"type":"comment","url":null},{"author":"franga2000","children":[],"created_at":"2026-11-13T21:12:54.000Z","created_at_i":1794604374,"id":50489735,"options":[],"parent_id":50481695,"points":null,"story_id":50471731,"text":"Meanwhile we were very happy that we mainly rely on email. We were still able to send out urgent messages (like  &quot;sorry if we don&#x27;t reply, Microsoft is down, you can reach us by [phone] or [backup email]&quot;) via SMTP and if we <i>really</i> needed to receive some email, we&#x27;d be able to set up a secondary MX record to a holding server in about an hour.<p>If we were mainly using Teams or whatever other &quot;better than email&quot; service and that had an outage, we&#x27;d actually be in the dark!<p>As the resident complainer about Microsoft lock-in, I was honestly quite surprised by how well we could work around this. Don&#x27;t get me wrong, if it was Entra that fell over, we&#x27;d be thoroughly fucked, but Exchange wasn&#x27;t all that bad.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:58:11.000Z","created_at_i":1794567491,"id":50481695,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"What is driving me nuts is that we still heavily rely on email. Even to the point were we are unable to get notifications other than that.<p>I work at a fortune 500 company and they got me, 3 hours after I started working , the basic info about the obvious the internet is already screaming at you.<p>Since we are responsible for a large web application I tried to reach out to people through VIVA (yes, we only make use of that) and we managed only to reach about 2-3% of the user base. Information-wise it&#x27;s like a blackout. For living in 2026 this is completely unacceptable.","title":null,"type":"comment","url":null},{"author":"EvanAnderson","children":[{"author":"j45","children":[],"created_at":"2026-11-13T16:51:14.000Z","created_at_i":1794588674,"id":50486190,"options":[],"parent_id":50483143,"points":null,"story_id":50471731,"text":"Exchange should be well protected behind a firewall or 10 after all these years.<p>What this leaves is a comparison of whether on-premise exchange servers have been compromised or down compared to the cloud.","title":null,"type":"comment","url":null},{"author":"bigfatkitten","children":[{"author":"EvanAnderson","children":[{"author":"bigfatkitten","children":[{"author":"EvanAnderson","children":[],"created_at":"2026-11-13T22:22:08.000Z","created_at_i":1794608528,"id":50490860,"options":[],"parent_id":50490490,"points":null,"story_id":50471731,"text":"My take is they want anything on-prem to go away.<p>Exchange, in particular, is sort of &quot;feature complete&quot; to me. I&#x27;m happy w&#x2F; what it does and how it does it for the most part.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T21:57:37.000Z","created_at_i":1794607057,"id":50490490,"options":[],"parent_id":50490006,"points":null,"story_id":50471731,"text":"The difference with their other products is that they generally want you to adopt it, and they actually do feature development, neither of which are true for Exchange SE.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T21:27:58.000Z","created_at_i":1794605278,"id":50490006,"options":[],"parent_id":50489412,"points":null,"story_id":50471731,"text":"Realistically, though, when it comes to support that&#x27;s every MSFT product unless your org is shelling-out support dollars in advance.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T20:46:53.000Z","created_at_i":1794602813,"id":50489412,"options":[],"parent_id":50483143,"points":null,"story_id":50471731,"text":"Microsoft will still charge you money for Exchange SE, and occasionally release security and other bug fixes, but \u201csupported\u201d is an extremely generous description of the state of the product.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:23:07.000Z","created_at_i":1794576187,"id":50483143,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"&gt; So email uses something called Microsoft Exchange Server, there used to be an on-premises version of this but MS stopped supporting it ...<p>On-premises Exchange is still supported and licensed. It&#x27;s a subscription instead of a perpetual license.<p>&gt; I don\u2019t know if what I said is accurate but know that Exchange server code was like a fossil that didn\u2019t change as much, over the ~5 years I worked on it from 2019-2024.<p>Exchange is a mature product (albeit not without its flaws). Its era of change was between its 2007 and 2013 versions (inclusive) when it was made more modular and many parts were ported to the .NET runtime. The 2016, 2019, and now Subscription Edition codebases were more of an evolution and has much less churn.","title":null,"type":"comment","url":null},{"author":"glitchbot","children":[{"author":"reaperducer","children":[{"author":"nomadygnt","children":[],"created_at":"2026-11-13T17:33:08.000Z","created_at_i":1794591188,"id":50486797,"options":[],"parent_id":50485596,"points":null,"story_id":50471731,"text":"I&#x27;m not a middle manager and in general I agree with you. But I tried to log in and it sent a code to my email. Whelp... I&#x27;ll do what I can I guess.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T16:09:37.000Z","created_at_i":1794586177,"id":50485596,"options":[],"parent_id":50484277,"points":null,"story_id":50471731,"text":"All I see today is middle managers using an e-mail outage as an excuse for not getting things done yesterday.<p>Pick. Up. The. God. Damned. Phone. And do your job.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T14:46:06.000Z","created_at_i":1794581166,"id":50484277,"options":[],"parent_id":50479360,"points":null,"story_id":50471731,"text":"I see Walker and Texas ranger running around screaming ANARCHY?","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T06:52:26.000Z","created_at_i":1794552746,"id":50479360,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Ex-MSFT here, sharing my outdated POV based on working on a product that was using Microsoft Exchange and therefore was hooked onto the email delivery pipeline.<p>Note that the infra for M365, Azure etc is different. They would be running on servers hosted in MSFT DCs but have completely different CI&#x2F;CD pipelines. M365 services have their own deployment pipelines and it takes on the order of weeks to deploy your changes to production.<p>Considering the fact that Outlook is down, clearly email doesn\u2019t seem to be working. So email uses something called Microsoft Exchange Server, there used to be an on-premises version of this but MS stopped supporting it to run the cloud version hereby called M365. Email is one big \u201cmacro-service\u201d, if you\u2019re running Windows Server, look at the process called \u201cEdgeTransport.exe\u201d this is responsible for sending&#x2F;receiving email on Windows Servers. There are probably multiple 100s of services supported by 100s of teams that are run while email is routed from sender to receiver via MSFT Exchange servers. My recollection is that even if one of these services goes down or introduces latency in the pipeline, it caused a major incident. When I was working in M365 Security in 2024, this Exchange Server pipeline was called \u201clegacy\u201d because it\u2019s one big .NET Framework service. I don\u2019t know if they upgraded to .NET core but developing on this was as HN comments say, very janky.<p>The reason Teams doesn\u2019t seem to be down is that Teams services are completely different and are written using .NET Core and have their own separate release pipeline. It was much easier to interact with Teams services. I actually worked closely with the team that was responsible for ingesting Teams messages to the customer\u2019s data store. Their code base was much more modern and easy to understand. Exchange Server not so much.<p>I don\u2019t know if what I said is accurate but know that Exchange server code was like a fossil that didn\u2019t change as much, over the ~5 years I worked on it from 2019-2024.<p>Story time over.","title":null,"type":"comment","url":null},{"author":"nnevatie","children":[],"created_at":"2026-11-13T07:29:24.000Z","created_at_i":1794554964,"id":50479636,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"We&#x27;ll see a global productivity spike, as no one needs to attend to useless Teams sessions.","title":null,"type":"comment","url":null},{"author":"mmoustafa","children":[],"created_at":"2026-11-13T07:59:26.000Z","created_at_i":1794556766,"id":50479900,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"12 hours later, outlook still down","title":null,"type":"comment","url":null},{"author":"monegator","children":[],"created_at":"2026-11-13T08:06:58.000Z","created_at_i":1794557218,"id":50479962,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Are you guys able to create accounts? i&#x27;ve tried last night with half a dozen emails and no OTP received yet","title":null,"type":"comment","url":null},{"author":"grumblepeet","children":[],"created_at":"2026-11-13T08:09:58.000Z","created_at_i":1794557398,"id":50479994,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Maybe problems with the Microsoft 365 Substrate that they dont like to talk too much about, but uses Microsoft Exchange code base to store copies of data that is exposed in higher level services. Some of Teams data is stored there (you cant get at it from Exchange) but not all. It also is involved in retention and other stuff used in Purview.<p>My knowledge of this isnt great, but I remember being given a briefing on some of this years ago.","title":null,"type":"comment","url":null},{"author":"amai","children":[],"created_at":"2026-11-13T08:14:37.000Z","created_at_i":1794557677,"id":50480036,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Seem like one of the fired persons had a placed a timebomb ...","title":null,"type":"comment","url":null},{"author":"amai","children":[],"created_at":"2026-11-13T08:18:19.000Z","created_at_i":1794557899,"id":50480066,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Who would have thought that outsourcing everything to Microsoft would be a bad idea.","title":null,"type":"comment","url":null},{"author":"miyuru","children":[],"created_at":"2026-11-13T08:18:36.000Z","created_at_i":1794557916,"id":50480070,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Shouldn&#x27;t the AI they are using, fix this issue in couple of hours at least.<p>surly MS can afford flagship models.","title":null,"type":"comment","url":null},{"author":"woggy","children":[{"author":"hereonout2","children":[],"created_at":"2026-11-13T08:32:35.000Z","created_at_i":1794558755,"id":50480187,"options":[],"parent_id":50480134,"points":null,"story_id":50471731,"text":"Great 30 mins before I logon for my usual day of Teams meetings:(","title":null,"type":"comment","url":null},{"author":"layoric","children":[],"created_at":"2026-11-13T08:35:35.000Z","created_at_i":1794558935,"id":50480209,"options":[],"parent_id":50480134,"points":null,"story_id":50471731,"text":"Still 100% down in Australia, didn&#x27;t work the whole day.","title":null,"type":"comment","url":null},{"author":"aurareturn","children":[],"created_at":"2026-11-13T08:39:42.000Z","created_at_i":1794559182,"id":50480248,"options":[],"parent_id":50480134,"points":null,"story_id":50471731,"text":"Nothing here. Still no email. Can&#x27;t send, can&#x27;t receive. Just insane.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T08:27:26.000Z","created_at_i":1794558446,"id":50480134,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I think emails are starting to come through","title":null,"type":"comment","url":null},{"author":"erdoc69","children":[],"created_at":"2026-11-13T08:42:05.000Z","created_at_i":1794559325,"id":50480265,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"At this point Microsoft should just throw in the towel and replace Exchange Server with postfix or something. At least we know those tried-and-true FOSS products work.","title":null,"type":"comment","url":null},{"author":"mike_watson","children":[],"created_at":"2026-11-13T08:44:22.000Z","created_at_i":1794559462,"id":50480282,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Hopefully, AI can help them fix it.","title":null,"type":"comment","url":null},{"author":"dlcarrier","children":[],"created_at":"2026-11-13T08:59:39.000Z","created_at_i":1794560379,"id":50480401,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"The magic eight ball predicted this, when it said:<p><pre><code>    Outlook not so good</code></pre>","title":null,"type":"comment","url":null},{"author":"snvzz","children":[],"created_at":"2026-11-13T10:23:24.000Z","created_at_i":1794565404,"id":50481276,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"&gt;service degradation<p>Gotta love the PR damagecontrol speak for global outage.","title":null,"type":"comment","url":null},{"author":"sammy2255","children":[{"author":"philipwhiuk","children":[{"author":"sammy2255","children":[{"author":"Merrill","children":[],"created_at":"2026-11-13T12:32:45.000Z","created_at_i":1794573165,"id":50482607,"options":[],"parent_id":50482133,"points":null,"story_id":50471731,"text":"hotmail.com seems to be delivering spam normally. The public MS mail systems must use different infrastructure.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:43:34.000Z","created_at_i":1794570214,"id":50482133,"options":[],"parent_id":50482080,"points":null,"story_id":50471731,"text":"For personal outlook","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T11:37:44.000Z","created_at_i":1794569864,"id":50482080,"options":[],"parent_id":50481346,"points":null,"story_id":50471731,"text":"That doesn&#x27;t work. Your tenant location is fixed.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:28:02.000Z","created_at_i":1794565682,"id":50481346,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Service is back in Japan if anyone wants to VPN and check their emails","title":null,"type":"comment","url":null},{"author":"larodi","children":[{"author":"philipwhiuk","children":[],"created_at":"2026-11-13T11:37:06.000Z","created_at_i":1794569826,"id":50482071,"options":[],"parent_id":50481610,"points":null,"story_id":50471731,"text":"&gt; Curious nobody allows for the possibility this all comes as result of some adversarial action on behalf of \u2026 potentially so many actors, and given the recent streak and stream of CVEs discovered with help of LLMs.<p>Occam&#x27;s razor.","title":null,"type":"comment","url":null},{"author":"mmillin","children":[{"author":"jkkola","children":[{"author":"tremon","children":[],"created_at":"2026-11-13T15:16:08.000Z","created_at_i":1794582968,"id":50484763,"options":[],"parent_id":50483025,"points":null,"story_id":50471731,"text":"Microsoft employs enough people that they can afford to have one team scan for unusual ingress&#x2F;egress traffic patterns while others work on troubleshooting. If not, they should not be shedding 60k employees right now.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:11:23.000Z","created_at_i":1794575483,"id":50483025,"options":[],"parent_id":50482595,"points":null,"story_id":50471731,"text":"I think the &quot;at this time&quot; is important, they were probably more focused on bringing everything back rather than doing a full investigation. I&#x27;m curious about the post mortem.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T12:32:14.000Z","created_at_i":1794573134,"id":50482595,"options":[],"parent_id":50481610,"points":null,"story_id":50471731,"text":"For what it\u2019s worth, the latest status updates from Microsoft address this concern: \u201cAt this time, we have no evidence of malicious activity associated with this incident.\u201d<p>Abscence of evidence vs evidence of absence notwithstanding, it\u2019s probably best not to overly speculate.","title":null,"type":"comment","url":null},{"author":"jasonvorhe","children":[],"created_at":"2026-11-13T13:10:47.000Z","created_at_i":1794575447,"id":50483018,"options":[],"parent_id":50481610,"points":null,"story_id":50471731,"text":"Looking at MS&#x27; track record I&#x27;m confused why anyone would assume a malicious 3rd party first while Microsoft has been &quot;trying to turn it off and on&quot; again for hours.","title":null,"type":"comment","url":null},{"author":"jasonvorhe","children":[],"created_at":"2026-11-13T16:08:36.000Z","created_at_i":1794586116,"id":50485579,"options":[],"parent_id":50481610,"points":null,"story_id":50471731,"text":"Blaming every outage on some evil AI aggressor isn&#x27;t helping. It&#x27;s just more FUD.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T10:50:34.000Z","created_at_i":1794567034,"id":50481610,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Curious nobody allows for the possibility this all comes as result of some adversarial action on behalf of \u2026 potentially so many actors, and given the recent streak and stream of CVEs discovered with help of LLMs.<p>So my bet is if this is in any way AI related - perhaps the reasoning should go the other way around and is not mere dumbness of otherwise great company everyone\u2019s buying like crazy for years now. Even my diehard Apple fans friends own MS stock.","title":null,"type":"comment","url":null},{"author":"tosti","children":[],"created_at":"2026-11-13T11:04:28.000Z","created_at_i":1794567868,"id":50481769,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"I just heard it works now, so I guess they got fed up and replaced Exchange with Postfix :)","title":null,"type":"comment","url":null},{"author":"haliliceylan","children":[],"created_at":"2026-11-13T11:16:29.000Z","created_at_i":1794568589,"id":50481892,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Its back","title":null,"type":"comment","url":null},{"author":"altern8","children":[],"created_at":"2026-11-13T12:34:02.000Z","created_at_i":1794573242,"id":50482624,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It seems to have started working again at my firm...","title":null,"type":"comment","url":null},{"author":"jimnotgym","children":[],"created_at":"2026-11-13T12:46:18.000Z","created_at_i":1794573978,"id":50482739,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Unfortunately it seems to be fixed","title":null,"type":"comment","url":null},{"author":"croes","children":[{"author":"jasonvorhe","children":[],"created_at":"2026-11-13T16:07:36.000Z","created_at_i":1794586056,"id":50485566,"options":[],"parent_id":50482928,"points":null,"story_id":50471731,"text":"It&#x27;s because MS is MS and will always be MS.","title":null,"type":"comment","url":null}],"created_at":"2026-11-13T13:02:49.000Z","created_at_i":1794574969,"id":50482928,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Is this because of MS using AI or despite MS using AI?","title":null,"type":"comment","url":null},{"author":"eranation","children":[],"created_at":"2026-11-13T13:18:14.000Z","created_at_i":1794575894,"id":50483108,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Microsoft 364","title":null,"type":"comment","url":null},{"author":"camillomiller","children":[],"created_at":"2026-11-13T13:26:50.000Z","created_at_i":1794576410,"id":50483184,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"The cognitive dissonance is infuriating. \nWe&#x27;re automating all and every software job, then this BS happens, and they&#x27;re out for almost a day. \nWhere are all the agents that would work without breaks to fix this is no time. \nBunch of AI-psychotic CEOs ruining all that&#x27;s been built so far. \nDisgusting.","title":null,"type":"comment","url":null},{"author":"cednore","children":[],"created_at":"2026-11-13T14:11:01.000Z","created_at_i":1794579061,"id":50483743,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"seems, it&#x27;s working now?","title":null,"type":"comment","url":null},{"author":"thatgloomyguy","children":[],"created_at":"2026-11-13T14:22:32.000Z","created_at_i":1794579752,"id":50483917,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Not yet fixed.","title":null,"type":"comment","url":null},{"author":"cjfd","children":[],"created_at":"2026-11-13T15:17:32.000Z","created_at_i":1794583052,"id":50484781,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"It seems this service degradation was noticed rather belatedly. I had the impression it started on April 4th, 1975.","title":null,"type":"comment","url":null},{"author":"OhMeadhbh","children":[],"created_at":"2026-11-13T16:22:03.000Z","created_at_i":1794586923,"id":50485763,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"<p><pre><code>   At   this   point  I&#x27;m  surprised  no   one&#x27;s   registered\n   [[ https:&#x2F;&#x2F;IsMicrosoftStillDown.Com&#x2F; ]] and points it to a\n   static page that just says &quot;yes.&quot;</code></pre>","title":null,"type":"comment","url":null},{"author":"capt_hotpants","children":[],"created_at":"2026-11-13T16:47:49.000Z","created_at_i":1794588469,"id":50486138,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Soo...<p>I did a 20-year stint in IT security (quit when my company was bought by a capital fond that wanted us to still do all the things but preferred not to pay wages.)<p>I still don&#x27;t feel qualified to guess what happened here - since I know next to nothing about this incident.<p>But darn it, it&#x27;s not like we have anything else to do...<p>So here&#x27;s my wild (emphasis) guess.<p>a) Lots of organisations have an &quot;allow any&quot; hole in their firewall for ike+ipsec, usually for reasons like &quot;that protocol seems complicated, firewalling it would be complicated&quot;, more or less.<p>b) There used to be botnets that could pacify routers with modified GRE datagrams, specifically the &quot;Mirai&quot; botnet, operating from hijacked webcams (doesn&#x27;t exist anymore afaik).<p>c) New botnets have surely emerged, and improved on the capabilities, maybe building on the publicized source code.<p>d) Just to give a random example, the &quot;Proxynvader&quot; botnet hijacks TV sticks; assessments vary but some experts say a quarter million, some say up to 8 million devices, each capable of delivering 0.1 Gbps into a volumetric attack.<p>I think it wouldn&#x27;t be far-fetched to imagine one of those botnets grew the capability to spoof fx. ipsec datagrams, and that someone out there decided it would be fun if Microsoft&#x27;s server parks started spending more time on fragment reassembly and decryption and less time doing whatever Microsoft thinks those servers should be doing.  And then began blasting them with traffic on fx. 4500&#x2F;udp.<p>(So in this example, traffic is routed around the normal ingress path through load balancers, tls offload, etc. for those servers, hitting them directly on a public IP via a permissive firewall rule instead.)<p>I think my odds of being correct are about 1% :-), since little is publicly known yet (and I personally know much much less than that.)<p>I enjoy reading the other theories here; some very interesting ones!<p>Haven&#x27;t given much thought to motivation, could be anything.  (I guess having an impact on the equity price means there&#x27;s theoretically a profit to be made though.)<p>(... tldr: &quot;ddos maybe?&quot; ...)","title":null,"type":"comment","url":null},{"author":"qwertyuiop_","children":[],"created_at":"2026-11-13T17:15:13.000Z","created_at_i":1794590113,"id":50486557,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"Need to bring back the laid off Americans to fix this. The offshore crew aint going to fix it.","title":null,"type":"comment","url":null},{"author":"OhMeadhbh","children":[],"created_at":"2026-11-13T21:24:20.000Z","created_at_i":1794605060,"id":50489939,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"<a href=\"https:&#x2F;&#x2F;imgflip.com&#x2F;i&#x2F;b5ty93\" rel=\"nofollow\">https:&#x2F;&#x2F;imgflip.com&#x2F;i&#x2F;b5ty93</a>","title":null,"type":"comment","url":null},{"author":"souvlakee","children":[],"created_at":"2026-11-14T02:24:32.000Z","created_at_i":1794623072,"id":50493019,"options":[],"parent_id":50471731,"points":null,"story_id":50471731,"text":"What if grounded pilots killed time in Flight Simulator, which overloaded Azure?","title":null,"type":"comment","url":null}],"created_at":"2026-11-12T18:20:48.000Z","created_at_i":1794507648,"id":50471731,"options":[],"parent_id":null,"points":1173,"story_id":50471731,"text":"<a href=\"https:&#x2F;&#x2F;www.abc.net.au&#x2F;news&#x2F;2026-11-13&#x2F;microsoft-outage-affects-users-worldwide&#x2F;107381050\" rel=\"nofollow\">https:&#x2F;&#x2F;www.abc.net.au&#x2F;news&#x2F;2026-11-13&#x2F;microsoft-outage-affe...</a><p><a href=\"https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;sysadmin&#x2F;comments&#x2F;1xuje83&#x2F;microsoft_office_seems_to_be_down&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;sysadmin&#x2F;comments&#x2F;1xuje83&#x2F;microsoft...</a><p><a href=\"https:&#x2F;&#x2F;downdetector.com&#x2F;status&#x2F;microsoft-365&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;downdetector.com&#x2F;status&#x2F;microsoft-365&#x2F;</a>","title":"Service degradation on Microsoft 365","type":"story","url":"https://status.cloud.microsoft/"}
