Cyber attacks or coincidence or something else?

That helps, thanks.

This is simultaneously comforting and disturbing.

Well… maybe… but the FAA groundstop was also a “so big” outage..

Assuming it was truly necessary to ground all the airlines. There have been ARTCC outages before, but they didn’t take down the entire system. Or was this having a couple ARTCC’s go down and someone in the maladministration decided to pull the plug on all of them?

This is a great synopsis. I’ll add some color: the Equifax hack a few years ago went on for much longer than it should have because of an expired certificate. Warning systems were trying to send alerts but the expired certificate meant they didn’t go. Apparently at some point Equifax noticed the expired cert, update it, and got a flood of notifications.

From a previous job:

Hanson’s Law: It’s a certificate issue.

Weald’s corollary: Even when it’s not a certificate issue, it’s a certificate issue.

Certificate expirations have been getting shorter and shorter, for good reasons) security related, of course). They’ve gone from years to months. Of course folks have developed automated systems to do the updates, but not everyone has them set up yet. So unexpected/unhandled expirations continue, and will for a while.

Just adding another IT incident to the list: I tried logging into the Kaiser website this morning and got a popup saying I needed to call in and change my password. (This after logging in successfully just yesterday)

According to the phone agent I talked to they had some kind of glitch in their system so everyone has to create a new password.

404 Media has an article discussing the idea that everything is breaking at once. Their hypothesis is that it is not a coordinated attack, but rather a set of similar bad decisions made by multiple groups that are all coming back to bite them in the ass. This is my summary of the list that they give.

  • mass layoffs of tech workers and related loss of institutional knowledge
  • mass deployment of AI written software that is not well understood
  • mass layoffs in the government and public sectors causing loss of government expertise and oversight
  • failure to invest in upgrading infrastructure
  • government corruption in handing out contracts
  • AI accelerated discovery of vulnerabilities
  • rushed and AI coded patches to vulnerabilities

Combine all of that with the fact that much software and technology processes have critical points of failure, as depicted in the well known XKCD “Dependency” cartoon explainer, and it is very easy for things to break.

Expanding on an example they give, when Musk bought Twitter they fired lots of people. A huge reduction in the workforce to drop reliability from 99.999% to 99.99% may actually be a reasonable trade off when worst case is you lose a bit of ad revenue and annoy your users. It is not a good trade off when you’re running air traffic control, or have sold yourself as a core business process for your customers.

Straining this analogy even further, not only does your car stop working when its registration expires, but if Honda fails to renew their certificate, then all Hondas stop working. You may have a well implemented system to automate your car/certificate renewal, but if one of the upstream certificates used to sign your certificate expires or is revoked, then your certificate is invalid—the garage that inspected your car loses their license, so now your car doesn’t work.

The change on November 16 was that Microsoft pushed an update to stop trusting certificates issued by eMudhra (because their secret key was “4”). So any updated Microsoft system will no longer trust anyone who uses a certificate issued by eMudhra.

Dig up a copy of Heinlein’s short story “The Year of the Jackpot”. The Year of the Jackpot - Wikipedia

Today another major issue arose, with a popular web server (Nginx) having a critical security bug that allows anyone to run arbitrary code on it. The other popular web server (Apache) had a similar one last week. A big Java framework had something similar too.

Every day now, AI is finding more and more issues that humans could not, and presumably some black hat hackers are also exploiting these. Open source has become a liability now both in terms of rogue agents being able to find new exploits, and also in terms of patches being used to reverse engineer the underlying bugs before the release and mitigations could be announced.

It’s more and more AI and fewer and fewer people, as echoreply pointed out (now who’s echoing who?).

TLDR it’s all fucked, lol, and there’s not a thing anyone can do about it. Everything on your computer and phone probably has dozens of security holes just waiting for an AI hacker to exploit. And the services you use probably have thousands. Turns out this whole time we’ve all been living under “security through obscurity”, and with enough AI eyes, nothing is safe anymore.

So this is the new normal, I guess?

Weird. I just logged into my Kaiser account with no trouble at all. Might be that we’re in different geographical areas (I’m in Northern California), but changing the password by phone vs. via the website has my alarms pinging.

Your guess is as good as mine, lol. We’re all lab rats in a maze now, but the walls are smarter than us. No telling what comes next…

Yeah, that does sound sketch. Might want to call the number on the back of your card and make sure you weren’t phished.

I think what happened is that Kaiser is retiring their “My Doctor Online” app and transitioning to a new one. When I got the notification I deleted the old app and installed the new one. I guess that triggered a requirement for a new password both on the app and the website account.

Interesting. I logged on to my Kaiser account yesterday afternoon with no problem. Didn’t have to change my password either.

I’m in SoCal. I did notice my home page was different, so I assume they installed updates very recently.