FAA issues nationwide ground stop due to "extraordinary circumstances" (for discussion, not breaking news)

Well said.

FAA ATC modernization has been an ongoing headache and failure since I was a teen. Various Big Bang projects have been started, encountered insane cost overruns and schedule delays, then been cancelled with nothing to show for it. Over and over.

By the time any smaller project gets installed, most of the hardware it was designed for is already obsolete and replacement parts are quickly becoming unavailable.

Congress always provides too little money too late and has no patience for the overruns and delays that are inherent in any / every IT project anywhere that’s of any serious scope.

Many subsystems of ATC’s total inventory of computers, radars, communications, procedures, software, etc., have been successfully replaced in the last 30-40 years. But there’s still a lot more backlog than there is completed work. And the earliest of those completed projects are themselves now well overdue for replacement / upgrade. Again.

So here we are. No different than we are with the interstate highway system that we could afford to build, but now choose not to be able to afford to maintain. Same with dams. And wastewater treatment systems. It’s somehow easy to appropriate money to build new. But not to maintain, nor to replace worn out with new stuff that may not offer anything other than the ongoing out of sight ought of mind reliability we all crave from our infrastructure.

It’s a legitimately Sisyphean task. Like painting the Golden Gate Bridge, when you get to one end the only sensible thing to do is go right back to the other end and starting painting it anew.

Those kinds of tasks require a mature management process and we do not, and have not had for decades, a mature Federal governance culture to deliver that patient far-sighted and adequately-resourced management.


Certainly all the mismanagement of the trump years, and of the MAGA Congress years have not helped. And of the “Starve the beast” years beginning with St. Ronnie the Senile.

But there’s plenty of blame to be spread across all those 50 years. For once, although trump and his incompetent traitorous thieving cronies are certainly the last ones to touch it, this one really isn’t any more their fault than it’s all their predecessors’ faults too.

I agree, but NY Governor doesn’t see it that way.

New York Gov. Kathy Hochul is calling for Transportation Secretary Sean Duffy to resign, or for President Donald Trump to remove him from office

Hochul argued that chronic air traffic controller shortages and repeated communications breakdowns have become an ongoing problem under Duffy’s leadership. She accused the transportation secretary of focusing on “starring in his own reality show” instead of addressing challenges facing the agency.

I’d call for Duffy’s resignation based on nothing more than his speech last night.

The controller shortage is a relatively recent (10-15 years) problem. But was, just like the pilot shortage, completely foreseeable since the birthday of every ATC controller & technician was known to their employer.

There ought to have been a full bore push to increase actual deployed headcount starting in about Obama’s first term. FAA management placed waaay too much faith in new automation projects that promised to let fewer workers move more metal. Thereby eliminating the need to replace most, not all, of the aging workforce. Of course that never happened.

The malign neglect of trump’s terms has left all of this to fester while the simple inexorable progress of the calendar has slowly turned a gathering crisis into an abject disaster.

A lot of posts before this on X saying all electric will be off for 3 months, mass chaos and death. Had me scared there. Supposed to happen on the 17th.

And now, some words of reassurance from Dear Leader as the ongoing crisis threatens to - (clutches earpiece) - sorry, I’m being told that he’s tweeting about golf now.

By some accounts, Duffy, Markwayne, and FAA acting Chief Technology Officer Rebecca Guy have given us three differing stories: router problems, new (AI) tech being installed, and most alarming of all, “mystery pings.” Per Guy, there were ‘two sources pinging the network at 1,000 connections every 4-5 seconds.’ And they don’t know the identity of those sources.

Congress needs to hold hearings. It shouldn’t be this hard for them to come up with an explanation.

My guess is that ‘something’ impacted FAA communications, for a small part of the network. And Duffy saw his chance to do what has not been done since 9/11: declare a nationwide ground stop lasting nearly six hours.

And why did he want to do that? What better way to extort $50 billion??!?

A ground stop was called in January 2023 under Biden. We know that because Donald Trump Jr. tweeted this message.

“Breaking - All flights nationwide have been grounded - the #FAA is facing a computer outage. Yet another major blow to incompetent Transportation Sect Mayor Pete and people who get important jobs with no experience to check some identity politics boxes.”

Oddly, Donald Trump Jr. has been completely silent about this ground stop under a Secretary of Transportation being a former Fox host with no experience. Anybody have any idea what might have changed?

Hell, Donald Trump Sr. has been completely silent about it. He spent all morning tweeting about golf and now he’s complaining about Gavin Newsom commuting death sentences.

Politico makes it sound like the $50 billion amount was made up on the spot:

Are Trump Officials Living in an Alternate Reality?

I’m thinking that whatever poorly tested system upgrade caused this should have been scheduled for, say, 2 AM EST, so that there would have been fewer planes to stop from taking off. Or would that have been worse because of flying in the dark?

Good catch.

Easy to miss, but Truth Social, 12:39 PM today:

"The FAA Funding should be a stand alone Bill — We should get Democrat support for that!”

I can think of several possibilities:

(a) Due to underfunding, a conscious decision was made not to test (or not to load test) whatever upgrade failed yesterday.

(b) Project management had no idea this was a risky change.

(c) Some brave soul was telling management that this needed an extra test, which could be accommodated with existing funding, and was ignored if not fired.

I am not expecting (a) above to be the answer when good long form journalism tells us what really happened. Quickly throwing more money at failure in response to headlines is hardly something Democrats should support. This debacle first needs investigating (and good journalists are probably at work on it).

Meh. That’s just him quoting John Kennedy, not expressing any thoughts of his own. I’m not sure he’s even aware anything happened, since he was tweeting about saving Hollywood yesterday WHILE the stop was in progress.

Incidentally, he hasn’t made a public appearance since Wednesday. He must be getting his Leqembi injections early this month.

Unfortunately had no choice, so I’m here. Yes, it sucks. But glad to have it after United had my flight “on time” all evening and into the morning, only to cancel it right when I was at the airport. Now I’m flying a Monday redeye arriving Tuesday morning. It’s not just the casino that smells like smoke, so do all the hallways as well as my “non-smoking” room. I thought the Mandalay Bay was pretty bad, but this place is a different level. I can’t believe people being their kids here.

It’s like the last couple of years I drove my ancient pick up - stuff kept breaking under normal use, I’d get it fixed, then go back to normal driving and then a bit later something else would break…

You patch it up and put it back into service because that’s all you have. What’s really needed is a replacement but until you can get one you use what you have.

Yes, that’s very unsettling when you’re talking about air traffic control.

American Airlines said they did add some flights on Saturday. I’ve already committed to flying Monday.
There was nothing Saturday when I looked and only pricy flights today.

Brian

My daughter was supposed to do a college visit to Earlham yesterday. Friday afternoon, my wife and daughter texted me from the Atlanta Airport, four hours away. Their flight, scheduled to leave around 3:30 pm, was finally cancelled around 8 pm.

There were absolutely no rental cars to be had. It took about an hour to find a hotel room–in Atlanta–that wasn’t booked. Then it took another two hours to get a Lyft: two drivers cancelled on them, probably seeking higher fares from the thousands of stranded passengers. They got to their hotel around midnight.

Yesterday I drove the four hours to pick them up, and we road-tripped back.

Through all this, the administration gives us multiple, contradictory responses, none of which involve anyone taking any responsibility, just blaming Congress and unnamed contractors.

I fucking hate this administration.

But that’s if you can get it fixed. From what we’re being told so far, it sounds like the break was, itself, the system being under too high a load. If that was the actual nature of the problem (and who knows if it was, given the vague and inconsistent information that’s being released), then the fix is to decrease the load.

The story being floated right now is that a network router was being replaced by a contractor, and apparently this caused cascading effects through the network.

That’s coming from US Secretary of Transportation Sean Duffy, who has every reason to lie, blame a contractor, and connect the fault to issues that predated the administration. So take it with a grain of salt.

It raises more questions than it answers. There are probably tens thousands of routers in the network. A network is supposed to be redundant and prevent cascading failures.

It’s not really workable to decree that every little pizza-box router can only get upgraded in the wee hours of a Saturday or Sunday morning, it concentrates too much risk into a tiny window. But a fair question for the administration would be, has this failure mode never been tested? Why are you blowing money on AI gadgetry instead of tracking down single points of failure in a critical system?

So I wondered if the solution is to have DOT make their ‘work orders to contractors’ more specific about quality expectations? Maybe I should write my congressional rep or senator to ask for that?