Highly classified US national security communications network goes down

383 points - today at 3:38 PM

Source

Comments

lucascdotnet today at 4:41 PM
I wonder (and have no idea) whether the increased reports of services being down is a case of the Baader–Meinhof phenomenon, or a actual increase in failure rate.
dustfinger today at 6:09 PM
I may not understand expectations, or the law around this, but I find it a little surprising that the NSA would publicly announce that their internal and highly classified network is down. At least not before getting it back up, running and secure again.
btreesOfSpring today at 6:35 PM
I feel like something started after Elon purchased twitter and made all those personnel deep cuts. In the era prior, it wasn't too hard to look around and see people who were dragging productivity down. Their cuts would be an improvement. Twitter into X looked to cut to the bone and despite a few hiccups, nothing catastrophic happened to the service layer. This ushered in a new era of tech department downsizing that feels like it is still happening today. Ask any new graduate how the job search if going. Sprinkle in a little DOGE + time and we are starting to see the exhausted people supporting these glued together systems experience real large scale failures.

Yeah, you can do fine with only one set of eyes on a problem. Yeah, it is more "efficient" in the short term. Culling lots of do-nothing people in your organization isn't going to produce many tears. Even so, devs and IT departments are now missing all sorts of backup and vital personnel that keep the gears oiled and running.

getcrunk today at 10:40 PM
as other commenters have said:

> theres some sort of strategy of tension regarding cyber/fraility of systems being pushed.

> 'Manufacturing Consent', new Congress AI regulation for industry capture in the pipeline

both capture my inclinations, but the other thing is this can simply be symptoms/indicators. looking at the recent faa thing, this could be "move fast and break things" happening in real time.

new contractors, new programs, more outsourcing/privatizations etc, palantir type companies moving into new places.

this is right after midterms, so the admin is doing its final phase of plays

usernomdeguerre today at 7:11 PM
People seem to be leaning on the AI speculation from the "vibe coded" angle, but couldn't this also be an "AI is the reason" from the attacker side? I think we've seen more than a fair share of AI assisted exploits that chain many small vulnerabilities into something more pronounced. I'm thinking of the rash of attacks in SK and China against Banks using offensive harnesses.

I'd be more willing to believe the network in question here was under an attack load that either was probed or exploited far enough that shutting it down was worthwhile. It seems more reasonable to me than believing they've let AI run amok on their internals such that it's now failing.

Not because I'm deifying the NSA but because the system has to be decades old, at least, and I wouldn't expect significant changes to something that "just works".

Avicebron today at 4:07 PM
It's clear, there is a screaming need for competent, well paid IT across all sectors.
twotwoone today at 7:20 PM
Don't fall for stories that AI did all this. The NSA's internal network is unavailable every year or so. Just like all other services.

The only thing that distinguishes this particular moment in time is the thousands of bots from companies preparing for an IPO.

tgsovlerkhgsel today at 4:36 PM
That's a LOT of things going down, and I haven't heard of some major infrastructure outage likely to affect many sites in this manner.

Coincidence or is there some common explanation that I missed?

ssalka today at 4:42 PM
For me, 2 is coincidence, 3 is a pattern. Now we are at 4:

1. All flights grounded

2. Microsoft outage

3. Optimizely malware

4. Classified NSA network down

I don't know what, but something is clearly happening.

phishin today at 4:55 PM
The comment sections are starting to read like Reddit threads. That is what I find most bizarre since all of this started happening.
markus_zhang today at 10:11 PM
I wonder that the said network looks like. I’ll never know because I don’t work there. Do we get any genuine insider look maybe for the same network 20 years ago?

Or is it close to a large corporation network built on MSFT stack?

pjdesno today at 7:31 PM
FWIW, I had a summer internship 40 years at BBN, working on the obsolete and soon-to-be-retired switches running the ARPAnet; one of their other customers was the NSA.

I'm pretty sure they were calling that network the NSANet back then; I assume it's gone through many generations of upgrade since then. I don't remember much about them as a customer, except that (a) we weren't supposed to mention their name, and (b) they were running a horribly old version of the switch firmware. My understanding was that they literally tested stuff for years before deploying it.

It was a long time ago, and I was just a summer hire, so I could have this wrong; in addition things may have changed in the intervening 40 years.

MomsAVoxell today at 8:14 PM
Considering the heinous violations of human rights at massive global scale that this service commits, this is finally some good news.
roody15 today at 4:11 PM
Foreign Bad Actors... State level resources ... AI enhancement. Cyber warfare could get really ugly here.
AISnakeOil today at 4:57 PM
What I haven't seen mentioned is whether it's possible that these are a rogue or state-controlled AI cyber-attack and it's just doing a really good job at covering its tracks?
throwawayk7h today at 9:46 PM
The perfect crime is one which is never discovered. We know of no perfect crimes to ever have been committed.
GuyPostington today at 6:58 PM
I wonder how much the Java RCE plays into this one.
lokimedes today at 6:38 PM
Why is the operational state of a classified network not itself classified? This seems like a serious breach of security.
lacoolj today at 6:16 PM
It would help if the moment the service came back online the title of the post could be changed to (FIXED) or something

Like the United Airlines thing yesterday, the moment I got to the article it said "was down for a few hours" but the post was still just something about United Airlines network being offline

sandworm101 today at 4:19 PM
Give it a minute. Bespoke networks fall down all the time. We are probably only hearing about this because of the coincidence of the other recent network failures. It is a self-fulfilling prophecy. As we become more sensitive to outages, every normal everyday outage becomes part of the global pattern.

If the network was one of those no-fail important ones (think NORAD stuff) then nobody would be talking about it as doing so would be treasonous. So, at most, this is a less-important internal network. It will probably be back up by end of business.

bayat today at 5:12 PM
Following the series of such events over the past couple of days, I have to say I’m a bit surprised by how quickly some in this community are brushing them off as AI-related pain or simply another example of the clickbait-driven media ecosystem.

I understand the skepticism, and I certainly don’t think we should go down a rabbit hole of conspiracy theories. But shouldn’t we also be a little skeptical of dismissing these events so quickly? Is it unreasonable to at least consider the possibility that they’re not entirely coincidental, or to wonder why so many seem to be taking place in the US?

deleted today at 4:46 PM
stevenhubertron today at 4:42 PM
It’s been a hella few weeks. Hard to believe it’s coincidence even if you want to blame AI.
ericcholis today at 4:43 PM
There's a part of me that doesn't want to know this....
deleted today at 4:59 PM
UncleOxidant today at 5:18 PM
Why do we even know about this? This is likely not information that should be known outside of the NSA.
SpicyLemonZest today at 4:19 PM
I feel like this is attention bias. A government built messaging service used by one agency for a subset of their data isn't going to have 3 nines in the first place.
reedf1 today at 3:52 PM
Anyone have knowledge of the backend of this system?
joshymochy666 today at 8:04 PM
Anybody know if they fired Cern back up yet after reportedly getting major updates?
qphe95 today at 6:29 PM
So how are people getting their work done right now?
qphe95 today at 6:21 PM
How are people getting their work done right now?
Mossab22 today at 8:11 PM
It's snowden guys
Consermo_AI today at 5:54 PM
its getting spooky
swalsh today at 5:17 PM
I have this distinct memory in I think Jan 2020 where I looked at the front page of CNN or NYT or something. Big picture of Trump impeachment, and proceedings. Small picture at the bottom of the page of China dealing with this virus. Worthy news, but not top page news. Nobody was paying attention. Feb, more people started paying attention, but it wasn't top page yet. By March, people were starting to realize that this is a serious crisis that's going to severely impact their lives.

I'm getting Feb 2020 vibes. I don't know what's going on, but this feels like more than just some routine outages going on.

carimura today at 4:38 PM
I'll probably get downvoted for this but I feel like CNN stopped being a serious source of journalism a long time ago (along with Fox and most of the networks). A real story is the exception, so it's hard for me to take most of these things seriously.
wankerrific today at 6:13 PM
It’s absolutely not ai
howmayiannoyyou today at 5:15 PM
https://chinaselectcommittee.house.gov/media/reports/strange...

Allowing our infrastructure to be manufactured elsewhere, maintained by companies who struggle to retain top talent, and overseen by folks out of touch with cutting edge threats, and funded on annual budget cycles by legislators even more out-of-touch ... is a seemingly insurmountable set of obstacles.

ragle today at 5:24 PM
I have also been curious about frequency bias / Baader–Meinhof - but I am also wondering: what are the chances that a state actor is responsible for the last week of issues?

Trump is headed to China for a meeting with Xi and Putin.

We have 3 carriers off the coast of Iran and (despite Trump's pleas) NATO is essentially pushing their boot into Putin's neck w/ continued Ukrainian strikes on Russian oil infra.

I've seen a few takes from L3 Harris / FAA employees calling the official line about the ATC issue bunk and there are 3 other major issues in the last week, now this NSA outage - curious if these incidents could be the BRICS axis flexing their own cybermuscles (independently in multiple separate attacks with carefully placed assets) ahead of their meeting with Trump in China?

An interesting geopolitical Mexican standoff, if true.

I'm not claiming this is true. I'm literally pulling it out of my rear with little context beyond a bunch of random news stories and X posts, it's pure pedestrian speculation / curiosity.

Would love someone steeped in national security / geopolitics (like: professionally as their job, not armchair analysts) to offer their take on this.

Is this a dumb, naive theory?

deleted today at 7:06 PM
ColinWright today at 6:16 PM
dist-epoch today at 5:46 PM
What if they were post training a cyber model and got hacked from inside by the model, like OpenAI got hacked by it's own HuggingFace swarm.
AndrewKemendo today at 4:25 PM
That is crazy - even crazier than if SIPR or JWICS was broken

NSANet is one of the most locked down, observed and monitored networks on the planet

m4r1k today at 6:47 PM
* Outlook

* FAA

* Banks

* Optimizely malware

* nsanet

* Apple

Time to panic?

hmokiguess today at 4:15 PM
So the NSA also uses Microsoft 364?
joshka today at 4:48 PM
> The NSA did not immediately return a message seeking comment about the reported outage.

Did you try sending it via outlook.com?

gumby today at 6:05 PM
NSA seems to have deprioritized information assurance over the past decade or so and now the chickens are coming home to roost.

Someone who wants to launch a Y2K-style hardening business (LLMS to look for problems, humans+LLMs to fix them) could really make bank right now. Maybe there will be a cuple in the next YC batch.

iambateman today at 8:10 PM
What are the odds that Microsoft, air traffic, most banks, and the NSA would all have major outages in a single week by chance…
JeffDClark today at 5:41 PM
Weirder to me is that some of these recent stories have been CNN exclusives (filed under Politics) and CNN is now owned by Skydance (Ellison) which is anything but a unbiased actor.

It sure is fun living in a world of zero trust.

deleted today at 7:30 PM
mkotlikov today at 8:16 PM
I'm pretty sure it's just a router and some copper wires.
bluescrn today at 4:21 PM
If it's highly classified, we probably shouldn't know whether it's up or down.
h1bslop today at 3:51 PM
admittedly, this one cant be blamed on h1bs :(
kinabalu76 today at 5:22 PM
I see the shoe is now on the other foot NSA.
schainks today at 7:25 PM
A uniquely un-American look for the people in charge.
runjake today at 5:17 PM
NSA Net, for those in the know. (TS/SCI/NOFORN, IIRC)
andy_ppp today at 6:12 PM
Is someone running chaos monkey across society?
deleted today at 3:43 PM
chinathrow today at 5:41 PM
Well, on the other hand, a bridge is down as well.
throw7 today at 5:06 PM
Memo to the NSA... pulling the plug won't work. ;)
Kuyawa today at 6:27 PM
Fear, start with fear, it always works

A couple of incidents, spin the media, let them be terrified

Put your cape on, come to save the world

Then tax it, regulate it, sprinkle some tariffs, nuclear winter, external enemies, china, don't forget about china

Then we police the world and our AI is the only one with the seal of "liberty"

From the black book of politiks, watch the sheeple, rejoice

Computer0 today at 7:31 PM
Couldn’t have happened to a worse group of people
deleted today at 7:05 PM
fock today at 4:36 PM
so, war is brewing and I guess people got the memo to patch...
MadrasThorn today at 6:07 PM
Cant imagine how many people that will 'effect'
redwood today at 5:46 PM
"The NSA did not immediately return a message seeking comment about the reported outage". There's something humorous about that framing
majorchord today at 4:03 PM
But don't worry guys, it's totally not related to Microsoft, FAA, all major banks, United Airlines, and Microsoft again.

Definitely just a big coincidence due to firing people, upgrades, and AI.

...maybe.

Seriously though at what point does this become justifiably suspicious?

kylehotchkiss today at 5:24 PM
This country continues day after day to get exactly what we voted for. Incompetant old men who would rather play golf and point fingers than take any form of decisive leadership and fix things.

(I'm not saying the dems would do better, i'm saying we all need to stop voting for old men in primaries because they are more "electable")

demo4567 today at 5:41 PM
More fear mongering about day to day incidents: The network goes down every time I mess with DNS, VPC peering, TGWs, route tables.
swozey today at 3:58 PM
Just in time for the FEMA national emergency test this week
lemoncookiechip today at 5:01 PM
"That's life"-Donald J. Trump when asked about recent service outages.
ForHackernews today at 4:15 PM
NSA sysops: They're just like us!
hax0ron3 today at 7:33 PM
Good
insane_dreamer today at 6:50 PM
probably another router in Arkansas
classified today at 5:52 PM
Does that mean we can shitpost Trump jokes without getting arrested at the border?
micromacrofoot today at 4:51 PM
turns out we maybe needed all those people that were laid off a year ago
IAmGraydon today at 4:10 PM
Conspiracy theories are flying, but don't you think that enough people are involved in maintaining these systems that if it was, for example, an attack by a foreign country, it would have leaked from one of the tens of thousands of people involved?

Also consider that the media absolutely loves to run any story it can find about a network going down right now because it causes fear, and fear gets clicks. Now think about how many major networks have a problem in a given week. You just never hear about them until now.

vrganj today at 4:45 PM
There's some speculation that all of these recent outages might be related to attempts at taking Genesis Mission online - the Trump / Oracle project to have AI tie into government and private services:

https://en.wikipedia.org/wiki/Genesis_Mission

https://substack.com/@thedreydossier/note/c-389611426

grounder today at 6:39 PM
I thought they used Signal now /s
ovnz today at 3:42 PM
So it is not that classified after all? /s
beedeebeedee today at 4:27 PM
I’ve heard people suggest this is growing pains for the Genesis Mission coming online (we’re hitting the one year mark, and they may be a little cavalier trying to meet their timeline).
comrade1234 today at 4:21 PM
How many IT peolke weee later by doge? For some agencies it was all of them.
reedf1 today at 3:55 PM
Anybody know anything about how it's deployed? Nasdaq down 2% on the news?
deleted today at 4:52 PM
postsantum today at 4:09 PM
Source:

> according to six people

empath75 today at 4:12 PM
Once is happenstance. Twice is coincidence. The third time it's enemy action.
catigula today at 4:47 PM
We need more transparency ASAP or this should essentially be treated as a serious AI related event.
LastTrain today at 4:31 PM
"That's life"