No, they could not listen to all that, but that’s beside the point. They want to be able to go back and listen to the bits that they are interested in.
What they are doing, apparently, is NOT filtering the calls of everyone hoping to hear them planning an attack - what they are doing is storing all the data so that if the CIA agent says “this guy’s a terrorist suspect - I sure wish we could go back and listen to his phone calls for the last three months,” the NSA guy will say “get me a warrant and you can.”
What gaping hole would that be? Corruption and abuse exists in every industry and every workplace. That some government employees might possibly have abused their power in a way that harms noone anyway no more impugns the entire program than a couple of asshole cops means speed limits should be done away with.
Please Please PLEASE tell us that you’re actually a Republican Senate candidate. This could be the moment of the election cycle we’ve all been Akin for…
Interesting that people are wound up about this. I don’t want the government reading my e-mail or listening to my phone calls, but I don’t care if they are recording everyone’s phone calls. There just aren’t enough people to listen to more than an insubstantial fraction of them.
Exactly. When you start tracking EVERYTHING, every little piece of information just turns into meaningless noise. I’d also guess that it makes it harder to find the bad guys too because that weird pattern you might notice with Joe Terrorist also matches Jane Normal-Person, Peter Nut-Job, and Marsha Local-Eccentric.
^^^ In case it gets lost, the point, the principle - the basic human right - is to privacy.
There is, of course, a caveat: except when in the national interest - meaning in very specific cases for which a court order is required, from an independent judiciary.
What the US gov does is totally weird shit, way beyond anything of which the STASI could have dreamed.
Sure, but only because the STASI didn’t have the technology. Anyway, the point remains: spying on everyone without a warrant is *less *of a threat to freedom than just spying on some.
Did you read the exchange? Who said storage cost was the limiting factor. I specifically mentioned building out the infrastructure, and yes–the data warehouse is part of that. You guys understand that data warehousing is different than just buying a bunch of hard drives, right? There are real technological engineering concerns the larger your data warehouse gets. Not just the physical storage concerns which have their own space/electricity/cooling/cost aspect, but when you’re storing say, every customer transaction that’s ever happened on Amazon.com how do you setup it up so Amazon can use that information do do meaningful reporting?
If you actually read into what Amazon actually doesn’t, it’s not comparable in my mind to the Internet archive. The Internet archive is “dumb” storage, you look up what you want by knowing its URL, it’s a simple key/value relationship. Amazon (just one example) instead needs to be able to perform far more meaningful analytic functions on its data and how you engineer your data infrastructure will genuine affect how well you can do that, or in some cases whether it can be done at all.
And everything Amazon stores has clear, easy to handle information in terms of structuring it so it can be analyzed later. It’s all created by text type input, someone is buying a product, at a certain price, at a certain time, shipped to a certain area. Extant database technology makes all of that very easy to store. But when you’re talking about audio you’re now talking about automated speech recognition on an entire Amazon or far larger scale data store to make that information useful.
Obviously though, maybe the NSA system is dumb, and it’s just an archive. But if it’s just an archive the value of it relative to the expense is probably going to be a worse cost/return outcome, because you’re spending 99.9999% of your resources storing and collecting audio that is 100% of no value whatsoever. It’s like building and launching a Saturn V rocket with no astronauts on it to fake a moon landing, that rocket was most of the cost of each launch.
And again, the data collection, until I know for sure, is a valid concern. There are utility systems that measure in real time electricity or natural gas flow rates through large portions (but not all) of the natural gas or electricity infrastructure (“SCADA” systems.) The databases that store all of these ticks of data is massive, but that complexity in those systems is not the storage, it’s in the infrastructure involved in managing all of those collection points and physically keeping them all working. If the phone system is comparable at all, then the storage is far less of a concern than the collection.
Further, even if the NSA was doing what I said they may be doing, creating a “dumb” archive of audio files and hoping the metadata will be meaningful enough that they can make use of 1 out of every 200 million calls stored some day, the complexity of that system isn’t tied to the cost of the storage medium. The storage costs are probably going to be less than the engineering costs associated with getting the system up and running and the many actual computers (be they specialized data warehouse type servers or etc) that are used to manage the storage.
Literally all that has been said in response to questions on the technological feasibility of this are “well, this guy shows that the data storage size would be manageable.” Okay, so that’s one small piece of the entire system, and obviously if the required storage was out of scale with reality (like say, it required storing more information than could be stored on all available disk storage on the planet) that would be an immediate nonstarter. But just because you can physically build out enough storage really says nothing about the other serious concerns about how this system would work to any degree. The storage concerns of the PPACA for example were certainly an important aspect of the system design, but one they probably solved pretty quickly with a standard data warehouse type approach. But the complex systems integration on the other hand, was not so easy, and just throwing money and man hours at it didn’t fix those problems in a timely fashion. In fact with complex software problems you often cannot just throw money and man hours at them and get a fix.
This makes the situation even more alarming, by highlighting the fact that illegitimate uses of the stored data (“Here’s a list of phone numbers and e-mail addresses for this guy who’s being a PITA to one of my big contributors. Give me what you got on him.”) are fairly easy while the publicly professes functions (“Is somebody out there planning to blow something up?”) are difficult if not outright impossible.