Basically they can record everything and a constitutionally defined "search" doesn't occur unless a human search and looks at the information.
Binney and other were talking about this even long before Snowden.
So what happens now, everything you do gets recorded, stored in their data center and kept for decades. As soon as you do anything they deem suspicious they might find you downloaded strange foot fetish porn when you were in college and try to blackmail you.
That's how I feel about revenge porn/leaked nude photos and videos of non-underage people in general. There should be legal consequences for people who leak this content against the wish of the people depicted, but I feel the media often plays up the narrative that people shouldn't take nude pictures (a pragmatic approach, but not the best going forward) and never mentions the silliness of reacting harshly to other people's sexuality.
However, the pragmatic approach is still needed in a world where many people can attack you for your idiosyncrasies. Depending on your current situation, you won't lose your job and your particular interest will become only a minor office joke, but when you run for Congress, the masses may still care too much about it.
As someone mentioned on HN, the advantage of being transparent is that you can weaponize it — "I do (thing) and if that worries you, it's your problem, not mine".
And start downloading kinds of porn you have no interest in, just to confuse the snoops ;)
There have also been rumors about Amdocs [1] being kind of the Israeli counterpart. They do billing for telcos (i.e. determine who talked to whom for how long). The list of their customers is quite impressive.
These 'rumours' are more like an open secret inside the industry.
Personally I have seen billing APIs at AT&T (US) and T-Mobile (US) which are semi-equivalent. For one of those, calls go straight to an Amdocs domain on an AS hosted outside of the carrier. Of course, few people will see these now since Google Play canned external billing APIs (removing most of the interest here) and most new projects choose to access carrier billing via international aggregators (since integrating with one carrier can take months of pain, if you even have enough of a case to bother, and if they even talk to you). For NFC stuff, most US carriers are combining forces to produce a new API which will effectively similarly distance any integrators. The reason I got a look was we were developing the flagship app for Samsung Galaxy series device launch in the US, and the carriers were all on board with it.
An older, long term IT veteran friend of mine who recently retired in Australia and chaired the mobile phone number portability multi-carrier technical implementation roundtable told me he was essentially fired (contract not renewed) for opening up an inquiry in to the wasteful billing practices at one particular Australian carrier. It turned out they were using Amdocs. He described making a decision, being forced to sit through a presentation, making the same decision, being forced to sit through another presentation, until the end of this contract period.
This and other sources concur: the Amdocs billing stuff's like cancer. Once they're in your network, you can't get rid of them. If I were a national privacy authority or the European Data Protection Supervisor, I'd walk in to all my carriers, seize all third party billing systems, dump out disk images, and analyze them top to bottom in a nationally transparent, multi-party audit citing national security / privacy.
If the country that this article was referring to was the US, do you really think that Barton Gellman would let a scoop go like that?
I'm sure the first response will be something alluding to the US government secretly threatening the author if he revealed this, to which I would preemptively point out that this is the same man who has yet to receive any legal indictment and continues to walk the streets freely after revealing the PRISM program last year.
the spooks are merely taking a liking to how politicians operate their political campaigns. Nothing secret is beyond a court order or, a friend in the right place.
I'll quote the slip up of Tim Clemente, a former FBI agent:
> All digital communications are uh uh... There's a way to look at digital communications in the past. And I can't go into detail of how that's done or what's done but I can tell you that no digital communication is secure.
Ever hear about the mafia and RICO laws? It is 100% legal to listen to phone conversations with a warrant. If you have evidence of wholesale FBI phone call collection and eavesdropping I'd love to see it.
I already linked you the evidence in my previous post. Stop being purposely obtuse. At this point you just seem to be part of another NSA program. [1]
I'll just quote the lead:
> The US military is developing software that will let it secretly manipulate social media sites by using fake online personas to influence internet conversations and spread pro-American propaganda.
And more recently, GCHQ's JTRIG program. [2]
Again, I'll quote:
> (The core self-identified purposes of JTRIG is to) use social sciences and other techniques to manipulate online discourse and activism to generate outcomes it considers desirable
I have wondered about this with the whole damn thing, on those days when I am wearing my extra thick tinfoil hat.
Think about it from the Dr Strangelove cold war perspective that a doomsday device would only be an effective deterrent if everyone knew about it.
Perhaps they have put all the cables in, but really do not have the resources to back up or process 99% of it.
This is not that much of a problem for them if they leak a load of powerpoint slides claiming that they do, as the result is an instant global version of Benway's panopticon, with people behaving as though they are surveilled, even when they are not.
Perhaps Snowden never stopped working for the NSA.
Sure, but collecting and recording phone calls of US citizens is illegal and there hasn't been any evidence of this happening. Metadata of who you called and when has never been protected by the 4th Amendment so we can head that off...
"Illegal" in the same way that saying "No" to congress when the real answer was "Yes" is. Then later explaining that iw was "the least possible untruthful answer".
The NSA have twisted their use of language - to try and claim that "recording phone calls of US citizens" isn't an illegal act until a human being listens to one of those recordings.
I'm 99.999% sure that a "jury of peers" would not interpret the law that way. (Which might be why the need "special courts" without juries…)
The NSA doesn't have to record phone calls of US citizens. They just get one of the other Five Eyes countries to do it for them, in a quid pro quo arrangement that circumvents the inconvenient rule of law in several places at once.
You're carrying water for some seriously un-American people. The only reason you're not upset about it is that it doesn't seem to be affecting you, personally, at the moment.
That is a very good point, this might not have been explicitly said (or I just didn't read about it yet) but I just kind of assumed it works this way. We spy on your people we spy on our people and then we share if we find something interesting.
Other countries also might not have the same supposed privacy guarantees in their constitution so it doesn't even have to be symmetric (say Australians somehow spy both on us and their citizens).
"At the request of U.S. officials, The Washington Post is withholding details that could be used to identify the country where the system is being employed or other countries where its use was envisioned"
It's enough to make it interesting, but there could be a much more interesting diplomatic scandal depending on which country is targeted. Imagine if it's not Yemen or Iran, but Canada or Switzerland?
Or it could serve as a signal that the US is the best country to align with, since they know everything.
This whole NSA debacle could serve as an impressive advertisement for the strength and stability of the industrial spying complex, justifying great investment and pushing important business objectives.
It says NSA only keeps 1 month of voice records. I think they store everything for couple of years, perhaps indefinitely. Storing all that voice is very cheap and is too juicy to let go. Also there were rumors about this recording for the past 30 years.
GSM voice codec has rate 13 kbit/s. 6 billion people x 1 hour of talking per day = 6e9 x 3600 x 13/8 = 35 TB/day.
As with most newspaper articles that have government officials providing material input, what isn't said is usually more important that what is. (That's true in any context, not just NSA -- read stories about your local Mayor and road projects with a critical eye too)
The article states nothing at all about retention.
I doubt they only store it for a month. Besides how cheap (in national security budget terms) it is to store everything indefinitely, the timespan of a month is just not enough time to gather enough intelligence, especially when you don't know what you're looking for.
If you're already capturing everything, you want a big picture, and a big picture isn't something you get with just what's been happening for the past month.
Wasn't there a story very recently about new voice compression bringing voice storage down by 30%? I'm not even sure GSM was the go-to beforehand. So I'd say, halve that estimate and you're ballpark current.
6 billion people x 1 hour of talking per day = 6e9 x 3600 x 13/8 = 35 TB/day
I'd say most places more like 15 minutes per person as a maximum average, generally even less. That means 4.3TB/day. Which is only a couple of $200 hard disks, or four if you want RAID1.
Even if they only store the most of it for a month, I will eat my shorts if they do not use ML or plain old "intelligence" to select much of it for indefinite storage.
I'm pretty sure 96,000 bits/s vastly overstates the required storage. Common VoIP codecs uses as little as 5,300 bits/s[1] and military communication systems typically only require 2,400 bits/s and can go as low as 600 bits/sec[2]. Note: this is before all the transport overhead.
And this is for live communications. Recorded voice communication can be compressed further. For example the popular G.729 VoIP codec compresses down to something like 1,000 bits/sec in archives from it's normal 8,000 bits/s required during a live call[3]. Although lower bandwidth codecs probably don't compress as much.
What does it cost to transcribe All VOICE calls ->TEXT for faster analysis, apply DEEP learning to it, and apply a graph of Everyone bigger than Facebook to these patterns?
The voice->text is inaccurate enough (especially because the many different languages that can be used) so you have to keep the original recording and not just the text; but yes, you can easily do things like "find all conversations where the word 'nakamoto' is heard" with mass scale voice/speech analysis.
Just going by energy need I back-of-the-envelope estimated the Bluffdale center could run voice recognition on all U.S. voice calls, yes. I'd guess it's not the best use of that much power, currently, but it'll only get easier.
I wonder if it's not Afghanistan, Iran or any of the usual suapecta but actually Canada. We've got a puppet federal government submissive to US demands.. A small number of large NSA friendly telcos that reach a large majority of the population, and a large number of immigrants from all over the world. Perfect testing ground for such a system.
The goal is too record everything which means implementing programs like this in as many countries as they can. Actually identifying which countries such programs are currently operating in would be tricky without a leak. It's a real shame this article didn't publish it.
This makes me wonder how Greenwald, Gellman, and Poitras come to a consensus on what to hold back. Clearly they all have access to the data and it would be possible (read: very likely) for them to disagree on what should and should not be withheld.
Basically they can record everything and a constitutionally defined "search" doesn't occur unless a human search and looks at the information.
Binney and other were talking about this even long before Snowden.
So what happens now, everything you do gets recorded, stored in their data center and kept for decades. As soon as you do anything they deem suspicious they might find you downloaded strange foot fetish porn when you were in college and try to blackmail you.