For the Purposes of Analytical Efficiency, Making Copies of the Dragnet

In 2008, NSA started (or started telling the FISA Court) it was copying the dragnet.

Starting with the January docket BR 08-01 (the date is illegible but it should be around January 4, 2008), the orders added a footnote saying,

5 The Court understands that for the purposes of analytical efficiency a copy of meta data obtained pursuant to the Court’s Orders in this matter will be stored in the same database with data obtained pursuant to other NSA authorities and data provided to NSA from other sources. Access to such records shall be strictly limited in accordance with the procedures set forth in paragraphs A – G.

The footnote would appear in four more orders that year:  BR 08-04 4/3/08; BR 08-07 6/26/08; BR 08-08 9/19/08?. Then it disappeared in the December 11,  2008 docket, BR 08-13 12/11/08. It did not appear in any other orders, though starting with the October 29, 2010 docket BR 10-70, a different footnote noted that “NSA will maintain the BR metadata in recovery back-up systems.”

The change almost certainly relates to the federated query system, in which all the data from EO 12333 collection (and, given the reference to “data provided to NSA from other sources,” probably GCHQ collection) was and, at least until 2011, remained accessible from one interface.

The footnote almost certainly does reflect a change in the way NSA handled the data (that is, in this case NSA informed FISC in timely fashion), because by April of that year, 31 “newly trained” NSA analysts were caught querying domestic phone data using 2,373 identifiers without knowing they were doing so, which seems to indicate the “newly trained” analysts just kept querying metadata as they would have using EO 12333 collected data. Though NSA didn’t tell FISC about that until 6 months later. In the interim (in August 2008), NSA also told FISC about how it correlated numbers — which we know works across data sources, not exclusively within the domestic data collection.

In other words, NSA was slowly integrating the phone dragnet in with its larger metadata collection, and informing – perhaps even more slowly — FISC what that meant.

In spite of the disappearance of the footnote in the first orders dealing with the dragnet problems in 2009, the NSA did not segregate the data from the federated interface. That’s clear from a memorandum of understanding NSA issued sometime after March 18, 2009 indicating that access to one metadata repository had been shut down, but four were still accessible:

  • SIGINT dating back to 1998
  • [redacted -- which could be STELLAR WIND data or could be foreign-supplied data]
  • BRFISA dating back to May 2006
  • PR/TT dating back to a redacted date that public records show to be July 2004

Given the previous inclusion of 3,000 US persons in with other queries, it’s possible the newly excluded collection consisted of GCHQ collected data that included significant US person data.

I raise all this to point out one of the inherent dangers with the dragnet. A program that was billed as a simple collection designed to serve FBI needs got integrated within 2 years of inception, creating a great deal of problems, without reconsideration of whether the stated purpose of the dragnet still matched what the by-then clearly different intent was. And this from a program that was supposed to be closely minimized.

Oh by the way, NSA told the FISC, we made an extra copy of the database of all phone-based relationships in the United States. Because it’s more efficient to have two databases.

Tweet about this on Twitter0Share on Reddit0Share on Facebook0Google+0Email to someone

2 Responses to For the Purposes of Analytical Efficiency, Making Copies of the Dragnet

  • 1
  • 2
Emptywheel Twitterverse
bmaz @OKnox @emptywheel @Ali_Gharib You three are my favorite people. Okay, that big fella @dcbigjohn is okay too. Keep doing that voodoo you do.
2mreplyretweetfavorite
emptywheel RT @nathanLfuller: @MarkMazzettiNYT Mark, can you explain why "signed a classified order" was changed to "decided"? http://t.co/0fqMUtD0zV
6mreplyretweetfavorite
emptywheel RT @FrankPasquale: Disaster as smart strategy: 5 "years after the financial crash, biggest banks are 37% larger than they were before” http…
7mreplyretweetfavorite
bmaz RT @ScottGreenfield: Journalists: A person's prior crim history is a smear unless it's relevant. #AkaiGurley did nothing to deserve to die.…
8mreplyretweetfavorite
bmaz RT @ScottGreenfield: NYPD smears #AkaiGurley "Gurley has 24 prior arrests on his record, police said." As if this makes it okay. http://t.c…
8mreplyretweetfavorite
bmaz @gracels @jacklgoldsmith Life is fine here, it is not...mostly, and for most people...the hell portrayed despite some of our elected idiots.
13mreplyretweetfavorite
bmaz @juliebosman @mattdpearce Or maybe not per CNN, am a little behind in my timeline reading. Still would not be shocked if done already.
14mreplyretweetfavorite
bmaz .@juliebosman @mattdpearce Do you think the #Ferguson GJ is not done? I bet they are, just delayed announcement.
16mreplyretweetfavorite
emptywheel @benjaminwittes VERY hard to support claim he had no desire to suppress when he made very historic efforts to suppress that. @dametzger
17mreplyretweetfavorite
bmaz @alexiszotos YESS!!! But gotta work harder, Bruins looking tough so far.
18mreplyretweetfavorite
emptywheel @benjaminwittes Any thoughts on why Obama's WH suppressed a short phrase referencing the Finding "authorizing" torture? @dametzger
18mreplyretweetfavorite
bmaz @gracels @jacklgoldsmith It is not just here, most counties in the state do the same. I bet this is not the only GOP state where that's case
18mreplyretweetfavorite
February 2014
S M T W T F S
« Jan   Mar »
 1
2345678
9101112131415
16171819202122
232425262728