To me its not an issue for the United States Government to own capability...it is a concern when 1) Government agencies allow themselves to become partisan, and subsequently weaponized against US citizens (See the IRS); 2) the technology is not segmented, and agencies like ANT contain personnel with full understanding of multiple "hacks"...that's bad, kinda like...its bad for an ICBM launch officer knowing certain things about launch codes, etc. ...I worry ANT folks with that kind of complete understanding can become mercenaries for corporate espionage...bad deal there.
The concept the NSA has me most frustrated over is indiscriminant gathering of data for later use...that's just asking to be abused...its dumb.