What happens when your data mining is flooded with SPAM? NSA's data center problem

Washingtonpost discuss the problem of the NSA data center being flooded with SPAM.

The NSA's data-collection activities are so resource-intensive, the agency can't complete its new server farms fast enough. But when it does, a significant share of what gets held on those servers could wind up being worthless spam.

We now know the NSA collects hundreds of thousands of address books and contact lists from e-mail services and instant messaging clients per day. Thanks to this information, the NSA is capable of building a map of a target's online relationships.

The abundance of SPAM is probably one of the top reasons so many users try not to use e-mail.

The writer closes making the point that part of what is stored in the NSA data center is lots and lots of SPAM.

Industry reports show spam accounts for an overwhelming share of all e-mail. Other internal NSA documents obtained by The Post's Barton Gellman appear to agree. If what the NSA is downloading is at all reflective of the broader Internet, then it's fair to conclude the agency collects a significant amount of spam and has little choice but to store it — meaning that of the "alottabytes" of storage the NSA brags about in its Utah data center, a heap of them will be filled with junk.

Rethinking what is the Truth in Economic Data, Premise Challenges Government Reporting

The movie Trading Places with Dan Aykroyd and Eddie Murphy made millions gaming the government disclosure of OJ futures.

It does seem pretty fragile that the future prices are determined by decades old manual methods.

A startup came out of stealth mode today.  I caught the news first in the WSJ print version, and there is a SFGate article that also covers the new service.

He began to wonder what information the government was relying on, and how they were gathering and analyzing it.

"They're reporting on about half a percentage point of reality," he said.

Soloff thought that in the digital age, there had to be more complete, reliable and rapid ways to collect the data that informs critical monetary decisions, here and abroad. A year and a half ago, he co-founded a company that aims to prove it, using an unusual online and offline approach that could offer fresh economic insights.

It's called Premise Data Corp., using the term from logic meaning the assumption that something is true. But it remains to be seen whether the company's own premise is true - that it can make money selling better data, indexes and tools than vast government agencies.

Office vs. Office-less workers, HP/Yahoo! vs. 37 Signals

One of the biggest daily carbon footprints is the daily commute.  Notice how more and more start-ups are having workers scattered around the world?  I started a company with friends and we are separated by 900 miles, but we are on the same time zone.  Google Hangout is our main method of connecting.  Some may think e-mail is for the old guys.  Well we are a bunch old guys, and at the stage we are in now e-mail works to allow everyone to be in their own mode without an interruptions. This e-mail approach is opposed to a quick collaboration Agile type of solution.

Here is a post by 37 signals on their office setup.

“Everyone in the same office” is less true now than it ever was. People are waking up to the benefits of remote working. From quality of life to quality of talent. It’s a new world, and thus a new set of assumptions.

The interesting, and tricky, part of choosing a work pattern is comparing these different worlds. What’s the value of a group of people who a) can only be picked from amongst those within a 30-mile radius of a specific office, b) who have to deal with the indignity of a hour-long daily commute, c) but who’s Agile with that capital A?

Versus a team composed of a) the best talent you could find, regardless of where they live, and b) who has the freedom to work their own schedule, c) but can’t do the literal daily stand-up meeting or pair in front of the same physical computer?

37 Signals followed the above post with another one focusing on HP/Best Buy/Yahoo!'s call for "all hands on deck" everyone must be in the office.

Neither is the hilarious corporate doublespeak that’s being enlisted to make the case. Here’s a choice bit on just how important employees are to the Vapid Corporate Slogan of The Day.. uhm, I mean HP Way Now:

Belief in the power of our people is a core principle of the HP Way Now. Employees are at the center of what we do, we achieve competitive advantages through our people. HP has amazing employees who are driving great change.

So we have great people, but we can’t trust them to get anything done unless we see butts in seats from 9-5? Who cares whether all these great people have designed a lifestyle around not having to commute long hours or live in a given city. That’s all acceptable collateral damage in the “all hands on deck” playbook for sinking companies.

Having a space where you can do your best work is your goal. Some companies think this way.  Some don't.

What is so often true is management doesn't give you the reasons why they are changing policy.

It’s sad when you see once-great companies reduced to this smoldering mess of mistrust and cargo culting. But hey, at least we know now the pitch of the whistle that says its time to abandon ship. It’s “all hands on deck”.

Steam Controller Video Demo, gets 1 mil views in 24 hrs, Users are ready to decrease use of keyboards

If you are in the business of selling keyboard switches, life is not good.  I used to be program manager for Apple Keyboards so got into all the details of making keyboards, PCB, key switches, printing.  I also worked on mice and trackballs, so data input devices was in my blood long, long ago.

Those who hang on to must have features like a physical keyboard have a lot in common with the loyal Blackberry users who are disappearing fast.

In Gaming there is a debate between the keyboard and mouse users vs. controllers.

Probably the single most-argued argument in all of gaming is the silly, ill-formed rivalry between the console gamepad and the PC mouse and keyboard.

Here is video by Valve Software on the Steam Controller.  This video has over a million views in 24 hours.

Think about some of those things in your data center that may be the old way doing things like typing on a keyboard.