A quest for where the data is stored in the cloud

Cnn.com has an article by John D. Sutter who tries to find where his data goes in the cloud.  I feel sorry for the poor guy trying to find answers and not know the first rule of data centers is '”we don’t talk about data centers and where they are, let alone what data is in the data center.”

The following parts is when I felt the guys pain.

I was curious and I wanted to find the scattered bits of my online life before dumping everything on my laptop onto the Web.

So I decided to go on a scavenger hunt into the cloud.

Before I started the search, when I thought about cloud computing, this is the image that came to mind: a giant cartoon cloud just slurped information off of my computer like magic. My files just floated in the sky until I wanted them back.

Video: What is cloud computing?

The cloud doesn't work like that. It's made up of a massive and growing network of data centers, which are huge warehouses full of computers. They store and process information from all around the world, largely in secret.

Then he finally connected with Rich Miller who helped him a bit.  Except he realized he was kind of a clueless.

I found it shocking that the gut of the cloud, an image I found so soft and quaint, was actually comprised of an enormous and ever-growing network of machines.

But apparently lots of people already knew this.

"All the clouds live in data centers," Rich Miller, editor of a prominent cloud-computing blog called Data Center Knowledge, told me. "There's always hardware involved, and bricks and mortar. ... It's not a fluffy cloud. It's living in someone's building."

Awesome. So all I needed to do to find my family photos and the rest of my data was to call up the data center where it lives and go there, right?

Wrong. I quickly learned tours of the cloud aren't easy to come by.

I want a tour of a data center.  Let’s call Google.

Google, which has most of my sensitive data, like e-mail, calendars, to-do lists and documents, declined an interview request for this story. A spokeswoman said the company doesn't give tours either. Go figure.

Excited he gets a tour of an IBM data center.

Dismayed, I started turning to companies who don't have my data, just hoping to get a sense of how this system worked. IBM offered to give me a tour, maybe because, like me, it's trying to break into the cloud world.

and , finds a PUE of over 2.0.  Hopefully the IBM rep didn’t try to explain PUE to him.

Inside, I found rows of black, refrigerator-sized computer towers, 4,000 of them in all. They buzzed and whirred so loudly that I had to lean in to hear my tour guides. In front of the towers, grates and pinholes in the floor pump out frigid air to keep the machines from overheating. The computers breathe this air in and then exhale air as hot as a hair dryer's.

I'm told the cooling bill here costs more than running the computers.

So, he asks more questions and gets more confused.

As I walked around the center, IBM employees did their best to explain this hyper-complicated system. They rattled off machine types, specs and technical details faster than I could write them down.

I confess that I left the IBM tour not feeling much better about the safety of my data. Not that there seemed to be anything wrong with their cloud computing center. The IBM staff was friendly and helpful. The machines looked nice.

Maybe he is a snipe hunt.

A snipe hunt, a form of wild-goose chase that is also known as a fool's errand, is a type of practical joke that involves experienced people making fun of credulous newcomers by giving them an impossible or imaginary ta

So maybe he is asking the wrong question.

But the more I mulled over my failing scavenger hunt, the more I thought that maybe I was asking the wrong question. Perhaps it doesn't matter where my data is, just that there's some way for me to get a sense of how well it's managed.

And, then he realizes maybe he doesn’t own the data.

"Terms of service" agreements offer some details on free services. But, after reading several, it's still unclear to me who owns my data, if I can ever delete it from some sites and what would happen if any of these companies goes bankrupt. In response to an e-mail question about what would happen to Facebook data if the site closed, a company spokeswoman wrote, "The business is doing well and continuing to grow."

Who do you trust?  He talks to Microsoft’s Brian Hall.  Note: I was interested in what Brian had to say as I worked with Brian on Windows XP.

Still, without information, it's hard to know who to trust.

That makes it easy to fall back on flimsy methods of comparison, like going with a brand you already know. I'm sure this is how I ended up with so much data on Google's servers. It's a huge company. Billions use their search. Tens of millions save files with Gmail. They've got to know what's up, right?

That's exactly what the big cloud companies hope you will think. Microsoft's general manager of Windows Live, Brian Hall, told me brand recognition is the best way for people to compare services.

"Consumers, they don't really care if there are 9,000 data centers or two data centers as long as they have confidence that we're going to protect their data and they'll have access to it when they want to have access to it," he said. (In case you're wondering, Hall said Microsoft has "between 10 and 100 data centers" worldwide. Really specific.)

After all this, his conclusion is good.

The most important thing I realized on this search, though, was rather basic:

The cloud is not some fluffy ball of magic, it's an energy-sucking and fallible machine.

One I'll be more cautious before trusting.

Read more

Apple buys Map Service? Google limited to web app vs. future Apple’s iPhone app?

news.com speculates on Apple adding new mapping service to its application capabilities for the iPhone.

Apple buy map service to compete with Google?

by Steven Musil

  • (Credit: Screenshot by Steven Musil/CNET)

We may now have a better idea of why Apple objects to Google Latitude.

It appears that Apple has purchased PlaceBase, a company that produced a maps API called Pushpin and offered a mapping service much like Google Maps. The evidence, dug up by ComputerWorld's Seth Weintraub, first appeared in the form of a tweet in July by Fred Lalonde, the founder of Openspaces.org, a company that used PlaceBase's software, stating that Apple had purchased PlaceBase:

Apple bought PlaceBase - all hush hush. Pushpin site taken offline. Hyperlocal iPhone?

The next clue apparently came from Jaron Waldman, PlaceBase's founder and CEO. His LinkedIn page now lists PlaceBase under his "past" experience and now lists his current occupation as a member of Apple's "GEO Team." In addition, Placebase.com and Pushpin.com have been taken down.

Here is the LinkeIn Page.

 

Jaron Waldman Jaron is a 2nd degree contact

Geo Team at Apple

San Francisco Bay Area
Internet
Current
Past
  • Founder & CEO at Placebase
  • Director at Community Informatics
  • VP Product Development at eSourceWorld

see all...

Education
  • University of California, Los Angeles
Recommendations

1 person has recommended Jaron

Connections

198 connections

Websites

Experience

Geo Team
Apple

Public Company; AAPL; Computer Hardware industry

2009 – Present (less than a year)

Add this to the list of thing going into Apple’s data centers.

Read more

What is the Evolution of the Data Center? - Business Networking at Santa Fe Institute, Nov 12 –14, 2009

NYtimes had an article on Wall Street’s math wizards forgetting a few variables – human behavior.  This article got me thinking the top issues for data center operations have a human factor.

Wall Street’s Math Wizards Forgot a Few Variables

Published: September 12, 2009

IN the aftermath of the great meltdown of 2008, Wall Street’s quants have been cast as the financial engineers of profit-driven innovation run amok. They, after all, invented the exotic securities that proved so troublesome.

Enlarge This Image

James Yang

But the real failure, according to finance experts and economists, was in the quants’ mathematical models of risk that suggested the arcane stuff was safe.

The risk models proved myopic, they say, because they were too simple-minded. They focused mainly on figures like the expected returns and the default risk of financial instruments. What they didn’t sufficiently take into account was human behavior, specifically the potential for widespread panic. When lots of investors got too scared to buy or sell, markets seized up and the models failed.

That failure suggests new frontiers for financial engineering and risk management, including trying to model the mechanics of panic and the patterns of human behavior.

The interesting thing is the same companies that run huge data centers are leaders in this topic.

Much of the early work has been done tracking online behavior. The Web provides researchers with vast data sets for tracking the spread of all manner of things — news stories, ideas, videos, music, slang and popular fads — through social networks. That research has potential applications in politics, public health, online advertising and Internet commerce. And it is being done by academics and researchers at Google, Microsoft, Yahoo and Facebook.

And, there is a chance some of this is being applied to complex modeling in data centers.

One of the interesting areas I found was the topic of econophysics.

J. Doyne Farmer, a former physicist atLos Alamos National Laboratory and a founder of a quantitative trading firm, finds the behavioral research intriguing but awfully ambitious, especially to build into usable models. Instead, Mr. Farmer, a professor at the interdisciplinary Sante Fe Institute, is doing research on models of markets, institutions and their complex interactions, applying a hybrid discipline called econophysics.

To explain, Mr. Farmer points to the huge buildup of the credit-default-swap market, to a peak of $60 trillion. And in 2006, the average leverage on mortgage securities increased to 16 to 1 (it is now 1.5 to 1). Put the two together, he said, and you have a serious problem.

“You don’t need a model of human psychology to see that there was a danger of impending disaster,” Mr. Farmer observed. “But economists have failed to make models that accurately model such phenomena and adequately address their couplings.”

I’ve been sitting on this blog entry for the last week, and thanks to a social networking connection I  am attending Santa Fe Institute’s Business Networking event.

2009 Annual Business Network and Board of Trustees’ Symposium

Multi-Dimensions of Evolution

2009 is the bicentenary of the birth of Charles Darwin. This year SFI has been celebrating this event through a variety of wide-ranging lectures, symposia, and public events on the topic of evolution. The idea has been to explore the many ways in which a Darwinian and Post-Darwinian perspective on life and time have changed our science, society and metaphysics.

This November we shall continue our celebrations with a series of talks on the multi-dimensions of evolution followed by a concert performance and readings -- extending our inquiries into the world of nineteenth century, romantic exploration, and historical synthesis, spanning science and music.

Each speaker will address some unique application of evolutionary thought, describing how an evolutionary perspective has transformed our knowledge of the world. Speakers will consider how evolutionary thinking transformed their fields, and how new, post-Darwinian ideas have been evolving and generating further insights.

Organized by David Krakauer, SFI Chair of Faculty and Professor.

I am sure I’ll learn some interesting areas where the complexity of data centers can be understood with approaches used similar to the math wizards of finance.

Read more

Adding Twitter to the blogging process

I’ve been resistant to Tweet with Twitter given I already write on average two blog entries a day.  But, this week I connected my blog www.greenm3.com to my twitter feed www.twitter.com/greenm3

Here is what I did.

1) In Typepad I added my Twitter account

image

2) I could now publish my posts to twitter, but it was an extra step to go to TypePad posts to enable a twitter feed.  I use Windows Live Writer to write blog entries, and there is a twitter notify plug-in.

image

3) You can check to see if the twitter plug-in installed in the Windows Live Writer edit blog settings.

image

4)  When you publish a dialog box comes to confirm the publishing to Twitter.  Here is the dialog from this post.

image

Overall easier than I anticipated and it is just one more dialog box now that I have Windows Live Writer configured.

You can read my tweets at www.twitter.com/greenm3 which are an alternative to subscribing to my RSS feeds.

Read more

Intel Developer Forum presentation Social Networks and Innovation, a new method for data centers

Intel Developer Forum is a big technical media event.  There are lots to see and the media coverage is huge.  Here is a partial picture of the media room as people are busy writing about Intel’s latest announcements.  This room can hold over 200 people and it is full.

image

While I was in the media room I missed the most useful presentation of the day.  Below is a picture of Eleanor Wynn, Social Technology Architect and Principal Engineer, Intel Corporation, staffing the booth for IT-CMF

image 

I caught Eleanor moving, and here is a better picture.

eleanor

What is IT-CMF?

IT Capability Maturity Framework (IT-CMF)

Ran across an interesting piece of work out of Intel Corp. The IT Capability Maturity Framework trys to take a stab at a common problem. What attracted me to this framework was the business oriented approach this framework takes. But after digging through their site I was hungry for more information. I couldn't find much more information besides a high level explanation. They do have a sample assessment out there that give you a better idea of the framework.

From IT-CMF Website:

From the synthesis of leading academic research, proven industry best practices and Intel's own experience in transforming the Intel IT organisation, Intel developed the IT Capability Maturity Framework (IT-CMF). Based on the lack of existing frameworks and the huge appetite from other top Business and IT executives for such an approach, Intel has decided that the best way to further develop and disseminate the IT-CMF, its associated tools and practices is to have it included as part of IVI’s research and education agenda.

The IT-CMF consists of four integrated strategies:

So, this is cool, but then I realized I missed Eleanor’s presentation on Social Networks.

What does Social Networks have to do with data centers?  Social Networks characterize the behavior in the data center system for those companies/people who are doing the most innovative work.

image

Eleanor and I had a chance to talk for 3 hours at IDF, so I learned a lot even though I missed her presentation.  One big concept which was helpful to describe issues is the “tribal knowledge” in IT vs. meme.

: an idea, behavior, style, or usage that spreads from person to person within a culture

Which gets to my point of why Social Networks and Memes are important characteristics in Innovative Green Data Centers.

image

The most innovative people in data centers are networked to share and receive ideas.

image

The social network enabled organizations know this.

image 

Your head may hurt with these concepts, but here is summary to help you.  My head hurts a little bit too, but I’ve been playing with these ideas for a while, and luckily I can follow up with Eleanor.

image 

Some of the most innovative data center people are figuring out how to build their data center social networks as a competitive advantage.

Read more