Inspiration for the Low Carbon Data Center, 7x24 Exchange keynote by Robert F Kennedy jr

I am sitting at 7x24 Exchange, the first keynote is delivered by Robert F. Kennedy jr, and I was lucky to meet him at Breakfast.  Sometimes I wonder whether people get the idea of a Green (low carbon) data center.  What a great way to start a data center conference with a keynote educating the data center audience of the issues faced by a carbon based economy.

CONFERENCE KEYNOTE:
"Green Gold Rush - A Vision for Energy Independence, Jobs, and National Wealth"

The creation of a green economy is an increasingly promising solution to multiple challenges. Sustainable business and energy independence are keys to our economic revitalization, according to Kennedy. America can boost its own infrastructure by powering industry with plentiful and domestic renewable resources. A sophisticated, well-crafted energy policy will help sharpen American competitiveness while reducing energy costs and our national debt. Intelligent energy policy is also the national fulcrum for US foreign policy and national security. From green jobs and technologies to weaning our reliance on carbon energy, Kennedy offers a bold vision to restore US economic might, safeguard our environment, and reestablish America's role as an exemplary nation.

Robert F. Kennedy, Jr., Visionary, Environmental Business Leader and Advocate

Here is an article that captures part of what Robert F. Kennedy Jr. presented.

If ever an issue deserved President Obama's promise of change, this is it. Mining syndicates are detonating 2,500 tons of explosives each day -- the equivalent of a Hiroshima bomb weekly -- to blow up Appalachia's mountains and extract sub-surface coal seams. They have demolished 500 mountains -- encompassing about a million acres -- buried hundreds of valley streams under tons of rubble, poisoned and uprooted countless communities, and caused widespread contamination to the region's air and water. On this continent, only Appalachia's rich woodlands survived the Pleistocene ice ages that turned the rest of North America into a treeless tundra. King Coal is now accomplishing what the glaciers could not -- obliterating the hemisphere's oldest, most biologically dense and diverse forests. Highly mechanized processes allow giant machines to flatten in months mountains older than the Himalayas -- while employing fewer workers for far less time than other types of mining. The coal industry's promise to restore the desolate wastelands is a cruel joke, and the industry's fallback position, that the flattened landscapes will provide space for economic development, is the weak punchline. America adores its Adirondacks and reveres the Rockies, while the Appalachian Mountains -- with their impoverished and alienated population -- are dismantled by coal moguls who dominate state politics and have little to prevent them from blasting the physical landscape to smithereens.

Obama promised science-based policies that would save what remains of Appalachia, but last month senior administration officials finally weighed in with a mixture of strong words and weak action that broke hearts across the region. The modest measures federal bureaucrats promised amount to little more than a tepid pledge of better enforcement of existing laws.

And government claims of doing everything possible to halt the holocaust are simply not true. George Bush gutted Clean Water Act protections. Obama must restore them.

Next Three weeks of Data Center Events

It’s been a great 4 weeks where I haven’t been on a plane.  I went to DCD Seattle and Amazon’s Technology Open House as local events.  But, now I have three straight weeks of travel.  I’ll be at the following events. 

June 12 - 15 7x24 Exchange, and we will be having Data Center 2.0 on Monday event for thought leaders we have identified.  Version 1.0 we had at Uptime and we are changing the format a bit for 2.0.

http://www.7x24exchange.org/

June 22-23, GigaOm Structure.

June 30, Data Center Dynamics San Francisco.

Luckily I am from the Bay Area, and see my family while while I am down there, and my mom can fly back to Seattle with me, and we can fly back down to SJC after the weekend.  The house project is almost done.  Part of the fun we had a week ago was craning in the 1,000 lb marble countertop.

IP Network Discovery as a way to manage Data Center Power, joulex

I had a chance to talk Tom Noonan, President & CEO and Tim McCormick with joulex to discuss their data center power management solution.  What caught my eye is Tom's ME background and experience in systems engineering and real-time process control systems.

Tom Noonan
President & CEO

Tom Noonan assumed the role of president and CEO at JouleX in 2010 and also remains a partner at TechOperators, an early-stage investing firm he co-founded in 2008. He is the former chair, president and CEO of Internet Security Systems, which was acquired by IBM for $1.5 billion. Prior to ISS, Noonan held senior positions at Dun and Bradstreet Software, where he was vice president, worldwide marketing.  

After graduating from Georgia Tech with a Mechanical Engineering degree, Noonan joined Rockwell Automation as a systems engineer specializing in real-time process control systems for industrial automation applications. Noonan founded two successful control systems technology companies while residing in Boston: Actuation Electronics, a precision motion-control company and Leapfrog Technologies, a software development environment for real time process control and automation applications.

...

Tim McCormick
Vice President, Sales & Marketing

Tim McCormick brings over 25 years of marketing, sales and business development experience in both enterprise security and application software. Prior toJouleX, he was vice president of the Business Solutions Group at IBM Internet Security Systems. He also served as vice president of marketing for Lancope, a leading network behavior analysis and anomaly detection provider, and at ClickFox, a customer behavior intelligence solution provider.

One of the things that impressed me is JouleX uses an IP discovery strategy that allows an agentless approach to discover the inventory of power devices in the data center.  Note the Routers and Switches which are in the center of this diagram.

Working with other systems that has information about IP devices makes the discovery easier by communicating with devices that manage other devices.

This approach allows JouleX to create graphs like this on where the power is being used based on the IP addresses inventoried.

11 price reductions over 4 years, Amazon Web Service's James Hamilton thoughts on pace of innovation

James Hamilton is keynoting at SIGMOD Athens and his presentation description has some good ideas to think about.

Keynote 1: James Hamilton, Amazon Web Services

Internet Scale Storage

Abstract

The pace of innovation in data center design has been rapidly accelerating over the last five years, driven by the mega-service operators. I believe we have seen more infrastructure innovation in the last five years than we did in the previous fifteen. Most very large service operators have teams of experts focused on server design, data center power distribution and redundancy, mechanical designs, real estate acquisition, and network hardware and protocols. At low scale, with only a data or center or two, it would be crazy to have all these full time engineers and specialist focused on infrastructural improvements and expansion. But, at high scale with tens of data centers, it would be crazy not to invest deeply in advancing the state of the art.

Looking specifically at cloud services, the cost of the infrastructure is the difference between an unsuccessful cloud service and a profitable, self-sustaining business. With continued innovation driving down infrastructure costs, investment capital is available, services can be added and improved, and value can be passed on to customers through price reductions. Amazon Web Services, for example, has had eleven price reductions in four years. I don’t recall that happening in my first twenty years working on enterprise software. It really is an exciting time in our industry.

Here is anther thing to keep in mind.   From reading this statement it seems Amazon Web Services does not use blades.  If Amazon has determined it shouldn’t use blades why should you?

· Datacenter Construction Costs

o Land: <2%

o Shell: 5 to 9%

o Architectural: 4 to 7%

o Mechanical & Electrical: 70 to 85%

· Summarizing the above list, we get 80% of the costs scaling with power consumption and 10 to 20% scaling with floor space. Reflect on that number and you’ll understand why I think the industry is nuts to be focusing on density. See Why Blade Servers Aren’t the Answer to All Questions for more detail on this point – I think it’s a particularly important one.

From 2008 James has discussed blades.

Summary so far: Blade servers allow for very high power density but they cost more than commodity, low power density servers. Why buy blades? They save space and there are legitimate reasons to locate data centers where the floor space is expensive. For those, more density is good. However, very few data center owners with expensive locations are able to credibly explain why all their servers NEED to be there. Many data centers are in poorly chosen locations driven by excessively manual procedures and the human need to see and touch that for which you paid over 100 million dollars. Put your servers where humans don’t want to be. Don’t worry, attrition won’t go up. Servers really don’t care about life style, how good the schools are, and related quality of life issues.

Here is a simple one liner.

Density is fine but don’t pay a premium for it unless there is a measurable gain and make sure that the gain can’t be achieved by cheaper means.

Architecting for Outages, an architect posts on surviving AWS

Everyone wants to survive a data center outage, but as AWS outage shows, not all do survive.  Here is a post that summarize best practices in SW architecture to survive an outage like AWS.

Retrospect on recent AWS outage and Resilient Cloud-Based Architecture

Thursday, June 9, 2011 at 8:19AM

A bit over a month ago Amazon experienced its infamous AWS outage in the US East Region. As a cloud evangelist, I was intrigued by the history of the outage as it occurred. There were great posts during and after the outage from those who went down. But more interestingly for me as architect were the detailed posts of those who managed to survive the outage relatively unharmed, such as SimpleGeo, Netflix,SmugMug, SmugMug’s CTO, Twilio, Bizo and others.

The list of best practices are:

The main principles, patterns and best practices are:

• Design for failure
• Stateless and autonomous services
• Redundant hot copies spread across zones
• Spread across several public cloud vendors and/or private cloud
• Automation and monitoring
• Avoiding ACID services and leveraging on NoSQL solutions
• Load balancing

If this seems daunting, there are new services coming to provide scalability and availability services.

The emerging solution to this complexity is a new class of application servers that offers to take care of the high availability and scalability concerns of your application, allowing you to focus on your business logic. Forrester calls these "Elastic Application Platforms", and defines them as:

An application platform that automates elasticity of application transactions, services, and data, delivering high availability and performance using elastic resources.