NYTimes - Data Centers are evil power consuming polluting cloud factories

Unrestricted consumption is at the root of many bad things for the environment.  Not too long ago magazine and newspapers were the primary method people got the news and the advertising print ecosystem made money.  Behind all the paper consumption were huge pulp and paper mills that are now straining for survival if they aren't already closed.

Now you have products like Instagram that was built on free unlimited image sharing which was great to build market share and be disruptive to Facebook and Google's social media strategies.  Here is a question though, how many of those photos are needlessly wasting HD space sitting idle with little traffic.  

The NYTimes has published an article takes the direction of thinking of data centers like the pulp and paper mills - power consuming polluting buildings. 

THE CLOUD FACTORIES

This is the first article in a series about the physical structures that make up the cloud, and their impact on our environment.

The author is planning more articles.  Given the bad positioning of the data center industry I bet there are a bunch of people mentioned in the article that wished they hadn't spent time with the author.

A yearlong examination by The New York Times has revealed that this foundation of the information industry is sharply at odds with its image of sleek efficiency and environmental friendliness.

Most data centers, by design, consume vast amounts of energy in an incongruously wasteful manner, interviews and documents show. Online companies typically run their facilities at maximum capacity around the clock, whatever the demand. As a result, data centers can waste 90 percent or more of the electricity they pull off the grid, The Times found.

Here are a few example that will get you thinking.

“It’s staggering for most people, even people in the industry, to understand the numbers, the sheer size of these systems,” said Peter Gross, who helped design hundreds of data centers. “A single data center can take more power than a medium-size town.”

...

“This is an industry dirty secret, and no one wants to be the first to say mea culpa,” said a senior industry executive who asked not to be identified to protect his company’s reputation. “If we were a manufacturing industry, we’d be out of business straightaway.”

...

To guard against a power failure, they further rely on banks of generators that emit diesel exhaust. The pollution from data centers has increasingly been cited by the authorities for violating clean air regulations, documents show. In Silicon Valley, many data centers appear on the state government’s Toxic Air Contaminant Inventory, a roster of the area’s top stationary diesel polluters.

The US is positioned as the worst offender.

Worldwide, the digital warehouses use about 30 billion watts of electricity, roughly equivalent to the output of 30 nuclear power plants, according to estimates industry experts compiled for The Times. Data centers in the United States account for one-quarter to one-third of that load, the estimates show.

Power back up is criticized.  Bet those vendors are glad they didn't talk to the NYtimes.

Even running electricity at full throttle has not been enough to satisfy the industry. In addition to generators, most large data centers contain banks of huge, spinning flywheels or thousands of lead-acid batteries — many of them similar to automobile batteries — to power the computers in case of a grid failure as brief as a few hundredths of a second, an interruption that could crash the servers.

“It’s a waste,” said Dennis P. Symanski, a senior researcher at the Electric Power Research Institute, a nonprofit industry group. “It’s too many insurance policies.”

The air quality issues are highlighted.

At least a dozen major data centers have been cited for violations of air quality regulations in Virginia and Illinois alone, according to state records. Amazon was cited with more than 24 violations over a three-year period in Northern Virginia, including running some of its generators without a basic environmental permit.

The fight club data center culture is spun as a conspiracy.

For security reasons, companies typically do not even reveal the locations of their data centers, which are housed in anonymous buildings and vigilantly protected. Companies also guard their technology for competitive reasons, said Michael Manos, a longtime industry executive. “All of those things play into each other to foster this closed, members-only kind of group,” he said.

That secrecy often extends to energy use. To further complicate any assessment, no single government agency has the authority to track the industry. In fact, the federal government was unable to determine how much energy its own data centers consume, according to officials involved in a survey completed last year.

The PR people who set up interviews with the NYTimes must be sweating as they wonder what will be published in the future.

To investigate the industry, The Times obtained thousands of pages of local, state and federal records, some through freedom of information laws, that are kept on industrial facilities that use large amounts of energy. Copies of permits for generators and information about their emissions were obtained from environmental agencies, which helped pinpoint some data center locations and details of their operations.

In addition to reviewing records from electrical utilities, The Times also visited data centers across the country and conducted hundreds of interviews with current and former employees and contractors.

The author even compares data centers to the paper industry.

The industry has long argued that computerizing business transactions and everyday tasks like banking and reading library books has the net effect of saving energy and resources. But the paper industry, which some predicted would be replaced by the computer age, consumed 67 billion kilowatt-hours from the grid in 2010, according to Census Bureau figures reviewed by the Electric Power Research Institute for The Times.

Direct comparisons between the industries are difficult: paper uses additional energy by burning pulp waste and transporting products. Data centers likewise involve tens of millions of laptops, personal computers and mobile devices.

People feared the folks at Greenpeace.  Now they are going to watch out for the NYTimes and maybe other media.

Facebook uses heat maps to find problems in the IT Infrastructure

We are all used to the use of thermal scanners to find hot spots.  The term heat map is also used to figure out problem areas.

This ComputerWorld article has information on Facebook's use of the heat map technique to find problems in its IT infrastructure.

Facebook heat maps pinpoint data center trouble spots

A Facebook engineer developed heat-map technology to quickly identify server, rack or cluster failures

By Joab Jackson
September 19, 2012 03:37 PM ET

IDG News Service - Faced with the challenge of overseeing the health of large caching systems, a Facebook engineer developed heat-map software to quickly pinpoint problems in the social network's data centers.

The Facebook blog post has more details and some images.

When I first deployed Claspin, the view above had a lot more red in it. By making it easier for more people to spot server issues quickly, Claspin has allowed us to catch more "yellows" and prevent more "reds." I suppose there's no better validation of one's choice of statistics and thresholds than to have things start out red and then turn green as the service improves.

NewImage

NewImage

Some articles on China Data Center market

It can be hard to figure out what is going on in China's Data Center Market.

Here are three articles that a friend sent that happen to be all from DatacenterDynamics.

Tencent's data centers is one.

Company profile: China’s Tencent

Tencent is one of the largest cloud providers in China, a country with an insatiable appetite for internet-based services

2 August 2012 par Laura Luo -   

 
   
 
 
 
 
Company profile: China’s Tencent
Design sketch for Tianjian cloud computing data center of Tencent

Tencent, one of the largest internet service providers in China, has been taking aim at China’s cloud computing market, building new cloud computing data centers using advanced environmentally friendly and energy-efficient technologies. It has also been focusing heavily on research and development.

China's Cloud market.

China’s growing cloud industry

China’s cloud computing market is estimated to reach US$31.6bn in the next three years, thanks to investment from public and private players

21 May 2012 par Penny Jones - DatacenterDynamics

 
   
 
 
 
 
China’s growing cloud industry
China's cloud computing industry is preparing for growth

Cloud computing is emerging as one of the China’s fastest growing industries. The nation may account for less than 3% of global cloud computing market share – valued at US$90bn in 2011) but it is growing with an annual rate of 40%, according to analyst firm Gartner.

And some of the cloud build out.

China cloud computing roundup: R&D and newbuilds

Alcatel, Insigma, Inspur, Microsoft and more

26 July 2012 par Laura Luo -   

 
   
 
 
 
 
China cloud computing roundup: R&D and newbuilds
 

Xijian, a province in Northwest China, will build one of the largest cloud computing data center clusters in China in the next 10 years, according to the Tianshan Cloud Plan for the Xinjiang Province.

Two cloud computing industrial bases will be built in Urumqi and Karamay respectively. Once complete, the data center cluster will host a total of 250,000 cabinets and have an annual turnover of 32bn CNY.

Will Central WA wild fires cause problems for Air Cooled Data Centers in Quincy, WA?

The wild fires in Central WA are at an interesting junction of getting bigger or snuffing each other out.

2 wildfires may become 1: help or hindrance to firefighters?

As Washington state's two biggest wildfires burn toward each other, fire officials say they could either feed off each other, creating a more volatile conflagration, or they could consume all available fuel and help snuff each other out.

For those of you not familiar with the air here is a map from Cle Elum where the fires are strongest to Quincy, WA.

NewImage

NewImage

NewImage

Here is the state ecological update.

Specifically, Ecology and Forest Service air-quality monitors in Chelan County are reading in the hazardous and unhealthy ranges. Poorer conditions are trending in the Quincy area and conditions could worsen around Spokane, Pullman and Clarkston.

...

All residents in the Wenatchee area should stay indoors and curtail their physical activities both indoors and out. Doors and windows should remain closed. In the remainder of the Yakima and Columbia basins common sense precautions should be taken by everyone, but sensitive groups -- such as children, the elderly and heart patients -- are particularly vulnerable.

The biggest health threat comes from the fine particles in smoke. These can cause burning eyes, runny nose, bronchitis and other illnesses. Smoky air also can aggravate pre-existing heart and lung diseases, and even lead to death.

Air filtration systems are probably getting inspected as the fire continues to burn.

Here is a news video showing how bad the smoke can be.

GreenM3 going to Blackberry Jam Conference, San Jose Sept 25-27

i have been spending a lot of time working on some mobile solutions lately.  Building on the PC is so in the past.  My main phone is an iPhone 4S.  No I am not upgrading to the iPhone 5.  I have a Samsung Galaxy Note for a phabet experience and a Samsung Galaxy Nexus on Verizon to compensate for the AT&T devices.

At GigaOm Mobilize I ran into some ex-Windows 95 friends who now work at Blackberry and shared some ideas.  They said hey why don't you go to our Blackberry Jam Conference in SJ next week.

NewImage

So, I may add the Blackberry 10 Dev Alpha to my iOS and Android devices.

NewImage