NYTimes throws its 2nd punch at Microsoft Data Centers, Diesel Generators, and Policy

NYtimes had its 1st article on Power, Pollution and the Internet.   The 2nd punch (article) focusing on Microsoft as the bad guy who consumes huge amounts of power, pollutes with diesel generators, and plays hard ball.

But for some in Quincy, the gee-whiz factor of such a prominent high-tech neighbor wore off quickly. First, a citizens group initiated a legal challenge over pollution from some of nearly 40 giant diesel generators that Microsoft’s facility — near an elementary school — is allowed to use for backup power.

Then came a showdown late last year between the utility and Microsoft, whose hardball tactics shocked some local officials.

In an attempt to erase a $210,000 penalty the utility said the company owed for underestimating its power use, Microsoft proceeded to simply waste millions of watts of electricity, records show. Then it threatened to continue burning power in what it acknowledged was an “unnecessarily wasteful” way until the fine was substantially cut, according to documents obtained by The New York Times.

The story spins inconsistencies between Christian Belady who has Mike Manos's old job.

Mr. Belady, the Microsoft official, said the board’s resolution “eliminated the illogical financial incentive for Microsoft to consume unnecessary power in order to avoid a larger fine.”

Mr. Manos, the former Microsoft data center chief who had pledged to operate in an environmentally sensitive way, said he was surprised by the company’s response to the penalty. “Those types of decisions would not have been part of the program’s initial inception,” he said.

Note how the author closes, questioning the value of data centers to the local economy.

But Mr. Morgan, the president of Double Diamond Fruit, said the positive impact over all had been far less than many people imagined. As for all the digital services that data centers power around the country, Mr. Morgan said, “I understand that it’s a necessary situation for us as a society and the way we want to live.”

“But I don’t think it’s benefiting Quincy,” he said. “I think we’re taking one for the team, to tell you the truth.”

We'll see who he goes after next after Microsoft

THE CLOUD FACTORIES

This is the second article in a series about the physical structures that make up the cloud, and their impact on our environment.

Part 1: Power, Pollution and the Internet

Google, Amazon, Apple, Facebook?  Amazon has had Diesel Permit issues in VA.  

This kind of feels like a data center witch hunt or McCarthyism trial.  

One good lesson to learn from the NYTimes DC article, too many times the #1 goal of media is traffic

I was exchanging e-mail with a friend who said the NYTimes contacted him months ago for the interview of the now infamous Power, Pollution, and the Internet article.

THE CLOUD FACTORIES

Power, Pollution and the Internet

Ethan Pines for The New York Times

Data centers are filled with servers, which are like bulked-up desktop computers, minus screens and keyboards, that contain chips to process data.

As you can see there are 280 comments.  Many critcizing the article, many praising it.  

What do I think?  Was I mad at the inaccuracies?  Did I get frustrated at how facts were use?  No.  I just wrote my own post with my own observation that the people who talked to him were probably worried what the author would write next?

Ken Brill is in a 8 minute video.

One lesson I would say that is a good one to learn is media's #1 goal many times is traffic.  So, even though you explain the facts, the reporter is looking for things that get people's interest and gets them to read more.

All of you getting mad, forwarding the post are driving up the traffic of the article.  When a person is measured on traffic, there is no way to tell if the traffic is being read by a fan or a critic, whether or not you are consider accurate by the experts and insiders is not a priority.  Keep in mind this publication was not in DatacenterDynamics or Mission Critical Magazine.

Luckily my friend who was contacted by the NYTimes could tell the reporter was negative on data centers, and he passed on the interview.

The author has a PhD astrophysical sciences which in theory means he should be able to understand data centers.  But he has worked for the NYTimes since 1999, so he is well indoctorined to how things work at a news publication.  The way he writes you wouldn't think he was a PhD physicist.

James Glanz
Science Reporter

James Glanz is a physicist who received his Ph.D. in astrophysical sciences from Princeton University. He started his career in journalism with Research and Development Magazine, before moving to Science magazine, the premier science research publication in the United States.

Since 1991 he has reported on astronomy, cosmology and physics as well as military and technological topics like missile defense and nuclear weapons.

He joined The New York Times in 1999. Stories he wrote with Eric Lipton and others on the World Trade Center were chosen as a finalist for a Pulitzer in explanatory journalism in 2002. Stories Lipton and Glanz wrote were also a part of the Nation Challenged package that won a Pulitzer for Public Service in 2002.

The benefit the NYTimes has is when they call for an interview, few refuse.

But, now a call from the NYTimes's James Glanz is going to be as feared as a call from an environmental group who thinks data centers are dirty coal spewing cloud factories.

NYTimes - Data Centers are evil power consuming polluting cloud factories

Unrestricted consumption is at the root of many bad things for the environment.  Not too long ago magazine and newspapers were the primary method people got the news and the advertising print ecosystem made money.  Behind all the paper consumption were huge pulp and paper mills that are now straining for survival if they aren't already closed.

Now you have products like Instagram that was built on free unlimited image sharing which was great to build market share and be disruptive to Facebook and Google's social media strategies.  Here is a question though, how many of those photos are needlessly wasting HD space sitting idle with little traffic.  

The NYTimes has published an article takes the direction of thinking of data centers like the pulp and paper mills - power consuming polluting buildings. 

THE CLOUD FACTORIES

This is the first article in a series about the physical structures that make up the cloud, and their impact on our environment.

The author is planning more articles.  Given the bad positioning of the data center industry I bet there are a bunch of people mentioned in the article that wished they hadn't spent time with the author.

A yearlong examination by The New York Times has revealed that this foundation of the information industry is sharply at odds with its image of sleek efficiency and environmental friendliness.

Most data centers, by design, consume vast amounts of energy in an incongruously wasteful manner, interviews and documents show. Online companies typically run their facilities at maximum capacity around the clock, whatever the demand. As a result, data centers can waste 90 percent or more of the electricity they pull off the grid, The Times found.

Here are a few example that will get you thinking.

“It’s staggering for most people, even people in the industry, to understand the numbers, the sheer size of these systems,” said Peter Gross, who helped design hundreds of data centers. “A single data center can take more power than a medium-size town.”

...

“This is an industry dirty secret, and no one wants to be the first to say mea culpa,” said a senior industry executive who asked not to be identified to protect his company’s reputation. “If we were a manufacturing industry, we’d be out of business straightaway.”

...

To guard against a power failure, they further rely on banks of generators that emit diesel exhaust. The pollution from data centers has increasingly been cited by the authorities for violating clean air regulations, documents show. In Silicon Valley, many data centers appear on the state government’s Toxic Air Contaminant Inventory, a roster of the area’s top stationary diesel polluters.

The US is positioned as the worst offender.

Worldwide, the digital warehouses use about 30 billion watts of electricity, roughly equivalent to the output of 30 nuclear power plants, according to estimates industry experts compiled for The Times. Data centers in the United States account for one-quarter to one-third of that load, the estimates show.

Power back up is criticized.  Bet those vendors are glad they didn't talk to the NYtimes.

Even running electricity at full throttle has not been enough to satisfy the industry. In addition to generators, most large data centers contain banks of huge, spinning flywheels or thousands of lead-acid batteries — many of them similar to automobile batteries — to power the computers in case of a grid failure as brief as a few hundredths of a second, an interruption that could crash the servers.

“It’s a waste,” said Dennis P. Symanski, a senior researcher at the Electric Power Research Institute, a nonprofit industry group. “It’s too many insurance policies.”

The air quality issues are highlighted.

At least a dozen major data centers have been cited for violations of air quality regulations in Virginia and Illinois alone, according to state records. Amazon was cited with more than 24 violations over a three-year period in Northern Virginia, including running some of its generators without a basic environmental permit.

The fight club data center culture is spun as a conspiracy.

For security reasons, companies typically do not even reveal the locations of their data centers, which are housed in anonymous buildings and vigilantly protected. Companies also guard their technology for competitive reasons, said Michael Manos, a longtime industry executive. “All of those things play into each other to foster this closed, members-only kind of group,” he said.

That secrecy often extends to energy use. To further complicate any assessment, no single government agency has the authority to track the industry. In fact, the federal government was unable to determine how much energy its own data centers consume, according to officials involved in a survey completed last year.

The PR people who set up interviews with the NYTimes must be sweating as they wonder what will be published in the future.

To investigate the industry, The Times obtained thousands of pages of local, state and federal records, some through freedom of information laws, that are kept on industrial facilities that use large amounts of energy. Copies of permits for generators and information about their emissions were obtained from environmental agencies, which helped pinpoint some data center locations and details of their operations.

In addition to reviewing records from electrical utilities, The Times also visited data centers across the country and conducted hundreds of interviews with current and former employees and contractors.

The author even compares data centers to the paper industry.

The industry has long argued that computerizing business transactions and everyday tasks like banking and reading library books has the net effect of saving energy and resources. But the paper industry, which some predicted would be replaced by the computer age, consumed 67 billion kilowatt-hours from the grid in 2010, according to Census Bureau figures reviewed by the Electric Power Research Institute for The Times.

Direct comparisons between the industries are difficult: paper uses additional energy by burning pulp waste and transporting products. Data centers likewise involve tens of millions of laptops, personal computers and mobile devices.

People feared the folks at Greenpeace.  Now they are going to watch out for the NYTimes and maybe other media.

Facebook uses heat maps to find problems in the IT Infrastructure

We are all used to the use of thermal scanners to find hot spots.  The term heat map is also used to figure out problem areas.

This ComputerWorld article has information on Facebook's use of the heat map technique to find problems in its IT infrastructure.

Facebook heat maps pinpoint data center trouble spots

A Facebook engineer developed heat-map technology to quickly identify server, rack or cluster failures

By Joab Jackson
September 19, 2012 03:37 PM ET

IDG News Service - Faced with the challenge of overseeing the health of large caching systems, a Facebook engineer developed heat-map software to quickly pinpoint problems in the social network's data centers.

The Facebook blog post has more details and some images.

When I first deployed Claspin, the view above had a lot more red in it. By making it easier for more people to spot server issues quickly, Claspin has allowed us to catch more "yellows" and prevent more "reds." I suppose there's no better validation of one's choice of statistics and thresholds than to have things start out red and then turn green as the service improves.

NewImage

NewImage

Some articles on China Data Center market

It can be hard to figure out what is going on in China's Data Center Market.

Here are three articles that a friend sent that happen to be all from DatacenterDynamics.

Tencent's data centers is one.

Company profile: China’s Tencent

Tencent is one of the largest cloud providers in China, a country with an insatiable appetite for internet-based services

2 August 2012 par Laura Luo -   

 
   
 
 
 
 
Company profile: China’s Tencent
Design sketch for Tianjian cloud computing data center of Tencent

Tencent, one of the largest internet service providers in China, has been taking aim at China’s cloud computing market, building new cloud computing data centers using advanced environmentally friendly and energy-efficient technologies. It has also been focusing heavily on research and development.

China's Cloud market.

China’s growing cloud industry

China’s cloud computing market is estimated to reach US$31.6bn in the next three years, thanks to investment from public and private players

21 May 2012 par Penny Jones - DatacenterDynamics

 
   
 
 
 
 
China’s growing cloud industry
China's cloud computing industry is preparing for growth

Cloud computing is emerging as one of the China’s fastest growing industries. The nation may account for less than 3% of global cloud computing market share – valued at US$90bn in 2011) but it is growing with an annual rate of 40%, according to analyst firm Gartner.

And some of the cloud build out.

China cloud computing roundup: R&D and newbuilds

Alcatel, Insigma, Inspur, Microsoft and more

26 July 2012 par Laura Luo -   

 
   
 
 
 
 
China cloud computing roundup: R&D and newbuilds
 

Xijian, a province in Northwest China, will build one of the largest cloud computing data center clusters in China in the next 10 years, according to the Tianshan Cloud Plan for the Xinjiang Province.

Two cloud computing industrial bases will be built in Urumqi and Karamay respectively. Once complete, the data center cluster will host a total of 250,000 cabinets and have an annual turnover of 32bn CNY.