Wednesday, February 23, 2011

Lets take Amazon recently announced a video streaming service available for free to their Amazon Prime subscribers. From what we have heard in the media, Amazon will end up offering a competitive service to Netflix. We all know that Netflix has recently moved most of their infrastructure to Amazon Web Services .

When Amazon announced the new video streaming service, cloud pundits raised some valid questions on whether Amazon will tweak the QoS of their cloud infrastructure to help their own service over Netflix. Clearly, in a highly competitive environment like what exists between Netflix and Amazon, this is a realistic possibility. Remember, in spite of the openness we tout in the cloud world, the cost of moving the infrastructure away from Amazon will be prohibitive for Netflix. Will Amazon play dirty games to kick a competitor away from the market or will it play straight and protect their booming cloud business.

As soon as this discussion came out among Clouderati (a loose group of cloud practitioners, vendors, pundits on Twitter), Amazon CTO, Werner Vogels, jumped in immediately and clarified  that Amazon has no such plans and he even highlighted that any such attempts will be shortsighted move and doesn’t bode well for the longevity of both Amazon Web Services and Amazon’s brand itself. He pointed out to how Amazon is already living in peace with competing third party merchants on their ecommerce platform. He even highlighted the fact that Amazon has a history of cannibalizing their own business to support a customer oriented view.

I agree with Werner’s arguments completely. Some of my thoughts on this development are:
Amazon is very smart to not cannibalize their larger brand for short term gains
Netflix is not dumb to consider such possibilities before they decided to put their entire business on Amazon infrastructure
More importantly, regulators are not blind. Any anti-competitive measure will not sit well with regulators and Amazon knows it pretty well

However, this does raise a very important question which every business planning to move their infrastructure to a third party cloud provider should consider. Are they willing to trust the cloud provider not to poach into their business? Do they have enough protection through their SLAs? Depending on the nature of the business, it is important that due diligence is paid while evaluating the risks.

Saturday, February 19, 2011

NoSQL is a fad

I attended a Silicon Valley Cloud Meetup this week where Siddharth Anand (Sid) gave a great talk on how Netflix has moved to the cloud from applications hosted in their own datacenter. In particular he focused on moving applications from using a traditional RDMS (Oracle in this case) to first SimpleDB (an Amazon offering) and then Cassandra (an open source Key/Value store). SriSatish Ambati (DataStax <http://www.datastax.com/> , has given a great overview of Cassandra’s history and capabilities (slides <http://slidesha.re/svcc_nflx> ) as a warm up talk.

Sid focused down on the actual issues their engineering team ran into when moving to the could, including:
  • Data Model changes required
  • Living without SQL support
  • No joins
  • No transactions
  • No triggers
  • etc.
Netflix accomplishes this by a common layer in their architecture that deals with the NoSQL and hides some of these idiosyncrasies from the application layers above. This is a lot of work (as evidenced by their recent hiring spree – they do these talks to recruit), but is necessary if they are to outsource their resource management and planning to the cloud so that they can scale efficiently.

Sid will give a followup part 2 talk that deals in more depth with the Cassandra issues that they are still working on solving. His slides <http://slidesha.re/hOkpT1> and a whitepaper <http://practicalcloudcomputing.com/post/1267489138/netflixcloudstorage> are available if you want more details.

Monday, January 4, 2010

FTC to Investigate Cloud Computing

The investigation should raise some concerns with the enterprise community. Such an investigation could cover aspects of Internet communications that have been in use for years.

How would the FTC distinguish between the rights of the consumer and businesses that also use cloud computing services? What regulations would drift into the enterprise sector?

Any service provider could be viewed as part of the investigation under such a broad umbrella. The obvious parties would include Google, Amazon, Microsoft, Rackspace and the other large cloud computing services.

SaaS is a form of cloud computing. That could mean a company like NetSuite, Zoho or Salesforce.com would have a stake in the outcome of such an investigation.

According toThe Hill, the investigation surfaced in a filing with the Federal Communications Commission (FCC).

In the filing, The FTC recognizes the cost savings of cloud computing but has concerns about information being stored remotely:

"However, the storage of data on remote computers may also raise privacy and security concerns for consumers," wrote David Vladeck, who helms the FTC's Consumer Protection Bureau.

This statement is puzzling. People have been storing their data remotely since the early 1990s on services that predate the social networks.

The intent of the inquiry is to protect consumers privacy. But the repercussions of such a broad investigation will also have reverberations throughout the enterprise community if the inquiry is not narrowed.

According to The Hill, the FTC is holding a roundtable Jan. 28 to focus on privacy protections. It will include specific discussions about cloud computing, identity management, mobile computing and social networking.

Posted via web from chetty's posterous

Turn Your iPhone into a TV Remote

Posted via web from chetty's posterous

Monday, November 2, 2009

Inside one of the world's largest data centers

CHICAGO--On the outside, Microsoft's massive new data center resembles the other buildings in the industrial area.

Even the inside of the building doesn't look like that much. The ground floor looks like a large indoor parking lot filled with a few parked trailers.

It's what's inside those trailers, though, that is the key to Microsoft's cloud-computing efforts. Each of the shipping containers in the Chicago data center houses anywhere from 1,800 to 2,500 servers, each of which can be serving up e-mail, managing instant messages, or running applications for Microsoft's soon-to-be-launched cloud-based operating system--Windows Azure.

Upstairs, Microsoft has four traditional raised floor server rooms, each roughly 12,000 square feet and consuming, on average, 3 megawatts of power. It's all part of a data center that will eventually occupy 700,000 square feet, making it one of the world's largest.

"I think, I'm not 100 percent sure, but I think this could be the largest data center in the world," said Arne Josefsberg, general manager of infrastructure services for Microsoft's data center operations.

Even with only half the site ready for computers, the center has 30 megawatts of capacity--many times that found in a typical facility.

On a hot day, Microsoft would rely on 7.5 miles worth of chilled water piping to keep things cool, but general manager Kevin Timmons smiled as he walked in for the facility's grand opening in late September. It was around 55 degrees outside.

"When I stepped out, I said 'what good data center weather'," he said. "I knew the chillers were off."

Although Microsoft is open about many of the details of its data centers, there are others it likes to keep quiet, including the site's exact location, the names of its employees, and even which brand of servers fill its racks and containers.

The software maker also won't say exactly which services are running in each facility, but the many Bing posters inside the upstairs server rooms in Chicago offer a pretty good indication of what is going on there.

Microsoft originally intended to open the Chicago facility last year, but the company has slowed its data center pace some amid the weaker economy and an array of cutbacks companywide. Instead, the facility had its grand opening in late September.

Of Sidekick--and Azure
Within a month, though, Microsoft's data centers were attracting attention for a wholly different reason. A massive server failure at an older facility--one that Microsoft acquired as part of its Danger acquisition--left thousands of T-Mobile Sidekick owners without access to their data as part of an outage that is now stretching into its second month.

Although Sidekick uses an entirely different architecture, the failure represented a tangible example of the biggest fear of cloud computing--that one will wake up one day to find their data gone.

Microsoft is quick to highlight the differences between the Sidekick setup and what Microsoft is building in Chicago and elsewhere. "We write multiple replicas of user data to multiple devices so that the data is available in a situation where a single or multiple physical nodes may fail," Windows Azure general manager Doug Hauger said in a statement after the Sidekick failure.

As for Azure, Microsoft is expected to talk about its commercial launch at this month's Professional Developers Conference in Los Angeles, including offering more details on how the system will provide its redundancy. Microsoft has already announced some new Azure details, noting last week that it will begin charging for Azure as of February 1.

Microsoft is still trying to figure out just how much capacity at Chicago and elsewhere it needs to assign for Azure.

"Azure is incredibly hard to forecast," said Josefsberg. "We're probably erring toward having a little more capacity than we need in the short term."

What is clear is that, over time, Microsoft will need even more capacity. That's what has Josefsberg returning to a custom "heat map" that figures out the best place to build data centers based on factors including cheapness, greenness, and availability of power, political climate, weather, networking capacity, and other factors. Choosing the right spot is critical, Microsoft executives say, noting that 70 percent of a data center's economics are determined before a company ever breaks ground.

Josefsberg said he already has the next spot picked out.

"We know exactly where it is going to be but I can't tell you right now," he said.

But Microsoft has indicated how the next generation of data center will improve upon the Chicago design.

Moving to containers allows Microsoft to bring in computing capacity as needed, but still requires the company to build the physical building, power and cooling systems well ahead of time. The company's next generation of data center will allow those things to be built in a modular fashion as well.

"The beauty of that is two-fold," Josefsberg said. "We commit less capital upfront and we can then accommodate the latest in technology along the way."

Posted via web from chetty's posterous