Showing posts with label Facebook. Show all posts
Showing posts with label Facebook. Show all posts

Wednesday, April 3, 2013

Applied Micro's cloud chip is an ARM-based, switch-killing machine

Applied Micro Circuits, a chip firm that designs silicon parts for the computing and networking world, has spent the last three years making a big bet on the cloud computing market and the ARM architecture. The results began shipping last week, and the product essentially takes networking and computing and crams it all onto one system on a chip.

Dubbed the X-Gene server on a chip, the product has been touted by Applied as the first 64-bit-capable ARM-based server in existence, the ideal part for webscale users (check out the pic of Facebook's Frank Frankovsky holding one up) and also the future of Applied Micro. It's the first chip to contain a software-defined network (SDN) controller on the die that will offer network services such as load balancing and ensuring service-level agreements on the chip. It's like shoving the networking and computing vision of the Cisco Unified Computing System on a chip.

This is a big deal. Although the first generation won't have enough bandwidth to eliminate the need for a switch at the top of a rack, the following generation will.

Paramesh Gopi, president and CEO of Applied Micro, said that these new chips have now made it past the prototype stage (the board in the picture uses an FPGA instead of a production silicon) AND are now in the hands of several customers, including Dell and Red Hat. Gopi expects physical servers containing the X-Gene to hit the market by the end of this year.

Gopi's big bet

The chip is manufactured at 40 nanometers and contains eight 2.4 GHz ARM cores that Applied has designed, four smaller ARM Cortex A5 cores running the SDN controller software (the pink bit on the block diagram below), four 10-gigabit ethernet ports, and various ports that can support more Ethernet, SSDs, accelerator cards such as those from Fusion-io or SATA drives. In short, this a chip that combines networking and computing in one package.

When about asked about the power consumption of the chip, Gopi said it will run at 50 percent of the total cost of ownership of a comparable x86 product, but wouldn't discuss actual power consumption.

"We'll be able to run your LAMP stack and SQL jobs on Xeon-class ARM cores, and the routing protocols and such will be running on the Atom-class ARMs," Gopi said. "It's the fundamentals of a rack on a single chip."

xgeneblock

Building this chip has taken four years. It required Gopi to visit ARM at its U.K. headquarters to convince them to give him an architecture license to build a chip for servers. In an interview with me at the Open Compute Summit in January, Gopi explained that he saw the flexibility and the architecture that ARM offered could become an asset for webscale computing, so he embarked on turning Applied Micro, a public company with a few hundred million in revenue, into a startup.

Like others, such as Barry Evans of Calxeda or Andrew Feldman of Sea Micro, he saw that power issues were raising the cost of operating data centers - and cutting into the bottom line at web businesses - and he thought he had a solution. His solution was to get an architectural license from ARM, so he could make a 64-bit-capable chip ahead of ARM's plans to introduce that powerful a core. ARM introduced that core last year, and vendors of ARM-based server chips such as AMD and Calxeda expect to have 64-bit-capable chips next year. But Applied is shipping those machines today.

"We'll end this wimpy core vs. brawny core debate once and for all," Gopi said.

The new hardware mindset

Applied Micro CEO Paramesh Gopi.

Applied Micro CEO Paramesh Gopi.

Gopi has taken advantage of several different trends that are finally coming to fruition. The first trend is the use of the ARM core - ubiquitous in cell phones and tablets - for the enterprise and cloud computing market. But he's also taking advantage of a more subtle shift happening in the chip world as it pertains to the data center - namely the opening up of the ecosystem.

The mobile industry has relied upon the common ARM architecture to build a wide variety of chips that give each vendor a slightly different set of features. Both Nvidia and Qualcomm start with ARM cores (hell, even Apple has an ARM architectural license) to build their application processors. This lowers the cost of designing chips, because engineers can start from a higher level when solving problems.

And the modularity of the ARM cores combined with an architecture license also means firms can customize their designs for a certain market without spending a huge amount of time or dollars. Gopi will actually address some of this at our Structure event June 19 and 20, in a presentation on designing hardware at the speed of software.

For Applied, this dynamic plays out in the existence of a new type of chip for the data center, but also in the fact that in nine or 12 months Applied plans to test the second-generation X-Gene chip, one that will support 100-Gigabit Ethernet and will obviate the need for a top-of-rack switch. Ironically, this architecture probably won't be a welcome development for Applied's existing networking clients like Cisco and Juniper.

But it's clearly the direction that large webscale customers want to go. And the second-generation architecture is also important for the first-generation X-Gene products, because without it, Applied may not have a chance at getting technically savvy and forward-looking potential customers that need not just a single interesting product, but a real understanding of the roadmap before they commit to a new architecture.

So even as Applied ships these first products to customers for use in devices that hit the market at the end of this year, it's already developing its production of the next generation 28-nanometer versions of the heavy-duty ARM cores and 100-Gigabit-capable networking while prepping for later versions that may include photonics and other elements that data center customers are already discussing as tomorrow's technology.

It took a bold vision - and that trip to ARM - for Gopi to get Applied Micro to the table as these discussions about the next generation data center are playing out. But with this design, it has earned a seat. Now all it has to do is earn the business.


Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

http://gigaom.com/2013/04/03/applied-micro-cloud-chip


allvoices

Wednesday, February 20, 2013

First ARM-based servers in production support Baidu's cloud storage

Chinese search engine giant Baidu is using ARM-based servers from Marvell making it the first company to depend on servers using the cell-phone chip in a production environment. Baidu is using the new ARM servers in its cloud storage application named Baidu Pan.

ARM, which licenses its IP to a variety of chip makers, had stated its intentions to enter the data center market back in 2010, as worries about energy efficiency increased and the needs of webscale computing customers changed. While less powerful than their Intel counterparts, a cluster of lower-power ARM chips is more power efficient on a performance per watt basis and some workloads don't even need the performance characteristics of a big Intel core.

The combination of these two trends has led to a plethora of vendors from big names like Marvell and AMD to startups such as Calxeda to license ARM's cores with an eye toward making servers. Holding ARM back so far has been the delay in building out 64-bit capable cores (they are expected later this year) as well as a lack of enterprise software running on the ARM platform.

But given the economics of these so-called wimpy cores and the limits of using ARM cores in the enterprise server market today, the use of ARM-based servers in the storage arena is not surprising. Storage usage scenarios are perfect in many ways because they don't need a lot of raw performance, nor do they require 64-bit capable cores.

Thus, Baidu using ARM for storage makes sense. It's also an area where Calxeda expects to see its first production deployments sometime this year, according to a conversation I had with Karl Freund, the VP of marketing of Calxeda last December. As for the Baidu deployment, it's using the quad-core Armada CPU, Marvell's storage controller, and a 10Gb Ethernet switch all integrated on a single system on a chip.

Marvell's release says the chip firm customized the ARM servers specifically for Baidu's cloud storage requirements, taking the concept of server customization common in webscale deployments to the chip level. Marvell says the platform is designed to increase the amount of storage for conventional 2U chassis up to 96 TB, and to lower the total cost of ownership by 25 percent, compared with previous x86-based server solutions. The end result should cut Baidu's power in its data center by half according to the release.


Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

http://gigaom.com/2013/02/20/first-arm-based-servers-in-production-sup


allvoices

Monday, December 17, 2012

Peter Thiel funds tornado power: seriously

Peter Thiel, famous for co-founding PayPal and being an early investor in Facebook, has put a small grant of $300,000 into a Canadian inventor who has spent years working on the idea of harnessing man-made tornadoes to produce power. The funding was made through Thiel's Breakout Labs, which is part of the Thiel Foundation and which gives small rounds of funding for cutting-edge, early-stage science and technology research ideas.

The entrepreneur behind tornado power is Louis Michaud, who is a Canadian engineer that has spent years "trying to be taken seriously," as Toronto Star reporter Tyler Hamilton describes him (he profiled Michaud in his book Mad Like Tesla). Michaud's startup is called AVEtec and his technology is called the Atmospheric Vortex Engine (AVE). Breakout Labs describes the technology as:

In his design, warm or humid air is introduced into a circular station, where it takes the form of a rising vortex, i.e. a controlled tornado. The temperature difference between this heated air and the atmosphere above it supports the vortex and drives multiple turbines. The vortex can be shut down at any time by turning off the source of warm air.

AVEtec

AVEtec says vortex-power can deliver energy that is carbon emissions-free, and super cheap at 3 cents per kilowatt hour (coal can be anywhere from 4 to 5 cents per kwh, and it's got some of the highest carbon emissions).

The problem is that the tornado power has to be created in a large power plant, and that has yet to be built and tested at scale. The column of the tornado in a commercial-size plant would be 130 feet tall. Reporter Hamilton says Michaud's plan eventually is to create tornadoes using waste heat from power plant or industrial factory and then harness those vortexes.

AVEtec will work with Lambton College in Ontario to build and study a prototype using the funding from Breakout Labs. Breakout Labs has also funded Modern Meadow, which combines in-vitro meat with 3D printing.

Thiel clearly has an interest in backing early stage research around new ways to use resources from energy to food to water. Despite that he was widely quoted as saying cleantech has been a disaster, he's taking more of an ARPA-E style approach for cleantech through Breakout Labs. Thiel has also put money into LightSail Energy, a startup that makes a next-generation compressed air energy storage technology.

http://gigaom.com/cleantech/peter-thiel-funds-tornado-power-seriously


allvoices

Friday, January 16, 1970

Facebook takes on Mother Nature by using open air cooling for N.C. data center

Facebook has managed to make its newest data center in North Carolina more efficient than the one it built in Prineville, Ore., despite the sweltering heat of the Carolina summer. By using open-air cooling and its Open Compute Foundation servers, Facebook has achieved a PUE score of 1.07 (the Prineville facility has a PUE of 1.09).

PUE, or power usage effectiveness, is a metric that divides how much energy a data center uses in total by how much its IT equipment uses, and the closer you are to one the more efficient your data center is. So how on earth did Facebook manage to avoid using air conditioning in its data center located in the South where temperatures can hit triple digits and the humidity is enough to make you feel like you’re breathing underwater?

Dueling weather metrics and swamp coolers

Facebook’s blog post on the topic opens with dueling weather forecasts. It weighed forecasts using BinMaker software for calculating temperature and humidity on computing and forecasts and data from the American Society of Heating, Refrigerating and Air-Conditioning Engineers, Inc. to figure out if it would need to use A/C. The ASHRAE estimates said the social networking giant would need to use its A/C in Forest City, N.C. and BinMaker didn’t. Undeterred by the prospect of turning on the chillers, Facebook installed them but also went ahead with plans for open air cooling.

As an Open Compute blog post written by a Facebook engineer notes, “We ended up installing a direct expansion (DX) coil system in the facility, just in case it might be needed, but it was important to us to find a way to make the free cooling system work — the potential efficiency gains to be found in keeping those DX units switched off were just too great to ignore.” The social networking company then built its own servers based on the Open Compute standards it had pioneered and tweaked them to handle higher indoor temperatures and humidity.

For engineers, the heat wasn’t the issue, the humidity was. Much like eBay, which uses open-air cooling in Phoenix, that “dry-heat” everyone praises actually is better because the data center operations team can use a mist to cool down the air before it enters the data center. In high heat and low humidity environments basically Facebook is using a swamp cooler. That’s the same method it uses in Prineville on warm days.

Last summer, one in which North Carolina had the second-highest July on record and the temperature hit 100 degrees one day, Facebook lucked out because the humidity stayed low. This meant Facebook never had to turn on the A/C. It did, however, have to use some of the dry hot air from the data center hall to lower the overall humidity on days when it was really humid but not that hot.

So all that hot air generated on Facebook by your friends and their political opinions can be put to good use.

Check out this series by GigaOM’s Katie Fehrenbacher on North Carolina’s mega data center clusters:

Here’s my 4-part series on data centers and power:

http://gigaom.com/cloud/facebook-takes-on-mother-nature-by-using-open-air-cooling-for-n-c-data-center/


allvoices

Facebook and Open Compute want a biodegradable server chassis


Facebook is sponsoring an Open Compute Foundation contest with Purdue to develop a more sustainable server chassis. The goal of the contest is to build a biodegradable box, instead of steel casing‚ to hold the innards of a server. Since most companies replace their servers every two to three years (the Purdue contest site says four), why not make the case out of something that doesn't need to be recycled at the end of its rather short life?

From the design challenge web site:
Servers are typically replaced about every four years. This is necessary to maintain fast, reliable equipment. Unfortunately, this results in a lot of waste. Open Compute wants to change this starting with the server chassis. These are typically made of steel, which is recyclable, but even recycling generates waste. What would happen if these chassis could be placed in compost instead?
Purdue University's College of Technology entrepreneurship program, called Tech Ventures, will work with the Foundation and the social network to get students to rethink the humble chassis. The challenge will begin with a Computer and Information Technology (CNIT) course at Purdue in the spring semester. I, for one, can't wait to see the cardboard server chassis, although in some ways I think eliminating the chassis and making the rack the protective unit for the boards and components might make more sense.





http://feedproxy.google.com/~r/OmMalik/~3/yk3_hG0kKFw/story01.htm
http://gigaom.feedsportal.com/c/34996/f/646446/s/2562b682/l/0Lgigaom0N0Ccloud0Cfacebook0Eand0Eopen0Ecompute0Ewant0Ea0Ebiodegradable0Eserver0Echassis0C/story01.htm

allvoices

Meet ARM’s two newest cores for faster phones and greener servers

ARM has created a new family of processor cores designed with user demands for always-on computing as well as the need for more efficient computing on the data center side in mind. The new A50 family of cores will be available to chipmakers at the end of next year and ARM expects devices containing those cores to hit the market in 2014 and 2015.

Unlike Intel or even Qualcomm, ARM doesn’t build or design chips, but instead licenses its technology to other chipmakers who take the ARM IP and build chips or systems on a chip around those core designs. The new cores are designed in a “big” version that offers 64-bit processing and more powerful cores, and a 64-bit “little” version (that is also 32-bit compatible) that is aimed at the mobile market. The big A-57 core will deliver three times more performance at the same power consumption as today’s mobile phone chips, according to ARM, while the little A-53 core will deliver four times the power efficiency as today’s phone platforms with a better performance than current generation phone platforms.

Computing is no longer a desk job or sold by the server

Our computing habits have changed in the last five years. Where we once may have sat at a desk and completed our computing tasks, we now wake up and roll over in bed to check out email on phones, before maybe moving to a tablet, a connected car and then finally to a laptop or desktop at work. As we hop from machine-to-machine we expect a similar and continuous experience, which we get thanks to web services that most of us use in the browser or via clients.

To meet that demand, web companies are deploying millions of servers in data centers the size of warehouses. At that scale things change — not just the focus on power consumption, but also the ability to use hardware tuned to a specific workload. For example, Facebook isn’t one app, it’s a combination of more than 20 different services that are tied together with software. But because Facebook is so huge, those services can require a lot of computing resources. Facebook doesn’t buy servers, it buys racks, and at that level of hardware consumption, buying a rack using ARM-based servers to cut power costs may slightly increase the management load on operations team members, but it also cuts the energy requirement.

The combination of these shifts on the user and on the web services side are why ARM has seen a chance to get into the data center. It’s also why players from AMD, Dell and even Intel are embracing heterogeneous compute. During the last 20 years, just like Ford’s original Model T that only came in black, you could only have one type of instruction set as long as it was an x86. But with the rise of webscale, cloud and even a broader use for high performance computing, companies wanted variety.

ARM’s response is modular building blocks

So Intel is working on its MIC architecture, Nvidia is introducing graphics processors in servers and AMD is embracing ARM, x86 and GPUs. Startups ranging from Tilera to Adapteva are also trying to bring new architectures to the market. ARM’s approach with its latest architecture (ARMv8) is to emphasize power efficiency even at the expense of performance. It has always done this in the mobile market, where a poor battery life can doom device to the scrap heap, even if the graphics are vivid and the applications are speedy.

Companies that license these new cores can mix big cores with little cores or build systems containing big cores and ARM graphics cores, or any number of configurations to meet the needs of the device and market they are building for.

The two new cores also will eventually bring 64-bit processing into the mobile device arena, which Nole Hurley, VP of marketing and strategy for ARM’s processor division, said is important because people are creating more content on mobile devices (this will also offer ARM a credible core for the laptop market as well). Now, all of this depends on software that can run using the ARM instruction set, but in both the consumer side and the data center market ARM is building out ecosystem partners.

The new cores should appear in chips built using the 28 and 20 nanometer process node, and will scale down to 14 nanometers and the newer chipmaking processes that build up instead of out. As the process node shrinks and more transistors are crammed on the chip expect additional performance and energy gains.

For those who are still looking for gigahertz performance numbers Hurley sais]d that new A-50 family will deliver performance ranging from 1.3 gigahertz to 3 Gigahertz depending on how the ARM licensees tweak their designs. At that point I wonder if we can still get away with calling a 3GHz ARM-based design a wimpy core. However, Ian Ferguson, who heads ARM’s server ambitions, (and who doesn’t use the phrase wimpy core) noted that ARM isn’t expressing its server goals in terms of the traditional enterprise.

“What we’re not saying is that we’re going to blaze on into traditional enterprise infrastructure … that is not the space we’re planning to attack,” Ferguson said. “We want places where the server is the business.” And as we’ve stated before, that space is where much of the growth in servers will come from in the coming years. Seeing this, ARM has developed a family of processor cores that can be configured to meet the needs of all-day computing from the user side and the server side.

http://gigaom.com/2012/10/30/meet-arms-two-newest-cores-for-faster-phones-and-greener-servers/


allvoices

Meet ARM’s two newest cores for faster phones and greener servers

ARM has created a new family of processor cores designed with user demands for always-on computing as well as the need for more efficient computing on the data center side in mind. The new A50 family of cores will be available to chipmakers at the end of next year and ARM expects devices containing those cores to hit the market in 2014 and 2015.

Unlike Intel or even Qualcomm, ARM doesn’t build or design chips, but instead licenses its technology to other chipmakers who take the ARM IP and build chips or systems on a chip around those core designs. The new cores are designed in a “big” version that offers 64-bit processing and more powerful cores, and a 32-bit “little” version that is aimed at the mobile market. The big A-57 core will deliver three times more performance at the same power consumption as today’s mobile phone chips, according to ARM, while the little A-53 core will deliver four times the power efficiency as today’s phone platforms with a better performance than current generation phone platforms.

Computing is no longer a desk job or sold by the server

Our computing habits have changed in the last five years. Where we once may have sat at a desk and completed our computing tasks, we now wake up and roll over in bed to check out email on phones, before maybe moving to a tablet, a connected car and then finally to a laptop or desktop at work. As we hop from machine-to-machine we expect a similar and continuous experience, which we get thanks to web services that most of us use in the browser or via clients.

To meet that demand, web companies are deploying millions of servers in data centers the size of warehouses. At that scale things change — not just the focus on power consumption, but also the ability to use hardware tuned to a specific workload. For example, Facebook isn’t one app, it’s a combination of more than 20 different services that are tied together with software. But because Facebook is so huge, those services can require a lot of computing resources. Facebook doesn’t buy servers, it buys racks, and at that level of hardware consumption, buying a rack using ARM-based servers to cut power costs may slightly increase the management load on operations team members, but it also cuts the energy requirement.

The combination of these shifts on the user and on the web services side are why ARM has seen a chance to get into the data center. It’s also why players from AMD, Dell and even Intel are embracing heterogeneous compute. During the last 20 years, just like Ford’s original Model T that only came in black, you could only have one type of instruction set as long as it was an x86. But with the rise of webscale, cloud and even a broader use for high performance computing, companies wanted variety.

ARM’s response is modular building blocks

So Intel is working on its MIC architecture, Nvidia is introducing graphics processors in servers and AMD is embracing ARM, x86 and GPUs. Startups ranging from Tilera to Adapteva are also trying to bring new architectures to the market. ARM’s approach with its latest architecture (ARMv8) is to emphasize power efficiency even at the expense of performance. It has always done this in the mobile market, where a poor battery life can doom device to the scrap heap, even if the graphics are vivid and the applications are speedy.

Companies that license these new cores can mix big cores with little cores or build systems containing big cores and ARM graphics cores, or any number of configurations to meet the needs of the device and market they are building for.

The two new cores also will eventually bring 64-bit processing into the mobile device arena, which Nole Hurley, VP of marketing and strategy for ARM’s processor division, said is important because people are creating more content on mobile devices (this will also offer ARM a credible core for the laptop market as well). Now, all of this depends on software that can run using the ARM instruction set, but in both the consumer side and the data center market ARM is building out ecosystem partners.

The new cores should appear in chips built using the 28 and 20 nanometer process node, and will scale down to 14 nanometers and the newer chipmaking processes that build up instead of out. As the process node shrinks and more transistors are crammed on the chip expect additional performance and energy gains.

For those who are still looking for gigahertz performance numbers Hurley sais]d that new A-50 family will deliver performance ranging from 1.3 gigahertz to 3 Gigahertz depending on how the ARM licensees tweak their designs. At that point I wonder if we can still get away with calling a 3GHz ARM-based design a wimpy core. However, Ian Ferguson, who heads ARM’s server ambitions, (and who doesn’t use the phrase wimpy core) noted that ARM isn’t expressing its server goals in terms of the traditional enterprise.

“What we’re not saying is that we’re going to blaze on into traditional enterprise infrastructure … that is not the space we’re planning to attack,” Ferguson said. “We want places where the server is the business.” And as we’ve stated before, that space is where much of the growth in servers will come from in the coming years. Seeing this, ARM has developed a family of processor cores that can be configured to meet the needs of all-day computing from the user side and the server side.

http://feedproxy.google.com/~r/OmMalik/~3/QfV_p5LVvmw/

http://gigaom.com/2012/10/30/meet-arms-two-newest-cores-for-faster-phones-and-greener-servers/


allvoices