Information in Formation

 
 
By Peter Coffee  |  Posted 2004-11-15 Email Print this article Print
 
 
 
 
 
 
 

eWEEK Technology Editor Peter Coffee examines why there's less division than there once was between high-performance and data center computing.

When you hear the phrase "flying in formation," you probably think of the dazzling maneuvers of an air-show team such as the Thunderbirds or Blue Angels. You see another example, though, whenever you drive on a freeway: vehicles moving at high speed, in close proximity, pursuing similar but independent goals with only each vehicles movements as signals to the drivers who coordinate their actions.

A one-piece design rather than a coordinated "formation flight" of components may seem a simpler approach to a solution.
As a problem grows to larger scale, however, a massive monolith can turn out to be more difficult to design, deploy, debug, maintain and improve. Thats especially true if the problem, or the state of the art in the technologies used to attack it, is still evolving—and even more so if those evolutions proceed at different rates.

People learn to maneuver cars, most of the time successfully, with little formal training. Observing this, MIT Associate Professor David Miller has explored other ways of using cooperating units, coordinated by adaptive algorithms, rather than monolithic systems to perform complex tasks.

Millers remarks, made at an MIT alumni event this month in Santa Monica, Calif., were in the context of student research projects aimed at improving the cost-effectiveness of satellite systems. One group is using magnetic fields to maneuver satellites relative to one another; another group is building small satellites for indoor operation on the International Space Station to serve as low-cost (and low-risk) formation-flight testbeds.

My aerospace-industry readers will be interested in both projects—the first with its potential for letting satellites work near one another without thruster-caused damage or surface contamination, and the second with its promise of more rapid evolution of flight software. But while Miller and his students do what they do, Id like to consider "formation flight" in the IT milieu. The concept, though not the label, was apparent in the offerings at last weeks SC2004, the conference on high-performance computing, networking and storage, held in Pittsburgh.

The idea of IT formation flight, using such technologies as massive parallelism or cluster computing, has so far been mostly limited to research and specialized applications. Thats changing. In a preconference conversation, Dell Engineering Director Reza Rooholamini told eWEEK Senior Editor Jeffrey Burt, "The line between the two worlds has blurred." In other words, theres less division than there once was between high-performance and data center computing.

Click here to read about IBMs Blue Gene supercomputer that was recently-released to the market. Conference debuts such as Dells SC1425 cluster node and Hewlett-Packards Unified Cluster Portfolio of hardware, software and services give mainstream IT buyers the kind of manageability and support they expect—even while putting enterprise data centers in the same end of the technology pool as the worlds fastest systems.

The Dell offering includes technology from Toronto-based Platform Computing, whose Platform Rocks cluster management tool kit is based on the San Diego Supercomputer Centers Rocks stack. Thats the same Rocks foundation that enabled a team at last years SC conference in Phoenix to assemble a 128-node Sun Fire V60x system that immediately qualified as a top-500 supercomputer. Dubbed RockStar, the 2-hour construction project debuted at No. 201 on the worldwide list of supercomputing installations at www.top500.org.

When I see this kind of cluster technology coming to enterprise markets, I think of a convoy of 18-wheelers. Theyre carrying different loads and working for different owners, but they have a common infrastructure and theyre able to cooperate toward mutual goals—as made famous by the 1975 C.W. McCall song, "Convoy," a CB-jargon saga of massively concurrent speed-trap evasion. Simple communications are all it takes.

And like those highway convoys, but unlike the flashy flying in circles of the Thunderbirds or Blue Angels, an enterprise formation flight needs to know what its delivering and to where.

Technology Editor Peter Coffee can be reached at peter_coffee@ziffdavis.com.

 
 
 
 
Peter Coffee is Director of Platform Research at salesforce.com, where he serves as a liaison with the developer community to define the opportunity and clarify developers' technical requirements on the company's evolving Apex Platform. Peter previously spent 18 years with eWEEK (formerly PC Week), the national news magazine of enterprise technology practice, where he reviewed software development tools and methods and wrote regular columns on emerging technologies and professional community issues.Before he began writing full-time in 1989, Peter spent eleven years in technical and management positions at Exxon and The Aerospace Corporation, including management of the latter company's first desktop computing planning team and applied research in applications of artificial intelligence techniques. He holds an engineering degree from MIT and an MBA from Pepperdine University, he has held teaching appointments in computer science, business analytics and information systems management at Pepperdine, UCLA, and Chapman College.
 
 
 
 
 
 
 

Submit a Comment

Loading Comments...
 
Manage your Newsletters: Login   Register My Newsletters























 
 
 
 
 
 
 
 
 
 
 
Thanks for your registration, follow us on our social networks to keep up-to-date
Rocket Fuel