DreamWorks: 'Storage Is a Way of Life'

DreamWorks moves incredible amounts of video data in modern HPC daily workloads.

SANTA CLARA, Calif.-DreamWorks, the maker of computer-generated movies that has produced such hit films as "Shrek," "Madagascar" and "Bee Movie," knows what it's talking about when the topic is high-performance computing.
Senior Technologist Skottie Miller, who's been with DreamWorks for nine years after serving seven years at Disney's animation studio, told the audience at the Platform Global Conference held May 19 to 21 here at the Hyatt Regency that he's seen quite a change in the HPC tools for rendering streaming video.
"In 1999, when I arrived here, we had a total of 140 cores [processors], and now we have more than 10,000 of them-in fact, I've lost count," Miller said. "We used to have to physically share the most powerful computers by putting them in boxes and shipping them from one studio to another to get a movie done. Sometimes we'd have fistfights over the RAM, because memory used to cost $4,000 to $5,000 per megabyte back then.
"We just didn't have the bandwidth, tools or computing power in 1999 that we have now. Now we've got multicore processors, dynamic allocation of computing power, incredible amounts of storage. It's been awesome to witness all these advancements."
DreamWorks' latest computer graphics film, "Kung Fu Panda," which debuts June 6 and was created in a three-dimensional-like style, took more than 25 million CPU hours and about three years to make, Miller said.
"That compares to about 5 million CPU hours and four years to make 'Shrek,' which was the last of the 8TB movies," Miller said. "And the bulk of those hours happen during the final three to four months of production."
"Kung Fu Panda" is the most advanced CG movie made thus far, Miller said, because of the 3D-like nature of the production. It requires about 50TB of storage space.
"We had to account for every single hair in the fur of the panda bear, for example," Miller said. "Each hair has a thickness and a behavior pattern, according to the way it moves during an action sequence. The way the light shines on it is also a factor. Silk clothing is also a challenge to do correctly. Much of the movie is basically animals fighting and in water and with fire; those actions are particularly tough to do well in CG."
Miller said the processing power and all those hours eventually pay off in a memorable film, but there is no cutting corners to do it right.
"You take a movie like 'Polar Express,' for example," Miller said. "Now I hate to criticize work like that, because it's generally very good. But if you look closely, the eyes in the characters are dead; some of the expressions just aren't right. It ultimately makes the characters a bit creepy.
"The bar is very high: Viewers will notice if the result isn't as close to perfection as it can be."

Chris Preimesberger

Chris J. Preimesberger

Chris J. Preimesberger is Editor-in-Chief of eWEEK and responsible for all the publication's coverage. In his 15 years and more than 4,000 articles at eWEEK, he has distinguished himself in reporting...