Posts Tagged 3D animation

ABC’s ‘V’ Returns from Hiatus — Zoic Provides the VFX

v_april_2010_630x354

Recently ABC’s alien invasion drama V returned from hiatus, and Zoic Studios has been working night and day creating the VFX for the critically-acclaimed sci-fi series.

I managed to pry compositor Nate Overstrom away from his desk for a few minutes, to discuss some of the work the Zoic team has done for V since the show returned from its Winter Olympics break.

nateoverstrom_188x250“We’ve been working on so many shots that everything kind of blurs together,” Overstrom says. “We’re delivering about 200 shots per episode, on a two-week turnaround. We’re moving lightning fast, and doing the best we can to keep everything running smoothly.”

The most memorable effects scene since the show returned might be the final shot of episode #105, “Welcome to the War,” when (spoiler alert) V leader Anna (Morena Baccarin, Firefly), having just finished mating joylessly with an anonymous V male, says “now my eggs need nourishment” – her head juts forward, a mouthful of fangs protrudes from her maw, and she lunges at the doomed male.

“Anna’s teeth were pretty interesting,” Overstrom says. “There were two shots we worked on for her face. The first one, where she first started opening her mouth, was primarily a 2D effect. First we used The Foundry’s Nuke to warp her mouth and jaw open, and moved her existing teeth out of the way. Then we rendered the upper and lower CG jaws and teeth separately, and tracked in the 3D elements to the new warped face.

“The second shot was a digital prosthetic. The matchmovers tracked Anna’s face, and modeler Jason Monroe built out a new lower face with the jaws extended, as well as the new CG jaws and teeth. Sal Massimini and Chris Strauss took it through texturing, lighting and rendering. They projected the textures of Anna’s original face back onto the CG model, so everything lined up pretty well. Then it was just a matter of color correcting it in.”

She seemed to do a thing where her whole head slid forward…

“That was just [Baccarin]. She leaned forward, and I did a little bit of a warp on her jaw before she opened her mouth, to kick her jaw forward a little bit, and give her a bit of a menacing motion.”

In another scene, Fifth Column member Ryan Nichols (Morris Chestnut, Boyz n the Hood) reveals his alien nature to terrorist Kyle Hobbes (Charles Mesure, Hercules: The Legendary Journeys) by pulling down his lower eyelid and pushing up his false human eye, revealing a reptilian slit pupil. “Jason built the eye models and did the initial textures,” Overstrom says. “Sal and Chris did the rendering.

“Those were pretty straightforward. We layered in each eye separately to maintain as much control in comp as possible. The tricky part was getting just the right kind of ‘membrane’ effect on the human lid, which was accomplished through a few extra CG elements. We had to do a little bit of extra 2D warping on the pupil of the second shot to simulate the eye constricting and dilating.”

There’s nothing practical with the actor, right?

“He’s just doing this [pulls down eyelid].”

The brunt of the show is virtual sets – anything on the mothership, which is a lot of shots…

Episode #104, “It’s Only the Beginning,” reveals a surveillance room aboard the mothership, from which the Vs can monitor humans who have been tagged with fake flu shots. “These are 300 foot long digital sets,” Overstrom explains, “with dozens of digitally added extras, and accompanied by 3D holographs around each group. The only thing rendered in CG was the room; then Dayna Mauer populated the expanse of the room using Nuke’s 3D capabilities. She extended out a full set of extras and holograph screens, and added reflections and shadows of everybody.

“The groups of extras were shot on greenscreen – six or seven plates of five groups of people standing in different positions. She went though and did 30 extra greenscreen comps, lifted those people out, put them on cards and placed them out in 3D.”

Since the show came back, the mothership technology has centered a great deal on the V control screens, which are flat 3D interfaces that appear in midair. What’s involved in creating these floating holographic screens?

“The production has a group of motion graphics artists that provide us with the playback elements,” Overstrom explains. He says that the actor is given on-set direction about how to interact with the screen, which has no practical on-set element. “They provide us with the elements. We track them into the shots in Nuke, and time the animations accordingly.

“Sometimes we get fancy and add some chromatic depth by taking a display, duplicating the object twice, and shift the channels on each iteration so each is either a red, green, or blue channel. Then we shift each ‘channel’ in space so the three are slightly offset from each other and then recombine them. So if the camera rotates around, we see that there’s a little 3D depth to it that creates a chromatic separation.”

In another memorable scene, from episode #106 “Pound of Flesh,” Anna tests the loyalty of a group of Vs who failed an empathy test. They are told to consume pills that will immolate their bodies instantly. The Vs who take the pills die, but pass Anna’s test. “The V immolation shot was definitely challenging, especially on such a tight turnaround. We custom-built and animated a CG rig to provide a series of animated mattes, skeleton elements, a charcoal mannequin, and several sets of particle passes. We then cleaned several actors out of the greenscreen and re-layered the effects in, also taking care to add the reflections of everything in comp.”

Overstrom admits that working on V, while tremendously satisfying, is also a challenge, due to the scope of the work. “The brunt of the show is virtual sets – anything on the mothership, and a lot of matte paintings for New York City, which when you watch the show… is a lot of shots. But we also have to take account of all the other shots that go into the show as well: all the holoscreens, the healing effects, medical instruments and prosthetics that need cleanup, rig removal… you know all the ‘standard’ work that goes into just about every show. That’s all there as well.”

“The biggest hurdle for any of these shots that we’re doing is the time constraint — but our work on V has come off pretty successfully!”

More info: Official V site on ABC.com; Nate Overstrom, Jason Monroe, and Chris Strauss on IMDb.

, , , , , , , , , , , , , ,

No Comments

Contest: CG Society Challenges You to Re-Imagine B-Movies

bmovie_188x250Over at CGSociety — a contest challenging artists to create digital video, still images, or even audio re-imagining themes from the B-movies of the past.

Since the dawn of movies there was always a creepier, scarier, and unintentionally funnier cousin to the big budget blockbusters… the B-Grade Movie.

Cinema screens around the world flickered with startling images of wolfmen, zombies, nuclear-mutated monsters, and bug-eyed aliens with a penchant for probing. The 25th CGChallenge: “Attack of the 50ft CGChallenge” asks you, the artist, to bring these gems back to life, or create your own in their spirit, via a still image, video, or, for the first time, audio.

Awards will be given in modeling, texturing, animation, lighting, visual effects, landscape/matte painting, art direction, compositing and editing, best character, concept art, digital painting, and music & sound. Prizes include PC workstations and software packages.

The deadline for entries is April 19th.

More info: CGSociety Challenge XXV.

, , , , ,

No Comments

3D TV, New Technology and the Future of Media


This is a moment of unparalleled change in the media world, part of a process of barely-controlled destruction and reconstruction that began over a decade ago. Business models and revenue streams are collapsing, and media creators are turning to the latest technologies to create new opportunities and new businesses. At this year’s Consumer Electronics Show in Las Vegas, technology firms touted a slate of new 3D TVs as a solution to video piracy, and a way to lure fickle consumers back away from free Internet content. But are such promises tenable?

It all started in the music industry, when Napster, the original digital music sharing service, was launched in June of 1999. With music freed from the baryonic prison of vinyl, polyester tape and polycarbonate plastic, consumers could copy, edit, sample, decode and redistribute it and other copyrighted content at will.

Rights holders had always controlled their intangible product by controlling the tangible media – records, cassette tapes and CDs, as well as radio frequencies, for music; television channels and chunky videotapes for video; multiple 40-pound reels of motion picture film for movies; floppy disks and CDs for software; plus dead-tree books and photographs. Suddenly, their control of intellectual property was just gone, vaporized in a mist of ones and zeroes. On one side, many music executives saw digital media as a tremendous new opportunity for both creative expression and for business. Zoic’s Jeff Suhy, a former record company executive, was quoted in the May 2000 Village Voice: “I love that the world is quite obviously changing before our eyes and no one really knows how it’s going to play out!”

Suddenly, control of intellectual property was gone, vaporized in a mist of ones and zeroes.

On the other hand, some rights holders saw any perceived change to their traditional revenue stream as a threat to be destroyed at all costs. They dug in their heels and fought the future – engendering numerous disasters, from Circuit City’s Digital Video Express, which sold consumers DVD movies that “expired” after two days, to the RIAA’s litigious pogrom against file-sharing college kids and soccer moms. And money spent to develop various copy-protection and DRM schemes was almost always wasted, as consumers found ways to defeat protection, or avoided protected products altogether.

But some in the business world saw opportunities, not enemies. When Steve Jobs first laid eyes on the Xerox Alto in the late 1970s, with its GUI user interface and mouse controller, he saw the future of computing. Decades later, Jobs understood that the original Napster, driven out of business by the record companies, was the template for media distribution in the new millennium. With Apple’s iTunes software and online store, Jobs went from computer mogul to media mogul, taking advantage of record companies’ desperation to gain control of digital music, and appointing to himself the power to single-handedly set prices for online entertainment. But iTunes by itself would not have been enough to compete with free MP3s – it was the convenience, portability, style, incredible ease of use, sound quality and price point of the iPod that gave Apple control first of the personal music player market, and then of legitimate online music and video distribution.

Now the media industry has reached another watershed moment of change, as file-sharing endangers the revenue models of film and television creators, as well as publishers and journalists. But media moguls have absorbed the lessons of the music industry’s tribulations in the last decade, and there is a new humility in the face of change — a willingness, even an eagerness, to adapt to the new digital world, rather than to deny it. In the last few years, movie and television creators have moved their product online, to free video sites like Hulu, which will soon experiment with for-pay models; and are offering high-definition, appointment-free content on demand to home televisions through cable companies and Netflix.

There is a new humility in the face of change — an eagerness to adapt to the new digital world.

In 2010, how else are media producers taking control of the future of their own industry? What are they doing to reimagine their businesses, and insure that the media world of 2020 is profitable and stable?

Some of the answers were on display at this year’s Consumer Electronics Show in Las Vegas. Publishers are betting that consumers will gladly pay to read their content on a new breed of flat, portable, easy-to-read e-book products. Just as the iPod saved music, publishers hope that Amazon’s Kindle and Barnes & Noble’s Nook will save literature and journalism, at least until true e-paper is developed.

The greatest buzz at CES was elicited by a whole crop of new HDTVs with 3D capabilities. The motion picture industry and the movie theater chains are increasingly turning to 3D and IMAX as ways to lure audiences into theaters, and the current success of James Cameron’s Avatar demonstrates that even in a serious global recession, moviegoers are willing to pay extra for a high-tech movie experience they can’t get at home.

The new 3D TVs, including the Panasonic TC-PVT25 series that won the Best of CES award this year, promise to provide an in-home 3D experience for only a few hundred dollars more than ordinary HDTVs. In addition, satellite television provider DirectTV announced at CES that it has teamed with Panasonic to create three HD 3D channels, to launch this spring. Working with media partners including NBC Universal and Fox Sports, DirectTV will offer a pay-per-view channel, an on-demand channel, and a free sampler channel, all in 24-hour 3D and compatible with the current generation of sets.

Like the original HD offerings in the mid-1990s, which focused on sports events and video from space missions, the new 3D channels will offer existing 3D movies, 3D upgrades of traditional 2D movies, and sports. Unlike with HDTV however, there is no indication the government will legislate widespread adoption of 3D TV. And there are issues.

3D will likely establish its foothold in the living room is not with sports or movies, but with video games.

The greatest usability issue is the need for viewers to wear glasses. While there are experimental technologies that work without glasses, today if you want to experience high-quality 3D television images you need to wear pricey shutter glasses. Unlike the polarized glasses patrons wear at theaters, shutter glasses respond to signals from the TV, directing alternating frames to alternating eyes. The glasses are expensive – only Panasonic is promising to provide a pair with your TV purchase, and additional pairs will run around $50. At least one manufacturer is already offering lighter, more fashionable, more expensive replacement glasses.

And wearing special glasses while watching TV at home is not conducive to the average person’s lifestyle. As Microsoft exec Aaron Greenberg told GameSpy at CES, “when I play games or watch TV, I’ve got my phone, I’ve got all kinds of things going on… I get up, I get down, I’m looking outside at the weather… I’m not in a dark theater, wearing glasses, staring at a screen.” You cannot walk around comfortably wearing modern shutter glasses, and just happen to be wearing them when you want to watch TV. Until 3D TVs don’t require glasses, consumers are going to have trouble integrating 3D television watching into their lives.

The new 3D TVs also suffer from varying levels of picture clarity and a pronounced flicker, although these issues are expected to disappear as the technology improves. More importantly, 3D media demand changes in how movies and television and produced. Right now, only computer animated films are expressly produced with the needs of 3D in mind, producing stunningly realistic depth-of-field and fine gradations of perceived depth. Film and video produced according to the traditional rules of 2D creates flat, paper-thin figures moving in a 3D environment that can appear shallow or truncated. Sports coverage, intended to be a killer app for 3D TV, particularly suffers from these issues, and 3D broadcasts of sporting events may require drastic changes to the technology used on the field.

Filmmakers are still learning how to deal with changing depth of focus. In the real world, the viewer chooses unconsciously where to focus their eyes; but in a 3D production this decision is made for the viewer. A plane of focus that appears to constantly shift can give audiences headaches and eye strain. A largely different language of cinema is being developed, to produce content in which 3D is a core component rather than a faddish trinket.

And finally, CNN Tech reports that between four and 10 percent of consumers suffer from something called “stereo blindness,” a sometimes treatable condition that makes it impossible to experience 3D movies or television. This is hardly a deal-killer, but one wonders how the spread of stereo music technology would have been affected if 10% of listeners had not been able to appreciate the difference.

Honestly, how 3D will likely establish its foothold in the living room is not with sports or movies, but with video games. Video gamers are already accustomed to buying expensive high-tech peripherals. They are used to content designed for one person, one screen. And when designed properly, 3D does not just add visual excitement to a game, but actually affects and enhances the gameplay itself.

So will 3D television lure viewers away from legitimate free Internet video, and from illegally pirated video files? It is too soon to tell. But there is a key difference to this strategy, as compared to some of the previously unsuccessful responses to piracy and the Internet. As with Steve Jobs and the iPod, 3D TV producers are offering consumers something new and exciting that, once the issues are worked out, will enhance their news and entertainment experiences. Rather than treating customers like the enemy, they are approaching customers as customers. And iTunes proves that people are more than willing to pay for their media, as long as they can experience a clear benefit.

More info: “Keeping Up With the Napsters” on Village Voice; “Why I can’t watch 3D TV” on CNN Tech; “DirectTV to launch the first 3D HDTV Channel” on Device; “Microsoft Exec Not Sold on 3D Home Gaming” on GameSpy; “3D TV? Too Soon Now, but One Day You Will Want It” on Singularity Hub; “I’m Sold On 3D TVs…And I Kind of Hate Myself For It” on Gizmodo.

, , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

2 Comments

Zoic Studios’ ZEUS: A VFX Pipeline for the 21st Century

zeus_v_greenscreen_630x354Actors Christopher Shyer and Morena Baccarin on the greenscreen set of ABC’s V; the virtual set is overlaid.

Visual effects professionals refer to the chain of processes and technologies used to produce an effects shot as a “pipeline,” a term borrowed both from traditional manufacturing and from computer architecture.

In the past year, Zoic Studios has developed a unique pipeline product called ZEUS. The showiest of ZEUS’ capabilities is to allow filmmakers on a greenscreen set to view the real-time rendered virtual set during shooting; but ZEUS does far more than that.

Zoic Studios pipeline supervisor Mike Romey explains that the pipeline that would become ZEUS was originally developed for the ABC science fiction series V. “We realized working on the pilot that we needed to create a huge number of virtual sets. [Read this for a discussion of the program's VFX and its virtual sets.] That led us to try to find different components we could assemble and bind together, that could give us a pipeline that would let us successfully manage the volume of virtual set work we were doing for V. And, while ZEUS is a pipeline that was built to support virtual sets for V, it also fulfills the needs of our studio at large, for every aspect of production.

“One of its components is the Lightcraft virtual set tracking system, which itself is a pipeline of different components. These include InterSense motion tracking, incorporating various specialized NVIDIA graphics cards for I/O out, as well as custom inertial sensors for rotary data for the camera.

“Out of the box, we liked the Lightcraft product the most. We proceeded to build a pipeline around it that could support it.

“Our studio uses a program called Shotgun, a general-purpose database system geared for project shot management, and we were able to tailor it to support the virtual set tracking technology. By coming up with custom tools, we were able to take the on-set data, use Shotgun as a means to manage it, then lean on Shotgun to retrieve the data for custom tools throughout our pipeline. When an artist needed to set up or lay out a scene, we built tools to query Shotgun for the current plate, the current composite that was done on set, the current asset, and the current tracking data; and align them all to the timecode based on editorial selects. Shotgun was where the data was all stored, but we used Autodesk Maya as the conduit for the 3D data – we were then able to make custom tools that transport all the layout scenes from Maya to The Foundry’s Nuke compositing software.”

By offloading a lot of the 3D production onto 2D, we were able to cut the cost-per-shot.

Romey explains the rationale behind creating 3D scenes in Nuke. “When when you look at these episodic shows, there’s a large volume of shots that are close-up, and a smaller percentage of establishing shots; so we could use Nuke’s compositing application to actually do our 3D rendering. In Maya we would be rendering a traditional raytrace pipeline; but for Nuke we could render a scanline pipeline, which didn’t have same overhead. Also, this would give the compositing team immediate access to the tools they need to composite the shot faster, and it let them be responsible for a lot of the close up shots. Then our 3D team would be responsible for the establishing shots, which we knew didn’t have the quality constraints necessary for a scanline render.

“By offloading a lot of the 3D production onto 2D, we were able to cut the cost-per-shot, because we didn’t have to provide the 3D support necessary. That’s how the ZEUS pipeline evolved, with that premise – how do we meet our client’s costs and exceed their visual expectations, without breaking the bank? Throughout the ZEUS pipeline, with everything that we did, we tried to find methodologies that would shave off time, increase quality, and return a better product to the client.

“One of the avenues we R&Ded to cut costs was the I/O time. We found that we were doing many shots that required multiple plates. A new component we looked at was a product that had just been released, called Ki Pro from AJA.

“When I heard about this product, I immediately contacted AJA and explained our pipeline. We have a lot of on-set data – we the have tracking data being acquired, the greenscreen, a composite, and the potential for the key being acquired. The problem is when we went back to production, the I/O time associated with managing all the different plates became astronomical.

“Instead of running a Panasonic D5 deck to record the footage, we could use the Ki Pro, which is essentially a tapeless deck, on-set to record directly to Apple ProRes codecs. The units were cost effective – they were about $4,000 per unit – so we could set up multiple units on stage, and trigger them to record, sync and build plates that all were the exact same length, which directly corresponded to our tracking data.”

We found methodologies that would shave off time, increase quality, and return a better product to the client.

Previously, the timecode would be lost when Editorial made their selects, and would have to be reestablished. “That became a very problematic process, which would take human intervention to do — there was a lot of possibility for human error. By introducing multiple Ki Pros into the pipeline, we could record each plate, and take that back home, make sure the layout was working, and then wait for the editorial select.” The timecode from the set was preserved.

“The ZEUS pipeline is really about a relationship of image sequence to timecode. Any time that relationship is broken, or becomes more convoluted or complicated to reestablish, it introduces more human error. By relieving the process of human error, we’re able to control our costs. We can offer this pipeline to clients who need the Apple ProRes 442 codec, and at the end of the day we can take the line item of I/O time and costs, and dramatically reduce it.”

Another important component is Python, the general-purpose high-level programming language. “Our pipeline is growing faster than we can train people to use it. The reason we were able to build the ZEUS pipeline the way we have, and build it out within a month’s time, is because we opted to use tools like Python. It has given us the ability to quickly and iteratively develop tools that respond proactively to production.

“One case in point – when we first started working with the tracking data for V, we quickly realized it didn’t meet our needs. We were using open source formats such as COLLADA, which are XML scene files that stored the timecode. We needed custom tools to trim, refine and ingest the COLLADA data into our Shotgun database, into the Maya cameras, into the Nuke preferences and Nuke scenes. Python gave us the ability to do that. It’s the glue that binds our studio.

“While most components in our pipeline are interchangeable, I would argue that Python is the one component that is irreplaceable. The ability to iteratively making changes on the fly during an episode could not have been deployed and developed using other tools. It would not have been as successful, and I think it would have taken a larger development team. We don’t have a year to do production, like Avatar – we have weeks. And we don’t have a team of developers, we have one or two.

While most components in our pipeline are interchangeable, Python is the one component that is irreplaceable.

“We’re kind of new to the pipeline game. We’ve only been doing a large amount of pipeline development for two years. What we’ve done is taken some rigid steps, to carve out our pipeline such a way that when we build a tool, it can be shared across the studio.”

Romey expects great things from ZEUS in the future. “We’re currently working on an entire episodic season using ZEUS. We’re working out the kinks. From time to time there are little issues and hiccups, but that’s traditional for developing and growing a pipeline. What we’ve found is that our studio is tackling more advanced technical topics – we’re doing things like motion capture and HDR on-set tracking. We’re making sure that we have a consistent and precise road map of how everything applies in our pipeline.

“With ZEUS, we’ve come up with new ways that motion capture pipelines can work. In the future we’d like to be able to provide our clients with a way not only to be on set and see what the virtual set looks like, while the director is working — but what if the director could be on set with the virtual set, with the actor in the motion capture suit, and see the actual CG character, all in context, in real-time, on stage? Multiple characters! What if we had background characters that were all creatures, and foreground characters that were people, interacting? Quite honestly, given the technology of Lightcraft and our ability to do strong depth-of-field, we could do CG characters close-to-final on stage. I think that’s where we’d like the ZEUS pipeline to go in the future.

“Similar pipelines have been done for other productions. But in my experience, a lot of times they are one-off pipelines. ZEUS is not a pipeline just for one show; it’s a pipeline for our studio.

“It’s cost effective, and we think can get the price point to meet the needs of all our clients, including clients with smaller budgets, like webisodes. The idea of doing an Avatar-like production for a webisode is a stretch; but if we build our pipeline in such a way that we can support it, we can find new clients, and provide them with a better product.

“Our main goal with ZEUS was to find ways to make that kind of pipeline economical, to make it grow and mature. We’ve treated every single component in the pipeline as a dependency that can be interchanged if it doesn’t meet our needs, and we’re willing to do so until we get the results that we need.”

For more info: Lightcraft Technology; InterSense Inc.; Shotgun Software; AJA Video Systems; IDYE’s coverage of V.

, , , , , , , , , , , , , , , , , , , ,

5 Comments

The End of Rendering: Zoic Studios’ Aaron Sternlicht on Realtime Engines in VFX Production

Zoic created this Killzone 2 commercial spot entirely within the Killzone 2 engine.

The level of the technology available to produce computer graphics is approaching a new horizon, and video games are part of the equation.

Creators in 3D animation and visual effects are used to lengthy, hardware-intensive render times for the highest quality product. But increasingly, productions are turning to realtime rendering engines, inspired by the video games industry, to aid in on-set production and to create previz animations. Soon, even the final product will be rendered in realtime.

Aaron Sternlicht, Zoic Studios’ Executive Producer of Games, has been producing video game trailers, commercials, and cinematics since the turn of the millennium. He has charted the growth of realtime engines in 3D animation production, and is now part of Zoic’s effort to incorporate realtime into television VFX production, using the studio’s new ZEUS pipeline (read about ZEUS here).

Sternlicht explains how realtime engines are currently used at Zoic, and discusses the future of the technology.

“The majority of what we do for in-engine realtime rendering is for in-game cinematics and commercials. We can take a large amount of the heavy-lifting in CG production, and put it into a game engine. It allows for quick prototyping, and allows us to make rapid changes on-the-fly. We found that changing cameras, scenes, set-ups, even lighting can be a fraction of the workload that it is in traditional CG.

“Right now, you do give up some levels of quality, but when you’re doing something that’s stylized, cel-shaded, cartoonish, or that doesn’t need to be on a photo-realistic level, it’s a great tool and a cost effective one.

We’re going to be able to radically alter the cost structures of producing CG.

“Where we’re heading though, from a production standpoint, is being able to create a seamless production workflow, where you build the virtual set ahead of time; go to your greenscreen and motion capture shoot; and have realtime rendering of your characters, with lighting, within the virtual environment, shot by a professional DP, right there on-set. You can then send shots straight from the set to Editorial, and figure out exactly what you need to focus on for additional production — which can create incredible efficiencies.

“In relation to ZEUS, right now with [ABC’s sci-fi series] V, we’re able to composite greenscreen actors in realtime onto CG back plates that are coming straight out of the camera source. We’re getting all the camera and tracking data and compositing real-time, right there. Now if you combine that with CG characters that can be realtime, in-engine rendered, you then can have live action actors on greenscreen and CG characters fully lit, interacting and rendered all in realtime.

“People have been talking about realtime VFX for the last 15 years, but now it’s something you’re seeing actually happening. With V we have a really good opportunity. We’re providing realtime solutions in ways that haven’t been done before.

“Now there’s been a threshold to producing full CG episodic television. There has been a lot of interest in finding a solution to generate stylized and high quality CG that can be produced inexpensively, or at least efficiently. A process that allows someone to kick out 22 minutes of scripted full CG footage within a few weeks of production is very difficult to do right now, within budgetary realities.

“But with in-engine realtime productions, we can get a majority of our footage while we’re actually shooting the performance capture. This is where it gets really exciting, opening an entire new production workflow, and where I see the future of full CG productions.”

What game-based engines have Zoic used for realtime rendering?

“We’ve done a several productions using the Unreal 3 engine. We’ve done productions with the Killzone 2 engine as well. We’re testing out different proprietary systems, including StudioGPU’s MachStudio Pro, which is being created specifically with this type of work in mind.

“If you’re doing a car spot, you can come in here and say ‘okay, I want to see the new Dodge driving through the salt flats.’ We get your car model, transfer that to an engine, in an environment that’s lit and realtime rendered, within a day. We even hand you a camera, that a professional DP can actually shoot with on-site here, and you can produce final-quality footage within a couple of days. It’s pretty cool.”

How has the rise of realtime engines in professional production been influenced by the rise of amateur Machinima?

“I’ve been doing game trailers since 2000. I’ve been working with studios to design toolsets for in-game capture since then as well. What happened was, you had a mixture of the very apt and adept gamers who could go in and break code, or would use say the Unreal 2 engine, to create their own content. Very cool, very exciting.

“Concurrently, you had companies like Electronic Arts, and Epic, and other game studios and publishers increasing the value of their product by creating tool sets to let you capture and produce quality game play — marketing cameras that are spline-based, where you can adjust lighting and cameras on-the-fly. This provided a foundation of toolsets and production flow that has evolved into today’s in-engine solutions.”

It’s truly remarkable how the quality level is going up in realtime engines, and where it’s going to be in the future.

How has this affected traditional producers of high-end software?

“It hasn’t really yet. There’s still a gap in quality. We can’t get the quality of a mental ray or RenderMan render out of a game engine right now.

“But the process is not just about realtime rendering, but also realtime workflow. For example, if we’re doing an Unreal 3 production, we may not be rendering in realtime. We’ll be using the engine to render, instead of 30 or 60 frames a second, we may render one frame every 25 seconds, because we’re using all the CPU power to render out that high-quality image. That said, the workflow is fully realtime, where we’re able to adjust lighting, shading, camera animation, tessellation, displacement maps — all realtime, in-engine, even though the final product may be rendering out at a non-realtime rate.

“Some of these engines, like Studio GPU, are rendering out passes. We actually get a frame-buffered pass system out of an engine, so we can do secondary composites.

“With the rise of GPU technology, it’s truly remarkable how the quality level is going up in realtime engines, and where it’s going to be in the future. Artists, rather than waiting on renders to figure out how their dynamic lighting is working, or how their subsurface scattering is working, will dial that in, in realtime, make adjustments, and never actually have to render to review. It’s really remarkable.”

So how many years until the new kids in VFX production don’t even know what “render time” means?

“I think we’re talking about the next five years. Obviously there will be issues of how far we can push this and push that; and we’re always going to come up with something that will add one more layer to the complexity of any given scene. That said, yes, we’re going to be able to radically alter the cost structures of producing CG, and very much allow it to be a much more artist-driven. I think in the next five years… It’s all going to change.”

Read Zoic Studios’ ZEUS: A VFX Pipeline for the 21st Century.

, , , , , , , , , , , , , , , , , , , , , ,

4 Comments

Zoic Studios Puts ‘NFL on Fox’ Robot into James Cameron’s ‘Avatar’

fox401_FRIDAY_00091

Last weekend, NFL on Fox aired a promotional clip for the upcoming James Cameron film Avatar, featuring effects work done by Zoic Studios. Zoic inserted NFL on Fox’s robot mascot, Cleatus, into a scene from Avatar, which also featured Fox NFL Sunday co-host Terry Bradshaw.

Zoic executive producer for commercials Erik Press explained that, in his experience, Fox seems to seek partnerships with various brands, including feature films, to enhance the NFL on Fox brand and the Cleatus character. When Fox Sports approached Fox Feature Marketing Division’s Mike Perman about an Avatar tie-in, he contacted Zoic based on the studio’s previous work on a Cleatus/Terminator Salvation tie-in.

fox401_FRIDAY_00096

fox401_FRIDAY_00132

New Zealand’s Weta Digital provided Zoic with back plates and necessary assets for the shots into which Cleatus would be composited. The work involving compositing Bradshaw into the RDA Combat Amp Suit was done by another vendor.

“The project came up pretty fast,” Press said. From the time the project came to Zoic, “we delivered two 10-second billboards inside of two weeks – animation, rendering, lighting, even editorial.”

fox403_FRIDAY_00036

fox403_FRIDAY_00101

“Weta was incredibly helpful,” Press added, “as was Mike Perman. We have a great, ongoing relationship with Fox, and we look forward to future projects.”

The 3D sci-fi epic Avatar, starring Sam Worthington, Sigourney Weaver, Zoe Saldaña and Michelle Rodriguez, opens tomorrow in the US. It is Cameron’s first major feature film since 1997’s Titanic.

, , , , , , , , , ,

No Comments