Posts Tagged greenscreen
Zoic Presents: The Creatures of ‘Fringe’ – Part 1
Posted by Erik Even in I Design Your Eyes on December 22, 2009

Part 2 of this post is now available.
Now in its second season, the Fox Network’s science fiction drama Fringe tells the story of three paranormal investigators for the FBI’s “Fringe Division” in Boston. Created by veteran television producer and feature film director JJ Abrams (Felicity, Alias, Lost; Star Trek), the cult favorite features a variety of bizarre and otherworldly creatures, many created with the help of Zoic studios.
Zoic senior compositor Johnathan R. Banta sat down with IDYE to discuss the creation of some of these monsters. His previous credits include Quarantine, The X Files: I Want to Believe, John Adams and V.
The Heartbug (from episode 1:07, “In Which We Meet Mr. Jones”)
In this episode, a strange, other-worldly parasite mysteriously attaches itself to the internal organs of an FBI agent. The creature wraps itself around the man’s heart, and surgery must be performed to attempt to remove it.
Banta says, “We received artwork from production, done by a very good illustrator; and I set about making a maquette of the creature for two reasons. One, because it would help us understand what the form was — it was hard to figure it out from all the drawings, because in the multiple views we didn’t quite see how it meshed together at first. And secondly, it was fun. I just wanted to sculpt something and this seemed to be a prime opportunity for it.
“A couple of people did versions of it, one in [Luxology] modo, one in [Pixologic] ZBrush, just to kind of play around — they weren’t actually anything we used. The final model was made by [Zoic artist] Mike Kirylo.”
A great deal of work was done to allow the creature to move along with the beating heart. Scans of an actual beating human heart, provided by Zygote Media as a morph sequence, were used. “Mike had to figure out how to attach this creature to the heart,” Banta says, “and as it pulsated he would have a ‘softness’ in-between each of the hard shell [segments]. So there’s the hard carapace of the creature, and the soft squishy connective bits. Mike said he was able to find a way to make the bones between the different sections scale as the heart was beating. That way it stayed connected without being stretched.”
Everything we see inside the man’s chest is CG. “They had a prop on set that was over the top of an actor. Oddly enough, it was not in the place where the heart would actually be accessed. So for a wide shot we actually had to cut the actor down by a third of his original height, so that the hole would be in the appropriate spot to get to his heart. But for the close-ups it didn’t really matter. It was a piece of foam rubber with green paint inside of it, and we keyed that out and continued it into the cavity; and put in CG guts and an odd-shaped little bug.”

The Virus Slug (from episode 1:11, “Bound”)
In a lecture hall at Boston College, a biology professor gives a lecture about pathogens. In mid-sentence, he begins to choke and falls over. While his teaching assistant watches in horror, the professor’s throat becomes enlarged, and what looks like a massive slug crawls out of his open mouth. As the slimy creature slithers across the floor, students flee the hall in a panic.
Banta explains: “It’s a super-sized cold virus – a giant squishy slug with little cilia across its surface. This thing pulled itself out of his mouth, flopped onto the floor and squished away as quick as it could. It’s quite disgusting, and was played for dinnertime theater.
“It was a fairly simple model – a slug with a couple of things sticking out of it. But it had to maintain its volume and look like it was a rubbery object moving around, so there was a lot of finessing in the animation. We didn’t use any form of volume-preserving algorithms — other than Mike Kirylo — so it was all based on a really good animator.
“But the [professor’s] face was the interesting portion of it. This slug is rather large, and begins to distend his throat and pull his face into contorted positions that it wasn’t in originally, as the actor just basically laid there and flopped his head over to the side.
“We had to do an exact match move of the actor. We used our performance transfer system; projected the footage frame-for-frame onto our digital actor; and then we had the ability to push him around anywhere we needed to. Add a little bit of clever compositing, and next thing you know there’s a creature coming out of this man’s mouth.
“His movements were not tracked on stage — no tracking markers on him. They were tracked in post and match moved. Basically, we used every bit of detail that was available on his skin. Unfortunately, most actors don’t have very bad complexions.
“That’s something we’ve been doing a lot of, actually — digital makeup [for Fringe]. That all plays into what we’re doing with the creatures, because most of the time they are interacting directly with humans. They’re not just in the room walking around; they are becoming, or coming out of, or in some way touching people, for the most part.”

Porcuman (from episode 1:13, “The Transformation”)
In an airliner bathroom, a man shudders in pain as a hideous transformation begins. His teeth start falling out — then he screams in agony as giant quills pierce through the back of his shirt. The passengers on the plane react when the bathroom door splinters and a hideous, inhuman beast bursts into the cabin.
Banta: “This man on an airplane should learn not to experiment on himself; as a result he turns into a giant porcupine creature which brings the airplane down.
“It was in very few shots. It is originally modeled in ZBrush and Maya; we import the model, and it is rigged by our animation department and put through its paces. We run the standard passes that you would expect – diffuse, specular, ambient occlusion, fill passes, indirect lighting, those kinds of things, so that we can integrate it in the composite.
“A lot of times we’ll do what is called ‘RGB lighting,’ where every three lights will be either a prime red, a prime green, or a prime blue; and that way we have a lighting matte in every single render that we can use to do some tweaks in the composite. Also, since we’re getting normals rendered from our passes, we can use a plug-in from RE:Vision Effects to re-light the object. Whatever lighting passes that the CG department was not able to get to can be generated at the end.”
Banta notes that because of the nature of the effect, very little of the transformation involves practical, on-set elements. “This is all post at this point. They shoot it as if the creature were there — they just shoot it very naturally.
“Now that [Fringe has] a make-up crew that is known for doing creature work, there is a lot more practical stuff being done. But we have to exactly, precisely match with the practical elements when we do the CG. There are things that practical does so much better than we can do, and vice versa. It’s an all-in equation for me, because whatever works best, works best. There’s something about having a light bouncing off of a card onto a person on set holding this thing, which just gives it a sense of reality that we have to try to recreate.
“Porcuman was a combination of digital makeup with practical elements. It was a close interaction. During the transformation scene, we have a medium shot of the back, and then cut to a tight close-up of the shirt ripping as these giant porcupine spines come through it. They had an inflatable balloon on the back of the actor for the shirt; so we tracked that inflatable balloon; used our performance transfer to get that onto the back of the creature; and then animated spines coming out, and composited that underneath his shirt, which had a greenscreen on it.
“We had to do some warping of the cloth to get it to line up to the actual geometry of the creature. Then for the close-up of the shirt, instead of using the photography directly, we went with a cloth simulation of the shirt, and animated the spines. But we took sections of the torn cloth from the actual photography, and used those to sell that the tear is ripping a piece of fabric. This is a good example where something done practically pays off in spades, because we could just grab that tearing fabric and place it on each of the individual spines, and save ourselves a lot of simulation time.
Zoic Brings Visitors to Earth for ABC’s ‘V’
Posted by Erik Even in I Design Your Eyes on November 2, 2009

A Visitor mothership hovers over Manhattan.
Tomorrow evening (11/3/09), ABC will broadcast the premiere episode of its highly anticipated new sci-fi series V, which updates and re-imagines the original 1983 miniseries of the same name. The visual effects for the new V were created by Culver City, California’s Zoic Studios, known for providing VFX for a number of well-loved science fiction franchises.
Scott Peters, creator of The 4400, brings fans a modern take on the classic V that pays loving homage to its 80s inspiration. Written by Peters and directed by Yves Simoneau, the pilot episode stars Elizabeth Mitchell (Lost), Morris Chestnut (Kung Fu Panda 2), Joel Gretsch (The 4400, Taken); and Firefly alumni Morena Baccarin and Alan Tudyk.
The remake hews closely to the story of the original: mile-wide alien motherships appear above the major cities of the Earth. The aliens call themselves “The Visitors,” and appear to be identical to humans. They claim to come in peace, seeking to trade advanced technology for resources. But the Visitors are not what they seem, and hide sinister intentions. While much of humanity welcomes the Visitors, a resistance movement begins to form.
Four episodes will air this month; the show will return from hiatus after the 2010 Olympics.
Visual effects and digital production
Zoic is handling all of the visual effects for V, under the oversight of creative director and VFX supervisor Andrew Orloff (FlashForward, Fringe, CSI) and visual effects producer Karen Czukerberg (Eleventh Hour). Work on the pilot was split between Zoic’s Vancouver studio, which handled greenscreen and virtual sets, and the Los Angeles studio, where the motherships and other effects were created.
Zoic began work in February 2009 on the pilot, which featured about 240 effects shots, 125 of which involved live actors shot on greenscreen in Vancouver where the series is filmed. Another three episodes now in post-production have some 400 effects shots overall, half of which involve digital compositing of actors on greenscreen.

A more detailed view of a Visitor mothership.
Orloff worked in collaboration with the show’s creators – Peters, Simoneau, and executive producers Steve Pearlman and Jace Hall – to design the motherships. The enormous, saucer-shaped Visitor mothership is one of the original V’s iconic images (along with a certain hamster), and visually represents the Visitors’ technological superiority and their domination over humanity. In addition, Orloff says, the creators were dedicated to realism and internal consistency and logic in the design of the alien technology and culture.
Orloff created the mothership on his laptop, working through numerous iterations with input from Peters and Simoneau. He wanted a design that was “freaky and menacing,” and would be emotionally impactful when it made its first momentous appearance onscreen.

The underside of a Visitor mothership begins its transformation. Buildings in Vancouver were supplemented with 3D models of real Manhattan skyscrapers from Zoic’s library.
Because the mothership itself is enormous, the 3D model used to represent it is huge and highly detailed. Zoic CG supervisor Chris Zapara (Terminator: The Sarah Connor Chronicles, Pathfinder) modeled the “transformation” effect, in which the ventral surface of the ship changes, causing the frightened humans below to fear an imminent attack. In fact, the ship is deploying an enormous video screen, displaying the greeting message of Visitor leader Anna (Baccarin). After many rounds of pre-visualizations, a design was chosen with large, movable panels and a grid of smaller panels arranged in a snakeskin pattern. The mothership was created in NewTek’s Lightwave 3D.

The “snakeskin” panels underneath the mothership flip over to reveal a video projection surface.
Digital artist Steve Graves (Fringe, Sarah Connor Chronicles) was responsible for filling in the copious detail that gives the mothership the impression of immense scale. After the pilot was picked up by ABC, the dorsal surface was remodeled to add photorealism. The model initially was detailed only from the angles at which it was shown in the pilot, due to the many hours of work necessary. As shots were created for the second through fourth episodes, Graves created detail from new angles, and now the mothership model is complete.

Our first view of the alien mothership, reflected in the glass of a skyscraper.
The mothership design was not the only way the Visitors’ arrival was made to seem momentous and frightening. As businessman Ryan Nichols (Morris Chestnut) looks to the skies for an explanation of various alarming occurrences, he first sees the mothership reflected in the glass windows of a skyscraper. Although a relatively simple effect (Zoic took shots of real buildings in Vancouver, skinned them with glass textures, and then put the reflected image on the glass), the effect on the viewer is chilling.

Visitor leader Anna (Baccarin, seated left) is interviewed by Chad Decker (Scott Wolf, seated right) on board the Manhattan mothership. The “set” was created virtually, with the actors shot on a greenscreen stage.
Because the motherships are enormous, it only makes sense that they would feature enormous interior spaces. These sets would be too large to build, so half the effects shots on V involve actors filmed on a greenscreen stage with tracking markers. These virtual sets, based on Google Sketch-Up files from V‘s production designers (Ian Thomas (Fringe, The 4400) for the pilot; Stephen Geaghan (Journey to the Center of the Earth, The 4400) for later episodes), were created at Zoic’s Vancouver studio in Autodesk Maya and rendered in mental images’ mental ray.
The ship interiors were created before the related greenscreen shots were filmed. For the episodes shot after the pilot, Zoic provided the production with its new, cutting edge proprietary Zeus system, which allows filmmakers to see actors on a real-time rendered virtual set, right on the greenscreen stage. The technology is of immeasurable aid to the director of photography, crew, and especially the actors, who can see themselves interacting with the virtual set and can adjust their performances accordingly. Zeus incorporates Lightcraft Technology’s pre-visualization system.
After actors are filmed on the Vancouver greenscreen set and the show creators are happy with the pre-visualized scenes in Zeus, the data is sent south to Zoic’s Los Angeles studio, where the scenes are laid out in 3D. Then the data goes back up to Zoic in Vancouver, where the virtual set backgrounds are rendered in HD.

An alien mothership inserted into a stock shot of London.

A mothership composited into a stock shot of Rio de Janeiro, with matched lighting and atmospheric effects.
Other alien technology was created for the series, including shuttlecraft and a “seek & destroy” weapon used to target a resistance meeting.

A Visitor shuttle docks with a mothership.
The alien shuttle and the shuttle docking bays were created in Los Angeles by visual effects artist Michael Cliett (Fringe, Serenity), digital compositor Chris Irving and freelance artist James Ford.

The “Atrium,” a city in the interior of a Visitor mothership.
The “Atrium,” a massive interior space inside the mothership, was created for Zoic by David R. Morton (The Curious Case of Benjamin Button, Serenity). The complex 3D model served essentially as a matte painting. It was incorporated into a complex composited shot, with actors on the greenscreen stage inserted into virtual sets of a corridor and balcony by the Vancouver studio; the camera pulls out to reveal the Atrium, which was created in LA. Extras in Visitor uniforms were shot on greenscreen and composited into the Atrium itself.

An F-16 fighter, its electronics disrupted by a Visitor mothership, crashes onto a city street.
An F-16 fighter crash, featured in the first few minutes of the pilot, was done by the Los Angeles studio. The airplane, automobiles, taxis, and Manhattan buildings in the background, and of course the explosion, smoke and particles, are all digital. All the components came from Zoic’s library. The actor was shot on the greenscreen stage. Correction: The actor was shot on a Vancouver street. Thanks to Johnathan Banta for the correction.

FBI Agent Erica Evans (Mitchell) examines a wounded Visitor and makes an alarming discovery.
A scene involving an injured Visitor, which gives the viewer one of the first clues to the aliens’ true nature, was shot entirely with practical effects (including the blinking eye). But Zoic used CG to enhance the wound, merge human skin with reptile skin, and add veins and other subcutaneous effects.

Visitor leader Anna looks out over her new dominion.
According to Czukerberg, one of the more difficult shots to pull off was the final scene in the pilot. It involves the alien leader, Anna (actress Morena Baccarin on the greenscreen stage), in an observation lounge on the mothership (virtual set); the camera pulls out (practical camera move) past the mothership windows to reveal the entire ship hovering over Manhattan (CG mothership over an original shot of the real Manhattan created for this production). The shot required cooperation between the LA and BC studios, and took a great deal of time and effort – “it was crazy,” Czukerberg said, but she adds that everyone involved is tremendously satisfied with the finished product.
Zoic Studios looks forward to doing more work when V returns next year, and helping the series become a ratings and critical success. “Rarely do you get an opportunity to redefine a classic series,” Orloff said. “Everyone at Zoic put their heart and soul into this show, and it shows on the screen.”
For more information: V on ABC; the first nine minutes of the pilot on Hulu; original series fan site.
Zoic Studios riding VFX boom
NBC and Zoic
Fringe gets animated
Recent Comments
So glad to hear that Fringe was given a 4th season. It’s one of my...
You’re absolutely right, I am a big fan of the show and Zoic’s...
Really true. You can find everything on the internet. I idolize...