3D Vision Blog

A normal user's look into the world of 3D Stereo Technologies

3D Vision Blog header image 4

Talking More 2D to 3D Conversion with Barry Sandrew from Legend3D

January 12th, 2011 · 7 Comments · 2D to 3D Conversion

I’m talking again with Barry Sandrew who is the Founder of Legend3D, one of the top companies specialized in 2D to 3D conversion about some interesting recent conversion work that the company has done. Barry Sandrew is one of the still not so many real expert in the field of 2D to 3D conversion of videos. We talk about the recently completed conversion of the movies Shrek, Shrek 2 and Shrek the Third for DreamWorks Animation by Legend 3D, what is happening on the 2D to 3D conversion world, and some other things that you might find interesting. Barry also shares his view on the upcoming conversions of some movie classics like Titanic, the Star Wars saga and the Indiana Jones series, and about what are some of the competitive companies in the area of the 2D to 3D conversions doing lately. I hope you will find this interview interesting and feel free to share your comments below…

Barry, it has been a few month since our first interview and there have been some interesting news around Legend3D, can you tell us in brief what is new?
There certainly has been a lot of excitement surrounding Legend3D since our last interview. We completed conversion of “Shrek”, “Shrek 2” and “Shrek the Third” for DreamWorks Animation which, together with our conversion on “Alice In Wonderland” and our current ongoing projects, makes us the most prolific conversion vendor in the industry and the company everyone seems to be seeking out.

We’ve increased our capacity by more than 700% both in our San Diego design center and our India operations, and we’ve taken on 5 new projects. Unfortunately, I can’t disclose what those projects are because of very strict NDAs with the studios.

Also since our last interview Legend3D hired a very significant Hollywood veteran, Rob Hummel, as our new President and head of Business Development. Rob came from a very productive position as CEO of Post Production, North America with our leading competitor, where he was also responsible for managing business expansion efforts. We hired Rob Hummel because he is a significant presence in the industry with decades of relevant experience. Rob has been high profile since 1979 with key positions at Technicolor, Sony, DreamWorks, Warner Bros. and Dalsa. The fact that he is held in such high regard within the industry was a significant factor in bringing him in to the fold. Rob is very knowledgeable in 2D-to-3D conversion having been an integral part of the process during its genesis and he’s considered an authority on just about every aspect of film production. We are obviously very pleased to have him join our ranks.

We have achieved a great deal over the past year, but one of the most important of Legend3D’s recognitions came from CONNECT, anon-profit organization promoting innovation and ties between universities and businesses in Southern California. Competing against 26 of the top high tech companies in the region, Legend3D was awarded CONNECT’s Most Innovative Product Award at an event hosting 800 people. Each year, CONNECT assesses high tech innovation in Southern California and recognizes the single software company that is considered the most significant technology innovator.

Legend3D has done the 2D to 3D conversion of DreamWorks Animation’s Shrek, Shrek 2 and Shrek the Third, how long has the work on the three movies taken you?
The work took us approximately 6 months to do, or more specifically, 8 weeks per title. This was a short period of time to complete the work but we devoted our entire studio and all available resources to the completion of the conversion of this trilogy.

How many people did you have working on each of the movies at the same time and do you think that doubling the team for example can halve the needed time, or even with more people you should still not rush things too much?
The number of people that we have working on each film is a trade secret, sorry. Regarding how accelerating the process might affect the work, one must always keep in mind that 3D conversion is a highly creative process. There are aspects of it that are very labor intensive and which can benefit from the addition of resources. However, the final depth placement and interaction with the client’s creative representatives require that a single creative decision maker working closely with the client; a process which would not be made more efficient by having more resources.

What is the timeframe you consider normal for a making a good conversion of a full-length feature film into 3D and is the major issue of bad conversions that conversion companies and the movie studios always want things to happen too fast?
Though we can convert a film in 8 weeks as we did with each of the Shrek films, the ideal amount of time to convert a film is between 12 and 16 weeks. The more time that we are given to complete the work, the better and more effectively the process will work. The longer that we have to do a conversion, the more creative thought can be dedicated to the project so having the appropriate length of time directly affects the creative process more so than the mechanical process of the conversion. There are a few companies out there doing conversions that are very shallow with many shots actually remaining in 2D. That work clearly lacks depth detail and have imperfections or artifacts caused by their conversion process. With those few studios time is not an issue because the short cuts they take to speed up their processes result in the quality of their conversion being compromised. We have never compromised on quality nor will we do so in the future.

Is there any difference for Legend3D’s conversion process if you are converting a computer animated movie or live action movie, which one is more complicated or there is no difference?
It all depends on whether or not the CG assets from the original computer animation production are available. If they are, then the process is very straightforward and the quality of the conversion is essentially the same as if it was re-rendered “natively” with another camera in the computer. If the CG assets are not available, then the computer-animated movie is handled in very much the same way as a live action film.

Why did DreamWorks prefer Legend3D’s 2D to 3D conversion method for the first three Shrek movies as opposed to just re-render the movies in 3D by themselves?

The process of recovering and de-archiving the assets of animation catalog titles, if they even actually still exist, can be very expensive, time consuming and requires a significant amount of skilled resources. We did receive a large number of assets from DreamWorks which was very helpful though all assets were not available. Without the CG assets, there was no way to convert the trilogy without going back and actually redoing the films. It would have been cost and resource prohibitive to do whereas I believe the partnership with Legend3D proved to be a more financially sound and efficient decision.

What is your opinion about the more recent live action movies that were released using 2D to 3D conversion, do you see general improvement of the quality of conversions?
I’ve been less than satisfied with the quality of the conversions that some competitors have produced following “Alice In Wonderland”, the first and most successful conversion this year in which Legend3D had a hand. I worry that the compromised quality of 3D conversions will ultimately hurt the industry. Indeed, there is speculation that a couple of last year’s titles were glossed over for Oscar nominations due primarily to the Industry’s perception of them as subpar 3D conversions. I think we are entering a period where conversion vendors producing inferior conversions will be eliminated and those that refuse to compromise on quality will thrive going forward.

Do you think that the lack of confidence and knowledge in most filmmakers to shoot in 3D, and the additional expenses are the main reason for them preferring to stay only in the more familiar 2D format or to go for 2D to 3D conversion?
I don’t think it is as much about a lack of confidence as it is about the filmmakers having a greater comfort level with the established formats they’ve used for decades. Those film makers that are truly savvy about shooting in 3D will tell you about the substantial extras that go into the various stages of pre-production, production and post-production of a 3D project. When these extras are taken into account, they result in longer production schedules and higher costs. The easiest way to produce a 3D feature film is to shoot it in 2D with the involvement of a skilled stereographer from the first day of pre-production and to hire a reputable and time/project tested conversion company like Legend3D as early on in the process as is feasible.

Another consideration the filmmaker has to deal with is the artifacts generated when shooting in 3D. In fact, artifacts resulting from shooting with stereo camera rigs can be greater than that created throughout the conversion process. An example of the issues that a filmmaker faces with shooting in 3D is the discrepancies that can result between the two cameras in the rig they are using. In an over and under 3D rig used for tight shots, one camera rests on top of the other and a mirror beam splitter is used to create the close interaxial that is normally required. One camera must focus through the beam splitter mirror, shooting polarized light, while the other camera is shooting the reflection off the mirror. This is just one example of an instance where shooting with 3D camera rigs can result in conflicting images, called binocular rivalry. In this example, one eye sees a reflection on a mirror and the other eye is looking through polarized glass. While this is not impossible to deal with, it is just one example to counter the current misconception that shooting in 3D is an automatic or easier way to create 3D, and that somehow it’s more “natural than conversion. This is where the term “native” drives me a little crazy because there is obviously very little involved in shooting 3D that is “native”. It’s not the way humans natively perceive depth. There are equally significant considerations when using a side by side rig where the cameras are positioned next to each other. In each case, discrepancies between the two lenses, sensors, etc. influence the ultimate quality of the stereo.

The news about Titanic, Star Wars, Indiana Jones going to be re-released in 3D after conversion led to a lot of controversy among fans, what is your opinion about bringing classical movies back at the cinemas converted in 3D?
If you have James Cameron working with a conversion vendor from the short list of viable conversion companies on “Titanic”, as well as George Lucas on “Star Wars” and Steven Spielberg on “Indiana Jones, there shouldn’t be any issues with converting their contemporary classics. I believe that as long as the original filmmaker and/or the original creative team is involved on some level, 3D conversion is a very acceptable option for the studios that enables our finest filmmakers to significantly and uniquely enhance these cornerstones of our cinematic heritage.

Is there anything else you would like to share with our readers?
We are constantly refining, expanding and evolving our process with each new feature film project that comes into the Legend3D studio because each title presents new and often unique challenges. Surmounting each of these challenges continues to provide us with increased flexibility and enables us to preserve and maintain the standard of excellence that we have been committed to since Day 1. We are currently working on a film that we consider to be one of the most difficult titles that will ever undergo conversion. For that film, we had our software engineers coding for the nine months prior to the start of conversion to customize and expand our technology so that we can better handle the film’s unique complexities. In fact, each feature film that we take on typically requires us to add features that complement and enhance our ongoing R&D development path. This has resulted in the creation of a very large, ever-expanding and sophisticated conversion toolset from which each new title benefits. I genuinely do not believe that there is a feature film project that exists as a catalog title, is currently in production or will be produced in the future that we cannot complete while maintaining the highest level of quality in the industry. We have a dedicated department of incredibly talented software engineers that continue to push the envelope and improve our process in ways that enable us to increase our efficiency and maintain the standards of excellence that studios have come to expect from us.

If you have missed the previous interview with Barry Sandrew here on the blog…

→ 7 CommentsTags:·····

Talking with Barry Sandrew from Legend3D about 2D to 3D Conversion

October 6th, 2010 · 8 Comments · 2D to 3D Conversion

The 2D to 3D conversion of videos and movies is still getting mostly bad publicity due to not so good examples of projects that were rushed too much, or were done on the cheap, however when properly made, using enough resources and expertise, and taken the right amount of time needed, the final result might actually be really good and hardly distinguishable from a material shot in 3D. The recent announcements about upcoming 2D to 3D conversions of very popular older, but cult movies like Titanic and the Star Wars saga has yet again led to a lot of controversy regarding the conversion process. But I had the chance to do a short interview with an expert in the field of 2D to 3D conversions, getting his opinion on some key subjects that a lot of people are interested in. I’m talking about Barry Sandrew who is the Founder, President, and COO of Legend3D – one of the top companies specialized in 2D to 3D conversion…

Barry, please briefly introduce yourself to the readers of the 3D Vision Blog.
My career began evolving in the entertainment business in 1986, when I invented the first digital process for colorization. Prior to that, I served as a staff neuroscientist at Harvard Medical School. I’ve been involved in the film and television industry for more than 23 years and am responsible for more than 14 VFX patents. In 2005, I founded Legend3D, a dynamic digital media and visual effects company that utilizes a patented 2D-to-3D conversion technology. This technology was recently used to complete the 3D conversion for the most complex portions of Tim Burton’s Alice in Wonderland as well as three films for DreamWorks, and continues to be an access point for filmmakers, studios, and library holders across the globe.

Please provide a short overview of Legend3D – how did you start the company and what does it specialize in?

In 2005, I merged my expertise in graphic arts, image processing and neurophysiology to develop Legend3D’s patented 2D-to-3D conversion process, along with my associate, Greg Passmore. We advanced the colorization technology I created in 1986, and developed a proprietary process that combines technology and artistry to convert films from 2D to 3D. Today, my patented 3D technology has established Legend3D as a leader in the stereo conversion industry.

At Legend3D, we specialize in enhancing filmmakers’ storytelling by deepening their connections with audiences through the highest quality 3D, whether they are converting movies, television, advertisements, or mobile content.

You handled some of the conversion for Tim Burton’s Alice in Wonderland. What were you specifically involved with (i.e. what scenes?)

Legend3D was responsible for converting the following scenes:
– The Mad Hatter’s sewing room
– Scene of Alice falling into the round room
– The Mad Hatter’s tea party
– Scene where Alice meets the Tweedles in the castle
– Majority of the castle scenes with the Queen of Hearts
– Part of the battle scene at the end
– The goodbye scene where Mad Hatter says goodbye
– The execution scene where the Queen of Hearts is watching the Mad Hatter get his head chopped off
– Much of the mushroom forest chases
– Scenes where Stayne and The Mad Hatter are fighting in the makeup room
– Other shots and scenes

Unlike Alice in Wonderland, which turned out to be a real blockbuster, Clash of the Titans was not well accepted. What is your opinion about the conversion process used for that film?

2D to 3D conversion is a time-intensive process. Clash was simply a reflection of pushing the process in too tight of a timeframe, in this case 10 weeks which actually turned into a time frame of 5 to 7 weeks. This can’t be done with quality.

What is your opinion about bad 2D to 3D conversions? Can they drive away viewers from 3D movies in general?

Of course, there’s always the likelihood that bad conversions will detract audiences. However, we have to remember that even with Clash of the Titans, the film broke holiday box office records. 3D has a way of immersing audiences that 2D cannot and that experience, even at a premium, is proving to be popular among consumers. I hope that the theater going audience and the eventual home video 3D enthusiasts become discerning consumers and reject poorly converted product.

Please discuss the 2D to 3D conversion process Legend3D uses and explain why it produces convincing results.

I can’t get into the technology in detail because it is proprietary. However, I can tell you that we use our colorization masking technology which produces better and more organic results than the traditional roto methods that all others use. Our process for creating volume in 3D is considerably different than all the other processes. It has proven to be higher quality and faster than the other conversion companies.

Are there scenes that are harder to convert from 2D to 3D, or that are even impossible to do a convincing volume perception? Or given enough time and resources, can any scene be converted?

I can’t conceive of any scenes that can’t be converted convincingly. Believe it or not, an intense dolly shot of two people eating lunch in an outdoor restaurant setting is more difficult than an effects heavy scene with explosions and pyro. The former is less forgiving and requires much more attention to detail.

Why are more studios considering shooting in 2D and going for 3D conversion over shooting with 3D cameras? Is it only because of the higher costs associated with shooting everything in 3D?

The market for 2D-to-3D conversion and 3D content represents an extremely large, fast-growing opportunity for studios worldwide. When filmmakers rely on conversion, they have tremendous flexibility to shoot as they always have and that’s extremely appealing compared to the constraints of shooting natively in 3D. 3D rigs are awkward and very tricky to use and two cameras have to be perfectly aligned and identical in every aspect. The director then has to spend extra time to block and frame a shot rather than in 3D.

To answer your question, there are higher costs involved when shooting in native 3D. However, studios are turning to 3D conversion for other reasons as well. Conversion continues to remain the preferred solution for filmmakers who are more comfortable in the 2D medium. Additionally, the quality of conversion from top companies, like Legend3D, are continuing to dramatically improve, making the process essential for effects driven feature films that demand cost effective solutions.

Do you see a lot of movie studios starting to work on conversions of older popular titles in order to bring them back onto theatre screens?

Absolutely. As you can imagine there are numerous older library films that lend themselves to 3D – for example Star Wars, the Harry Potter series, Lord of the Rings, The Matrix, Jurassic Park, Titanic, and, of course, animated films. Conversion is the only way the industry is going to create enough content to get to “critical mass” in the consumer market.

Do you think there is a potential market for TV shows and even advertisements to soon start getting their 2D-to-3D treatment with all the attention 3D is getting from home users?

The 3D home market is primed for growth, and with the onset of 3D programming from ESPN, Discovery, and DirectTV, it’s only natural that 3D advertisement will soon experience an increase in popularity. We’ve already received great interest from brands and advertisers looking to convert ads.

Can you share information about recent projects that you finished working on or are starting with, or is this confidential?

Legend3D has been one of the industry’s most sought-after companies for 2D-to-3D projects. As I mentioned earlier, we most recently performed many of the most intricate portions of the 3D conversion for Tim Burton’s Alice in Wonderland. We’re also responsible for converting the first digital 3D advertisement to ever appear in movie theaters, titled “Skittles Transplant” for M&M Mars, which debuted June 1, 2009. In February 2009, Legend3D converted the opening credits and interstitials for the Super Bowl episode of “Chuck,” which was the first television show to ever air in 3D. Currently, we’re finishing a multi-picture deal with a major studio and beginning the conversion work on an upcoming feature film release for another studio.

What do you see in the future for 2D-to-3D conversion – say five or 10 years from now?

I see 3D conversion becoming an essential part of the 3D equation. Many of our most popular films will be converted as well as TV series and commercials. Vintage sports are also a possibility. Can you imagine the Ali/Fraser fight in stereo? Would be amazing to see and we can make it look exactly like it would if you were there in person.

Is there anything else you’d like to share with readers?

3D is not only a huge win for theater goers; it also represents a significant economic boost for the economy. The consumer electronics industry will revitalize product replacement cycles as the new 3D HDTVs come on the market. The Blu-ray business will get a huge boost as content becomes more prevalent via 3D conversion. And of course the studios and theatrical exhibitors are already seeing historically high revenues because of 3D. It’s all very positive news!

→ 8 CommentsTags:·····