Animated Features Like ‘Transformers One’ and ’Wild Robot’ and More Rely on Artists for the Magic as Machine Learning or AI Works in Support

As a seasoned film enthusiast with over three decades of immersion in the world of cinema, I’ve witnessed the evolution of visual effects and animation from rudimentary beginnings to the breathtaking spectacles we see today. Over the years, I’ve marveled at the artistry that goes into creating these magical worlds, and it’s been an absolute joy to observe how technology has augmented – but never replaced – human creativity.


Despite advancements in technology enabling increasingly stunning visuals among contenders for the Animated Feature Oscar, there’s a preference towards the experienced artisans who have honed their craft, rather than relying on artificial intelligence or machine learning.

In the preliminary stages of motion capture or for refining concepts, machine learning – a form of artificial intelligence – might be employed by some. However, it’s the wisdom of seasoned VFX artists and the artistic prowess of animators that truly drive the creation of the distinct visuals desired by filmmakers, such as those behind movies like “Lord of the Rings: The Lord of the Rohirrim.” Some productions, such as this one, opt for traditional, low-tech methods to establish their visual aesthetic.

In “Transformers One,” director Josh Cooley meticulously crafted the origin story, drawing heavily on prior Transformers narratives and experimenting with various metals to achieve the desired visual impact. The creative team, filled with artists who were childhood fans of Transformers, brought their personal insights and preferences regarding the characters’ appearance and movement. Notably, VFX supervisor Frazer Churchill mentioned that although they initially employed machine learning alongside motion capture methods during the filmmaking process, none of these techniques ended up in the final cut of the movie.

Churchill remarks, “This movie is essentially crafted through artistry and patience.” He emphasizes that their initial aim was to make the metal appear tangible, so viewers could almost reach out and touch the metallic characters. To accomplish this, they amassed a vast collection of metal surfaces as a basis, collaborating with surface artists, examining various types of metals and painted metals. Subsequently, they opted for intensely saturated colors to create a more stylized effect. All their lighting is what they refer to as ‘plausible lighting.’ This means they’ve strategically placed numerous lights throughout the scenes, aiming for a cinematic backlit look with characters such as Megatron being highlighted by beautiful rim light. The artists are responsible for these creative decisions.

Cooley emphasizes that currently, AI operates based on the information provided, meaning “it can just repeat what you give it.” For groundbreaking concepts like the Transformers project, he’s looking for a team of seasoned filmmakers who are enthusiastic about collaborating.

Interestingly, despite “The Wild Robot” being a narrative about a robot bonding with a gosling, the use of AI didn’t align with the filmmakers’ plans. Instead, VFX supervisor Jeff Budsberg opted for a painterly technique in the film’s visual effects, as director Chris Sanders desired a fairy-tale-like aesthetic, characterized by less intricate details and a more dreamy, impressionistic atmosphere. This artistic choice not only maintained consistency with the book’s world but also infused the movie with a warmer overall feeling.

Budsberg explains that carefully deciding where to include details and which information to omit, subtly guiding the viewers’ focus, is crucial. Early in the project, Chris [Sanders] expressed a desire to honor early Disney films like ‘Bambi’, while also being inspired by Miyazaki’s works. The enchanting environments and heartwarming feel of these movies captivated him, and he challenged Budsberg and the team to recreate that magic in their work. Having recently worked on ‘The Bad Guys’, which explored a non-photorealistic style reminiscent of comic books or illustrations, this was the first step towards creating 2022’s ‘Puss in Boots’. ‘Puss in Boots’ featured a distinctly different style, leaning more towards fantasy. This hybrid 2D and 3D style is currently being used for ‘The Wild Robot’, although at Dreamworks, AI is not utilized in their films yet as it is still considered a developing technology.

As a passionate film enthusiast, I’ve witnessed firsthand how AI has been seamlessly integrated into various facets of Pixar’s animated movie magic for quite some time now. While the heart and soul of our creations are undeniably driven by artists, there are certain tasks – such as refining specific visual aspects – that are aided by advanced AI or machine learning technology.

To give “Piece by Piece,” the animated biography on musician/producer/entrepreneur Pharrell Williams made from Legos, a more relatable and human touch, director Morgan Neville aimed to make the Lego characters resemble real people, especially since they are well-known musicians that Williams meets throughout his journey. Neville found it fitting to base the Lego figures on the individuals interviewed for the biopic as many of them are significant in music. With scanning technology, Neville and his team created and mapped the faces of those featured in the film, transforming them into Lego characters.

According to Neville, there were certain guidelines for how our Lego figures could be animated and what actions they could perform since Lego sets have specific rules. Essentially, we had to adhere to the limitations imposed by real-life Lego capabilities and the Lego universe. Despite these restrictions, we had ample room for creativity, such as designing Lego representations of flowing water and a floating boat. Our talented team of artists were skilled enough to handle this unique challenge.

“Lord of the Rings: The Lord of the Rohirrim” showcases a style inspired by traditional Japanese 2D animation and features hand-drawn elements throughout its design, from characters to lighting, adopting a more painterly feel. Although AI wasn’t involved in this particular adaptation of “LOTR”, Animation Supervisor Kei Yoshimizu envisions it as playing a significant role in the future of Japanese animation.

Yoshimizu, speaking through a translator, is confident that AI will increasingly be used in different parts of the Japanese anime production sector. He compares this trend to the arrival of 3D CGI in the 1990s. In this specific project, 3D CGI plays a more supporting role, whereas other works might feature more prominent 3D elements. However, it’s important to note that full 3D productions abandoning hand-drawn techniques are still uncommon in Japan. Essentially, 3D CGI has become an integral part of the anime production process, but hasn’t entirely replaced traditional animation methods,” Yoshimizu explains.

From another perspective, Yoshimizu points out that hand-drawn animation encounters a substantial hurdle due to the scarcity of proficient workers to tackle the heavy production requirements. This efficiency offered by AI becomes an essential aspect to ponder upon in such a scenario. In my opinion, much like with 3D CGI animation, the field might strive for a balance between AI and traditional methods. The acceptance of AI will largely depend on the market’s preference. As of now, it appears that many Japanese anime fans continue to cherish the traditional ‘key frame’ style of hand-drawn animation.

Read More

2024-10-26 19:54