Wētā FX and Amazon Web Services (AWS) have unveiled a new agreement to jointly develop artificial intelligence tools they say will increase the efficiency, control, and creative flexibility of visual effects artists.
Today’s press release lays out a multi-pronged plan to research AI systems built specifically for high-end VFX production rather than broad, general-purpose use.
Kimball Thurston, CTO at Wētā FX, framed the collaboration as an opportunity to rethink how major film and streaming projects are crafted:
AI represents an opportunity to shift how high-end entertainment is crafted, with custom agents to assist with mechanical tasks. We are collaborating with AWS to build tools that provide a new interface for artists, not with chatbots or text prompts, but providing artists the ability to orchestrate intelligent systems with a natural interface and manage a complexity and sophistication not yet possible. With the artist in full control, they are then enabled to collaborate with the rest of the team, crafting the next-generation of premier storytelling to entertain the world.
We asked Thurston to clarify if all of the models used by Wētā will be trained exclusively on the company’s own assets, and he told us:
Yes, our fundamental policy is that we believe in the beauty and provenance of our clients’ data, and that of artists around the world. Any training we do for generic tools will be using our own data, rights-managed external datasets, and synthetic data we are generating, hence why we are investigating using AWS compute to generate data in concert with training models.
The companies say their partnership centers on exploring how AI might handle time-consuming technical steps that underpin modern VFX work. Artists today often spend weeks on a single shot, juggling performance capture, creature animation, environment creation, and various layers of simulation and refinement. Wētā and AWS say they want to investigate AI-enabled workflows that preserve artistic control while reducing repetitive labor, including models capable of generalizing physics and motion for both human and non-human characters.
A major part of the initiative involves developing purpose-built AI models specifically tuned to VFX work, rather than relying on broad public datasets that lack the detail and complexity required for Hollywood-scale productions.
Wētā’s proprietary tools and production data will be used to generate large volumes of synthetic training material. With AI integration into the industry seemingly inevitable, the company’s decision to use only its own assets addresses a main complaint many uneasy artists have about new AI models, which are trained indiscriminately on stolen or scraped data.
Weta and AWS say they plan to explore how to make AI-driven VFX workflows more accessible and sustainable, too. By leveraging AWS’s “elastic compute” infrastructure, Wētā hopes to research smaller, more efficient models that reduce resource consumption while accelerating creative iteration cycles from days to hours.
Daniel Seah, CEO of Wētā FX, explained:
World-class filmmakers turn to Wētā FX to deliver iconic, awe-inspiring visual effects, from the battlefields of Middle-earth in The Lord of the Rings to the bioluminescent forests of Pandora in Avatar. We’ve done this for three decades by ensuring our artists have the most innovative tools as they craft the best path forward for every creative challenge. Together with AWS, we’re approaching AI with the goal of enhancing our artists’ work, enabling them to be more creative. We strongly believe AI technology should amplify human creativity and intent, and together with AWS we are committed to exploring and developing this.
Nina Walsh, global leader, industry business development for media, entertainment, games and sport at AWS, added:
AWS has been powering media and entertainment innovation for nearly two decades, and this agreement represents an exciting milestone to explore and develop AI workflows and services that will transform the visual effects industry. Wētā FX’s vision is about enabling exceptional artists to be more exceptional by creating purpose-built AI to fit their creative workflow. That’s exactly the kind of innovation we want to enable with AWS infrastructure and our AI services.
The collaboration continues Wētā’s long history of technical innovation. This time, there will certainly be more pushback regarding that innovation, but only time will tell how the new tools may impact workflows, employment, and sustainability at the studio.