Unity3D acquires Weta

Wednesday 17th November, 2021 - Bruce Sterling

*Facebook became Meta, so now it’s mayhem in the FX biz. “By combining the industry leading VFX tools and technical talent from the incredible team at Weta, plus the deep development and real-time knowledge within Unity, we aim to deliver tools to unlock the full potential of the metaverse.”

Weta vs Meta!

https://blog.unity.com/news/welcome-weta-digital?_ga=2.164870655.1995680536.1636681170-1645606552.1636681170

(…)

Tools sneak peek

This list represents just a glimpse of the breadth and depth of innovation from Weta Digital’s 15 years of deep research and development. Individually, these tools are capable of spectacular results, but their real power is as part of a unified pipeline allowing changes made using one tool to instantly be reflected in another tool and allowing groups of artists to collaborate in the pursuit of their vision. These tools have been foundational in award-winning TV and films like Avatar, Black Widow, Game of Thrones, Lord of the Rings, Planet of the Apes, Wonder Woman, The Suicide Squad, and more.

Manuka: Manuka is the flagship path-tracing renderer used to generate final frames and is able to produce physically accurate results based upon specific spectral lighting profiles.

Gazebo: Gazebo is the core interactive renderer used for viewing scenes in real time with visual fidelity inside any pipeline attached application. Since the Gazebo real-time rendering of the 3D viewport approaches the same results from Manuka, artists can iterate in context of the final frame regardless of which application they use. Gazebo is also the core of the production pipeline for pre-visualization and virtual production workflows.

Loki: Loki provides physics-based simulation of visual effects including water, fire, smoke, hair, cloth, muscles, and plants. Physical accuracy for complex simulations is delivered through the use of cross-domain coupling and high-accuracy numerical solvers.

Physically-based workflows: Tools including PhysLight, PhysCam, and HDRConvert provide the foundation for lighting and color workflows. Using these tools, artists can create spectral-based lighting and accurately replicate effects of different lenses, sensors, and other parts of the pipeline, resulting in a physically accurate rendering workflow for both Gazebo and Manuka.

Koru: Koru is an advanced puppet rigging system optimized for speed and multi-character performance. Using Koru, technical directors and developers can create constraints, rigs, deformers, and puppets to support high-performance animation, cloth simulation, and similar applications.

Facial Tech: Facial Tech provides advanced facial capture and manipulation workflows, using machine learning to support direct manipulation of facial muscles and transferring actor face capture onto a target (puppet) model.

Barbershop: Barbershop is a suite of tools for hair and fur that supports the entire workflow from growth through grooming. Artists can use a combination of procedural and artist-guided tools to grow hair and fur, adjust growth patterns, and groom the final model. Advanced procedural tools support concepts such as braided hair, and the resulting models are simulation-ready to provide realistic dynamics resulting from motion and wind.

Tissue: Tissue enables artists and animators to create biologically accurate anatomical character models that accurately represent behaviors of muscle and skin, and transfer the resulting characters into simulation tools.
Apteryx: Apteryx provides artists with a complete workflow starting with procedural generation of feathers, hand sculpting, and grooming for animated feathered creatures and costumes.

World Building: These tools include Scenic Designer and Citybuilder to support world building, layout, and set dressing ranging from planet-scale to small-scale scenes. With these tools, artists can procedurally create scenes with node graphs, place content programmatically, and manually adjust placement.

Lumberjack: Lumberjack provides the core toolset for vegetation and includes modeling, editing, and deformation tools. Using Lumberjack, artists can author and edit plant topology including animated geometry, manage levels of detail, instancing, and variability among individual assets.

Totara: Totara is a procedural growth and simulation system for vegetation and biomes that integrates with Lumberjack to create large-scale and complex scenes procedurally. Using Totara, artists can grow individual trees and entire forest biomes, grow other vegetation such as vines, adjust growth parameters and control biomechanics, add snow cover, and reduce the complexity and size of scenes.
Eddy: Eddy is an advanced liquid, smoke and fire compositing plug-in for refining volumetric effects. Eddy allows artists to generate new, high-quality fluid simulations and render them directly inside their compositing environment.

Production Review: HiDef and ShotSub are the foundation for production review. HiDef is a core tool for production review, with features for note taking, version browsing, and more, integrated with a color-accurate browser and playback engine. ShotSub is a core tool for production review, with tools to prepare artist work for review with the appropriate color space, frame ranges, and settings for frame rate and resolution.

Live Viewing: Live viewing tools support the mixing of computer-generated (CG) content in real-time with on-set camera feeds. These tools support live mixing for on-set viewing, live compositing of CG elements onto chromakey or other CG elements, depth-based live compositing and projection of face capture onto a motion capture puppet.

Projector: Projector is a production tool supporting scheduling, resourcing, and prediction, with controls for data access and analytics to improve production decision-making….