Check out the new machine learning tools in Silhouette 2024.5
Originally posted on 10 June 2024, and updated with details of Silhouette 2024.5.
Boris FX has begun its 2024 updates to Silhouette, its roto and paint software.
Silhouette 2024.0 introduces a number of new AI-trained nodes to speed up routine tasks, including Matte Assist ML for generating quick animated mattes from a single frame.
New Retime ML and Optical Flow ML nodes semi-automatically retime footage, and generate optical flow data for use with Silhouette’s roto tools.
Silhouette 2024.5 adds another AI-trained tool, Mask ML, and a new Roto > Markup Tool.
Matte Assist ML generates animated mattes from a single rotoscoped frame
One of the most significant new tools in Silhouette 2024 is the Matte Assist ML node, which creates animated mattes isolating an object from the background of footage.
Users feed in a single frame with an alpha channel, and Matte Assist ML automatically propagates the matte throughout the clip, matching the motion of the object.
The alpha channel can be created using existing roto tools like the PowerMatte node, or the new EZ Mask node, which generates masks semi-automatically.
Users paint rough strokes to identify the foreground and background of the frame, and EZ Mask generates a matte automatically.
Boris FX describes the combination as a quick way to create garbage masks, temp comps or any task where “sub-pixel-perfect roto isn’t necessary”.
New AI-trained nodes for retiming footage and generating optical flow data
The update also introduces Retime ML, a new AI-trained retiming node.
The retiming effect is keyframable, and Boris FX claims that it generates smoother results with fewer visual artefacts than the legacy tools.
A separate new Optical Flow ML node generates optical flow data from video footage.
It can be used with Silhouette’s existing roto nodes, or with a new Auto Keyframe tool that “uses flow data together with manual animation”.
The Denoiser ML node introduced in Silhouette 2023 has been updated, and now features new, “2x faster” AI models.
Workflow and performance improvements
Workflow improvements in Silhouette 2024 include support for brushes in Photoshop’s .abr format.
The nodes shared with Boris FX’s effects plugins have been updated to match their current releases: Continuum 2024 and Sapphire 2024.5.
Silhouette’s Mocha tracking node has also been updated to integrate the core solver from from SynthEyes, which Boris FX acquired last year.
Performance improvements include “15-30% speed increases” when using multiple GPU nodes, while roto nodes use “33% less” memory.
In addition, a new Cache node caches all upstream nodes to disk to speed up playback.
Updated 14 September 2024: Boris FX has released Silhouette 2024.5.
The update adds another AI-trained tool, Mask ML, which automatically generates a mask for a significant object like a person or an animal within a single frame of video.
Users can click within the object or drag a box on-screen to select it, then add or subtract areas from the mask with additional clicks.
The mask generated can then be used as an input for Matte Assist ML, automatically masking the same object as it moves throughout a video clip.
For project reviews, another new – non-AI-based – tool, Roto > Markup, makes it possible to annotate projects by adding trackable freehand strokes with associated notes.
Price and system requirements
Silhouette 2024.5 is available as a standalone tool for Windows 10+, Linux and macOS 12.0+, and as a plugin for Adobe software and OFX-compatible tools like Nuke.
Perpetual licences of the standalone cost $1,995; the plugin costs $1,095. Rental costs $150/month or $795/year for the standalone; $100/month or $495/year for the plugin.
Read an overview of new features in Silhouette on the product website
Have your say on this story by following CG Channel on Facebook, Instagram and X (formerly Twitter). As well as being able to comment on stories, followers of our social media accounts can see videos we don’t post on the site itself, including making-ofs for the latest VFX movies, animations, games cinematics and motion graphics projects.