Machine Learning Tools Coming to Flame 2020
At NAB, Autodesk announced Flame 2020, the latest release of the Flame Family of integrated visual effects (VFX), colour grading, look development and finishing system for artists. A new machine learning-powered feature set along with a host of new capabilities bring Flame artists significant creative flexibility and performance boosts.
Advancements in computer vision, photogrammetry and machine learning have made it possible to extract motion vectors, Z depth and 3D normals based on software analysis of digital stills or image sequences. The Flame 2020 release adds built-in machine learning analysis algorithms to isolate and modify common objects in moving footage, dramatically accelerating VFX and compositing workflows.
“Machine learning has enormous potential for content creators, particularly in the areas of compositing and image manipulation where AI can be used to track and isolate objects in a scene to pull rough mattes quickly,” said Steve McNeill, Director Flame Family Products, Autodesk, Media and Entertainment. “Flame has a reputation as the de facto finishing system of choice in the deadline driven world of professional production, and this latest 2020 release significantly extends creative flexibility and performance for our artists.”
Flame Family 2020 highlights include:
Z Depth Map Generator – Enables Z depth map extraction analysis using machine learning for live action scene depth reclamation. This allows artists doing color grading or look development to quickly analyze a shot and apply effects accurately based on distance from camera.
Human face Normal Map Generator – Since all human faces have common recognisable features (relative distance between eyes, nose, location of mouth,) machine learning algorithms can be trained to find these patterns. This tool can be used to simplify accurate colour adjustment, relighting and digital cosmetic/beauty retouching.
Refraction – With this feature, a 3D object can now refract, distorting background objects based on its surface material characteristics. To achieve convincing transparency through glass, ice, windshields and more, the index of refraction can be set to an accurate approximation of real-world material light refraction.
- Automatic Background Reactor – Immediately after modifying a shot, this mode is triggered, sending jobs to process. Accelerated, automated background rendering allows Flame artists to keep projects moving using GPU and system capacity to its fullest. This feature is available on Linux only, and can function on a single GPU.
- Simpler UX in Core Areas – A new expanded full width UX layout for MasterGrade, Image surface, and several Map User interfaces, are now available, allowing for easier discoverability and accessibility to key tools.
- ‘Manager’ for Action, Image, Gmask – A simplified list schematic view, Manager makes it easier to add, organize and adjust video layers and objects in the 3D environment
- Open FX Support – Flame, Flare and Flame Assist version 2020 now includes comprehensive support for industry standard Open FX creative plugins as Batch/BFX nodes or on the Flame timeline.
- Cryptomatte Support – Available in Flame and Flare, support for the Cryptomatte open source advanced rendering technique offers a new way to pack alpha channels for every object in a 3D rendered scene.
Single user license offering – Linux customers can now opt for monthly, yearly and three-year single user licensing options. Customers with an existing Mac-only single user license can transfer their license to run Flame on Linux.
Flame, Flare, Flame Assist and Lustre 2020 is available from April 16, 2019 at no additional cost to customers with a current Flame Family 2019 subscription. For details and pricing, visit the Autodesk website. Early Flame 2020 adopters on beta have responded with enthusiasm to the latest updates.
“I’m super excited about the new machine learning tools in Flame. Machine learning can be used to automate a lot of processes, letting artists focus on more creative tasks. Z Depth Map Generator is a great tool for making depth-of-field adjustments but it’s also a really useful tool for speeding up selective colour correction and beauty clean up too.”
Bryan Bayley, Flame Artist, Treehouse Edit
“Arthur C. Clarke once said ‘Any sufficiently advanced technology is indistinguishable from magic’. The machine learning technology inside of Flame is truly magic. I recently worked on a virtual set comp where they forgot to add depth-of-field on the backgrounds. It took me two hours per shot to roto and add motion blur, I ran the same shots through the Z Depth Map Generator and got results in two seconds. Wow!,” said Craig Russo, VFX Supervisor, cr2creative
“Loads of people have talked about machine learning for compositing work, but nobody has delivered anything in an actual product. This is really impressively fast compared to the object labelling/mask approach to getting rough mattes quickly,” saidLewis Saunders, freelance Flame Artist, London