Page 1 of 1

Neural Engine Optimization

PostPosted: Fri Feb 02, 2024 7:58 am
by Jacob Carmona
Hi!

In the latest versions of DaVinci, the Neural Engine has been introduced as a truly useful tool. However, we have found that when starting each installation for the first time, it is necessary to run the Optimizing Engine, which takes several minutes.

This wouldn't be much of an issue if each workstation were only used by one user. However, in our case, each machine is used by several operators throughout the day, and each of them has to go through the process of optimizing Neural Engines.

My question is: could the optimization process take into account the hardware of the machine, and could this optimization be performed collectively only once, considering that all users are using the same machine?

Thank you.

Re: Neural Engine Optimization

PostPosted: Fri Feb 02, 2024 9:24 am
by panos_mts
Neural engine optimization creates a file named TensorRT.cache in the following folder on Windows (no idea what is the folder for other operating systems)
C:\Users\Username\AppData\Roaming\Blackmagic Design\DaVinci Resolve\Support\DVIP\Cache

A workaround is to place the TensorRT.cache to a folder accessible from all users, then create a symbolic link to this file and copy the symbolic link to the corresponding folder for each user

Re: Neural Engine Optimization

PostPosted: Fri Feb 02, 2024 3:23 pm
by waltervolpatto
Jacob Carmona wrote:Hi!

In the latest versions of DaVinci, the Neural Engine has been introduced as a truly useful tool. However, we have found that when starting each installation for the first time, it is necessary to run the Optimizing Engine, which takes several minutes.

This wouldn't be much of an issue if each workstation were only used by one user. However, in our case, each machine is used by several operators throughout the day, and each of them has to go through the process of optimizing Neural Engines.

My question is: could the optimization process take into account the hardware of the machine, and could this optimization be performed collectively only once, considering that all users are using the same machine?

Thank you.


Yep... painful. and that file will keep being added to the local drive... over and over....

Re: Neural Engine Optimization

PostPosted: Fri Feb 02, 2024 10:46 pm
by ohimbz
I keep seeing people talking about this Optimization window but i have never seen it on my part... I have the option checked but nothing ever happens to optimize anything

Re: Neural Engine Optimization

PostPosted: Sat Feb 03, 2024 1:33 am
by roger.magnusson
The optimization is for TensorRT if I understood correctly, so only for Nvidia. More discussion here: https://forum.blackmagicdesign.com/viewtopic.php?f=21&t=188275

Re: Neural Engine Optimization

PostPosted: Mon May 19, 2025 2:29 pm
by Mark Weiss
I've only seen this run on 2 of 3 machines.. the first one with an RTX3090. The second one with a GTX1060. It never ran on the machine with the GTX1080Ti.