Fusion 8 RenderNode won't start on Farm, fine on workstation

The issue I am having is that the Fusion Render Node 8 would not start on our farm racks.
When running with the /log option, it writes the following log:

Code: Select all

---------------------------------------------------
Starting Fusion Render Node 8.1.1 at 12/Jul/16 12:48:40
C:/Program Files/Blackmagic Design/Fusion Render Node 8\FusionRenderNode.exe
---------------------------------------------------
Checking for licenses...
Loading support DLLs
Loading Plugins
Initialising Class Registry

It seems like the process starts for half a second and then terminates.
The job is therefore unable to render on the farm as the render node is not started.

We tried installing it on a workstation and it works fine, the render manager is able to pick the machine up and render through it. No problems with licenses or with the dongle.

We are using Fusion 8.0 with Deadline 8.0.5.1 as the render manager.

I had a look on the forum and some people report being unable to start the RenderNode when using a machine without a dedicated graphic card. Was any of you able to confirm this?

The render farm machine specs are:


Operating System
Windows 7 Professional 64-bit SP1
CPU
Intel Xeon E3 1240 @ 3.40GHz 26 °C
Haswell-WS 22nm Technology
RAM
32.0GB Dual-Channel DDR3 @ 666MHz (9-9-9-24)
Motherboard
Dell Inc. 081N4V (CPU1) 28 °C
Graphics
16MB Matrox Standard VGA Graphics Adapter (Dell)
Storage
232GB Seagate ST9250610NS ATA Device (SATA) 22 °C


On the other hand, the workstation specs are:


Operating System
Windows 10 Pro 64-bit
CPU
Intel Core i7 920 @ 2.67GHz 47 °C
Bloomfield 45nm Technology
RAM
30.0GB Triple-Channel DDR3 @ 532MHz (9-8-8-20)
Motherboard
Gigabyte Technology Co. Ltd. EX58-UD5 (Socket 1366) 56 °C
Graphics
4095MB NVIDIA GeForce GTX 970 (EVGA) 62 °C
Storage
223GB SanDisk SDSSDA240G (SSD) 41 °C
3726GB Seagate ST4000DX000-1CL160 (SATA) 40 °C

Thanks in advance for the help!

Hey Leonardo,

i am having the exact same problems you have (viewtopic.php?f=22&t=49687),
i was also in contact with blackmagic support, and they forwarded this to the dev team.
Can you install F7.7 rendernodes on the blades and confirm if that version still works for you?
It did with my farm.

Cheers,
Moritz

edit:
you do not have a Win10 Rendernode by chance?

Hay Mauritz,

I remember seeing your thread, I've got a support ticket open too. I just received this reply:

Code: Select all

We have been able to replicate this behavior in our office, this has been escalated to our development team where further tests and finally a solution to this will be generated and then addressed in later updates.

We cannot estimate how long this will take to, therefore cannot provide a time in which an update will be released.

Hi there,

We're seeing similar behaviour here on Fusion 8.1.1.3 and Deadline 7.2.1.0 on Windows 7 x64 (we've backported the working Fusion modules from Deadline 8.x to 7.x ) and seeing similar problems here.

For us it seems to fail when starting up GLtools. Will continue the process of stripping things out and re-testing.

cheers

Jamie

We're also using Deadline and have stripped nodes back to bare minimum, nothing else that could interfere, no envs other than the license server or 3rd party plugins and it's still failing to start up render on dedicated nodes.

Doesn't get any cleaner than this for a test.

Error logs with specs below:

Code: Select all

2016-07-15 12:44:24:  0: INFO: ** Render Slave preference file not being set **
2016-07-15 12:44:24:  0: INFO: Stdout Redirection Enabled: True
2016-07-15 12:44:24:  0: INFO: Stdout Handling Enabled: True
2016-07-15 12:44:24:  0: INFO: Popup Handling Enabled: False
2016-07-15 12:44:24:  0: INFO: Using Process Tree: True
2016-07-15 12:44:24:  0: INFO: Hiding DOS Window: False
2016-07-15 12:44:24:  0: INFO: Creating New Console: False
2016-07-15 12:44:24:  0: INFO: Running as user: renderman
2016-07-15 12:44:24:  0: INFO: Executable: "C:/Program Files/Blackmagic Design/Fusion Render Node 8/FusionConsoleNode.exe"
2016-07-15 12:44:24:  0: INFO: Argument: "P:\PROJECTSERVER\user\Jamie\Fusion\8.1_tests\Simple_Test.comp" /render /start 11 /end 15 /step 1 /verbose /quiet /quietlicense /clean /quit /log
2016-07-15 12:44:24:  0: INFO: Startup Directory: "C:\Program Files\Blackmagic Design\Fusion Render Node 8"
2016-07-15 12:44:24:  0: INFO: Process Priority: BelowNormal
2016-07-15 12:44:24:  0: INFO: Process Affinity: default
2016-07-15 12:44:24:  0: INFO: Process is now running
2016-07-15 12:44:24:  0: STDOUT: ---------------------------------------------------
2016-07-15 12:44:24:  0: STDOUT: Starting Fusion Render Node 8.1.1 at 15/Jul/16 12:44:24
2016-07-15 12:44:24:  0: STDOUT: C:/Program Files/Blackmagic Design/Fusion Render Node 8\FusionConsoleNode.exe
2016-07-15 12:44:24:  0: STDOUT: ---------------------------------------------------
2016-07-15 12:44:24:  0: STDOUT: Initialising QuickTime
2016-07-15 12:44:24:  0: STDOUT: Checking for licenses...
2016-07-15 12:44:24:  0: STDOUT: Loading support DLLs
2016-07-15 12:44:24:  0: STDOUT: Loading FusionOperators.dll
2016-07-15 12:44:24:  0: STDOUT: Loading FusionFormats.dll
2016-07-15 12:44:24:  0: STDOUT: Loading Plugins
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/3D.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/Alembic.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/CinemaRaw/CinemaRaw.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/DDS.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/Dimension.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/DirectShow.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/FBX.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/Fuses.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/OMF.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/OpenColorIO.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/OpenEXR.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/OpenFX.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/Paint.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/Particles.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/QuickTime.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/Text.plugin
2016-07-15 12:44:24:  0: STDOUT: Loading plugin C:/Program Files/Blackmagic Design/Fusion Render Node 8/Plugins/Blackmagic/Utilities.plugin
2016-07-15 12:44:24:  0: STDOUT: Initialising Class Registry
2016-07-15 12:44:25:  0: STDOUT: Initialising all geometry caches
2016-07-15 12:44:25:  0: STDOUT: Initialising GLTools
2016-07-15 12:44:25:  0: STDOUT: ERROR: GLTools failed to initialise!
2016-07-15 12:44:25:  0: STDOUT: Initialising Texture Manager
2016-07-15 12:44:26:  0: INFO: Process exit code: -1073741819
2016-07-15 12:44:27:  0: An exception occurred: Error: Renderer returned non-zero error code -1073741819. Check the console slave's output.
2016-07-15 12:44:27:     at Deadline.Plugins.ScriptPlugin.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel) (Deadline.Plugins.RenderPluginException)



Node spec & env.

Code: Select all

=======================================================
Details
=======================================================
Date: 07/15/2016 12:44:27
Frames: 11-15
Elapsed Time: 00:00:00:04
Job Submit Date: 07/15/2016 12:23:44
Job User: jamiem
Average RAM Usage: 6382663680 (13%)
Peak RAM Usage: 6473822208 (13%)
Average CPU Usage: 9%
Peak CPU Usage: 13%
Used CPU Clocks: 233378
Total CPU Clocks: 2593080

=======================================================
Slave Information
=======================================================
Slave Name: QUAD-41
Version: v7.2.2.1 R  (8d27fcaf8)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: renderman
IP Address: xxx.xxx.xxx.xxx
MAC Address: xx:xx:xx:xx:xx
CPU Architecture: x64
CPUs: 24
CPU Usage: 10%
Memory Usage: 6.0 GB / 48.0 GB (12%)
Free Disk Space: 522.183 GB (261.091 GB on C:\, 261.091 GB on U:\)
Video Card: Standard VGA Graphics Adapter

Hi,

I just wanted to ask if there is any progress regarding the Render Node issue.

I have the same problem on my Farm (20 Nodes). Would be great if we could have an update if this will be fixed in the near future.

Thanks in advance.

Christian

FYI

The problem has been resolved in version 8.2 Beta 2.

The funny thing is that I'm getting this exact error ("-1073741819") since I installed 8.2 b2. All was fine with 8.2 b1.

P.S.: Deadline successfully renders the frames but after finishing the task displays them as "Queued" and adds an error log to the slave.

I am also getting exit code: -1073741819 with Muster too (8.2 official release). It would be great to hear back from anyone who resolves the issue.

I found a Maya reference to this code related to OpenCL so was thinking it may be Fusion trying to use OpenCL on a render node that doesn't have it. Modifying RenderNode.prefs to enforce "cpu" use doesn't seem to have any affect.

Our latest testing on Deadline 7.2 with Fusion 8.2.0.2 is showing the exact same behaviour.

viewtopic.php?f=22&t=53115

Is this ever going to be resolved Black Magic? Think we'll have to escalate our testing regime here and raise a ticket with BMD support on this as it's a bit of a show stopper.

The premise of the forums is for the guidance of the community with the occasional employee signing on to assist as they can. If you haven't already opened a support ticket, we would suggest contacting your regions support office.