V-Ray support for Deadline in Houdini

Yasen_Panev · May 8, 2019, 8:22am

Hi guys
we currently doing test with vray for houdini and rendering over deadline, but its seems we have a problem regarding outputting files. It says that the output is not defined even though its defined in vray node. Says also that the driver will handle it, but no files are written.
And other than that in Export Jobs tab there are few tabs regarding Mantra, Arnold, Renderman and Redshift Exports but no for V-Ray. Would be cool if we have tab for Vray Export (for exporting vrscenes). This option is available only in vray node. For some big renders we’ll need to write it on the farm.

anthonygelatka · May 8, 2019, 9:24am

+1 for this, I’d like to see more Houdini / V-Ray options including export to standalone workflow.

Thanks

psanitra · May 8, 2019, 3:36pm

+1 for V-Ray Houdini support.

anthonygelatka · September 12, 2019, 11:25am

Chaos Group have published a guide to running this (I’ve not tried this but will get round to it)
https://docs.chaosgroup.com/display/VRAYHOUDINI/Deadline+and+V-Ray

Be great to have this native in Deadline along with the export option. the ROP ignores the custom sanity script
https://docs.thinkboxsoftware.com/products/deadline/10.0/1_User%20Manual/manual/app-houdini.html#custom-sanity-check-setup

@psanitra your work is incredible!

psanitra · September 15, 2019, 8:58pm

It will be nice to have more support for V-Ray for Houdini. Please add V-Ray to export jobs tab, like you have for the other render engines, so we can export and run dependency render easily.

Right now(i`m on 10.0.26) output path from vray ROP node is not recognised by the deadline ROP, and i get

Output path for ROP: “xyz” is not specified.

Tasks will render fine, but i`m not able to view the image or explore the output location by right/double clicking on the finished task.

Glacierise · October 8, 2019, 9:41am

Hi,

Any updates here? It’s becoming very important for us.

Thanks

Jeff2 · October 9, 2019, 10:55pm

We’ve gotten it working on AWS over the past week but it is so far from ready from primetime that I don’t really recommend it.

If you want some help and need to test it out in this state, I’m happy to share my AMI with you that Edwin and Charles helped put together @Glacierise.

jurweer · October 15, 2019, 7:40am

We are also looking for support on this matter! We have been manually exporting and linking job dependencies in deadline since July, when VRay for Houdini was released…

HtoA, Mantra, Renderman and Redshift interfaces are already there, please add VRay!

Glacierise · October 26, 2019, 12:26pm

Sounds promising, let’s do this

Jeff2 · November 7, 2019, 11:31pm

Also, sorry I didn’t see this sooner!

Sergic · July 18, 2022, 9:02am

Hi, I’m stuck with Houdini v-ray and I don’t know exactly what’s going on I’ve tried declaring it in plugins but, I’m lost.

=======================================================
Error
=======================================================
FailRenderException : [2022/Jul/18|10:51:24] [84 MB] error: Error in file "Test_vray.vrscene", line 0: No file "C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\jobsData\62d51cf678f3bd131c46d6f4\thread0_tempeCLkr0\Test_vray.vrscene" exists
   at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
  File "C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\plugins\62d51cf678f3bd131c46d6f4\Vray.py", line 310, in handleStdoutError
    self.FailRender( self.GetRegexMatch( 0 ) )
   at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
   at __FranticX_Processes_ManagedProcess_StdoutHandlerDelegateDispatcher.Invoke()
   at FranticX.Processes.ManagedProcess.RegexHandlerCallback.CallFunction()
   at FranticX.Processes.ManagedProcess.e(String di, Boolean dj)
   at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)
   at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
   at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
   at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type
=======================================================
RenderPluginException

=======================================================
Stack Trace
=======================================================
   at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgj, CancellationToken bgk)
   at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
   at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajq, CancellationToken ajr)

=======================================================
Log
=======================================================
2022-07-18 10:51:21:  0: Loading Job's Plugin timeout is Disabled
2022-07-18 10:51:21:  0: SandboxedPlugin: Render Job As User disabled, running as current user 'Sergi-PC'
2022-07-18 10:51:22:  0: Executing plugin command of type 'Initialize Plugin'
2022-07-18 10:51:22:  0: INFO: Executing plugin script 'C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\plugins\62d51cf678f3bd131c46d6f4\Vray.py'
2022-07-18 10:51:22:  0: INFO: Plugin execution sandbox using Python version 3
2022-07-18 10:51:22:  0: INFO: About: V-Ray Standalone Plugin for Deadline
2022-07-18 10:51:22:  0: INFO: The job's environment will be merged with the current environment before rendering
2022-07-18 10:51:22:  0: Done executing plugin command of type 'Initialize Plugin'
2022-07-18 10:51:22:  0: Start Job timeout is disabled.
2022-07-18 10:51:22:  0: Task timeout is disabled.
2022-07-18 10:51:22:  0: Loaded job: Test_vray- Vray- /out/vray (62d51cf678f3bd131c46d6f4)
2022-07-18 10:51:22:  0: Executing plugin command of type 'Start Job'
2022-07-18 10:51:22:  0: DEBUG: S3BackedCache Client is not installed.
2022-07-18 10:51:22:  0: INFO: Executing global asset transfer preload script 'C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\plugins\62d51cf678f3bd131c46d6f4\GlobalAssetTransferPreLoad.py'
2022-07-18 10:51:22:  0: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer...
2022-07-18 10:51:22:  0: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py...
2022-07-18 10:51:22:  0: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.
2022-07-18 10:51:22:  0: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.
2022-07-18 10:51:22:  0: Done executing plugin command of type 'Start Job'
2022-07-18 10:51:22:  0: Plugin rendering frame(s): 1
2022-07-18 10:51:23:  0: Executing plugin command of type 'Render Task'
2022-07-18 10:51:23:  0: INFO: Starting V-Ray Task
2022-07-18 10:51:23:  0: INFO: Performing path mapping on vrscene file
2022-07-18 10:51:23:  0: INFO: The include file K:\jobs\Test_vray.vrscene does not exist.
2022-07-18 10:51:23:  0: INFO: Stdout Redirection Enabled: True
2022-07-18 10:51:23:  0: INFO: Stdout Handling Enabled: True
2022-07-18 10:51:23:  0: INFO: Popup Handling Enabled: False
2022-07-18 10:51:23:  0: INFO: Using Process Tree: True
2022-07-18 10:51:23:  0: INFO: Hiding DOS Window: True
2022-07-18 10:51:23:  0: INFO: Creating New Console: False
2022-07-18 10:51:23:  0: INFO: Running as user: Sergi-PC
2022-07-18 10:51:23:  0: INFO: Executable: "C:\Program Files\Chaos Group\V-Ray\Houdini 18.5.499\appsdk\bin\vray.exe"
2022-07-18 10:51:23:  0: INFO: Argument:  -scenefile="C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\jobsData\62d51cf678f3bd131c46d6f4\thread0_tempeCLkr0\Test_vray.vrscene" -interactive=0 -display=0 -rtEngine=0 -frames=1 -numThreads=0 
2022-07-18 10:51:23:  0: INFO: Full Command: "C:\Program Files\Chaos Group\V-Ray\Houdini 18.5.499\appsdk\bin\vray.exe"  -scenefile="C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\jobsData\62d51cf678f3bd131c46d6f4\thread0_tempeCLkr0\Test_vray.vrscene" -interactive=0 -display=0 -rtEngine=0 -frames=1 -numThreads=0 
2022-07-18 10:51:23:  0: INFO: Startup Directory: "C:\Program Files\Chaos Group\V-Ray\Houdini 18.5.499\appsdk\bin"
2022-07-18 10:51:23:  0: INFO: Process Priority: BelowNormal
2022-07-18 10:51:23:  0: INFO: Process Affinity: default
2022-07-18 10:51:23:  0: INFO: Process is now running
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] warning: The parameter 'interactive' has been removed and so it has been ignored!
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] Reading configuration from "C:\Program Files\Chaos Group\V-Ray\Houdini 18.5.499\appsdk\bin\/vrayconfig.xml"
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] ===============================================
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] V-Ray Standalone, version 5 Standalone, update 2.1 for x64
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] Copyright (C) 2000-2021 Chaos Group OOD. All rights reserved.
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] Use -credits option for additional third-party copyright notices.
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] 
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] Build 58987b7e from Dec  2 2021, 13:17:27
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] Compiled with Microsoft Visual C++ compiler, version 19.12
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] Operating system is Windows 10 Pro (21H2, Build 19044)
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] CPU: AMD, AMD Ryzen 7 5800X 8-Core Processor             , 3800 MHz, threads: 16
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] RAM: 65456 MiB
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] 
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] V-Ray core version is 5.20.02
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] ===============================================
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [16 MB] 
2022-07-18 10:51:23:  0: STDOUT: [2022/Jul/18|10:51:23] [22 MB] Loading plugins from "C:\Program Files\Chaos Group\V-Ray\Houdini 18.5.499\appsdk\bin/plugins/vray_*.dll"
2022-07-18 10:51:24:  0: STDOUT: [2022/Jul/18|10:51:23] [22 MB] 79 plugin(s) loaded successfully
2022-07-18 10:51:24:  0: STDOUT: [2022/Jul/18|10:51:23] [22 MB] Finished loading plugins.
2022-07-18 10:51:24:  0: STDOUT: [2022/Jul/18|10:51:24] [84 MB] Reading scene file "Test_vray.vrscene"
2022-07-18 10:51:24:  0: Done executing plugin command of type 'Render Task'

anthonygelatka · July 18, 2022, 9:13am

It can’t find the scene file, how are you submitting this? you’ve configured the V-Ray standalone plugin, and it looks like it’s running a standalone job.

Do you submit from within Houdini as an export job, if so do you use the submitter menu or the deadline node in /out? Do you run the export locally or on the farm also? Have you specified the vrscene output and can you confirm it writes this?

Sergic · July 18, 2022, 9:33am

Yes, I used the deadline node from houdini and enabled the submit dependent v-ray standalone job option.

I run locally from a worker but I don’t know where to specify the vrscene output, thanks.

anthonygelatka · July 18, 2022, 9:36am

I don’t have time to check atm, but it’d be worth trying the export via the menu instead of the node. At worst submit the vrscene manually via Deadline Monitor

Sergic · July 18, 2022, 9:38am

No worries, you are a great help, I will try that thank you very much.

anthonygelatka · July 18, 2022, 3:17pm

I had a quick look at this, houdini 19.0.455 py3 with V-Ray 5.20.02 and Deadline 10.1.22.5

I created a spinning torus, added v-ray car paint, dome light and camera settings

Then dropped down a vray node and connected to both the (Vray) vrayDeadline node and a (Deadline) deadline1 node

The vrayDeadline and deadline1 nodes were both set to export locally and render the vrscene file, which they did no problem.

do you have backticks in the vray ROP which reference other things? seem to remember this causing issues elsewhere. Are you using the Fetch rop or do you have the output stuff in /obj or are you running this in Solaris?

I tried running both with the export via Deadline and they both failed, looks like a py version issue. Vray is being called by a packages json

2022-07-18 16:24:05:  0: INFO: Executable: "C:\Program Files\Side Effects Software\Houdini 19.0.455\bin\Hython.exe"
2022-07-18 16:24:05:  0: INFO: Argument: "C:\ProgramData\Thinkbox\Deadline10\workers\WS01\plugins\1234\hrender_dl.py" -f 5 5 1 -d /out/vray -tempdir "C:\ProgramData\Thinkbox\Deadline10\workers\WS01\jobsData\62d57acf71aa8fb094874788\0_temp3dpGr0" -arnoldAbortOnLicenseFail 1 "C:/Users/antg/vray_test/h19.0.455_vray_test.hipnc"
2022-07-18 16:24:05:  0: INFO: Full Command: "C:\Program Files\Side Effects Software\Houdini 19.0.455\bin\Hython.exe" "C:\ProgramData\Thinkbox\Deadline10\workers\WS01\plugins\123\hrender_dl.py" -f 5 5 1 -d /out/vray -tempdir "C:\ProgramData\Thinkbox\Deadline10\workers\ET-WS03\jobsData\1234\0_temp1234" -arnoldAbortOnLicenseFail 1 "C:/Users/antg/vray_test/h19.0.455_vray_test.hipnc"
2022-07-18 16:24:05:  0: INFO: Startup Directory: "C:\Program Files\Side Effects Software\Houdini 19.0.455\bin"
...
2022-07-18 16:24:06:  0: STDOUT: [2022/Jul/18|16:24:06] VFH |   Error| * Python evaluation error: "No module named 'vray'"

mois.moshev · July 18, 2022, 6:05pm

We use v-ray + houdini 19.0 quite a bit. It works great, in general.
The issue I think is the vray plugin installation on the worker.
You must install it the same way it is installed on your workstation.

anthonygelatka · July 19, 2022, 8:17am

Thanks @mois.moshev, I’m trying to see where it’s gone wrong for @Sergic, it looks like the export is missing so the vrscene doesn’t get picked up. For my submission it’s using the same machine, I’m testing on my laptop with repo, submission and worker all on the same machine.

I’m not sure why the deadline export doesn’t work, whether hython doesn’t pick up the json info or Deadline does something different.

mois.moshev · July 19, 2022, 8:57am

No, the error means that the python module “vray” could not be imported, which means that vray is not correctly installed on the worker. If using a json package, you should review that. Vray provides a new package template for python 3 Houdinis, btw.

Sergic · July 19, 2022, 11:06am

I am using the deadline node, but the vraydeadline node does not work or I do not know how to use it.

I have just a scene with a sphere with texture, I use Vray: 5.20.02, houdini 18.5.499 py2 and 10.1.22.5, at the moment I have installed the server and client in the same computer, I mean I run the submit locally, I have tried from the deadline monitor and no results.

FailRenderException : [2022/Jul/19|12:38:45] [84 MB] error: Error in file "Test_vray.vrscene", line 0: No file "C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\jobsData\62d685b362e4b10704490382\thread0_tempMPXsS0\Test_vray.vrscene" exists
   at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
  File "C:\ProgramData\Thinkbox\Deadline10\workers\Sergi-PC\plugins\62d685b362e4b10704490382\Vray.py", line 310, in handleStdoutError
    self.FailRender( self.GetRegexMatch( 0 ) )
   at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
   at __FranticX_Processes_ManagedProcess_StdoutHandlerDelegateDispatcher.Invoke()
   at FranticX.Processes.ManagedProcess.RegexHandlerCallback.CallFunction()
   at FranticX.Processes.ManagedProcess.e(String di, Boolean dj)
   at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)
   at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
   at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
   at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type
=======================================================
RenderPluginException

=======================================================
Stack Trace
=======================================================
   at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgj, CancellationToken bgk)
   at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
   at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajq, CancellationToken ajr)