Swap paths with houdini 19.5/Karma/Mantra

Sergic · December 2, 2022, 2:48pm

Hi, I am trying to change routes for my clients, but I have not been able to make any progress for some days…

I need a conversion of all the paths from A-Z to be converted to \ACRender_Sync, but it has not worked for me and I am a little lost.

Some users send their work from a drive application, some of them have it installed in C:\ACRender_Sync and F:\ACRender_Sync.

First user: The first thing I did is a test with this method, When I detect the houdini file from a HIP and job located in C:\ I have created the following rule for the nodes to access the server and have access to the local location, ok all this works correctly.

INFO: Set HOUDINI_PATHMAP to {"C:/ACRender_Sync":"//192.168.1.119/ACRender_Sync", "D:/ACRender_Sync":"//192.168.1.119/ACRender_Sync", "F:/ACRender_Sync":"//192.168.1.119/ACRender_Sync"}
2022-12-02 14:49:51:  0: INFO: Redshift Path Mapping...
2022-12-02 14:49:51:  0: INFO: source: "C:\ACRender_Sync" dest: "\\192.168.1.119\ACRender_Sync"
2022-12-02 14:49:51:  0: INFO: source: "D:\ACRender_Sync" dest: "\\192.168.1.119\ACRender_Sync"
2022-12-02 14:49:51:  0: INFO: source: "F:\ACRender_Sync" dest: "\\192.168.1.119\ACRender_Sync"

2022-12-02 14:49:51:  0: CheckPathMapping: Swapped "C:/ACRender_Sync/Project/RWD.LesanJoan.Ryzenator/Vfx/Houdini Reddit/Scripts/Joan/plano02/plano02 v03 shoot_timing.hip" with "\\192.168.1.119\ACRender_Sync/Project/RWD.LesanJoan.Ryzenator/Vfx/Houdini Reddit/Scripts/Joan/plano02/plano02 v03 shoot_timing.hip"
2022-12-02 14:50:02:  0: STDOUT: Setting variable "JOB" to \\192.168.1.119\ACRender_Sync/Project/RWD.LesanJoan.Ryzenator

2022-12-02 14:44:29:  0: CheckPathMapping: Swapped "D:/ACRender_Sync/Project/RWD.LesanJoan.Ryzenator/Vfx/Houdini Reddit/Scripts/Joan/plano04/plano04_franceses v32 NEW Gorro_poly.hip" with "\\192.168.1.119\ACRender_Sync/Project/RWD.LesanJoan.Ryzenator/Vfx/Houdini Reddit/Scripts/Joan/plano04/plano04_franceses v32 NEW Gorro_poly.hip"
2022-12-02 14:44:35:  0: STDOUT: Input File: //192.168.1.119/ACRender_Sync/Project/RWD.LesanJoan.Ryzenator/Vfx/Houdini Reddit/Scripts/Joan/plano04/plano04_franceses v32 NEW Gorro_poly.hip
2022-12-02 14:44:36:  0: STDOUT: Could not find node /obj/ipr_camera
2022-12-02 14:44:36:  0: STDOUT: Begin Path Mapping
2022-12-02 14:44:38:  0: STDOUT: b''
2022-12-02 14:44:40:  0: STDOUT: b''
2022-12-02 14:44:40:  0: STDOUT: Setting variable "JOB" to \\192.168.1.119\ACRender_Sync/Project/RWD.LesanJoan.Ryzenator
2022-12-02 14:44:40:  0: STDOUT: Setting variable "POSE" to \\192.168.1.119\ACRender_Sync\Project\RWD.LesanJoan.Ryzenator

Second User: But when a job comes from a F:drive it loads the scene and renders, but when it writes to file there is nothing.

As houdini doesn’t give much information in deadline I have compared the 2 logs but they are the same.

With the second test I found the F:\ disk problem but this setup does not work with the previous one.

What I did is to create a path that replaces F:\ to C:\ AND from C:\ to \192.168.1.119\ACRender_Sync
and it makes the change correctly and renders.

2022-12-02 01:46:50:  0: INFO: Set HOUDINI_PATHMAP to {"A:/":"C:/", "D:/":"C:/", "F:/":"C:/", "C:/ACRender_Sync":"//192.168.1.119/ACRender_Sync"}
2022-12-02 01:46:50:  0: INFO: Redshift Path Mapping...
2022-12-02 01:46:50:  0: INFO: source: "A:\" dest: "C:\"
2022-12-02 01:46:50:  0: INFO: source: "D:\" dest: "C:\"
2022-12-02 01:46:50:  0: INFO: source: "F:\" dest: "C:\"
2022-12-02 01:46:50:  0: INFO: source: "C:\ACRender_Sync" dest: "\\192.168.1.119\ACRender_Sync"
2022-12-02 01:46:50:  0: CheckPathMapping: Swapped "F:/ACRender_Sync/Project/RWD.Sergio.Alvarez.DESKTOP-861JA99/DEF_crowdsVelada_v02.hip" with "C:\ACRender_Sync/Project/RWD.Sergio.Alvarez.DESKTOP-861JA99/DEF_crowdsVelada_v02.hip"

jarak · December 2, 2022, 6:36pm

Hi,

Have you tried using the regex option?

e.g.:
path to replace: [A-Za-z]:\\ACRender_Sync\\
windows path: \\192.168.1.119\ACRender_Sync\

Sergic · December 2, 2022, 6:56pm

Hi thanks for the reply, I am quite new and did not know.

I will investigate it, that expression means that any route from A to Z convert it right ?

jarak · December 2, 2022, 7:28pm

Yes, the regular expression:

[A-Za-z]:\\ matches a single characater (upper|lower), colon, and backslash (have to escape the backslash with another backslash)

Sergic · December 2, 2022, 8:12pm

I tried to put the expression and I activated the regular expression option but it didn’t work…

=======================================================
Error
=======================================================
FailRenderException : Error: Caught exception: The attempted operation failed.
   at Deadline.Plugins.DeadlinePlugin.FailRender(String message) (Python.Runtime.PythonException)
  File "C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\plugins\638a5a1a0950611b54b51c95\Houdini.py", line 438, in HandleStdoutError
    self.FailRender(self.GetRegexMatch(1))
   at Python.Runtime.Dispatcher.Dispatch(ArrayList args)
   at __FranticX_Processes_ManagedProcess_StdoutHandlerDelegateDispatcher.Invoke()
   at FranticX.Processes.ManagedProcess.RegexHandlerCallback.CallFunction()
   at FranticX.Processes.ManagedProcess.e(String di, Boolean dj)
   at FranticX.Processes.ManagedProcess.Execute(Boolean waitForExit)
   at Deadline.Plugins.DeadlinePlugin.DoRenderTasks()
   at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)
   at Deadline.Plugins.PluginWrapper.RenderTasks(Task task, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type
=======================================================
RenderPluginException

=======================================================
Stack Trace
=======================================================
   at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgj, CancellationToken bgk)
   at Deadline.Plugins.SandboxedPlugin.RenderTask(Task task, CancellationToken cancellationToken)
   at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ajq, CancellationToken ajr)

=======================================================
Log
=======================================================
2022-12-02 21:05:26:  0: Render Thread - Render State transition from = 'ReceivedTask' to = 'Other'
2022-12-02 21:05:26:  0: Plugin will be reloaded because a new job has been loaded.
2022-12-02 21:05:26:  0: Loading Job's Plugin timeout is Disabled
2022-12-02 21:05:26:  0: SandboxedPlugin: Render Job As User disabled, running as current user 'AC-ND-MEDIUM-01'
2022-12-02 21:05:28:  0: Loaded plugin Houdini
2022-12-02 21:05:28:  0: Executing plugin command of type 'Initialize Plugin'
2022-12-02 21:05:28:  0: INFO: Executing plugin script 'C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\plugins\638a5a1a0950611b54b51c95\Houdini.py'
2022-12-02 21:05:28:  0: INFO: Plugin execution sandbox using Python version 3
2022-12-02 21:05:28:  0: INFO: About: Houdini Plugin for Deadline
2022-12-02 21:05:28:  0: INFO: The job's environment will be merged with the current environment before rendering
2022-12-02 21:05:28:  0: Done executing plugin command of type 'Initialize Plugin'
2022-12-02 21:05:28:  0: Start Job timeout is disabled.
2022-12-02 21:05:28:  0: Task timeout is disabled.
2022-12-02 21:05:28:  0: Loaded job: test - /out/KARMA_OUT (638a5a1a0950611b54b51c95)
2022-12-02 21:05:28:  0: Executing plugin command of type 'Start Job'
2022-12-02 21:05:28:  0: DEBUG: S3BackedCache Client is not installed.
2022-12-02 21:05:28:  0: INFO: Executing global asset transfer preload script 'C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\plugins\638a5a1a0950611b54b51c95\GlobalAssetTransferPreLoad.py'
2022-12-02 21:05:28:  0: INFO: Looking for legacy (pre-10.0.26) AWS Portal File Transfer...
2022-12-02 21:05:28:  0: INFO: Looking for legacy (pre-10.0.26) File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py...
2022-12-02 21:05:28:  0: INFO: Could not find legacy (pre-10.0.26) AWS Portal File Transfer.
2022-12-02 21:05:28:  0: INFO: Legacy (pre-10.0.26) AWS Portal File Transfer is not installed on the system.
2022-12-02 21:05:28:  0: Done executing plugin command of type 'Start Job'
2022-12-02 21:05:28:  0: Plugin rendering frame(s): 1
2022-12-02 21:05:28:  0: Render Thread - Render State transition from = 'Other' to = 'Rendering'
2022-12-02 21:05:29:  0: Executing plugin command of type 'Render Task'
2022-12-02 21:05:29:  0: INFO: Set HOUDINI_PATHMAP to {"[A-Za-z]://ACRender_Sync//":"//192.168.1.119/ACRender_Sync/"}
2022-12-02 21:05:29:  0: INFO: Redshift Path Mapping...
2022-12-02 21:05:29:  0: INFO: source: "[A-Za-z]:\\ACRender_Sync\\" dest: "\\192.168.1.119\ACRender_Sync\"
2022-12-02 21:05:29:  0: INFO: [REDSHIFT_PATHOVERRIDE_FILE] now set to: "C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\jobsData\638a5a1a0950611b54b51c95\RSMapping_tempnd7WM0\RSMapping.txt"
2022-12-02 21:05:29:  0: INFO: Starting Houdini Job
2022-12-02 21:05:29:  0: INFO: Stdout Redirection Enabled: True
2022-12-02 21:05:29:  0: INFO: Stdout Handling Enabled: True
2022-12-02 21:05:29:  0: INFO: Popup Handling Enabled: True
2022-12-02 21:05:29:  0: INFO: QT Popup Handling Enabled: False
2022-12-02 21:05:29:  0: INFO: WindowsForms10.Window.8.app.* Popup Handling Enabled: False
2022-12-02 21:05:29:  0: INFO: Using Process Tree: True
2022-12-02 21:05:29:  0: INFO: Hiding DOS Window: True
2022-12-02 21:05:29:  0: INFO: Creating New Console: False
2022-12-02 21:05:29:  0: INFO: Running as user: AC-ND-MEDIUM-01
2022-12-02 21:05:29:  0: INFO: Enforcing 64 bit build
2022-12-02 21:05:29:  0: INFO: Executable: "C:\Program Files\Side Effects Software\Houdini 19.5.303\bin\hython.exe"
2022-12-02 21:05:29:  0: INFO: Argument: "C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\plugins\638a5a1a0950611b54b51c95\hrender_dl.py" -f 1 1 1 -d /out/KARMA_OUT -tempdir "C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\jobsData\638a5a1a0950611b54b51c95\0_temp6zzmu0" -arnoldAbortOnLicenseFail 0 "D:/ACRender_Sync/SergiCendrero.Sergi-PC/Houdini/Karma/A Beautiful Game/P2_MantraToKarma_test.hip"
2022-12-02 21:05:29:  0: INFO: Full Command: "C:\Program Files\Side Effects Software\Houdini 19.5.303\bin\hython.exe" "C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\plugins\638a5a1a0950611b54b51c95\hrender_dl.py" -f 1 1 1 -d /out/KARMA_OUT -tempdir "C:\ProgramData\Thinkbox\Deadline10\workers\ND-MEDIUM-01\jobsData\638a5a1a0950611b54b51c95\0_temp6zzmu0" -arnoldAbortOnLicenseFail 0 "D:/ACRender_Sync/SergiCendrero.Sergi-PC/Houdini/Karma/A Beautiful Game/P2_MantraToKarma_test.hip"
2022-12-02 21:05:29:  0: INFO: Startup Directory: "C:\Program Files\Side Effects Software\Houdini 19.5.303\bin"
2022-12-02 21:05:29:  0: INFO: Process Priority: BelowNormal
2022-12-02 21:05:29:  0: INFO: Process Affinity: default
2022-12-02 21:05:29:  0: INFO: Process is now running
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         | log started Fri Dec  2 21:05:29 2022
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         | Arnold 7.1.3.1 [fdf4d417] windows clang-10.0.1 oiio-2.4.1 osl-1.12.0 vdb-7.1.1 adlsdk-6.3.1.44 clmhub-2.0.0.235 rlm-14.1.3 optix-6.6.0 2022/08/26 18:25:20
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         | running on ND-MEDIUM-01, pid=4404
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         |  1 x 12th Gen Intel(R) Core(TM) i7-12700K (20 cores, 20 logical) with 65349MB
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         |  NVIDIA driver version 526.98 (Optix 60805)
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         |  GPU 0: NVIDIA GeForce RTX 3070 @ 1725MHz (compute 8.6) with 8191MB (8032MB available) (NVLink:0)
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         |  GPU 1: NVIDIA GeForce RTX 3070 @ 1755MHz (compute 8.6) with 8191MB (7649MB available) (NVLink:0)
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         |  Windows 10 (version 10.0, build 22621)
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         |  soft limit for open files changed from 8192 to 2048
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   427MB         |  
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   446MB         | [color_manager_ocio] default ocio.config found in C:\Users\AC-ND-BASIC-03\htoa\htoa-6.1.3.2_r2bc6797_houdini-19.5.303.py37\htoa-6.1.3.2_r2bc6797_houdini-19.5.303.py37\scripts\bin\../ocio/configs/arnold/config.ocio
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   446MB         | loading plugins from C:\Users\AC-ND-BASIC-03\htoa\htoa-6.1.3.2_r2bc6797_houdini-19.5.303.py37\htoa-6.1.3.2_r2bc6797_houdini-19.5.303.py37\scripts\bin\..\plugins ...
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   446MB         |  alembic_proc.dll: alembic uses Arnold 7.1.3.1
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   446MB         |  cryptomatte.dll: cryptomatte uses Arnold 7.1.3.1
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   446MB         |  cryptomatte.dll: cryptomatte_filter uses Arnold 7.1.3.1
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   446MB         |  cryptomatte.dll: cryptomatte_manifest_driver uses Arnold 7.1.3.1
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   446MB         |  htoa_mandelbulb_proc.dll: mandelbulb uses Arnold 7.1.3.1
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   456MB         |  usd_proc.dll: usd uses Arnold 7.1.3.1
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   456MB         | loaded 6 plugins from 4 lib(s) in 0:00.07
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   458MB         | [htoa_op] Begin registration ...
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   459MB         | [obj_procedurals] Registering procedurals ...
2022-12-02 21:05:31:  0: STDOUT: 00:00:01   465MB         | [obj_procedurals] procedural registration done.
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Redshift for Houdini plugin version 3.5.8 (Sep  2 2022 15:35:51)
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Plugin compile time HDK version: 19.5.303
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Houdini host version: 19.5.303
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Plugin dso/dll and config path: C:/ProgramData/Redshift/Plugins/Houdini/19.5.303/dso
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Core data path: C:\ProgramData\Redshift
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Local data path: C:\ProgramData\Redshift
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Procedurals path: C:\ProgramData\Redshift\Procedurals
2022-12-02 21:05:32:  0: STDOUT: [Redshift] Preferences file path: C:\ProgramData\Redshift\preferences.xml
2022-12-02 21:05:32:  0: STDOUT: [Redshift] License path: C:\ProgramData\Redshift
2022-12-02 21:05:32:  0: STDOUT: 00:00:03   567MB         | [rop_operators] Registering operators ...
2022-12-02 21:05:32:  0: STDOUT: 00:00:03   567MB         | [rop_operators] operator registration done.
2022-12-02 21:05:32:  0: STDOUT: 00:00:03   631MB         | [vop_shaders] Registering shaders ...
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   635MB         | [vop_shaders] shader registration done.
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   635MB         | [vop_imagers] Registering imagers ...
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   635MB         | [vop_imagers] imager registration done.
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   635MB         | [htoa_op] USD shader translation registration
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   652MB         | [htoa_op] End registration.
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   652MB         |  
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   652MB         | releasing resources
2022-12-02 21:05:33:  0: STDOUT: 00:00:03   631MB         | Arnold shutdown
2022-12-02 21:05:35:  0: STDOUT: Detected Houdini version: (19, 5, 303)
2022-12-02 21:05:35:  0: STDOUT: ['C:\\ProgramData\\Thinkbox\\Deadline10\\workers\\ND-MEDIUM-01\\plugins\\638a5a1a0950611b54b51c95\\hrender_dl.py', '-f', '1', '1', '1', '-d', '/out/KARMA_OUT', '-tempdir', 'C:\\ProgramData\\Thinkbox\\Deadline10\\workers\\ND-MEDIUM-01\\jobsData\\638a5a1a0950611b54b51c95\\0_temp6zzmu0', '-arnoldAbortOnLicenseFail', '0', 'D:/ACRender_Sync/SergiCendrero.Sergi-PC/Houdini/Karma/A Beautiful Game/P2_MantraToKarma_test.hip']
2022-12-02 21:05:35:  0: STDOUT: Start: 1
2022-12-02 21:05:35:  0: STDOUT: End: 1
2022-12-02 21:05:35:  0: STDOUT: Increment: 1
2022-12-02 21:05:35:  0: STDOUT: Ignore Inputs: False
2022-12-02 21:05:35:  0: STDOUT: No output specified. Output will be handled by the driver
2022-12-02 21:05:35:  0: STDOUT: Driver: /out/KARMA_OUT
2022-12-02 21:05:35:  0: STDOUT: Input File: D:/ACRender_Sync/SergiCendrero.Sergi-PC/Houdini/Karma/A Beautiful Game/P2_MantraToKarma_test.hip
2022-12-02 21:05:35:  0: Done executing plugin command of type 'Render Task'

jarak · December 2, 2022, 10:31pm

I think you need to disable the Houdini path mapping in the plugin:

Monitor → Configure plugins → Houdini → Path Mapping → Enable Path Mapping False

Otherwise, Houdini will try to path map via HOUDINI_PATHMAP instead of deadline path mapping . (I think that’s how it works)…

Sergic · December 3, 2022, 8:18am

Good morning, thank you very much for the help, when I disable the option from the houdini plugin, when I send a job, it doesn’t write any route anymore, when I have
[A-Za-z]:\ACRender_Sync with regular expression, if I put a normal one if it continues to do the swapping.

Sergic · December 5, 2022, 9:52am

I have already solved it, the first way works, the problem is that when the client sent the job it was confused of $JOB, THANK YOU.