AWS Thinkbox Discussion Forums

Vdenoise problems with image sequences

I actually have a post about using vdenoise back last year, but now that I’ve had a chance to use it in Deadline 10, I’m still at an impasse on how to use this tool.

How do you use the submitter?

If I submit like this:


I get ONE image denoised (the frame I specified, re-rendered 170 times)

if I submit like this:


I get this error:

The same error happens if I submit with #### marks.

Your manual says “Input Image(s): Specify the input .vrimg or .exr file; can contain wildcards, f.e. c:\path\to\files\sequence_???.exr to denoise a sequence of frames.”

Good question! I dug into the plugin (only 95 lines!), and it looks like we just pass the straight output path in, along with “-frames=X-Y” to the denoiser.

From this guide, your “???” seems like the right way to go:
docs.chaosgroup.com/display/VRA … C+vdenoise

The only idea I have right now as to why it’s claiming the files aren’t there is that “UseFrames” isn’t making it through. You’ve got it checked there.

Do you want to send the whole job report? We’re just looking for “-frames” in the “Full Command” line though, so you can just check that yourself if you like.

I’ll just past it here since the job log isn’t very big

=======================================================
Error
=======================================================
Error: Renderer returned non-zero error code, 3. Check the log for more information.
   at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)

=======================================================
Type
=======================================================
RenderPluginException

=======================================================
Stack Trace
=======================================================
   at Deadline.Plugins.Plugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
   at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ahp)

=======================================================
Log
=======================================================
2018-02-16 12:25:25:  0: Loading Job's Plugin timeout is Disabled
2018-02-16 12:25:25:  0: Loaded plugin VDenoise
2018-02-16 12:25:25:  0: INFO: Executing plugin script 'C:\Users\quberender\AppData\Local\Thinkbox\Deadline10\slave\render60\plugins\5a8713f8f117f630f04148ac\VDenoise.py'
2018-02-16 12:25:25:  0: INFO: About: VDenoise Plugin for Deadline
2018-02-16 12:25:25:  0: INFO: Render Job As User disabled, running as current user 'quberender'
2018-02-16 12:25:25:  0: INFO: The job's environment will be merged with the current environment before rendering
2018-02-16 12:25:25:  0: Start Job timeout is disabled.
2018-02-16 12:25:25:  0: Task timeout is disabled.
2018-02-16 12:25:25:  0: Loaded job: Untitled (5a8713f8f117f630f04148ac)
2018-02-16 12:25:25:  0: INFO: Executing global asset transfer preload script 'C:\Users\quberender\AppData\Local\Thinkbox\Deadline10\slave\render60\plugins\5a8713f8f117f630f04148ac\GlobalAssetTransferPreLoad.py'
2018-02-16 12:25:25:  0: INFO: Looking for AWS Portal File Transfer...
2018-02-16 12:25:25:  0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py...
2018-02-16 12:25:25:  0: INFO: Could not find AWS Portal File Transfer.
2018-02-16 12:25:25:  0: INFO: AWS Portal File Transfer is not installed on the system.
2018-02-16 12:25:25:  0: INFO: Executing global job preload script 'C:\Users\quberender\AppData\Local\Thinkbox\Deadline10\slave\render60\plugins\5a8713f8f117f630f04148ac\GlobalJobPreLoad.py'
2018-02-16 12:25:25:  0: INFO: Looking for AWS Portal File Transfer...
2018-02-16 12:25:25:  0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py...
2018-02-16 12:25:25:  0: INFO: Could not find AWS Portal File Transfer.
2018-02-16 12:25:25:  0: INFO: AWS Portal File Transfer is not installed on the system.
2018-02-16 12:25:25:  0: Plugin rendering frame(s): 15
2018-02-16 12:25:25:  0: INFO: Stdout Redirection Enabled: True
2018-02-16 12:25:25:  0: INFO: Stdout Handling Enabled: True
2018-02-16 12:25:25:  0: INFO: Popup Handling Enabled: False
2018-02-16 12:25:25:  0: INFO: Using Process Tree: True
2018-02-16 12:25:25:  0: INFO: Hiding DOS Window: True
2018-02-16 12:25:25:  0: INFO: Creating New Console: False
2018-02-16 12:25:25:  0: INFO: Running as user: quberender
2018-02-16 12:25:25:  0: INFO: Executable: "C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin\vdenoise.exe"
2018-02-16 12:25:25:  0: INFO: Argument: -display=0 -inputFile="\\prod\class\rhagen\noise_test\beauty_2\Shot_0050.????.exr" -mode=Strong -boost=1 -frames=15-15 -threshold=0.01 -strength=0.5 -radius=3.0 -frameBlend=4 -strips=-1 
2018-02-16 12:25:25:  0: INFO: Full Command: "C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin\vdenoise.exe" -display=0 -inputFile="\\prod\class\rhagen\noise_test\beauty_2\Shot_0050.????.exr" -mode=Strong -boost=1 -frames=15-15 -threshold=0.01 -strength=0.5 -radius=3.0 -frameBlend=4 -strips=-1 
2018-02-16 12:25:25:  0: INFO: Startup Directory: "C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin"
2018-02-16 12:25:25:  0: INFO: Process Priority: BelowNormal
2018-02-16 12:25:25:  0: INFO: Process Affinity: default
2018-02-16 12:25:25:  0: INFO: Process is now running
2018-02-16 12:25:25:  0: STDOUT: V-Ray Denoiser tool for denoising still images and image sequences.
2018-02-16 12:25:25:  0: STDOUT: Copyright (C) 2016-2017 by Chaos Group Ltd. All rights reserved.
2018-02-16 12:25:25:  0: STDOUT: Build from Sep 11 2017
2018-02-16 12:25:25:  0: STDOUT: Using radius 3, strength 0.75 and threshold 0.01
2018-02-16 12:25:25:  0: STDOUT: No files found matching "\\prod\class\rhagen\noise_test\beauty_2\Shot_0050.????.exr"
2018-02-16 12:25:25:  0: INFO: Process exit code: 3
2018-02-16 12:25:25:  0: An exception occurred: Error: Renderer returned non-zero error code, 3. Check the log for more information.
2018-02-16 12:25:25:     at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel) (Deadline.Plugins.RenderPluginException)

=======================================================
Details
=======================================================
Date: 02/16/2018 12:25:27
Frames: 15
Elapsed Time: 00:00:00:02
Job Submit Date: 02/16/2018 12:25:13
Job User: rhagen
Average RAM Usage: 4636962816 (4%)
Peak RAM Usage: 4636962816 (4%)
Average CPU Usage: 0%
Peak CPU Usage: 0%
Used CPU Clocks (x10^6 cycles): 0
Total CPU Clocks (x10^6 cycles): 56954

=======================================================
Slave Information
=======================================================
Slave Name: render60
Version: v10.0.10.3 Release (a93ce690b)
Operating System: Windows 81 Enterprise

If I specify a specific frame, I get this

[code]=======================================================
Log

2018-02-16 12:29:20: 0: Plugin already loaded: VDenoise
2018-02-16 12:29:20: 0: Start Job timeout is disabled.
2018-02-16 12:29:20: 0: Task timeout is disabled.
2018-02-16 12:29:20: 0: Job already loaded: Untitled
2018-02-16 12:29:20: 0: Plugin rendering frame(s): 170
2018-02-16 12:29:20: 0: INFO: Stdout Redirection Enabled: True
2018-02-16 12:29:20: 0: INFO: Stdout Handling Enabled: True
2018-02-16 12:29:20: 0: INFO: Popup Handling Enabled: False
2018-02-16 12:29:20: 0: INFO: Using Process Tree: True
2018-02-16 12:29:20: 0: INFO: Hiding DOS Window: True
2018-02-16 12:29:20: 0: INFO: Creating New Console: False
2018-02-16 12:29:20: 0: INFO: Running as user: quberender
2018-02-16 12:29:20: 0: INFO: Executable: “C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin\vdenoise.exe”
2018-02-16 12:29:20: 0: INFO: Argument: -display=0 -inputFile="\prod\class\rhagen\noise_test\beauty_2\Shot_0050.0001.exr" -mode=Strong -boost=1 -frames=170-170 -threshold=0.01 -strength=0.5 -radius=3.0 -frameBlend=4 -strips=-1
2018-02-16 12:29:20: 0: INFO: Full Command: “C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin\vdenoise.exe” -display=0 -inputFile="\prod\class\rhagen\noise_test\beauty_2\Shot_0050.0001.exr" -mode=Strong -boost=1 -frames=170-170 -threshold=0.01 -strength=0.5 -radius=3.0 -frameBlend=4 -strips=-1
2018-02-16 12:29:20: 0: INFO: Startup Directory: “C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin”
2018-02-16 12:29:20: 0: INFO: Process Priority: BelowNormal
2018-02-16 12:29:20: 0: INFO: Process Affinity: default
2018-02-16 12:29:20: 0: INFO: Process is now running
2018-02-16 12:29:20: 0: STDOUT: V-Ray Denoiser tool for denoising still images and image sequences.
2018-02-16 12:29:20: 0: STDOUT: Copyright © 2016-2017 by Chaos Group Ltd. All rights reserved.
2018-02-16 12:29:20: 0: STDOUT: Build from Sep 11 2017
2018-02-16 12:29:20: 0: STDOUT: Using radius 3, strength 0.75 and threshold 0.01
2018-02-16 12:29:20: 0: INFO: Process exit code: 0
2018-02-16 12:29:20: 0: Render time for frame(s): 1.000 s
2018-02-16 12:29:20: 0: Total time for task: 757.654 ms
2018-02-16 12:29:21: 0: Saving task log…

=======================================================
Details

Date: 02/16/2018 12:29:21
Frames: 170
Job Submit Date: 02/16/2018 12:29:00
Job User: rhagen
Average RAM Usage: 0 (0%)
Peak RAM Usage: 0 (0%)
Average CPU Usage: 0%
Peak CPU Usage: 0%
Used CPU Clocks (x10^6 cycles): 0
Total CPU Clocks (x10^6 cycles): 0

=======================================================
Slave Information

Slave Name: RENDER01
Version: v10.0.10.3 Release (a93ce690b)
Operating System: Windows 81 Enterprise
[/code]

and then on another machine, I get the same frame rendered… this happens over and over (for as many times as I specified in the frame range), overwriting the same file each time.

[code]=======================================================
Log

2018-02-16 12:29:19: 0: Plugin already loaded: VDenoise
2018-02-16 12:29:19: 0: Start Job timeout is disabled.
2018-02-16 12:29:19: 0: Task timeout is disabled.
2018-02-16 12:29:19: 0: Job already loaded: Untitled
2018-02-16 12:29:19: 0: Plugin rendering frame(s): 169
2018-02-16 12:29:19: 0: INFO: Stdout Redirection Enabled: True
2018-02-16 12:29:19: 0: INFO: Stdout Handling Enabled: True
2018-02-16 12:29:19: 0: INFO: Popup Handling Enabled: False
2018-02-16 12:29:19: 0: INFO: Using Process Tree: True
2018-02-16 12:29:19: 0: INFO: Hiding DOS Window: True
2018-02-16 12:29:19: 0: INFO: Creating New Console: False
2018-02-16 12:29:19: 0: INFO: Running as user: quberender
2018-02-16 12:29:19: 0: INFO: Executable: “C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin\vdenoise.exe”
2018-02-16 12:29:19: 0: INFO: Argument: -display=0 -inputFile="\prod\class\rhagen\noise_test\beauty_2\Shot_0050.0001.exr" -mode=Strong -boost=1 -frames=169-169 -threshold=0.01 -strength=0.5 -radius=3.0 -frameBlend=4 -strips=-1
2018-02-16 12:29:19: 0: INFO: Full Command: “C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin\vdenoise.exe” -display=0 -inputFile="\prod\class\rhagen\noise_test\beauty_2\Shot_0050.0001.exr" -mode=Strong -boost=1 -frames=169-169 -threshold=0.01 -strength=0.5 -radius=3.0 -frameBlend=4 -strips=-1
2018-02-16 12:29:19: 0: INFO: Startup Directory: “C:\Program Files\Chaos Group\V-Ray\Maya 2017 for x64\bin”
2018-02-16 12:29:19: 0: INFO: Process Priority: BelowNormal
2018-02-16 12:29:19: 0: INFO: Process Affinity: default
2018-02-16 12:29:19: 0: INFO: Process is now running
2018-02-16 12:29:19: 0: STDOUT: V-Ray Denoiser tool for denoising still images and image sequences.
2018-02-16 12:29:19: 0: STDOUT: Copyright © 2016-2017 by Chaos Group Ltd. All rights reserved.
2018-02-16 12:29:19: 0: STDOUT: Build from Sep 11 2017
2018-02-16 12:29:19: 0: STDOUT: Using radius 3, strength 0.75 and threshold 0.01
2018-02-16 12:29:20: 0: INFO: Process exit code: 0
2018-02-16 12:29:20: 0: Render time for frame(s): 1.000 s
2018-02-16 12:29:20: 0: Total time for task: 691.901 ms
2018-02-16 12:29:21: 0: Saving task log…

=======================================================
Details

Date: 02/16/2018 12:29:21
Frames: 169
Job Submit Date: 02/16/2018 12:29:00
Job User: rhagen
Average RAM Usage: 0 (0%)
Peak RAM Usage: 0 (0%)
Average CPU Usage: 0%
Peak CPU Usage: 0%
Used CPU Clocks (x10^6 cycles): 0
Total CPU Clocks (x10^6 cycles): 0

=======================================================
Slave Information

Slave Name: render39
Version: v10.0.10.3 Release (a93ce690b)
Operating System: Windows 81 Enterprise

[/code]

Note that I have tried vdenoise locally with the command line and it will never work for me using the ??? variable. Chaosgroup support just shrugged their shoulders and said it worked for them.

From what I’m seeing the error makes perfect sense. I’m telling to render a file called “Shot_0050.???.exr” which doesn’t exist. I’d get the same error with any filename that doesn’t exist on disk. Vdenoise is supposed to translate that ??? into a number based on the frame sequence value but it isn’t.

So, while this is Chaosgroup’s bug, is there a way your submitter could work around it?

What EXACT version of VDenoise are you using here? Perhaps Chaos Group changed the logic in their latest release? Are you using that version?

I’m using 3.6 of Vray - specifically release “36001”

I’m still thinking it is user error, but I have zero idea what I’m doing wrong.

Has anyone else actually gotten this tool to denoise a sequence?

Here’s me trying to do this locally, using the simplest instruction as shown on their page.

[code]C:\Program Files\Chaos Group\V-Ray\Maya 2018 for x64\bin>vdenoise -inputFile=“Z:
\rhagen\noise_test\beauty_2\Shot_0050.???.exr”
V-Ray Denoiser tool for denoising still images and image sequences.
Copyright © 2016-2017 by Chaos Group Ltd. All rights reserved.
Build from Sep 11 2017

Using radius 10, strength 1 and threshold 0.001
No files found matching “Z:\rhagen\noise_test\beauty_2\Shot_0050.???.exr”

C:\Program Files\Chaos Group\V-Ray\Maya 2018 for x64\bin>[/code]

quote from their page:

well, whatever - not a major issue… just annoying.

I suppose we could walk over each frame ourselves and just call VDenoise over each one… I’d really rather it just worked though. :smiley:

It does work - just did another test to re-confirm. I’ve poured over this thread but I can’t crack it either. Only thought is that maybe the exr’s are multilayer or don’t have the prerequisite channels TO denoise?

I specified a file name, replaced the frames with .???. and then changed frames from 0-150

[code]Log

2018-02-21 07:16:52: 0: Start Job timeout is disabled.
2018-02-21 07:16:52: 0: Task timeout is disabled.
2018-02-21 07:16:52: 0: Plugin rendering frame(s): 2
2018-02-21 07:16:52: 0: Executing plugin command of type ‘Render Task’
2018-02-21 07:16:52: 0: INFO: Stdout Redirection Enabled: True
2018-02-21 07:16:52: 0: INFO: Stdout Handling Enabled: True
2018-02-21 07:16:52: 0: INFO: Popup Handling Enabled: False
2018-02-21 07:16:52: 0: INFO: Using Process Tree: True
2018-02-21 07:16:52: 0: INFO: Hiding DOS Window: True
2018-02-21 07:16:52: 0: INFO: Creating New Console: False
2018-02-21 07:16:52: 0: INFO: Running as user: SuperWorkstation
2018-02-21 07:16:52: 0: INFO: Executable: “C:\Program Files\Chaos Group\V-Ray\V-Ray for SketchUp\extension\tools\vdenoise.exe”
2018-02-21 07:16:52: 0: INFO: Argument: -display=0 -inputFile=“O:\N-Lab Temp\test_draft_SKP.???.exr” -mode=Default -boost=0 -frames=2-2 -skipExisting=1 -useGpu=1 -frameBlend=2 -strips=-1
2018-02-21 07:16:52: 0: INFO: Full Command: “C:\Program Files\Chaos Group\V-Ray\V-Ray for SketchUp\extension\tools\vdenoise.exe” -display=0 -inputFile=“O:\N-Lab Temp\test_draft_SKP.???.exr” -mode=Default -boost=0 -frames=2-2 -skipExisting=1 -useGpu=1 -frameBlend=2 -strips=-1
2018-02-21 07:16:52: 0: INFO: Startup Directory: “C:\Program Files\Chaos Group\V-Ray\V-Ray for SketchUp\extension\tools”
2018-02-21 07:16:52: 0: INFO: Process Priority: BelowNormal
2018-02-21 07:16:52: 0: INFO: Process Affinity: default
2018-02-21 07:16:52: 0: INFO: Process is now running
2018-02-21 07:16:52: 0: STDOUT: V-Ray Denoiser tool for denoising still images and image sequences.
2018-02-21 07:16:52: 0: STDOUT: Copyright © 2016-2017 by Chaos Group Ltd. All rights reserved.
2018-02-21 07:16:52: 0: STDOUT: Build from Feb 9 2018
2018-02-21 07:16:52: 0: STDOUT: Using radius 10, strength 1 and threshold 0.001
2018-02-21 07:16:52: 0: STDOUT: VDenoise: Using device 0: GeForce GTX 980 Ti
2018-02-21 07:16:52: 0: STDOUT: VDenoise: Driver version 390.65
2018-02-21 07:16:52: 0: STDOUT: VDenoise: OpenCL compiled successfuly
2018-02-21 07:16:52: 0: STDOUT: Denoising 151 file(s), blending 5 frame(s).
2018-02-21 07:16:52: 0: STDOUT: Reading file “O:\N-Lab Temp\test_draft_SKP.0002.exr”
2018-02-21 07:16:55: 0: STDOUT: File read successfully.
2018-02-21 07:16:55: 0: STDOUT: Reading file “O:\N-Lab Temp\test_draft_SKP.0000.exr”
2018-02-21 07:16:57: 0: STDOUT: File read successfully.
2018-02-21 07:16:57: 0: STDOUT: Reading file “O:\N-Lab Temp\test_draft_SKP.0001.exr”
2018-02-21 07:17:00: 0: STDOUT: File read successfully.
2018-02-21 07:17:00: 0: STDOUT: Reading file “O:\N-Lab Temp\test_draft_SKP.0003.exr”
2018-02-21 07:17:03: 0: STDOUT: File read successfully.
2018-02-21 07:17:03: 0: STDOUT: Reading file “O:\N-Lab Temp\test_draft_SKP.0004.exr”
2018-02-21 07:17:06: 0: STDOUT: File read successfully.
2018-02-21 07:17:07: 0: STDOUT: Denoising RGB color
2018-02-21 07:17:09: 0: STDOUT: Denoising RGB color… 10.0 %
2018-02-21 07:17:10: 0: STDOUT: Denoising RGB color… 20.0 %
2018-02-21 07:17:12: 0: STDOUT: Denoising RGB color… 30.0 %
2018-02-21 07:17:14: 0: STDOUT: Denoising RGB color… 40.0 %
2018-02-21 07:17:16: 0: STDOUT: Denoising RGB color… 50.0 %
2018-02-21 07:17:17: 0: STDOUT: Denoising RGB color… 60.0 %
2018-02-21 07:17:19: 0: STDOUT: Denoising RGB color… 70.0 %
2018-02-21 07:17:21: 0: STDOUT: Denoising RGB color… 80.0 %
2018-02-21 07:17:23: 0: STDOUT: Denoising RGB color… 90.0 %
2018-02-21 07:17:24: 0: STDOUT: Denoising RGB color… 100.0 %
2018-02-21 07:17:24: 0: STDOUT: Denoising RGB color… done
2018-02-21 07:17:24: 0: STDOUT: Denoising complete in 18.28 s
2018-02-21 07:17:24: 0: STDOUT: Writing image file “O:\N-Lab Temp\test_draft_SKP_denoised_ocl.0002.exr”
2018-02-21 07:17:25: 0: STDOUT: File written successfully.
2018-02-21 07:17:25: 0: STDOUT: Denoising took: 17.278000s
2018-02-21 07:17:25: 0: INFO: Process exit code: 0
2018-02-21 07:17:25: 0: Done executing plugin command of type ‘Render Task’[/code]

EDIT: OH OH! I BET ITS CAUSE YOU HAVE A SERIES OF NUMBERS AS PART OF THE FRAME NAME! I’VE RUN ACROSS THIS ISSUE ALONG TIME AGO WHEN WE WERE FIRST GETTING VRSCENES WORKING. TRY A BATCH CHANGE SO THATS ITS ALL LETTERS AND THE ONLY NUMBERS ARE FRAME NUMBERS (IE SUPERCOOLFRAMES.0150.EXR)

There’s an idea… Want to submit that over to the CG side? We’re just passing these arguments in verbatim and they should fix this for everyone (not just users of Deadline). If not, the fallback plan is still possible.

So that’s why! I knew it was something simple. I’ll certainly tell support about this bug. :stuck_out_tongue:

I just tested it and yes, it totally works. Numbers are not allowed in your filename if you want to use vray denoiser. :astonished:

Nice! Good work guys. I’ve opened an issue here so we can track it internally over here as well. I’ll rename the thread as I do.

In testing I found that if I move the sequence to a different file server, it works as described.

However, it don’t see how it could be file permissions because it will work in both locations if I do the frame on its own (i.e. sequence.0001.exr works, instead of sequence.???.exr). Additionally, I have tried running vdenoise as an administrator and it doesn’t change anything either.

I have a ticket with chaosgroup to see what becomes of this weirdness.

Both file servers are running ZFS and both have the permissions set to Open Access (i.e. - everyone> full control permissions).

How are you exporting your ZFS volumes? I’ve played with about every configuration there over the years (Kernel NFS/SMB on Solaris, SMB on FreeBSD, Samba on Linux). I wonder if there’s something on the serving side that might be different.

Only thing I can think of is that the OmniOS version is a bit newer, but that’s about it. They’re set up the same way without any unique features. Both are using SMB, but I’d have to see if the versions of those are different - that’s about all I can think of.

Privacy | Site terms | Cookie preferences