AWS Thinkbox Discussion Forums

Deadlinecommand does not work with Draft submissions

Deadline
#1

I am using the plugin Draft to turn a dpx sequence into a low-rez mov. I’d like to automate this process with our studio’s internal tools. The trouble is, when I use deadlinecommand to submit a draft job the render fails.
We are using Deadline 10.0, on Linux.

If I submit manually, through Deadline, then Draft renders the MOV just fine on the same computer. Even if I use the exact same draft_job_info.job and draft_plugin_info.job files, deadlinecommand submits ok but fails when rendering.

Here is the terminal command I am submitting with:

/opt/Thinkbox/Deadline10/bin/deadlinecommand “/home/admin/Thinkbox/Deadline10/temp/draft_job_info.job” “/home/admin/Thinkbox/Deadline10/temp/draft_plugin_info.job”

This is the output I get from the failed job:

=======================================================
Type

RenderPluginException

=======================================================
Stack Trace

at Deadline.Plugins.SandboxedPlugin.d (Deadline.Net.DeadlineMessage aoa) [0x00242] in :0
at Deadline.Plugins.SandboxedPlugin.RenderTask (System.String taskId, System.Int32 startFrame, System.Int32 endFrame) [0x000df] in :0
at Deadline.Slaves.SlaveRenderThread.c (Deadline.IO.TaskLogWriter aek) [0x00718] in :0

=======================================================
Log

2019-01-18 12:50:38: 0: Loading Job’s Plugin timeout is Disabled
2019-01-18 12:50:39: 0: Executing plugin command of type ‘Sync Files for Job’
2019-01-18 12:50:39: 0: All job files are already synchronized
2019-01-18 12:50:39: 0: Plugin DraftPlugin was already synchronized.
2019-01-18 12:50:39: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-01-18 12:50:39: 0: Executing plugin command of type ‘Initialize Plugin’
2019-01-18 12:50:39: 0: INFO: Executing plugin script ‘/home/admin/Thinkbox/Deadline10/slave/fwfxlnx009/plugins/5c423b115a35a264d1c54e79/DraftPlugin.py’
2019-01-18 12:50:39: 0: INFO: Found Draft python module at: ‘/home/admin/Thinkbox/Deadline10/slave/fwfxlnx009/Draft/Draft.so’
2019-01-18 12:50:39: 0: INFO: About: Draft Plugin for Deadline
2019-01-18 12:50:39: 0: INFO: Render Job As User disabled, running as current user ‘admin’
2019-01-18 12:50:39: 0: INFO: The job’s environment will be merged with the current environment before rendering
2019-01-18 12:50:39: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-01-18 12:50:39: 0: Start Job timeout is disabled.
2019-01-18 12:50:39: 0: Task timeout is disabled.
2019-01-18 12:50:39: 0: Loaded job: MyFile (5c423b115a35a264d1c54e79)
2019-01-18 12:50:39: 0: Executing plugin command of type ‘Start Job’
2019-01-18 12:50:39: 0: INFO: Executing global asset transfer preload script ‘/home/admin/Thinkbox/Deadline10/slave/fwfxlnx009/plugins/5c423b115a35a264d1c54e79/GlobalAssetTransferPreLoad.py’
2019-01-18 12:50:39: 0: INFO: Looking for AWS Portal File Transfer…
2019-01-18 12:50:39: 0: INFO: Looking for File Transfer controller in /opt/Thinkbox/S3BackedCache/bin/task.py…
2019-01-18 12:50:39: 0: INFO: Could not find AWS Portal File Transfer.
2019-01-18 12:50:39: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-01-18 12:50:39: 0: Done executing plugin command of type ‘Start Job’
2019-01-18 12:50:39: 0: Plugin rendering frame(s): 1001-1013
2019-01-18 12:50:40: 0: Executing plugin command of type ‘Render Task’
2019-01-18 12:50:40: 0: INFO: Draft job starting…
2019-01-18 12:50:40: 0: INFO: Stdout Redirection Enabled: True
2019-01-18 12:50:40: 0: INFO: Asynchronous Stdout Enabled: False
2019-01-18 12:50:40: 0: INFO: Stdout Handling Enabled: True
2019-01-18 12:50:40: 0: INFO: Popup Handling Enabled: False
2019-01-18 12:50:40: 0: INFO: Using Process Tree: True
2019-01-18 12:50:40: 0: INFO: Hiding DOS Window: True
2019-01-18 12:50:40: 0: INFO: Creating New Console: False
2019-01-18 12:50:40: 0: INFO: Running as user: admin
2019-01-18 12:50:40: 0: INFO: Looking for bundled python at: ‘/opt/Thinkbox/Deadline10/bin/dpython’
2019-01-18 12:50:40: 0: INFO: Executable: “/opt/Thinkbox/Deadline10/bin/dpython”
2019-01-18 12:50:40: 0: INFO: Argument: -u “” resolution=“0.25” codec=“h264” colorSpaceIn=“Draft AlexaV3LogC” colorSpaceOut=“Draft AlexaV3LogC” annotationsFilePath="“None”" annotationsImageString=“None” annotationsResWidthString=“None” annotationsResWidthString=“None” annotationsFramePaddingSize=“None” quality=“85” frameRate=“23.976” quickType=“createMovie” isDistributed=“False” frameList=1001-1013 startFrame=1001 endFrame=1013 outFolder="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/Draft" outFile="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/Draft/TH_205_536_210_BG.mov" inFile="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/TH_205_536_210_BG.#######.dpx" deadlineRepository="/net/isilon.lan/ifs/library/deadline/DeadlineRepository10/DeadlineRepository10" taskStartFrame=1001 taskEndFrame=1013
2019-01-18 12:50:40: 0: INFO: Full Command: “/opt/Thinkbox/Deadline10/bin/dpython” -u “” resolution=“0.25” codec=“h264” colorSpaceIn=“Draft AlexaV3LogC” colorSpaceOut=“Draft AlexaV3LogC” annotationsFilePath="“None”" annotationsImageString=“None” annotationsResWidthString=“None” annotationsResWidthString=“None” annotationsFramePaddingSize=“None” quality=“85” frameRate=“23.976” quickType=“createMovie” isDistributed=“False” frameList=1001-1013 startFrame=1001 endFrame=1013 outFolder="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/Draft" outFile="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/Draft/TH_205_536_210_BG.mov" inFile="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/TH_205_536_210_BG.#######.dpx" deadlineRepository="/net/isilon.lan/ifs/library/deadline/DeadlineRepository10/DeadlineRepository10" taskStartFrame=1001 taskEndFrame=1013
2019-01-18 12:50:40: 0: INFO: Startup Directory: “/home/admin/Thinkbox/Deadline10/slave/fwfxlnx009/Draft”
2019-01-18 12:50:40: 0: INFO: Process Priority: BelowNormal
2019-01-18 12:50:40: 0: INFO: Process Affinity: default
2019-01-18 12:50:40: 0: INFO: Process is now running
2019-01-18 12:50:40: 0: STDOUT: /opt/Thinkbox/Deadline10/bin/python/bin/dpython: can’t find ‘main’ module in ‘’
2019-01-18 12:50:40: 0: INFO: Process exit code: 1
2019-01-18 12:50:40: 0: Done executing plugin command of type ‘Render Task’

=======================================================
Details

Date: 01/18/2019 12:51:07
Frames: 1001-1013
Elapsed Time: 00:00:00:05
Job Submit Date: 01/18/2019 12:46:33
Job User: admin
Average RAM Usage: 5591414272 (17%)
Peak RAM Usage: 5599002624 (17%)
Average CPU Usage: 8%
Peak CPU Usage: 10%
Used CPU Clocks (x10^6 cycles): 9724
Total CPU Clocks (x10^6 cycles): 121542

=======================================================
Slave Information

Slave Name: fwfxlnx009
Version: v10.0.20.2 Release (12de851eb)
Operating System: CentOS Linux release 7.5.1804 (Core)
Machine User: admin
IP Address: 10.21.1.176
MAC Address: 0C:9D:92:C1:38:A1
CPU Architecture: x86_64
CPUs: 16
CPU Usage: 6%
Memory Usage: 5.1 GB / 31.3 GB (16%)
Free Disk Space: 25.027 GB
Video Card: NVIDIA Corporation GK104 [GeForce GTX 760] (rev a1)

If necessary I can provide my plugin_info.job and job_info.job files, but keep in mind those exact same files work fine when submitted manually through Deadline. Just in case I did try manually editing them to remove unnecessary options, etc but nothing worked. I have successfully submitted deadlinecommand files in the past, but I haven’t done it with Draft before.

Thanks for your help,
Mike

#2

I wonder if you have “IncludeEnvironment=True” in your job info file. When the exact same command works in one place and not the other, that tends to be the culprit.

#3

No, I don’t have that flag in the file.

Here’s my job_info file:

Plugin=DraftPlugin
Name=Untitled
Comment=
Department=
Pool=none
SecondaryPool=
Group=none
Priority=40
TaskTimeoutMinutes=0
LimitGroups=
JobDependencies=
OnJobComplete=Nothing
Frames=1001-1013
ChunkSize=1000000
MachineLimit=1
OutputFilename0=/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/Draft/TH_205_536_210_BG.mov

Here’s my plugin info file:

ScriptArg0=resolution=“0.25”
ScriptArg1=codec=“h264”
ScriptArg2=colorSpaceIn=“Draft AlexaV3LogC”
ScriptArg3=colorSpaceOut=“Draft AlexaV3LogC”
ScriptArg4=annotationsString=“None”
ScriptArg5=annotationsImageString=“None”
ScriptArg6=annotationsResWidthString=“None”
ScriptArg7=annotationsResWidthString=“None”
ScriptArg8=annotationsFramePaddingSize=“None”
ScriptArg9=quality=“85”
ScriptArg10=frameRate=“23.976”
ScriptArg11=quickType=“createMovie”
ScriptArg12=isDistributed=“False”
ScriptArg13=frameList=1001-1013
ScriptArg14=startFrame=1001
ScriptArg15=endFrame=1013
ScriptArg16=outFolder="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/Draft"
ScriptArg17=outFile="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/Draft/TH_205_536_210_BG.mov"
ScriptArg18=inFile="/net/isilon.lan/ifs/data/Fake_TV_Project/Season_03/FTP304/Shots/REJ/FTP304_REJ_200/Assets/Sequences/Background/TH_205_536_210_BG.#######.dpx"

#4

Hmm. This is a challenge. Can you open a ticket so we can coordinate a phone call? I’d like to do a screen sharing session and we’ll poke around.

#5

To anybody stuck on the same problem in the future, the resolution was to add this:
‘/mnt/library/deadline/DeadlineRepository10/DeadlineRepository10/events/DraftEventPlugin/DraftQuickSubmission/QuickDraft.py’
to the end of the deadlinecommand line. Apparently submitting it through the UI does this automatically. Obviously you will have to change the path to QuickDraft.py, that just happens to be the path to our repository here.

So, your deadline command would be like this:

/opt/Thinkbox/Deadline10/bin/deadlinecommand /home/admin/Thinkbox/Deadline10/temp/draft_job_info.job /home/admin/Thinkbox/Deadline10/temp/draft_plugin_info.job ‘/mnt/library/deadline/DeadlineRepository10/DeadlineRepository10/events/DraftEventPlugin/DraftQuickSubmission/QuickDraft.py’

Privacy | Site terms | Cookie preferences