Hi,
it seems that the shotgun submission is broken. Since the update to 7.2.0.14 none of our Deadline jobs are submitted to shotgun anymore. Doesn’t matter whether it’s 3ds Max or Nuke (haven’t tested others yet). Since we haven’t changed anything i. our configuration or workflow i suspect it has to do with the upgrade.
Cheers,
Holger
Thanks for reporting this! We’ll look into it to see if we can reproduce.
In the meantime, can you check the following:
Cheers,
Ryan
I think we figured out the problem. I’ve attached an updated shotgun script file that you can unzip to \your\repository\events\Shotgun (just overwrite the existing Shotgun.py file).
After doing this, try submitting a job again to confirm it fixes the problem.
Thanks!
Ryan
Shotgun.zip (4.66 KB)
Hi Ryan,
yes
There are indeed error messages in the Reports panel. Note: they are neither with a red font nor labeled ‘Error’ but just ‘Log’.
Below is an example for a OnJobSubmitted log and the two OnJobFinished logs of the same job.
OnJobSubmitted:
2015-08-21 13:37:26: BEGIN - CELL-WS-17\matthiasw
2015-08-21 13:37:26: INFO: Importing Shotgun API from ‘\cell-dead-01\deadlinerepo\events\Shotgun’…
2015-08-21 13:37:26: INFO: An error occurred while retrieving Shotgun info from the submitted Job. No Version has been created.
Date: 08/21/2015 13:37:26
Event Type: OnJobSubmitted
Frames: (no task)
Job User: matthiasw
Job Submit Date: 08/21/2015 13:37:25
[/code]
The contents of the Slave Name, Task ID and Frames columns read ‘(no slave)’, ‘(no task)’ and ‘(no task)’. Same goes for the two OnJobFinished logs’ TaskID and Frames columns but it gives the name of the Slave in those cases.
OnJobFinished #1
2015-08-21 13:43:57: BEGIN - CELL-WS-20\render
2015-08-21 13:43:57: Creating output directory ‘Y:\kit\kit_001_020\comp\kit_kit_001_020_comp_v002_mw\1998x1080_dpx_left\Draft’…
2015-08-21 13:43:57: INFO: MODE: Shotgun|UploadMovie
2015-08-21 13:43:57: WARNING: Could not find an associated Shotgun Version ID. The Draft output will not be uploaded to Shotgun.
2015-08-21 13:43:57: Submitting Shotgun H264 Movie Creation Job to Deadline…
2015-08-21 13:43:59: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:43:59: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:43:59: Submission Contains the Following Auxiliary Files:
2015-08-21 13:43:59: 1) \cell-dead-01\deadlinerepo\events\Shotgun\Draft_CreateShotgunMovie.py
2015-08-21 13:43:59: Result=Success
2015-08-21 13:43:59: JobID=55d70eff5850470f5452418b
2015-08-21 13:43:59: The job was submitted successfully.
2015-08-21 13:43:59: INFO: MODE: Shotgun|UploadFilmstrip
2015-08-21 13:43:59: WARNING: Could not find an associated Shotgun Version ID. The Draft output will not be uploaded to Shotgun.
2015-08-21 13:43:59: Submitting Shotgun Filmstrip Creation Job to Deadline…
2015-08-21 13:44:01: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:01: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:01: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:01: 1) \cell-dead-01\deadlinerepo\events\Shotgun\Draft_CreateShotgunFilmstrip.py
2015-08-21 13:44:01: Result=Success
2015-08-21 13:44:01: JobID=55d70f015850470848ae0310
2015-08-21 13:44:01: The job was submitted successfully.
2015-08-21 13:44:01: ====Submitting Job for Output 1 of 8====
2015-08-21 13:44:01: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:03: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:03: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:03: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:03: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:03: Result=Success
2015-08-21 13:44:03: JobID=55d70f025850470d482d30c7
2015-08-21 13:44:03: The job was submitted successfully.
2015-08-21 13:44:03: ====Submitting Job for Output 2 of 8====
2015-08-21 13:44:03: Creating output directory ‘Y:\kit\kit_001_020\comp\kit_kit_001_020_comp_v002_mw\1998x1080_jpg_left\Draft’…
2015-08-21 13:44:03: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:05: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:05: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:05: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:05: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:05: Result=Success
2015-08-21 13:44:05: JobID=55d70f045850470310bf0bc6
2015-08-21 13:44:05: The job was submitted successfully.
2015-08-21 13:44:05: ====Submitting Job for Output 3 of 8====
2015-08-21 13:44:05: Creating output directory ‘Y:\kit\kit_001_020\comp\kit_kit_001_020_comp_v002_mw\1998x540_jpg_sbsh\Draft’…
2015-08-21 13:44:05: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:07: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:07: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:07: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:07: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:07: Result=Success
2015-08-21 13:44:07: JobID=55d70f065850470704551680
2015-08-21 13:44:07: The job was submitted successfully.
2015-08-21 13:44:07: ====Submitting Job for Output 4 of 8====
2015-08-21 13:44:07: Creating output directory ‘Y:\kit\kit_001_020\comp\kit_kit_001_020_comp_v002_mw\1998x2160_jpg_sbsv\Draft’…
2015-08-21 13:44:07: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:08: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:08: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:08: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:08: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:08: Result=Success
2015-08-21 13:44:08: JobID=55d70f085850470dec107bca
2015-08-21 13:44:08: The job was submitted successfully.
2015-08-21 13:44:08: ====Submitting Job for Output 5 of 8====
2015-08-21 13:44:08: Creating output directory ‘Y:\kit\kit_001_020\comp\kit_kit_001_020_comp_v002_mw\1998x1080_dpx_right\Draft’…
2015-08-21 13:44:08: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:10: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:10: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:10: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:10: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:10: Result=Success
2015-08-21 13:44:10: JobID=55d70f09585047054893d93c
2015-08-21 13:44:10: The job was submitted successfully.
2015-08-21 13:44:10: ====Submitting Job for Output 6 of 8====
2015-08-21 13:44:10: Creating output directory ‘Y:\kit\kit_001_020\comp\kit_kit_001_020_comp_v002_mw\1998x1080_jpg_right\Draft’…
2015-08-21 13:44:10: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:12: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:12: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:12: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:12: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:12: Result=Success
2015-08-21 13:44:12: JobID=55d70f0b5850470fb4386183
2015-08-21 13:44:12: The job was submitted successfully.
2015-08-21 13:44:12: ====Submitting Job for Output 7 of 8====
2015-08-21 13:44:12: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:14: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:14: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:14: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:14: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:14: Result=Success
2015-08-21 13:44:14: JobID=55d70f0d5850470bb09852c3
2015-08-21 13:44:14: The job was submitted successfully.
2015-08-21 13:44:14: ====Submitting Job for Output 8 of 8====
2015-08-21 13:44:14: Submitting Quick Draft Job to Deadline…
2015-08-21 13:44:16: Deadline Command BG 7.2 [v7.2.0.14 R (dbc900863)]
2015-08-21 13:44:16: Submitting to Repository: \cell-dead-01\deadlinerepo
2015-08-21 13:44:16: Submission Contains the Following Auxiliary Files:
2015-08-21 13:44:16: 1) \cell-dead-01\deadlinerepo\events\Draft\DraftQuickSubmission\DraftCreateMovie.py
2015-08-21 13:44:16: Result=Success
2015-08-21 13:44:16: JobID=55d70f0f5850470d8c2e5d7d
2015-08-21 13:44:16: The job was submitted successfully.
Date: 08/21/2015 13:44:09
Event Type: OnJobFinished
Frames: (no task)
Job User: matthiasw
Job Submit Date: 08/21/2015 13:37:25
Slave Name: CELL-WS-20
Version: v7.2.0.14 R (dbc900863)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: render
IP Address: 192.168.1.30
MAC Address: 00:25:22:B7:97:2B
CPU Architecture: x64
CPUs: 8
CPU Usage: 12%
Memory Usage: 2.8 GB / 32.0 GB (8%)
Free Disk Space: 1,017.249 GB (28.085 GB on C:, 394.309 GB on D:, 594.854 GB on F:)
Video Card: mv video hook driver2
[/code]
OnJobFinished #2
2015-08-21 13:44:16: BEGIN - CELL-WS-20\render
2015-08-21 13:44:16: INFO: Found Shotgun Version info
2015-08-21 13:44:16: INFO: Event Plugin Mode: UploadThumbnail
2015-08-21 13:44:16: INFO: Importing Shotgun API from ‘\cell-dead-01\deadlinerepo\events\Shotgun’…
2015-08-21 13:44:18: INFO: An error occurred while retrieving Shotgun info from the submitted Job. No Version has been created.
Date: 08/21/2015 13:44:12
Event Type: OnJobFinished
Frames: (no task)
Job User: matthiasw
Job Submit Date: 08/21/2015 13:37:25
Slave Name: CELL-WS-20
Version: v7.2.0.14 R (dbc900863)
Operating System: Windows 7 Professional (SP1)
Running As Service: No
Machine User: render
IP Address: 192.168.1.30
MAC Address: 00:25:22:B7:97:2B
CPU Architecture: x64
CPUs: 8
CPU Usage: 12%
Memory Usage: 2.8 GB / 32.0 GB (8%)
Free Disk Space: 1,017.249 GB (28.085 GB on C:, 394.309 GB on D:, 594.854 GB on F:)
Video Card: mv video hook driver2
[/code]
I have no idea why all of a sudden it seems to not find the version info anymore. As i wrote before we haven’t changed anything in our workflow of how those submissions are done.
Let me know if you need anything else.
Cheers,
Holger
Ooops… just saw your post with the fix after i posted the logs.
Will try it out right away and report back!
We just did two successful submissions with Nuke and 3ds Max. So it seems the fix is working.
But shouldn’t the error logs in the job report be in red still?
And we just faced another issue. In the meantime we created the Shotgun versions from the “Scripts/CreateShotgunVersion” menu. The minute i copied over your fix it stopped working. We tried several times to submit a version like this and neither do we get any message from Deadline about success or failure nor is there a version being created in shotgun. Where can we actually find the logs of actions from the Scripts menu?
Could this be due to the depending Draft jobs for shotgun_h264 and shtogun filmstrip failing?
Because of the way the Shotgun event is currently implemented, these issues show up as logs instead of errors. Might be something we want to look at changing in the future.
I did a quick test and couldn’t reproduce. Can you open the Console panel in the Monitor to see if any errors show up here after running the script? If so, can you copy and paste the error message here?
Thanks!
Ryan
It seems there’s indeed an error message in the Console:
2015-08-24 16:10:58: Running script CreateShotgunVersion (\\cell-dead-01\deadlinerepo\scripts\Jobs\CreateShotgunVersion.py)
2015-08-24 16:11:30: Running script CreateShotgunVersion (\\cell-dead-01\deadlinerepo\scripts\Jobs\CreateShotgunVersion.py)
2015-08-24 16:12:03: VersionName=comp_v003_pj
2015-08-24 16:12:03: Description=added a couple of mask passes to facilitate the transition to white
2015-08-24 16:12:03: UserName=paulj
2015-08-24 16:12:03: TaskName=Render
2015-08-24 16:12:03: ProjectName=kit
2015-08-24 16:12:03: EntityName=kit_001_020
2015-08-24 16:12:03: TaskId=17120
2015-08-24 16:12:03: ProjectId=218
2015-08-24 16:12:03: EntityId=3906
2015-08-24 16:12:03: EntityType=Shot
2015-08-24 16:12:03: DraftTemplate=
2015-08-24 16:12:07: Traceback (most recent call last):
2015-08-24 16:12:07: File "DeadlineUI\UI\Commands\ScriptCommands.py", line 103, in InnerExecute
2015-08-24 16:12:07: PythonNetException: AttributeError : 'DeadlineScriptDialog' object has no attribute 'ShowErrorBox'
2015-08-24 16:12:07: File "none", line 53, in __main__
2015-08-24 16:12:07: File "none", line 133, in CreateShotgunVersion
Try unzipping the attached file to \your\repository\scripts\Jobs, and overwrite the existing CreateShotgunVersion.py file. Note that this still shouldn’t work, but at least you should get a message with the actual error that’s occurring in a popup dialog. Take a screenshot of the dialog and post it and we’ll have a look.
Also, is it possible to archive the job from the right-click menu and upload the exported zip file here? The problem could be related to specific settings for the job, so we could just import the job into our repository and try to reproduce.
Thanks!
Ryan
CreateShotgunVersion.zip (2.69 KB)
Hi Ryan,
just tried it and it showed the following error message:
[code]An error occurred while attempting to create a new Version to Shotgun:
Traceback (most recent call last):
File “none”, line 130, in CreateShotgunVersion
File “\cell-dead-01\deadlinerepo\events/Shotgun\ShotgunUtils.py”, line 259, in AddNewVersion
new_version = sg.create(‘Version’, data)
File “\cell-dead-01\deadlinerepo\events/Shotgun\shotgun_api3\shotgun.py”, line 654, in create
record = self._call_rpc(“create”, params, first=True)
File “\cell-dead-01\deadlinerepo\events/Shotgun\shotgun_api3\shotgun.py”, line 1549, in _call_rpc
self._response_errors(response)
File “\cell-dead-01\deadlinerepo\events/Shotgun\shotgun_api3\shotgun.py”, line 1756, in _response_errors
“Unknown Error”))
Fault: API create() CRUD ERROR #6: Create failed for [Version]: PG::Error: ERROR: value too long for type character varying(255)
: {“sql”:“UPDATE versions SET “code” = $1, “sg_status_list” = $2, “sg_upload_version” = $3, “user_id” = $4, “user_type” = $5, “sg_path_to_frames” = $6, “sg_last_frame” = $7, “description” = $8, “sg_first_frame” = $9, “entity_id” = $10, “entity_type” = $11, “frame_range” = $12, “frame_count” = $13, “sg_task_id” = $14, “sg_task_type” = $15, “updated_at” = $16 WHERE “id” = $17”,“bind_parameters”:[“rndr_setup_v003_pj”,“rev”,“na”,“124”,“HumanUser”,“Y:\kit\kit_001_020\rndr\kit_001_020_rndr_setup_v003_pj\1536x810_exr_left\kit_001_020_rndr_setup_v003_pj_left.RGB_color.####.exr”,“99”,“just a Deadline test. should be deleted after submission.”,“0”,“3906”,“Shot”,“0,10,20,30,40,50,60,70,80,90,100,5,15,25,35,45,55,65,75,85,95,2,4,6,8,12,14,16,18,22,24,26,28,32,34,36,38,42,44,46,48,52,54,56,58,62,64,66,68,72,74,76,78,82,84,86,88,92,94,96,98,1,3,7,9,11,13,17,19,21,23,27,29,31,33,37,39,41,43,47,49,51,53,57,59,61,63,67,69,71,73,77,79,81,83,87,89,91,93,97,99”,“101”,“17120”,“Task”,“2015-08-25 14:52:21.127284”,10986]}
[/code]
The job i tried it with is attached as a zip file created through the archiving option as you suggested.
I also tried it with another job (a Nuke comp) and this one was successfully submitted. So you’re probably right and it’s somehow job-related.
Btw., i noticed that the resulting zip file from the archiving operation has a space ’ ’ in its name - between the job name and the ID. I guess this is not intended?
Cheers,
Holger
paulj__3dsmax__kit_001_020_rndr_setup_v003_pj __55db083c84b018257c02e50a.zip (15.1 MB)
Thanks! This looks like something we fixed for the Shotgun Event plugin a little while back, but turns out the right-click job script needed the same fix. I’ve attached another update, which you can extract to \your\repository\scripts\Jobs and overwrite the existing CreateShotgunVersion.py file again. Give it a try and let me know if it fixes the problem.
Note that the reason the zip file has a space in it is because the job name has a space at the end. I confirmed this after importing your job.
Cheers,
Ryan
CreateShotgunVersion.zip (2.72 KB)
I tested it with the same job as before and this time it worked. Thanks!
Also thanks for pointing out where the space in the name came from.
Thanks again!
Cheers,
Holger
Brief update:
This new version of the script seems to not read and use the setting for the frame padding of the Shotgun Event configuration. The version it created had ‘filename.####.exr’ in the ‘Path to Frames’ field instead of ‘filename.%04d.exr’ (we configured the shotgun event to use ‘%0#d’). I understand it’s not an event but a user-invoked script - but could this still be implemented?
Another question: would it be possible to implement the common Draft workflow as is included in all the application submitters to this as well? So it’d be possible to automatically add the filmstrip and h264 to the version as well as the other dependent Draft jobs if needed?
Attached is a mockup of what i’m talking about.
Cheers,
Holger
Thanks! We’ve fixed this issue in the job script, and I’ve uploaded the fix here. Please do the following:
The next time you use the job right-click script to create a version, it should now respect the frame padding setting in the Shotgun event plugin.
Unfortunately, we won’t be able to add Draft settings to the Shotgun UI for 7.2, but we’ll definitely add it to the wishlist.
Cheers,
Ryan
Shotgun.zip (8.71 KB)
CreateShotgunVersion.zip (2.83 KB)
Unfortunately, i’m now getting an error when trying to submit the version (from the same job again).
Please see the attached screenshot.
No problem. Good to know it’ll be on the wishlist.
Cheers,
Holger
Hmm… I tested on the job you uploaded and it worked fine…
There should be an error message in the Console panel in the Monitor. Can you post the error message?
Right. Forgot to check that.
Here it is:
2015-08-26 15:45:48: Running script CreateShotgunVersion (\\cell-dead-01\deadlinerepo\scripts\Jobs\CreateShotgunVersion.py)
2015-08-26 15:46:19: VersionName=rndr_setup_v003_pj
2015-08-26 15:46:19: Description=another Deadline test. check 'path to frames for' %04d
2015-08-26 15:46:19: UserName=paulj
2015-08-26 15:46:19: TaskName=Render
2015-08-26 15:46:19: ProjectName=kit
2015-08-26 15:46:19: EntityName=kit_001_020
2015-08-26 15:46:19: TaskId=17120
2015-08-26 15:46:19: ProjectId=218
2015-08-26 15:46:19: EntityId=3906
2015-08-26 15:46:19: EntityType=Shot
2015-08-26 15:46:19: DraftTemplate=
2015-08-26 15:48:57: Traceback (most recent call last):
2015-08-26 15:48:57: File "none", line 134, in CreateShotgunVersion
2015-08-26 15:48:57: AttributeError: 'module' object has no attribute 'ReplacePadding'
I just tried on a different machine and there it worked. But i haven’t changed anything in the meantime.
Cheers,
Holger
Try restarting the Monitor on the machine that it wasn’t working on. I’m guessing the old ShotgunUtils module was still cached, as the ReplacePadding function was added in the patch I uploaded.
Bingo! 
Thanks again!
Holger
I just found that MANY (probably all) 3ds Max jobs have that additional space at the end (the Nuke jobs don’t). I can’t really imagine that this is being added by the artists. So maybe that’s a bug in SMTD? Not a big deal, of course, but i thought i let you know.
Cheers,
Holger
