AWS Thinkbox Discussion Forums

AWS Asset Server / Portal Link issue

In some submitters (don’t know if all) there is a checkbox if you want to pre-cache the assets. If you select it, the asset paths are added as properties in the job info.
I think if you don’t pre-cache the assets, they are requested by the plugin at render startup.

Can you try re-submitting (or submit a new job)? And then post/upload the full log files for:

/var/log/Thinkbox/S3BackedCache/central_controller.log (either via CloudWatch or ssh into the gateway instance)

/mnt/dtu/slave_controller.log (ssh into EC2 instance) or maybe it’s called worker_controller.log now?

complete output of the worker render log (via monitor or ssh into EC2 instance)

The AWS Portal Asset Server logs that you posted looked OK.

I don’t see the option to precache assets when running a draft job.

Here are the logs :

Cloudwatch log /thinkbox/S3BackedCache/cental

1721900191.668396 2024-07-25 09:36:31,668 [/opt/Thinkbox/S3BackedCache/Central/lib/python3.10/site-packages/central/central.py:__init__:1229] [root] [3448] [MainThread] [INFO] Initializing server
1721900191.988980 2024-07-25 09:36:31,988 [/opt/Thinkbox/S3BackedCache/Central/lib/python3.10/site-packages/central/central.py:validate_database_file:523] [root] [3448] [MainThread] [INFO] No cache database found.
1721900192.662618 2024-07-25 09:36:32,662 [/opt/Thinkbox/S3BackedCache/Central/lib/python3.10/site-packages/central/central.py:__init__:467] [root] [3448] [MainThread] [INFO] Using 4 upload threads
1721900192.678651 2024-07-25 09:36:32,678 [/opt/Thinkbox/S3BackedCache/Central/lib/python3.10/site-packages/central/central.py:start:1240] [root] [3448] [MainThread] [INFO] Starting server

cat /mnt/dtu/worker_controller.log on worker

Connection Accepted.Command exited with code: 0
Command Stdout: 1721900929.422560 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .log.level:20
1721900929.422687 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .log.path:/mnt/dtu/worker_controller.log
1721900929.422734 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .profile.enable:False
1721900929.422771 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .profile.path.functions:/tmp/deadline_dash_profile_functions
1721900929.422808 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .grpc.slave.server.url:[::]:4002
1721900929.422842 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .grpc.slave.server.concurrent.max:10000
1721900929.422876 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .grpc.slave.server.worker.max:5
1721900929.422910 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .grpc.central.server.url:10.128.2.4:4001
1721900929.422944 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .miscellaneous.enable_whitelist:True
1721900929.422976 2024-07-25 09:48:49,422 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .miscellaneous.enable_logging_readwrite:False
1721900929.423010 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .housekeep.enable:True
1721900929.423043 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .housekeep.retry:3
1721900929.423076 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .housekeep.watermark.high:84393531801
1721900929.423109 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .housekeep.watermark.use_apparent_bytes:False
1721900929.423141 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.ebs:/mnt/dtu
1721900929.423173 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.mount:/mnt/Data
1721900929.423205 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.db:/mnt/dtu/db.sqlite
1721900929.423236 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.sequence:/mnt/dtu/sequence
1721900929.423267 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.mirror:/mnt/dtu/mirror
1721900929.423298 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.s3:/mnt/dtu/s3
1721900929.423335 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.housekeep.root:/mnt/dtu/housekeep
1721900929.423367 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .path.housekeep.file:/mnt/dtu/housekeep/file.pickle
1721900929.423406 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .security.owner:pwd.struct_passwd(pw_name='ec2-user', pw_passwd='x', pw_uid=1000, pw_gid=1000, pw_gecos='EC2 Default User', pw_dir='/home/ec2-user', pw_shell='/bin/bash')
1721900929.423465 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .security.owner_group:grp.struct_group(gr_name='ec2-user', gr_passwd='x', gr_gid=1000, gr_mem=[])
1721900929.423507 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .fuse.entry_timeout:0
1721900929.423539 2024-07-25 09:48:49,423 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_log_fn:84] [root] [3594] [MainThread] [INFO] .fuse.attr_timeout:0
1721900929.851430 2024-07-25 09:48:49,851 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_fuse_main:22] [root] [3594] [MainThread] [INFO] Trying to mount FUSE file-system ...
1721915666.177755 2024-07-25 13:54:26,177 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py:wrapper:79] [root] [3594] [Dummy-2] [ERROR] CacheManagerException: 'getattr'
Traceback (most recent call last):
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 71, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 18, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 54, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/fuse_operations.py", line 212, in getattr
    ret = self.cache_manager.lstat(path_rel)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py", line 30, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py", line 1593, in lstat
    raise CacheManagerException('SequenceManager is not ready yet')
slavelib.cache_mgmt.CacheManagerException: SequenceManager is not ready yet
1721915666.181827 2024-07-25 13:54:26,181 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py:wrapper:79] [root] [3594] [Dummy-3] [ERROR] CacheManagerException: 'getattr'
Traceback (most recent call last):
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 71, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 18, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 54, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/fuse_operations.py", line 212, in getattr
    ret = self.cache_manager.lstat(path_rel)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py", line 30, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py", line 1593, in lstat
    raise CacheManagerException('SequenceManager is not ready yet')
slavelib.cache_mgmt.CacheManagerException: SequenceManager is not ready yet
1721915666.182187 2024-07-25 13:54:26,182 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py:wrapper:79] [root] [3594] [Dummy-2] [ERROR] CacheManagerException: 'getattr'
Traceback (most recent call last):
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 71, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 18, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py", line 54, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/fuse_operations.py", line 212, in getattr
    ret = self.cache_manager.lstat(path_rel)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py", line 30, in wrapper
    ret = func(*args, **kwargs)
  File "/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py", line 1593, in lstat
    raise CacheManagerException('SequenceManager is not ready yet')
slavelib.cache_mgmt.CacheManagerException: SequenceManager is not ready yet
1721915666.182720 2024-07-25 13:54:26,182 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py:_get_file_attributes:419] [root] [3594] [Dummy-3] [INFO] sending a GetFileAttributes - path: "/"

1721915666.211621 2024-07-25 13:54:26,211 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py:_get_file_att

Worker log:

2024-07-25 13:55:51:  RenderPluginException.HasSlaveLog: True
2024-07-25 13:55:51:  RenderPluginException.SlaveLogFileName: /var/log/Thinkbox/Deadline10/deadlineslave_renderthread_0-ip-10-128-36-199-0000.log
2024-07-25 13:55:51:  Exception.TargetSite: Deadline.Slaves.Messaging.PluginResponseMemento d(Deadline.Net.DeadlineMessage, System.Threading.CancellationToken)
2024-07-25 13:55:51:  Exception.Data: ( )
2024-07-25 13:55:51:  Exception.Source: deadline
2024-07-25 13:55:51:  Exception.HResult: -2146233088
2024-07-25 13:55:51:    Exception.StackTrace: 
2024-07-25 13:55:51:     at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgx, CancellationToken bgy
2024-07-25 13:55:51:     at Deadline.Plugins.SandboxedPlugin.Initialize(Job job, CancellationToken cancellationToken
2024-07-25 13:55:51:     at Deadline.Slaves.SlaveRenderThread.e(String ake, Job akf, CancellationToken akg
2024-07-25 13:55:51:     at Deadline.Slaves.SlaveRenderThread.b(TaskLogWriter aka, CancellationToken akb)
2024-07-25 13:55:51:  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2024-07-25 13:55:53:  Scheduler Thread - Job's Limit Groups: 
2024-07-25 13:55:53:  0: Loading Job's Plugin timeout is Disabled
2024-07-25 13:55:53:  0: SandboxedPlugin: Render Job As User disabled, running as current user 'ec2-user'
2024-07-25 13:55:55:  All job files are already synchronized
2024-07-25 13:55:55:  Plugin DraftPlugin was already synchronized.
2024-07-25 13:55:55:  0: Executing plugin command of type 'Initialize Plugin'
2024-07-25 13:55:55:  0: INFO: Executing plugin script '/var/lib/Thinkbox/Deadline10/workers/ip-10-128-36-199/plugins/6644dc7f641f9be783d465be/DraftPlugin.py'
2024-07-25 13:55:55:  0: INFO: Plugin execution sandbox using Python version 3
2024-07-25 13:55:55:  0: INFO: Found Draft python module at: '/var/lib/Thinkbox/Deadline10/workers/ip-10-128-36-199/Draft/Draft.so'
2024-07-25 13:55:55:  0: INFO: Setting Process Environment Variable PYTHONPATH to /var/lib/Thinkbox/Deadline10/workers/ip-10-128-36-199/Draft:/home/ec2-user/Thinkbox/Deadline10/pythonAPIs/vXiJchfTd6HrfrxRHxsOCw==:/opt/Thinkbox/Deadline10/bin/python3:/opt/Thinkbox/Deadline10/bin/python3/lib:/opt/Thinkbox/Deadline10/bin/python3/lib/site-packages:/opt/Thinkbox/Deadline10/lib/python3/lib/python310.zip:/opt/Thinkbox/Deadline10/lib/python3/lib/python3.10:/opt/Thinkbox/Deadline10/lib/python3/lib/python3.10/lib-dynload:/opt/Thinkbox/Deadline10/lib/python3/lib/python3.10/site-packages:/opt/Thinkbox/Deadline10/bin/
2024-07-25 13:55:55:  0: INFO: Setting Process Environment Variable MAGICK_CONFIGURE_PATH to /var/lib/Thinkbox/Deadline10/workers/ip-10-128-36-199/Draft
2024-07-25 13:55:55:  0: INFO: Setting Process Environment Variable LD_LIBRARY_PATH to /opt/Thinkbox/Deadline10/bin/python/lib:/var/lib/Thinkbox/Deadline10/workers/ip-10-128-36-199/Draft
2024-07-25 13:55:55:  0: CheckPathMapping: Swapped "P:\test\awsportal" with "/mnt/Data/P45fb528f0ad05bcc56680f4dffded1ec/test\awsportal"
2024-07-25 13:55:55:  0: INFO: Creating the output directory "/mnt/Data/P45fb528f0ad05bcc56680f4dffded1ec/test/awsportal"
2024-07-25 13:55:55:  0: Encountered an error while executing plugin command of type 'Initialize Plugin'
2024-07-25 13:55:57:  Sending kill command to process tree with root process 'deadlinesandbox.exe' with process id 2938
2024-07-25 13:55:59:  Scheduler Thread - Render Thread 0 threw a major error: 
2024-07-25 13:55:59:  >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2024-07-25 13:55:59:  Exception Details
2024-07-25 13:55:59:  RenderPluginException -- Initialize: Error: Failed to create output directory "/mnt/Data/P45fb528f0ad05bcc56680f4dffded1ec/test/awsportal". The path may be invalid or permissions may not be sufficient.
2024-07-25 13:55:59:  RenderPluginException.Cause: JobError (2)
2024-07-25 13:55:59:  RenderPluginException.Level: Major (1)
2024-07-25 13:55:59:  RenderPluginException.HasSlaveLog: True
2024-07-25 13:55:59:  RenderPluginException.SlaveLogFileName: /var/log/Thinkbox/Deadline10/deadlineslave_renderthread_0-ip-10-128-36-199-0000.log
2024-07-25 13:55:59:  Exception.TargetSite: Deadline.Slaves.Messaging.PluginResponseMemento d(Deadline.Net.DeadlineMessage, System.Threading.CancellationToken)
2024-07-25 13:55:59:  Exception.Data: ( )
2024-07-25 13:55:59:  Exception.Source: deadline
2024-07-25 13:55:59:  Exception.HResult: -2146233088
2024-07-25 13:55:59:    Exception.StackTrace: 
2024-07-25 13:55:59:     at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage bgx, CancellationToken bgy
2024-07-25 13:55:59:     at Deadline.Plugins.SandboxedPlugin.Initialize(Job job, CancellationToken cancellationToken
2024-07-25 13:55:59:     at Deadline.Slaves.SlaveRenderThread.e(String ake, Job akf, CancellationToken akg
2024-07-25 13:55:59:     at Deadline.Slaves.SlaveRenderThread.b(TaskLogWriter aka, CancellationToken akb)
2024-07-25 13:55:59:  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Thank you

So you started with 0 byte files on the P:\ share and they were uploaded to the bucket as 0 byte files?

Is your P:\ root level writable? Can you try using the full path P:\test\awsportal\ or whatever path you were testing with and make sure it is rw by the service user on the asset server?

On the ec2 instance, you’re getting a mount error with what appears to be a get attribute error, so I’m guessing that it may be one of the IAM policies?

1721900929.851430 2024-07-25 09:48:49,851 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slave/slave_linux.py:_fuse_main:22] [root] [3594] [MainThread] [INFO] Trying to mount FUSE file-system ...
1721915666.177755 2024-07-25 13:54:26,177 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/utilities.py:wrapper:79] [root] [3594] [Dummy-2] [ERROR] CacheManagerException: 'getattr'

and

slavelib.cache_mgmt.CacheManagerException: SequenceManager is not ready yet
1721915666.182720 2024-07-25 13:54:26,182 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py:_get_file_attributes:419] [root] [3594] [Dummy-3] [INFO] sending a GetFileAttributes - path: "/"

1721915666.211621 2024-07-25 13:54:26,211 [/opt/Thinkbox/S3BackedCache/Client/lib/python3.10/site-packages/slavelib/cache_mgmt.py:_get_file_att

Can you also check your IAM user/roles/policies?

IAM → Users → AWSPortal should have the attached policies:

  • AWSThinkboxAWSPortalAdminPolicy
  • AWSThinkboxDeadlineResourceTrackerAdminPolicy

IAM → Users → AWSPortalAssetServerUser

  • AWSThinkboxAssetServerPolicy

IAM Policies should include:

  • AWSThinkboxAWSPortalAdminPolicy
  • AWSThinkboxAWSPortalGatewayPolicy
  • AWSThinkboxAWSPortalWorkerPolicy

IAM → Roles → AWSPortalWorkerRole

  • AWSThinkboxAWSPortalWorkerPolicy

e.g. the AWSThinkboxAWSPortalAdminPolicy should have these for s3. (I copied from the docs so AWS may have updated the policy to include or made it more granular) The docs list which ones should have s3 policies.

        {
            "Effect": "Allow",
            "Action": [
                "s3:CreateBucket",
                "s3:GetBucketLocation",
                "s3:GetBucketLogging",
                "s3:GetBucketVersioning",
                "s3:PutBucketAcl",
                "s3:PutBucketCORS",
                "s3:PutBucketVersioning",
                "s3:GetBucketAcl",
                "s3:GetObject",
                "s3:PutBucketLogging",
                "s3:PutBucketTagging",
                "s3:PutObject",
                "s3:ListBucket",
                "s3:ListBucketVersions",
                "s3:PutEncryptionConfiguration",
                "s3:PutLifecycleConfiguration",
                "s3:DeleteBucket",
                "s3:DeleteObject",
                "s3:DeleteBucketPolicy",
                "s3:DeleteObjectVersion"
            ],
            "Resource": [
                "arn:aws:s3::*:awsportal*",
                "arn:aws:s3::*:stack*",
                "arn:aws:s3::*:aws-portal-cache*",
                "arn:aws:s3::*:logs-for-aws-portal-cache*",
                "arn:aws:s3::*:logs-for-stack*"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "s3:ListAllMyBuckets"
            ],
            "Resource": "*"
        },

https://docs.thinkboxsoftware.com/products/deadline/10.3/1_User%20Manual/manual/aws-thinkbox-managed-policies.html

Not sure which person is on the forum this week, but maybe @zainali would have some insight since he’s the one who wrote the KB about the asset server …

I think you found it ! By giving admin policy as a test to the AWSPortalWorkerRole I finally could see the right permissions on the Data folder and was able to run a Draft job ! Now I need to find out what permissions are really missing.

My AWSThinkboxAWSPortalWorkerPolicy policy (role and policy created by the wizard) is

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": [
                "ec2:DescribeTags"
            ],
            "Resource": [
                "*"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "ec2:TerminateInstances"
            ],
            "Resource": [
                "arn:aws:ec2:*:*:instance/*"
            ],
            "Condition": {
                "StringEquals": {
                    "ec2:ResourceTag/DeadlineRole": "DeadlineRenderNode"
                }
            }
        },
        {
            "Effect": "Allow",
            "Action": [
                "s3:GetObject",
                "s3:PutObject",
                "s3:ListBucket"
            ],
            "Resource": [
                "arn:aws:s3:::aws-portal-cache*"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "s3:GetObject"
            ],
            "Resource": [
                "arn:aws:s3:::stack*/gateway_certs/*"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "logs:CreateLogStream",
                "logs:PutLogEvents",
                "logs:DescribeLogStreams",
                "logs:DescribeLogGroups"
            ],
            "Resource": [
                "arn:aws:logs:*:*:log-group:/thinkbox*"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "logs:CreateLogGroup"
            ],
            "Resource": [
                "*"
            ]
        },
        {
            "Effect": "Allow",
            "Action": [
                "sqs:SendMessage",
                "sqs:GetQueueUrl"
            ],
            "Resource": [
                "arn:aws:sqs:*:*:DeadlineAWS*"
            ]
        }
    ]
}

It’s the exact one that’s linked on the docs.
Thank you for you help !

1 Like

Cool! Please post a follow up when you find out which policy actions were missing.

2 Likes
Privacy | Site terms | Cookie preferences