AWS Thinkbox Discussion Forums

Web forwarding - ArgumentOutOfRangeException

I have set up a License Forwarder with Web forwarding on a dedicated VM. Purpose is to allow workers without Internet access to authorise renders using UBL credits. Deadline 10.1.17.4 is in use on site. Followed documentation on activating this feature from cert creation to importing crt on the worker (CentOS 7-based OS). Forwarder has the UBL certificate as well as the web forwarder pfx file in the certificate folder it is referencing.

Enabled Web forwarding option for UBL in repository settings. License forwarder appears as running in the Monitor.

Upon submitting a Job I can see connection attempt from client worker to the license server which then in turn connects to an external Thinkbox certification address. The forwarder log shows an Exception and at that point the connection between the client → forwarder hangs until the forwarder process is KILLed. Log:

2021-11-18 13:36:14:  BEGIN - deadline-repo\root
2021-11-18 13:36:14:  Operating System: Linux
2021-11-18 13:36:14:  CPU Architecture: x86_64
2021-11-18 13:36:14:  CPUs: 2
2021-11-18 13:36:14:  Video Card: 
2021-11-18 13:36:14:  Deadline License Forwarder 10.1 [v10.1.17.4 Release (d3559fe75)]
2021-11-18 13:36:14:  License Forwarder Thread - License Forwarder thread initializing...
2021-11-18 13:36:14:  License Forwarder Thread - License Forwarder thread listening on port 17004
2021-11-18 13:36:18:  Web Forwarding Tunneler Thread: Initialized - listening on port 443
2021-11-18 13:36:20:  >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021-11-18 13:36:20:  Exception Details
2021-11-18 13:36:20:  ArgumentOutOfRangeException -- Index was out of range. Must be non-negative and less than the size of the collection. (Parameter 'index')
2021-11-18 13:36:20:  ArgumentException.ParamName: index
2021-11-18 13:36:20:  Exception.TargetSite: System.Object System.Collections.IList.get_Item(Int32)
2021-11-18 13:36:20:  Exception.Data: ( )
2021-11-18 13:36:20:  Exception.Source: System.Collections.NonGeneric
2021-11-18 13:36:20:  Exception.HResult: -2146233086
2021-11-18 13:36:20:    Exception.StackTrace: 
2021-11-18 13:36:20:     at System.Collections.CollectionBase.System.Collections.IList.get_Item(Int32 index
2021-11-18 13:36:20:     at System.Security.Cryptography.X509Certificates.X509CertificateCollection.get_Item(Int32 index
2021-11-18 13:36:20:     at Deadline.Net.HAProtocolV1.ClientCertificateSelectionCallback(Object sender, String targetHost, X509CertificateCollection localCertificates, X509Certificate remoteCertificate, String[] acceptableIssuers
2021-11-18 13:36:20:     at System.Net.Security.SslStream.UserCertSelectionCallbackWrapper(String targetHost, X509CertificateCollection localCertificates, X509Certificate remoteCertificate, String[] acceptableIssuers
2021-11-18 13:36:20:     at System.Net.Security.SecureChannel.AcquireClientCredentials(Byte[]& thumbPrint
2021-11-18 13:36:20:     at System.Net.Security.SecureChannel.GenerateToken(Byte[] input, Int32 offset, Int32 count, Byte[]& output
2021-11-18 13:36:20:     at System.Net.Security.SecureChannel.NextMessage(Byte[] incoming, Int32 offset, Int32 count
2021-11-18 13:36:20:     at System.Net.Security.SslStream.StartSendBlob(Byte[] incoming, Int32 count, AsyncProtocolRequest asyncRequest
2021-11-18 13:36:20:     at System.Net.Security.SslStream.ForceAuthentication(Boolean receiveFirst, Byte[] buffer, AsyncProtocolRequest asyncRequest
2021-11-18 13:36:20:     at System.Net.Security.SslStream.ProcessAuthentication(LazyAsyncResult lazyResult, CancellationToken cancellationToken
2021-11-18 13:36:20:     at System.Net.Security.SslStream.AuthenticateAsClient(SslClientAuthenticationOptions sslClientAuthenticationOptions
2021-11-18 13:36:20:     at System.Net.Security.SslStream.AuthenticateAsClient(String targetHost, X509CertificateCollection clientCertificates, SslProtocols enabledSslProtocols, Boolean checkCertificateRevocation
2021-11-18 13:36:20:     at Deadline.Net.SSLStreamEndpoint..ctor(String address, Int32 port, X509CertificateCollection collection, Boolean useHAHeader, String clientAddress, Int32 clientPort, NetworkStream stream
2021-11-18 13:36:20:     at Deadline.Net.FlexNetSSLStreamEndpoint..ctor(String address, X509CertificateCollection certificateCollection, String addressToReplace
2021-11-18 13:36:20:     at Deadline.LicenseForwarder.LicenseForwarderWebForwarder.HandleRequest(Object clientObject)
2021-11-18 13:36:20:  <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Any help appreciated - thanks, Martin.

Hello,

We also are experiencing this exact issue.
I am bumping this thread.

-nick

Hello @karpreet

Has anyone on your team ever seen this before?

Looking at logs from the License Forwarder, it seems like the Web Forwarder is failing on TLS Certificate validation and reporting the error in the logs. Follow this Setup documentation for Web Forwarding and I hope this would solve it: Web Forwarding — Deadline 10.2.0.10 documentation

You would need Web Forwarder enabled if the worker does not have access to the internet, so if your workers have internet access you can disable Web Forwarding.

Privacy | Site terms | Cookie preferences