with DL 7.2.0.7, we submit a cloud job, the balancer sees it and spins up the proper number of instances based on budget…as it should.
DL 7.2.0.13 does not. Ultimately, you’ll see the be log snippet below, there’s an error we didn’t get before:
2015-07-31 18:14:25: Equalizer (16): HttpError : <HttpError 400 when requesting googleapis.com/compute/v1/p … s?alt=json returned “Invalid value for field ‘resource.disk.initializeParams.diskSizeGb’: ‘9’. Requested disk size cannot be smaller than the image size (10 GB)”>
2015-07-31 18:14:16: HouseKeeper (16): Beginning house keeping…
2015-07-31 18:14:19: HouseKeeper (16): House keeping completed.
2015-07-31 18:14:19: Worker Thread (16): Updating the State…
2015-07-31 18:14:19: State Cache (16): Setup…
2015-07-31 18:14:19: State Cache (16): Populating Cloud Regions…
2015-07-31 18:14:19: State Cache (16): Finished populating 1 Cloud Regions.
2015-07-31 18:14:19: State Cache (16): Populating Slave data…
2015-07-31 18:14:19: State Cache (16): Finished populating 178 Slaves.
2015-07-31 18:14:19: State Cache (16): Populating Limits data…
2015-07-31 18:14:19: State Cache (16): Finished populating 1308 Limit groups.
2015-07-31 18:14:19: State Cache (16): Populating Job data…
2015-07-31 18:14:21: State Cache (16): Finished populating 1299 Jobs.
2015-07-31 18:14:21: State Cache (16): Populating Groups data…
2015-07-31 18:14:21: State Cache (16): Finished populating 1 Groups.
2015-07-31 18:14:21: Worker Thread (16): Executing the Algorithm: DefaultAlgorithm…
2015-07-31 18:14:22: Creating Balancer State Struct
2015-07-31 18:14:22: Computing Demand
2015-07-31 18:14:22: Group (cloudgroup): TaskCount: (24) Weight: (1200)
2015-07-31 18:14:22: Determining the Available Resources
2015-07-31 18:14:22: Computing Targets
2015-07-31 18:14:22: Traceback (most recent call last):
2015-07-31 18:14:22: File “none”, line 162, in ComputeTargets
2015-07-31 18:14:22: KeyError: u’55baa935ee8df236ccd6841e’
2015-07-31 18:14:22: Populating Targets
2015-07-31 18:14:22: Group: cloudgroup Target: 1
2015-07-31 18:14:22: Algorithm (16): Targets:
2015-07-31 18:14:22: Algorithm (16): Region: us-central1-f
2015-07-31 18:14:22: Algorithm (16): Group: cloudgroup: 1
2015-07-31 18:14:22: Worker Thread (16): Equalizing targets…
2015-07-31 18:14:22: Equalizer (16): Region: us-central1-f (55257505be202d20ded21323): Enabled
2015-07-31 18:14:23: Equalizer (16): Group: cloudgroup: Enabled 0 / 1
2015-07-31 18:14:23: Equalizer (16): Requesting 1 new instances be started.
2015-07-31 18:14:25: Equalizer (16): HttpError : <HttpError 400 when requesting googleapis.com/compute/v1/p … s?alt=json returned “Invalid value for field ‘resource.disk.initializeParams.diskSizeGb’: ‘9’. Requested disk size cannot be smaller than the image size (10 GB)”>
2015-07-31 18:14:25: Worker Thread (16): Waiting 60 seconds before next cycle.
2015-07-31 18:15:24: Worker Thread (16): House Keeping…
2015-07-31 18:15:24: HouseKeeper (16): Beginning house keeping…
2015-07-31 18:15:24: HouseKeeper (16): House keeping completed.
2015-07-31 18:15:24: Worker Thread (16): Updating the State…