Hi,
I’m trying to use your new distributed cellprofiler tool and I feel like I’m pretty (delusionally) close, but CP doesn’t seem to be retrieving the pipeline or images from my s3 bucket. I notice when I start the run that an ecsconfigs file appears in my bucket so it seems that something has access. I do all the steps and an SQS queue is created as well as a cluster, task and spotfleet, but nothing is written to my bucket and when I look in the cloudwatch logs it seems like there is a problem accessing files. I’ve modified the “ExampleSBS” to use the load data module and a file list I will attached those. It runs locally on my laptop without issue. I attached a screenshot of one of the cloudwatch logs for a well:
ExampleSBS_03.cppipe (17.0 KB)
setlist.csv (10.2 KB)
When I purge the queue to stop after it’s clear nothing is getting analyzed then the monitor function stops with this error:
Service has been downscaled
Old alarms deleted
Shutting down spot fleet sfr-f83e82b3-d07a-47f9-befd-c571055f50bc
Job done.
Deleting existing queue.
Deleting service
De-registering task
Removing cluster if it’s not the default and not otherwise in use
An error occurred (InvalidParameterException) when calling the CreateExportTask operation: GetBucketAcl call on the given bucket failed. Please check if the specified Amazon S3 Bucket is in the same AWS region as CloudWatch Logs.
Traceback (most recent call last):
File “run.py”, line 317, in
monitor()
File “run.py”, line 293, in monitor
result =getAWSJsonOutput(cmd)
File “run.py”, line 21, in getAWSJsonOutput
requestInfo = json.loads(out)
File “/usr/lib/python2.7/json/init.py”, line 339, in loads
return _default_decoder.decode(s)
File “/usr/lib/python2.7/json/decoder.py”, line 364, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File “/usr/lib/python2.7/json/decoder.py”, line 382, in raw_decode
raise ValueError(“No JSON object could be decoded”)
ValueError: No JSON object could be decoded
problem here is my s3 bucket appears to be “Global”. My vpc and cloudwatch are us-west-2. thanks in advance! -John