Batching with multi-core processors


I use CellProfiler for high-throughput screening so I process large amounts of images. We do not have a computer cluster but what we do have is powerful computers with 8-core processors for our analysis. What I was wondering is if there is any way to to do batch processing with each core individually in a similar way to what CPCluster does. Thanks for the help!

  • Juan Escribano

CellProfiler doesn’t currently make use of multicore machines in any special way, but you could try running multiple instances of it as if it were a cluster. If you have a large collection of images, I suggest splitting them into N batches for N=1,2,3,…,8 and seeing at which point you get the optimal throughput.