Local Multiprocessing
By default, if you don't configure an async task queue, QA-Board will use joblib
and local multiprocessing to run your batches.
Running batches locally
If you configured an another runner, you can always:
qa batch --runner=local my-batch
Configuration
There is only 1 option: concurrency
. You have multiple options to set it up:
- Per batch:
qa/batches.yaml
my-batch:
inputs:
- image.jpg
local:
concurrency: -1 # 1 concurrent run per CPUs, default
- Globally:
qaboard.yaml
runners:
default: local # default
local:
concurrency: 1 # serially
- On the CLI:
qa batch --local-concurrency 1
- via the
QA_BATCH_CONCURRENCY
environment variable
tip
Read joblib's docs