diff --git a/CODEOWNERS b/CODEOWNERS
deleted file mode 100644
index 3dab6e9..0000000
--- a/CODEOWNERS
+++ /dev/null
@@ -1,17 +0,0 @@
-/production @davidrohr @martenole @shahor02 @chiarazampolli
-
-/testing/detectors/CPV
-/testing/detectors/EMC
-/testing/detectors/FDD
-/testing/detectors/FT0
-/testing/detectors/FV0
-/testing/detectors/HMP
-/testing/detectors/ITS
-/testing/detectors/MCH @aphecethce
-/testing/detectors/MFT
-/testing/detectors/MID @aphecethce
-/testing/detectors/PHS
-/testing/detectors/TOF @noferini @chiarazampolli
-/testing/detectors/TPC @wiechula
-/testing/detectors/TRD @martenole
-/testing/detectors/ZDC
diff --git a/README.md b/README.md
index 50aad07..64fcf55 100644
--- a/README.md
+++ b/README.md
@@ -1,259 +1 @@
-This repository contains the PDP workflows to run on the EPN (in the future also on the FLP) and the parse script which parses the description files and creates the DDS XML files. For only a quick introduction and an example how to create a workflow on the EPN click [here](#Quick-guide-to-create-and-deploy-detector-workflow)
-
-# Terminology:
-- A **workflow** refers to a single DPL workflow binary, or multiple workflows binaries merged with the `|` syntax, or a shell script starting such a workflow.
-- A **full topology** refers to the final XML file that is passed to DDS to start up a processing chain for one single partition on the EPN.
-- A **partial topology** is the XML file created by DPL with the `--dds` option.
-
-# Folder structure:
-- **common** contains common scripts that can be used by all workflows, most importantly common environment variable scripts.
-- **production** contains the production workflows for global runs, which are maintained by PDP experts.
-- **tools** contains the **parser** script and auxiliary tools.
-- **testing** contains scripts for tests / standalone runs maintained by detectors or privately.
-
-# Topology descriptions and description library files:
-Another abstraction layer above the *workflows* are **topology descriptions**. The *parser* tool can generate the *full topology* XML file from such a *description*, using the `–dds` option of DPL and the `odc-topo-epn` tool. *Topology descriptions* are stored in **description library files** in the `O2DataProcessing` repository. A *description library file* can contain multiple *topology descriptions* each identified by a **topology name**
-
-# Remarks:
-- The repository does not store *full topologies*, but they are created on the fly. Users can cache the resulting full topology XML files.
-- The defaults (particularly also those set in the common environment files in the `common` folder) are tuned for running on a laptop / desktop.
-
-# Workflow requirements:
-- Workflows shall support 3 run modes selected via the `WORKFLOWMODE` env variable, the **dds** mode is mandatory:
- - **run** (default): run the workflow
- - **print**: print the final workflow command to the console
- - **dds**: create a partial topology.
-- If applicable, workflows shall use the settings from the `common/setenv.sh` script instead of implementing their own options. Mandatory env variables to respect are `SHMSIZE`, `GPUTYPE` (if the workflow supports GPUs),... (to be continued).
-
-# Configuring and selecting workflow in AliECS:
-There are 3 ways foreseenm to configure the *full topology* in AliECS: (currently only the manual XML option exists)
-- **hash of workflow repository**: In this mode, the following settings are configured in AliECS, and they uniquely identify a *full topology*. The *parser* will then create the final DDS XML file with the *full topology*:
- - A **commit hash** identifying a state of the `O2DataProcessing` repository (this can also be a tag, and in the case of production workflows it is required to be a tag).
- - The path of a **description library file** (relative path inside the `O2DataProcessing` repository).
- - The **workflow name** inside the *description library file*.
- - **detector list**: Three comma-separated lists of detectors participating in the run (global list, list for qc, list for calibration), defaulting to `ALL` for all detectors.
- - **workflow parameters**: text field passed to workflow as environment variable for additional options.
- - **number of nodes override**: Overrides the setting for the number of nodes required in the workflow (meant so quickly increase / decrease the EPN partition size).
-- **repository directory**: This is almost identical to the case above, but instead of the commit hash, there is the **repository path** specified, pointing to a checked out repository on the shared home folder in the EPN farm. The procedure is the same as before, the parser will create the full topology XML file from the specified workflow in the repository.
-- **manual XML file**: In this mode the `O2DataProcessing` repository is not used at all, but the absolute path of a *full topology* XML file in the EPN's shared home folder is specified. Such an XML file must be prepared manually by the same means as the *parser* would usually do (see paragraph on manual XML file below).
-
-# Topology descriptions:
-A *topology description* consists of
-- A list of modules to load, both for generating the DDS XML file with DPL's `--dds` option and when running the workflow. It can either be a single module, or a space-separated list of modules in double-quotes. In particular, this setting identifies the O2 version. We provide the `O2PDPSuite` package, which has the same versions as O2 itself, and which contain also corresponding versions `DataDistribution` and `QualityControl`, thus it is usually sufficient to just load `O2PDPSuite/[version]`.
-- A list of workflows, in the form of commands to run to create XML files by the `–dds` option. The command is executed with the `O2DataProcessing` path as working directory. The env options used to configure the workflow are prepended in normal shell syntax.
- - Each workflow is amended with the following parameters (the parameters stand in front of the workflow command, and are separated by commas without spaces, the workflow command must be in double-quotes):
- - Zone where to run the workflow (calib / reco)
- - For reco:
- - Number of nodes to run this workflow on
- - If a processor in the workflow needs to identify on which node it is running on, it can use the `$DDS_COLLECTION_INDEX` emvironment variable.
- - Minimum number of nodes required forthe workflow (in case of node failure)
- - In case the there are multiple workflows in the topology description, the largest number of nodes, and the largest minimum number of nodes are used.
- - For calib:
- - Number of physical cores to be reserved on the node to run the workflow.
- - Name of the calibration (used to set DDS properties which are used to make the reconstruction workflows connect to specific calibration workflows)
- - ODC/DDS allocates as many nodes as necessary to have sufficient CPU cores for the calibration workflows. The different calibration workflows may or may not run on the same node.
-
-An example for the topology library file looks like:
-- topologies.desc
-```
-demo-full-topology: O2PDPSuite/nightly-20210801 reco,128,126,"SHMSIZE=320000000000 full-system-test/dpl-workflow.sh" calib,5,"SHMSIZE=2000000000 calibration/some-calib.sh" calib,20,"SHMSIZE=2000000000 calibration/other-calib.sh";
-other-topology: O2PDPSuite/v1.0.0 reco,2,1,"tpc-test/tpc-standalone-test-1.sh"
-```
-- AliECS-config:
-```
-commit=xxxx|path=xxxx file=topologies.desc topology=demo-full-topology parameters="EVENT_DISPLAY" detectors="TPC,ITS" detectors_qc="TPC" [...]
-```
-
-# The parser script:
-The **parser** is a simple python script that parses a *topology description* and generates the DDS XML file with the *full topology*. To do so, it runs all the DPL workflows with the `--dds` option and then uses the `odc-topo-epn` tool to merge the *partial topology* into the final *full topology*.
-The *parser* is steered by some command line options and by some environment variables (note that the env variables get also passed through to the workflows).
-- The *parser* needs a DataDistribution topology file. Example files are shipped with the parser in the `tools/datadistribution_workflows` folder for: just discarding the TF, store the TF to disk, forward the TF to DPL processing (what we need for a DPL workflow), and forward to processing while storing to disk in parallel.
-- *Parser* command line options:
- - The parser is supposed to be executed from the root folder of the `O2DataProcessing` repository.
- - The syntax is:
-```
-[ENV_VARIABLES] ./tools/parse [DESCRIPTION_LIBRARY_FILE] [TOPOLOGY_NAME] [OUTPUT_NAME]
-```
- - In the above example, this could be:
-```
-DDWORKFLOW=tools/datadistribution_workflows/dd-processing.xml WORKFLOW_DETECTORS=TPC,ITS WORKFLOW_DETECTORS_QC=TPC WORKFLOW_DETECTORS_CALIB=ALL ./tools/parse topologies.desc demo-full-topology /tmp/output.xml
-```
-- The following environment variables steer the *Parser*:
- - `$FILEWORKDIR`: This variable must be set and is used by the workflows to specify where all required files (grp, geometry, dictionaries, etc) are located.
- - `$EPNMODE`: If set the parser assumes it is running on the EPN. If so it will automatically load the modules specified in the topology description. This variable is further used by the workflows themselves, e.g. to activate the InfoLogger and the Metrics monitoring.
- - `$INRAWCHANNAME`: Propagated to the workflow, defines the raw FMQ channel name used for the communication with DataDistribution.
- - `$RECO_NUM_NODES_OVERRIDE`: Overrides the number of nodes used for reconstruction (empty or 0 to disable)
- - `$DDMODE`: How to operate DataDistribution: **discard** (build TF and discard them), **disk** (build TF and store to disk), **processing** (build TF and run DPL workflow on TF data), **processing-disk** (both store TF to disk and run processing).
- - `$DDWORKFLOW`: (*alternative*): Explicit path to the XML file with the partial workflow for *DataDistribution*.
- - `$GEN_TOPO_IGNORE_ERROR`: Ignore ERROR messages during workflow creation.
-- When run on the EPN farm (indicated by the `$EPNMODE=1` variable), the *parser* will automaticall `module load` the modules specified in the *topology description*. Otherwise the user must load the respective O2 / QC version by himself.
-- The parser exports the env variable `$RECO_NUM_NODES_WORKFLOW` that contains on how many nodes the workflow will be running when running the workflow script. This can be used to tune the process multiplicities.
-
-# Creating a full topology DDS XML file manually:
-- Check out the `O2DataProcessing` repository, adjust the workflows and topology description to your need.
-- Open a shell and go to the root folder of `O2DataProcessing`.
-- Make sure the `odc-topo-epn` is in your path (e.g. `module load ODC` / `alienv enter ODC/latest`).
-- Set the required environment variables, e.g.
-```
-FILEWORKDIR=/home/epn/odc/files EPNMODE=1 DDWORKFLOW=tools/datadistribution_workflows/dd-processing.xml INRAWCHANNAME=tf-builder-pipe-0 WORKFLOW_DETECTORS=TPC,ITS,TRD,TOF,FT0
-```
-- If you are not on the EPN farm and have NOT set `EPNMODE=1`: Load the required modules for O2 / QC (`alienv load O2/latest QualityControl/latest`)
-- Run the parser, e.g.:
-```
-./tools/parse production/production.desc synchronous-workflow /tmp/dds-topology.xml
-```
-- Now you can use `/tmp/dds-topology.xml` to start the workflow via DDS.
-
-# Quick guide to create and deploy detector workflow:
-** Note: this is the current state of the EPN, not all configuration features (see [here](#Configuring-and-selecting-workflow-in-AliECS)) are available in AliECS yet, thus this guide shows only how to create the XML file for DDS. That XML file must then still be entered in the AliECS GUI as topology. This will be simplified in the future!**
-- **Temporarily** only `epn245` has the correct O2 installed, so please connect from the EPN head node to epn245 `ssh epn245`.
-- Check out the [O2DataProcessing](https://github.com/AliceO2Group/O2DataProcessing) repository to your home folder on the EPN (`$HOME` in the following).
-- Copy the content of `O2DataProcessing/testing/examples` (description library file `workflows.desc` and workflow script `example-workflow.sh`) to another place INSIDE the repository, usually under `testing/detectors/[DETECTOR]` or `testing/private/[USERNAME]`.
-- Edit the workflow script to your needs, adjust / rename the workflow in the description library file.
- - See [here](#Topology-descriptions) for the syntax of the lbirary file (in case it is not obvious), the workflow script is just a bash script that starts a DPL workflow, which must have the `--dds` parameter in order to create a partial DDS topology.
- - Please note that the modules to load must be exactly `"DataDistribution QualityControl"`. Later it will be possible to use `O2PDPSuite` and specify the version, but for now that must not be used as it would create a module collision!
-- Create an empty folder in your `$HOME` on the EPN, in the following `$HOME/test`.
-- Copy the topology generation template from `O2DataProcessing/tools/epn/run.sh` to your folder.
- - N.B.: this template script contains all the options that will be provided via AliECS automatically as environment variables. Eventually this file will not be needed any more, but the XML file will be automatically created from the AliECS GUI.
-- Edit your copy of the `run.sh` file. The following parameters are relevant for you:
- - Leave the `GEN_TOPO_HASH` setting to 0 and use the respective section of the file, the outcommented part with `GEN_TOPO_HASH=1` will become relevant once AliECS is updated.
- - Place the path to your copy of `O2DataProcessing` in `GEN_TOPO_SOURCE` and put your newly created description library file and the workflow in there as `GEN_TOPO_LIBRARY_FILE` and `GEN_TOPO_WORKFLOW_NAME`.
- - If you want to specify the number of reconstruction nodes to use here, you can use `RECO_NUM_NODES_OVERRIDE`, otherwise the default from your description library file will be used (leave it empty or `=0`).
- - The `WORKFLOW_DETECTORS` and `WORKFLOW_PARAMETERS` options are optional, your workflow does not need to use them. They are mostly for more complex workflows, so you can ignore them for now`.
- - Leave `DDMODE=processing` in order to run a workflow.
- - `GEN_TOPO_PARTITION` and `NHBPERTF` will be set by AliECS later automatically, no need to change them.
- - Change the output filename to a file somewhere in your `$HOME`, the default is `$HOME`/gen_topo_output.xml. This will be the file you have to enter in AliECS as topology.
-- Run `run.sh`
-- Put the output file (default is `$HOME/gen_topo_output.xml`) as EPN DDS topology in the AliECS GUI.
-
-When adapting your workflow, please try to follow the style of the existing workflows. The [testing/examples/example-workflow.sh](testing/examples/example-workflow.sh) should be a simple start, for a more complex example you can have a look at [testing/detectors/TPC/tpc-workflow.sh](testing/detectors/TPC/tpc-workflow.sh), and as a fulll complex example of a global workflow please look at [production/full-system-test/dpl-workflow_local.sh](production/full-system-test/dpl-workflow_local.sh)
-
-**Please note that currently when creating a workflow that contains QC, ERROR messages will be written to the console. The workflow creation scripts sees these error messages and then fails. These failures can be ignored using the `GEN_TOPO_IGNORE_ERROR=1` env variable, which is thus temporarily mandatory for all workflows containing QC.**
-
-For reference, the `run.sh` script internally uses the `parser` to create the XML file, it essentially sets some environment variables and then calls the *parser* with all options set. So in principle, you can also use the *parser* directly to create the workflow as described [here](Creating-a-full-topology-DDS-XML-file-manually).
-
-For comparison, see my console output below:
-```
-[drohr@head ~]$ ssh epn245
-Activate the web console with: systemctl enable --now cockpit.socket
-
-Last login: Wed Sep 1 19:11:47 2021 from 10.162.32.2
-[drohr@epn245 ~]$ git clone https://github.com/AliceO2Group/O2DataProcessing
-Cloning into 'O2DataProcessing'...
-remote: Enumerating objects: 182, done.
-remote: Counting objects: 100% (182/182), done.
-remote: Compressing objects: 100% (112/112), done.
-remote: Total 182 (delta 64), reused 135 (delta 48), pack-reused 0
-Receiving objects: 100% (182/182), 36.42 KiB | 5.20 MiB/s, done.
-Resolving deltas: 100% (64/64), done.
-[drohr@epn245 ~]$ cd O2DataProcessing/testing/
-[drohr@epn245 testing]$ mkdir -p private/drohr
-[drohr@epn245 testing]$ ls examples/
-example-workflow.sh workflows.desc
-[drohr@epn245 testing]$ cp examples/* private/drohr/
-[drohr@epn245 testing]$ vi private/drohr/workflows.desc
-[drohr@epn245 testing]$ mv private/drohr/example-workflow.sh private/drohr/my-workflow.sh
-[drohr@epn245 testing]$ vi private/drohr/my-workflow.sh
-[drohr@epn245 testing]$ cat private/drohr/workflows.desc
-drohr-workflow: "DataDistribution QualityControl" reco,10,10,"SHMSIZE=128000000000 testing/private/drohr/my-workflow.sh"
-[drohr@epn245 testing]$ mkdir ~/test
-[drohr@epn245 testing]$ cd ~/test
-[drohr@epn245 test]$ cp ~/O2DataProcessing/tools/epn/run.sh .
-[drohr@epn245 test]$ vi run.sh
-[drohr@epn245 test]$ cat run.sh
-#!/bin/bash
-
-export GEN_TOPO_PARTITION=test # ECS Partition
-export DDMODE=processing # DataDistribution mode - possible options: processing, disk, processing-disk, discard
-
-# Use these settings to fetch the Workflow Repository using a hash / tag
-#export GEN_TOPO_HASH=1 # Fetch O2DataProcessing repository using a git hash
-#export GEN_TOPO_SOURCE=v0.5 # Git hash to fetch
-
-# Use these settings to specify a path to the workflow repository in your home dir
-export GEN_TOPO_HASH=0 # Specify path to O2DataProcessing repository
-export GEN_TOPO_SOURCE=/home/drohr/O2DataProcessing # Path to O2DataProcessing repository
-
-export GEN_TOPO_LIBRARY_FILE=testing/private/drohr/workflows.desc # Topology description library file to load
-export GEN_TOPO_WORKFLOW_NAME=drohr-workflow # Name of workflow in topology description library
-export WORKFLOW_DETECTORS=ALL # Optional parameter for the workflow: Detectors to run reconstruction for (comma-separated list)
-export WORKFLOW_DETECTORS_QC= # Optional parameter for the workflow: Detectors to run QC for
-export WORKFLOW_DETECTORS_CALIB= # Optional parameters for the workflow: Detectors to run calibration for
-export WORKFLOW_PARAMETERS= # Additional paramters for the workflow
-export RECO_NUM_NODES_OVERRIDE=0 # Override the number of EPN compute nodes to use (default is specified in description library file)
-export NHBPERTF=256 # Number of HBF per TF
-
-/home/epn/pdp/gen_topo.sh > $HOME/gen_topo_output.xml
-[drohr@epn245 test]$ ./run.sh
-Loading ODC/0.36-1
- Loading requirement: BASE/1.0 GCC-Toolchain/v10.2.0-alice2-3 fmt/7.1.0-10 FairLogger/v1.9.1-7 zlib/v1.2.8-8 OpenSSL/v1.0.2o-9 libpng/v1.6.34-9 sqlite/v3.15.0-2 libffi/v3.2.1-2 FreeType/v2.10.1-8 Python/v3.6.10-12 Python-modules/1.0-16 boost/v1.75.0-13 ZeroMQ/v4.3.3-6 ofi/v1.7.1-8 asio/v1.19.1-2 asiofi/v0.5.1-2 DDS/3.5.16-5 FairMQ/v1.4.40-4
- protobuf/v3.14.0-9 c-ares/v1.17.1-5 re2/2019-09-01-11 grpc/v1.34.0-alice2-1
-Using topology drohr-workflow of library testing/private/drohr/workflows.desc
-Found topology drohr-workflow - ['drohr-workflow:', 'DataDistribution QualityControl', 'reco,10,10,SHMSIZE=128000000000 testing/private/drohr/my-workflow.sh']
-Loading module DataDistribution
-Loading DataDistribution/v1.0.6-2
- Loading requirement: libInfoLogger/v2.1.1-5 Ppconsul/v0.2.2-5 utf8proc/v2.6.1-3 lzma/v5.2.3-6 Clang/v12.0.1-2 lz4/v1.9.3-9 arrow/v5.0.0-alice1-4 GSL/v1.16-8 libxml2/v2.9.3-8 ROOT/v6-24-02-12 FairRoot/v18.4.2-7 Vc/1.4.1-11 Monitoring/v3.8.7-4 Configuration/v2.6.2-4 Common-O2/v1.6.0-13 ms_gsl/3.1.0-5 GLFW/3.3.2-10 libuv/v1.40.0-10
- DebugGUI/v0.5.6-6 libjalienO2/0.1.3-5 FFTW3/v3.3.9-6 O2/nightly-20210831-0930-1
-Loading module QualityControl
-Loading QualityControl/v1.27.0-1
- Loading requirement: Control-OCCPlugin/v0.26.3-1 VecGeom/89a05d148cc708d4efc2e7b0eb6e2118d2610057-40
-Adding reco workflow ( 10 - 10 nodes): SHMSIZE=128000000000 testing/private/drohr/my-workflow.sh
-Running DPL command SHMSIZE=128000000000 testing/private/drohr/my-workflow.sh | grep -v "^\[INFO" > /tmp/o2_workflowmfld0a0n/wf2.dds && [ `grep "^\[" /tmp/o2_workflowmfld0a0n/wf2.dds | wc -l` == 0 ]
-Creating reconstruction collection...
-New DDS topology successfully created and saved to a file "/home/drohr/gen_topo/test/output.xml"
-DDS topology "topology" successfully opened from file "/home/drohr/gen_topo/test/output.xml"
-Done
-[drohr@epn245 test]$ cat $HOME/gen_topo_output.xml
-
-[...]
-
-```
-
-For reference, here is the creation of the XML for the full synchronous processing workflow:
-```
-[drohr@epn245 test]$ cat run.sh
-#!/bin/bash
-
-export GEN_TOPO_PARTITION=test # ECS Partition
-export DDMODE=processing # DataDistribution mode - possible options: processing, disk, processing-disk, discard
-
-# Use these settings to fetch the Workflow Repository using a hash / tag
-#export GEN_TOPO_HASH=1 # Fetch O2DataProcessing repository using a git hash
-#export GEN_TOPO_SOURCE=v0.5 # Git hash to fetch
-
-# Use these settings to specify a path to the workflow repository in your home dir
-export GEN_TOPO_HASH=0 # Specify path to O2DataProcessing repository
-export GEN_TOPO_SOURCE=/home/drohr/O2DataProcessing # Path to O2DataProcessing repository
-
-export GEN_TOPO_LIBRARY_FILE=production/production.desc # Topology description library file to load
-export GEN_TOPO_WORKFLOW_NAME=synchronous-workflow # Name of workflow in topology description library
-export WORKFLOW_DETECTORS=ALL # Optional parameter for the workflow: Detectors to run reconstruction for (comma-separated list)
-export WORKFLOW_DETECTORS_QC= # Optional parameter for the workflow: Detectors to run QC for
-export WORKFLOW_DETECTORS_CALIB= # Optional parameters for the workflow: Detectors to run calibration for
-export WORKFLOW_PARAMETERS=EVENT_DISPLAY,CTF,GPU # Additional paramters for the workflow
-export RECO_NUM_NODES_OVERRIDE=0 # Override the number of EPN compute nodes to use (default is specified in description library file)
-export NHBPERTF=256 # Number of HBF per TF
-
-/home/epn/pdp/gen_topo.sh > $HOME/gen_topo_output.xml
-[drohr@epn245 test]$ ./run.sh
-Loading ODC/0.36-1
- Loading requirement: BASE/1.0 GCC-Toolchain/v10.2.0-alice2-3 fmt/7.1.0-10 FairLogger/v1.9.1-7 zlib/v1.2.8-8 OpenSSL/v1.0.2o-9 libpng/v1.6.34-9 sqlite/v3.15.0-2 libffi/v3.2.1-2 FreeType/v2.10.1-8 Python/v3.6.10-12 Python-modules/1.0-16 boost/v1.75.0-13 ZeroMQ/v4.3.3-6 ofi/v1.7.1-8 asio/v1.19.1-2 asiofi/v0.5.1-2 DDS/3.5.16-5 FairMQ/v1.4.40-4
- protobuf/v3.14.0-9 c-ares/v1.17.1-5 re2/2019-09-01-11 grpc/v1.34.0-alice2-1
-Using topology synchronous-workflow of library production/production.desc
-Found topology synchronous-workflow - ['synchronous-workflow:', 'DataDistribution QualityControl', 'reco,128,128,EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=0 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 SEVERITY=warning production/full-system-test/dpl-workflow_local.sh', 'reco,128,128,EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=1 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 SEVERITY=warning production/full-system-test/dpl-workflow_local.sh']
-Loading module DataDistribution
-Loading DataDistribution/v1.0.6-2
- Loading requirement: libInfoLogger/v2.1.1-5 Ppconsul/v0.2.2-5 utf8proc/v2.6.1-3 lzma/v5.2.3-6 Clang/v12.0.1-2 lz4/v1.9.3-9 arrow/v5.0.0-alice1-4 GSL/v1.16-8 libxml2/v2.9.3-8 ROOT/v6-24-02-12 FairRoot/v18.4.2-7 Vc/1.4.1-11 Monitoring/v3.8.7-4 Configuration/v2.6.2-4 Common-O2/v1.6.0-13 ms_gsl/3.1.0-5 GLFW/3.3.2-10 libuv/v1.40.0-10
- DebugGUI/v0.5.6-6 libjalienO2/0.1.3-5 FFTW3/v3.3.9-6 O2/nightly-20210831-0930-1
-Loading module QualityControl
-Loading QualityControl/v1.27.0-1
- Loading requirement: Control-OCCPlugin/v0.26.3-1 VecGeom/89a05d148cc708d4efc2e7b0eb6e2118d2610057-40
-Adding reco workflow ( 128 - 128 nodes): EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=0 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 SEVERITY=warning production/full-system-test/dpl-workflow_local.sh
-Running DPL command EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=0 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 SEVERITY=warning production/full-system-test/dpl-workflow_local.sh | grep -v "^\[INFO" > /tmp/o2_workflowkxkzei9w/wf2.dds && [ `grep "^\[" /tmp/o2_workflowkxkzei9w/wf2.dds | wc -l` == 0 ]
-Adding reco workflow ( 128 - 128 nodes): EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=1 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 SEVERITY=warning production/full-system-test/dpl-workflow_local.sh
-Running DPL command EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=1 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 SEVERITY=warning production/full-system-test/dpl-workflow_local.sh | grep -v "^\[INFO" > /tmp/o2_workflowkxkzei9w/wf3.dds && [ `grep "^\[" /tmp/o2_workflowkxkzei9w/wf3.dds | wc -l` == 0 ]
-Creating reconstruction collection...
-New DDS topology successfully created and saved to a file "/home/drohr/gen_topo/test/output.xml"
-DDS topology "topology" successfully opened from file "/home/drohr/gen_topo/test/output.xml"
-Done
-```
+The O2DataProcessing repository has moved, please find the new location [here](https://github.com/AliceO2Group/O2DPG/tree/master/DATA)!
diff --git a/aliecs_documentation/README.md b/aliecs_documentation/README.md
new file mode 100644
index 0000000..5c3a816
--- /dev/null
+++ b/aliecs_documentation/README.md
@@ -0,0 +1 @@
+The O2DataProcessing repository has moved, please find the instructions you are looking for [here](https://github.com/AliceO2Group/O2DPG/blob/master/DATA/aliecs_documentation/README.md)!
diff --git a/common/README.md b/common/README.md
index 35cee7e..32880bb 100644
--- a/common/README.md
+++ b/common/README.md
@@ -1,49 +1 @@
-The `setenv-sh` script sets the following environment options
-* `NTIMEFRAMES`: Number of time frames to process.
-* `TFDELAY`: Delay in seconds between publishing time frames (1 / rate).
-* `NGPUS`: Number of GPUs to use, data distributed round-robin.
-* `GPUTYPE`: GPU Tracking backend to use, can be CPU / CUDA / HIP / OCL / OCL2.
-* `SHMSIZE`: Size of the global shared memory segment.
-* `DDSHMSIZE`: Size of shared memory unmanaged region for DataDistribution Input.
-* `GPUMEMSIZE`: Size of allocated GPU memory (if GPUTYPE != CPU)
-* `HOSTMEMSIZE`: Size of allocated host memory for GPU reconstruction (0 = default).
- * For `GPUTYPE = CPU`: TPC Tracking scratch memory size. (Default 0 -> dynamic allocation.)
- * Otherwise : Size of page-locked host memory for GPU processing. (Defauls 0 -> 1 GB.)
-* `CREATECTFDICT`: Create CTF dictionary.
-* `SAVECTF`: Save the CTF to a root file.
- * 0: Read `ctf_dictionary.root` as input.
- * 1: Create `ctf_dictionary.root`. Note that this was already done automatically if the raw data was simulated with `full_system_test.sh`.
-* `SYNCMODE`: Run only reconstruction steps of the synchronous reconstruction.
- * Note that there is no `ASYNCMODE` but instead the `CTFINPUT` option already enforces asynchronous processing.
-* `NUMAGPUIDS`: NUMAID-aware GPU id selection. Needed for the full EPN configuration with 8 GPUs, 2 NUMA domains, 4 GPUs per domain.
- In this configuration, 2 instances of `dpl-workflow.sh` must run in parallel.
- To be used in combination with `NUMAID` to select the id per workflow.
- `start_tmux.sh` will set up these variables automatically.
-* `NUMAID`: SHM segment id to use for shipping data as well as set of GPUs to use (use `0` / `1` for 2 NUMA domains, 0 = GPUS `0` to `NGPUS - 1`, 1 = GPUS `NGPUS` to `2 * NGPUS - 1`)
-* 0: Runs all reconstruction steps, of sync and of async reconstruction, using raw data input.
-* 1: Runs only the steps of synchronous reconstruction, using raw data input.
-* `EXTINPUT`: Receive input from raw FMQ channel instead of running o2-raw-file-reader.
- * 0: `dpl-workflow.sh` can run as standalone benchmark, and will read the input itself.
- * 1: To be used in combination with either `datadistribution.sh` or `raw-reader.sh` or with another DataDistribution instance.
-* `CTFINPUT`: Read input from CTF ROOT file. This option is incompatible to EXTINPUT=1. The CTF ROOT file can be stored via SAVECTF=1.
-* `NHBPERTF`: Time frame length (in HBF)
-* `GLOBALDPLOPT`: Global DPL workflow options appended to o2-dpl-run.
-* `EPNPIPELINES`: Set default EPN pipeline multiplicities.
- Normally the workflow will start 1 dpl device per processor.
- For some of the CPU parts, this is insufficient to keep step with the GPU processing rate, e.g. one ITS-TPC matcher on the CPU is slower than the TPC tracking on multiple GPUs.
- This option adds some multiplicies for CPU processes using DPL's pipeline feature.
- The settings were tuned for EPN processing with 4 GPUs (i.e. the default multiplicities are per NUMA domain).
- The multiplicities are scaled with the `NGPUS` setting, i.e. with 1 GPU only 1/4th are applied.
- You can pass an option different to 1, and than it will be applied as factor on top of the multiplicities.
- It is auto-selected by `start-tmux.sh`.
-* `SEVERITY`: Log verbosity (e.g. info or error, default: info)
-* `INFOLOGGER_SEVERITY`: Min severity for messages sent to Infologger. (default: `$SEVERITY`)
-* `SHMTHROW`: Throw exception when running out of SHM memory.
- It is suggested to leave this enabled (default) on tests on the laptop to get an actual error when it runs out of memory.
- This is disabled in `start_tmux.sh`, to avoid breaking the processing while there is a chance that another process might free memory and we can continue.
-* `NORATELOG`: Disable FairMQ Rate Logging.
-* `INRAWCHANNAME`: FairMQ channel name used by the raw proxy, must match the name used by DataDistribution.
-* `WORKFLOWMODE`: run (run the workflow (default)), print (print the command to stdout), dds (create partial DDS topology)
-* `FILEWORKDIR`: directory for all input / output files. E.g. grp / geometry / dictionaries etc. are read from here, and dictionaries / ctf / etc. are written to there.
- Some files have more fine grained control via other environment variables (e.g. to store the CTF to somewhere else). Such variables are initialized to `$FILEWORKDIR` by default but can be overridden.
-* `EPNMODE`: Specify that this is a workflow running on the EPN, e.g. logging goes to InfoLogger, DPL metrics to to the AliECS monitoring, etc.
\ No newline at end of file
+The O2DataProcessing repository has moved, please find the instructions you are looking for [here](https://github.com/AliceO2Group/O2DPG/blob/master/DATA/comon/README.md)!
diff --git a/common/setenv.sh b/common/setenv.sh
deleted file mode 100755
index 20f2a6c..0000000
--- a/common/setenv.sh
+++ /dev/null
@@ -1,121 +0,0 @@
-#!/bin/bash
-
-# Make sure we can open sufficiently many files / allocate enough memory
-ulimit -n 4096 && ulimit -m unlimited && ulimit -v unlimited && [ -z "$GPUTYPE" ] || [ "$GPUTYPE" == "CPU" ] || ulimit -l unlimited
-if [ $? != 0 ]; then
- echo Error setting ulimits
- exit 1
-fi
-
-if [ -z "$NTIMEFRAMES" ]; then export NTIMEFRAMES=1; fi # Number of time frames to process
-if [ -z "$TFDELAY" ]; then export TFDELAY=100; fi # Delay in seconds between publishing time frames
-if [ -z "$NGPUS" ]; then export NGPUS=1; fi # Number of GPUs to use, data distributed round-robin
-if [ -z "$GPUTYPE" ]; then export GPUTYPE=CPU; fi # GPU Tracking backend to use, can be CPU / CUDA / HIP / OCL / OCL2
-if [ -z "$SHMSIZE" ]; then export SHMSIZE=$(( 8 << 30 )); fi # Size of shared memory for messages
-if [ -z "$DDSHMSIZE" ]; then export DDSHMSIZE=$(( 8 << 10 )); fi # Size of shared memory for DD Input
-if [ -z "$GPUMEMSIZE" ]; then export GPUMEMSIZE=$(( 24 << 30 )); fi # Size of allocated GPU memory (if GPUTYPE != CPU)
-if [ -z "$HOSTMEMSIZE" ]; then export HOSTMEMSIZE=0; fi # Size of allocated host memory for GPU reconstruction (0 = default)
-if [ -z "$CREATECTFDICT" ]; then export CREATECTFDICT=0; fi # Create CTF dictionary
-if [ -z "$SAVECTF" ]; then export SAVECTF=0; fi # Save the CTF to a ROOT file
-if [ -z "$SYNCMODE" ]; then export SYNCMODE=0; fi # Run only reconstruction steps of the synchronous reconstruction
-if [ -z "$NUMAID" ]; then export NUMAID=0; fi # SHM segment id to use for shipping data as well as set of GPUs to use (use 0 / 1 for 2 NUMA domains)
-if [ -z "$NUMAGPUIDS" ]; then export NUMAGPUIDS=0; fi # NUMAID-aware GPU id selection
-if [ -z "$EXTINPUT" ]; then export EXTINPUT=0; fi # Receive input from raw FMQ channel instead of running o2-raw-file-reader
-if [ -z "$CTFINPUT" ]; then export CTFINPUT=0; fi # Read input from CTF (incompatible to EXTINPUT=1)
-if [ -z "$NHBPERTF" ]; then export NHBPERTF=128; fi # Time frame length (in HBF)
-if [ -z "$GLOBALDPLOPT" ]; then export GLOBALDPLOPT=; fi # Global DPL workflow options appended at the end
-if [ -z "$EPNPIPELINES" ]; then export EPNPIPELINES=0; fi # Set default EPN pipeline multiplicities
-if [ -z "$SEVERITY" ]; then export SEVERITY="info"; fi # Log verbosity
-if [ -z "$SHMTHROW" ]; then export SHMTHROW=1; fi # Throw exception when running out of SHM
-if [ -z "$NORATELOG" ]; then export NORATELOG=1; fi # Disable FairMQ Rate Logging
-if [ -z "$INRAWCHANNAME" ]; then export INRAWCHANNAME=stfb-to-dpl; fi # Raw channel name used to communicate with DataDistribution
-if [ -z "$WORKFLOWMODE" ]; then export WORKFLOWMODE=run; fi # Workflow mode, must be run, print, od dds
-if [ -z "$FILEWORKDIR" ]; then export FILEWORKDIR=`pwd`; fi # Override folder where to find grp, etc.
-if [ -z "$EPNMODE" ]; then export EPNMODE=0; fi # Is this workflow supposed to run on EPN? Will enable InfoLogger / metrics / ...
-# Detectors used in the workflow / enabled parameters
-if [ -z "${WORKFLOW_DETECTORS+x}" ] || [ "0$WORKFLOW_DETECTORS" == "0ALL" ]; then export WORKFLOW_DETECTORS="ITS,MFT,TPC,TOF,FT0,MID,EMC,PHS,CPV,ZDC,FDD,HMP,FV0,TRD,MCH"; fi
-if [ -z "${WORKFLOW_DETECTORS_QC+x}" ] || [ "0$WORKFLOW_DETECTORS_QC" == "0ALL" ]; then export WORKFLOW_DETECTORS_QC=$WORKFLOW_DETECTORS; fi
-if [ -z "${WORKFLOW_DETECTORS_CALIB+x}" ] || [ "0$WORKFLOW_DETECTORS_CALIB" == "0ALL" ]; then export WORKFLOW_DETECTORS_CALIB=$WORKFLOW_DETECTORS; fi
-if [ -z "$WORKFLOW_PARAMETERS" ]; then export WORKFLOW_PARAMETERS=; fi
-# Some more options for running on the EPN
-if [ -z "$INFOLOGGER_SEVERITY" ]; then export INFOLOGGER_SEVERITY="warning"; fi
-if [ -z "$MULTIPLICITY_FACTOR_RAWDECODERS" ]; then export MULTIPLICITY_FACTOR_RAWDECODERS=1; fi
-if [ -z "$MULTIPLICITY_FACTOR_CTFENCODERS" ]; then export MULTIPLICITY_FACTOR_CTFENCODERS=1; fi
-if [ -z "$MULTIPLICITY_FACTOR_REST" ]; then export MULTIPLICITY_FACTOR_REST=1; fi
-
-
-SEVERITY_TPC="info" # overrides severity for the tpc workflow
-DISABLE_MC="--disable-mc"
-
-if [ $EXTINPUT == 1 ] && [ $CTFINPUT == 1 ]; then
- echo EXTINPUT and CTFINPUT are incompatible
- exit 1
-fi
-if [ $SAVECTF == 1 ] && [ $CTFINPUT == 1 ]; then
- echo SAVECTF and CTFINPUT are incompatible
- exit 1
-fi
-if [ $SYNCMODE == 1 ] && [ $CTFINPUT == 1 ]; then
- echo SYNCMODE and CTFINPUT are incompatible
- exit 1
-fi
-if [ $WORKFLOWMODE != "run" ] && [ $WORKFLOWMODE != "print" ] && [ $WORKFLOWMODE != "dds" ]; then
- echo Invalid workflow mode
- exit 1
-fi
-
-has_detector()
-{
- [[ $WORKFLOW_DETECTORS =~ (^|,)"$1"(,|$) ]]
-}
-
-has_detectors()
-{
- while true; do
- if [ "0$1" == "0" ]; then return 0; fi
- if ! has_detector $1; then return 1; fi
- shift
- done
-}
-
-has_detector_qc()
-{
- has_detector $1 && [[ $WORKFLOW_DETECTORS_QC =~ (^|,)"$1"(,|$) ]]
-}
-
-has_detectors_qc()
-{
- while true; do
- if [ "0$1" == "0" ]; then return 0; fi
- if ! has_detector_qc $1; then return 1; fi
- shift
- done
-}
-
-has_detector_calib()
-{
- has_detector $1 && [[ $WORKFLOW_DETECTORS_CALIB =~ (^|,)"$1"(,|$) ]]
-}
-
-has_detectors_calib()
-{
- while true; do
- if [ "0$1" == "0" ]; then return 0; fi
- if ! has_detector_calib $1; then return 1; fi
- shift
- done
-}
-
-workflow_has_parameter()
-{
- [[ $WORKFLOW_PARAMETERS =~ (^|,)"$1"(,|$) ]]
-}
-
-workflow_has_parameters()
-{
- while true; do
- if [ "0$1" == "0" ]; then return 0; fi
- if ! workflow_has_parameter $1; then return 1; fi
- shift
- done
-}
diff --git a/production/README.md b/production/README.md
new file mode 100644
index 0000000..49209ed
--- /dev/null
+++ b/production/README.md
@@ -0,0 +1 @@
+The O2DataProcessing repository has moved, please find the instructions you are looking for [here](https://github.com/AliceO2Group/O2DPG/blob/master/DATA/production/README.md)!
\ No newline at end of file
diff --git a/production/dpl-workflow.sh b/production/dpl-workflow.sh
deleted file mode 100755
index 42ff630..0000000
--- a/production/dpl-workflow.sh
+++ /dev/null
@@ -1,345 +0,0 @@
-#!/bin/bash
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Get this script's directory and load common settings (use zsh first (e.g. on Mac) and fallback on `readlink -f` if zsh is not there)
-command -v zsh > /dev/null 2>&1 && MYDIR=$(dirname $(zsh -c 'echo ${0:A}' "$0"))
-test -z ${MYDIR+x} && MYDIR="$(dirname $(readlink -f $0))"
-source $MYDIR/setenv.sh
-
-# ---------------------------------------------------------------------------------------------------------------------
-#Some additional settings used in this workflow
-if [ -z $OPTIMIZED_PARALLEL_ASYNC ]; then OPTIMIZED_PARALLEL_ASYNC=0; fi # Enable tuned process multiplicities for async processing on the EPN
-if [ -z $CTF_DIR ]; then CTF_DIR=$FILEWORKDIR; fi # Directory where to store dictionary files
-if [ -z $CTF_DICT_DIR ]; then CTF_DICT_DIR=$FILEWORKDIR; fi # Directory of CTF dictionaries
-if [ -z $RECO_NUM_NODES_WORKFLOW ]; then RECO_NUM_NODES_WORKFLOW=250; fi # Number of EPNs running this workflow in parallel, to increase multiplicities if necessary, by default assume we are 1 out of 250 servers
-
-workflow_has_parameter CTF && export SAVECTF=1
-workflow_has_parameter GPU && { export GPUTYPE=HIP; export NGPUS=4; }
-
-ITSCLUSDICT="${FILEWORKDIR}/ITSdictionary.bin"
-MFTCLUSDICT="${FILEWORKDIR}/MFTdictionary.bin"
-MFT_NOISE="${FILEWORKDIR}/mft_noise_220721_R3C-520.root"
-CTF_MINSIZE="2000000"
-NITSDECTHREADS=2
-NMFTDECTHREADS=2
-
-
-if [ "0$O2_ROOT" == "0" ]; then
- eval "`alienv shell-helper`"
- alienv --no-refresh load O2/latest
-fi
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Set general arguments
-ARGS_ALL="--session default --severity $SEVERITY --shm-segment-id $NUMAID --shm-segment-size $SHMSIZE"
-if [ $EPNMODE == 1 ]; then
- ARGS_ALL+=" --infologger-severity $INFOLOGGER_SEVERITY"
- #ARGS_ALL+=" --monitoring-backend influxdb-unix:///tmp/telegraf.sock --resources-monitoring 60"
- ARGS_ALL+=" --monitoring-backend no-op://"
-else
- ARGS_ALL+=" --monitoring-backend no-op://"
-fi
-if [ $EXTINPUT == 1 ] || [ $NUMAGPUIDS == 1 ]; then
- ARGS_ALL+=" --no-cleanup"
-fi
-if [ $SHMTHROW == 0 ]; then
- ARGS_ALL+=" --shm-throw-bad-alloc 0"
-fi
-if [ $NORATELOG == 1 ]; then
- ARGS_ALL+=" --fairmq-rate-logging 0"
-fi
-if [ $NUMAGPUIDS != 0 ]; then
- ARGS_ALL+=" --child-driver 'numactl --membind $NUMAID --cpunodebind $NUMAID'"
-fi
-if [ $GPUTYPE != "CPU" ] || [ $OPTIMIZED_PARALLEL_ASYNC != 0 ]; then
- ARGS_ALL+=" --shm-mlock-segment-on-creation 1"
-fi
-ARGS_ALL_CONFIG="NameConf.mDirGRP=$FILEWORKDIR;NameConf.mDirGeom=$FILEWORKDIR;NameConf.mDirCollContext=$FILEWORKDIR;NameConf.mDirMatLUT=$FILEWORKDIR;keyval.input_dir=$FILEWORKDIR;keyval.output_dir=/dev/null"
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Set some individual workflow arguments depending on configuration
-GPU_INPUT=zsraw
-GPU_OUTPUT=tracks,clusters
-GPU_CONFIG=
-GPU_CONFIG_KEY=
-TOF_INPUT=raw
-ITS_CONFIG=
-ITS_CONFIG_KEY=
-TRD_CONFIG=
-TRD_CONFIG_KEY=
-TRD_TRANSFORMER_CONFIG=
-EVE_CONFIG=
-MFTDEC_CONFIG=
-
-if [ $SYNCMODE == 1 ]; then
- ITS_CONFIG_KEY+="fastMultConfig.cutMultClusLow=30;fastMultConfig.cutMultClusHigh=2000;fastMultConfig.cutMultVtxHigh=500;"
- GPU_CONFIG_KEY+="GPU_global.synchronousProcessing=1;GPU_proc.clearO2OutputFromGPU=1;"
- TRD_CONFIG+=" --track-sources ITS-TPC --filter-trigrec"
- TRD_CONFIG_KEY+="GPU_proc.ompThreads=1;"
- TRD_TRANSFORMER_CONFIG+=" --filter-trigrec"
-else
- TRD_CONFIG+=" --track-sources TPC,ITS-TPC"
-fi
-
-if [ $CTFINPUT == 1 ]; then
- ITS_CONFIG+=" --tracking-mode async"
-else
- ITS_CONFIG+=" --tracking-mode sync"
- GPU_OUTPUT+=",compressed-clusters-ctf"
-fi
-
-if [ $EPNMODE == 1 ]; then
- EVE_CONFIG+=" --eve-dds-collection-index 0"
- MFTDEC_CONFIG+=" --noise-file \"${MFT_NOISE}\""
-fi
-
-if [ $GPUTYPE == "HIP" ]; then
- if [ $NUMAID == 0 ] || [ $NUMAGPUIDS == 0 ]; then
- export TIMESLICEOFFSET=0
- else
- export TIMESLICEOFFSET=$NGPUS
- fi
- GPU_CONFIG_KEY+="GPU_proc.deviceNum=0;GPU_global.mutexMemReg=true;"
- GPU_CONFIG+=" --environment \"ROCR_VISIBLE_DEVICES={timeslice${TIMESLICEOFFSET}}\""
- export HSA_NO_SCRATCH_RECLAIM=1
- #export HSA_TOOLS_LIB=/opt/rocm/lib/librocm-debug-agent.so.2
-else
- GPU_CONFIG_KEY+="GPU_proc.deviceNum=-2;"
-fi
-
-if [ ! -z $GPU_NUM_MEM_REG_CALLBACKS ]; then
- GPU_CONFIG+=" --expected-region-callbacks $GPU_NUM_MEM_REG_CALLBACKS"
-fi
-
-if [ $GPUTYPE != "CPU" ]; then
- GPU_CONFIG_KEY+="GPU_proc.forceMemoryPoolSize=$GPUMEMSIZE;"
- if [ $HOSTMEMSIZE == "0" ]; then
- HOSTMEMSIZE=$(( 1 << 30 ))
- fi
-fi
-
-if [ $HOSTMEMSIZE != "0" ]; then
- GPU_CONFIG_KEY+="GPU_proc.forceHostMemoryPoolSize=$HOSTMEMSIZE;"
-fi
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Process multiplicities
-N_TPCTRK=1
-N_TPCENT=1
-N_TPCITS=1
-N_ITSRAWDEC=1
-N_MFTRAWDEC=1
-N_TPCRAWDEC=$NGPUS
-N_EMC=1
-N_TRDENT=1
-N_TRDTRK=1
-N_TPCENTDEC=1
-N_MFTTRK=1
-N_ITSTRK=1
-N_MCHTRK=1
-N_TOFMATCH=1
-N_F_REST=$MULTIPLICITY_FACTOR_REST
-N_F_RAW=$MULTIPLICITY_FACTOR_RAWDECODERS
-N_F_CTF=$MULTIPLICITY_FACTOR_CTFENCODERS
-if [ $OPTIMIZED_PARALLEL_ASYNC != 0 ]; then
- # Tuned multiplicities for async Pb-Pb processing
- if [ $SYNCMODE == "1" ]; then echo "Must not use OPTIMIZED_PARALLEL_ASYNC with GPU or SYNCMODE" 1>&2; exit 1; fi
- if [ $NUMAGPUIDS == 1 ]; then N_NUMAFACTOR=1; else N_NUMAFACTOR=2; fi
- GPU_CONFIG_KEY+="GPU_proc.ompThreads=6;"
- TRD_CONFIG_KEY+="GPU_proc.ompThreads=2;"
- if [ $GPUTYPE == "CPU" ]; then
- N_TPCENTDEC=$((2 * $N_NUMAFACTOR))
- N_MFTTRK=$((3 * $N_NUMAFACTOR))
- N_ITSTRK=$((3 * $N_NUMAFACTOR))
- N_TPCITS=$((2 * $N_NUMAFACTOR))
- N_MCHTRK=$((1 * $N_NUMAFACTOR))
- N_TOFMATCH=$((9 * $N_NUMAFACTOR))
- N_TPCTRK=$((6 * $N_NUMAFACTOR))
- else
- N_TPCENTDEC=$((3 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 > 0 ? 3 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 : 1))
- N_MFTTRK=$((6 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 > 0 ? 6 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 : 1))
- N_ITSTRK=$((6 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 > 0 ? 6 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 : 1))
- N_TPCITS=$((4 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 > 0 ? 4 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 : 1))
- N_MCHTRK=$((2 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 > 0 ? 2 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 : 1))
- N_TOFMATCH=$((20 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 > 0 ? 20 * $NGPUS * $OPTIMIZED_PARALLEL_ASYNC * $N_NUMAFACTOR / 4 : 1))
- N_TPCTRK=$NGPUS
- fi
-elif [ $EPNPIPELINES != 0 ]; then
- # Tuned multiplicities for sync Pb-Pb processing
- N_TPCENT=$((3 * $EPNPIPELINES * $NGPUS / 4 > 0 ? 3 * $EPNPIPELINES * $NGPUS / 4 : 1))
- N_TPCITS=$((3 * $EPNPIPELINES * $NGPUS / 4 > 0 ? 3 * $EPNPIPELINES * $NGPUS / 4 : 1))
- N_ITSRAWDEC=$((3 * $EPNPIPELINES * $NGPUS / 4 > 0 ? 3 * $EPNPIPELINES * $NGPUS / 4 : 1))
- N_EMC=$((7 * $EPNPIPELINES * $NGPUS / 4 > 0 ? 7 * $EPNPIPELINES * $NGPUS / 4 : 1))
- N_TRDENT=$((3 * $EPNPIPELINES * $NGPUS / 4 > 0 ? 3 * $EPNPIPELINES * $NGPUS / 4 : 1))
- N_TRDTRK=$((3 * $EPNPIPELINES * $NGPUS / 4 > 0 ? 3 * $EPNPIPELINES * $NGPUS / 4 : 1))
- if [ $GPUTYPE == "CPU" ]; then
- N_TPCTRK=8
- GPU_CONFIG_KEY+="GPU_proc.ompThreads=4;"
- else
- N_TPCTRK=$NGPUS
- fi
-fi
-# Scale some multiplicities with the number of nodes
-RECO_NUM_NODES_WORKFLOW_CMP=$(($RECO_NUM_NODES_WORKFLOW > 15 ? $RECO_NUM_NODES_WORKFLOW : 15)) # Limit the scaling factor
-N_ITSRAWDEC=$((6 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP > $N_ITSRAWDEC ? 6 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP : $N_ITSRAWDEC))
-N_MFTRAWDEC=$((6 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP > $N_MFTRAWDEC ? 6 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP : $N_MFTRAWDEC))
-N_ITSTRK=$((2 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP > $N_ITSTRK ? 2 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP : $N_ITSTRK))
-N_MFTTRK=$((2 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP > $N_MFTTRK ? 2 * 30 / $RECO_NUM_NODES_WORKFLOW_CMP : $N_MFTTRK))
-# Apply external multiplicity factors
-N_TPCTRK=$((N_TPCTRK * $N_F_REST))
-N_TPCITS=$((N_TPCITS * $N_F_REST))
-N_EMC=$((N_EMC * $N_F_REST))
-N_TRDTRK=$((N_TRDTRK * $N_F_REST))
-N_TPCENTDEC=$((N_TPCENTDEC * $N_F_REST))
-N_MFTTRK=$((N_MFTTRK * $N_F_REST))
-N_ITSTRK=$((N_ITSTRK * $N_F_REST))
-N_MCHTRK=$((N_MCHTRK * $N_F_REST))
-N_TOFMATCH=$((N_TOFMATCH * $N_F_REST))
-N_TPCENT=$((N_TPCENT * $N_F_CTF))
-N_TRDENT=$((N_TRDENT * $N_F_CTF))
-N_ITSRAWDEC=$((N_ITSRAWDEC * $N_F_RAW))
-N_MFTRAWDEC=$((N_MFTRAWDEC * $N_F_RAW))
-N_TPCRAWDEC=$((N_TPCRAWDEC * $N_F_RAW))
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Input workflow
-if [ $CTFINPUT == 1 ]; then
- GPU_INPUT=compressed-clusters-ctf
- TOF_INPUT=digits
- CTFName=`ls -t $FILEWORKDIR/o2_ctf_*.root | head -n1`
- WORKFLOW="o2-ctf-reader-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --delay $TFDELAY --loop $NTIMEFRAMES --ctf-input ${CTFName} --ctf-dict ${CTF_DICT_DIR}/ctf_dictionary.root --onlyDet $WORKFLOW_DETECTORS --pipeline tpc-entropy-decoder:$N_TPCENTDEC | "
-elif [ $EXTINPUT == 1 ]; then
- PROXY_CHANNEL="name=readout-proxy,type=pull,method=connect,address=ipc://@$INRAWCHANNAME,transport=shmem,rateLogging=0"
- PROXY_INSPEC="dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION"
- PROXY_IN_N=0
- for i in `echo "$WORKFLOW_DETECTORS" | sed "s/,/ /g"`; do
- if [ $EPNMODE == 1 ] && [ $i == "TOF" ]; then
- PROXY_INTYPE=CRAWDATA
- else
- PROXY_INTYPE=RAWDATA
- fi
- PROXY_INNAME="RAWIN$PROXY_IN_N"
- let PROXY_IN_N=$PROXY_IN_N+1
- PROXY_INSPEC+=";$PROXY_INNAME:$i/$PROXY_INTYPE"
- done
- WORKFLOW="o2-dpl-raw-proxy $ARGS_ALL --dataspec \"$PROXY_INSPEC\" --channel-config \"$PROXY_CHANNEL\" | "
-else
- WORKFLOW="o2-raw-file-reader-workflow --detect-tf0 $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG;HBFUtils.nHBFPerTF=$NHBPERTF;\" --delay $TFDELAY --loop $NTIMEFRAMES --max-tf 0 --input-conf $FILEWORKDIR/rawAll.cfg | "
-fi
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Raw decoder workflows
-if [ $CTFINPUT == 0 ]; then
- if has_detector TPC && [ $EPNMODE == 1 ]; then
- GPU_INPUT=zsonthefly
- WORKFLOW+="o2-tpc-raw-to-digits-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --input-spec \"A:TPC/RAWDATA;dd:FLP/DISTSUBTIMEFRAME/0\" --remove-duplicates --pipeline tpc-raw-to-digits-0:$N_TPCRAWDEC | "
- WORKFLOW+="o2-tpc-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --input-type digitizer --output-type zsraw,disable-writer --pipeline tpc-zsEncoder:$N_TPCRAWDEC | "
- fi
- has_detector ITS && WORKFLOW+="o2-itsmft-stf-decoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --dict-file \"${ITSCLUSDICT}\" --nthreads ${NITSDECTHREADS} --pipeline its-stf-decoder:$N_ITSRAWDEC | "
- has_detector MFT && WORKFLOW+="o2-itsmft-stf-decoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --dict-file \"${MFTCLUSDICT}\" --nthreads ${NMFTDECTHREADS} --pipeline its-stf-decoder:$N_MFTRAWDEC ${MFTDEC_CONFIG} --runmft true | "
- has_detector FT0 && WORKFLOW+="o2-ft0-flp-dpl-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-output --pipeline ft0-datareader-dpl:$N_F_RAW | "
- has_detector FV0 && WORKFLOW+="o2-fv0-flp-dpl-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-output --pipeline fv0-datareader-dpl:$N_F_RAW | "
- has_detector MID && WORKFLOW+="o2-mid-raw-to-digits-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline MIDRawDecoder:$N_F_RAW,MIDDecodedDataAggregator:$N_F_RAW | "
- has_detector MCH && WORKFLOW+="o2-mch-raw-to-digits-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline DataDecoder:$N_F_RAW | "
- has_detector TOF && [ $EPNMODE == 0 ] && WORKFLOW+="o2-tof-compressor $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" | "
- has_detector FDD && WORKFLOW+="o2-fdd-flp-dpl-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-output --pipeline fdd-datareader-dpl:$N_F_RAW | "
- has_detector TRD && WORKFLOW+="o2-trd-datareader $ARGS_ALL --pipeline trd-datareader:$N_F_RAW | "
- has_detector ZDC && WORKFLOW+="o2-zdc-raw2digits $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-output --pipeline zdc-datareader-dpl:$N_F_RAW | "
- has_detector HMP && WORKFLOW+="o2-hmpid-raw-to-digits-stream-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline HMP-RawStreamDecoder:$N_F_RAW | "
-fi
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Common reconstruction workflows
-has_detector ITS && WORKFLOW+="o2-its-reco-workflow $ARGS_ALL --trackerCA $DISABLE_MC --clusters-from-upstream --disable-root-output $ITS_CONFIG --configKeyValues \"$ARGS_ALL_CONFIG;$ITS_CONFIG_KEY\" --its-dictionary-path $FILEWORKDIR --pipeline its-tracker:$N_ITSTRK | "
-has_detector TPC && WORKFLOW+="o2-gpu-reco-workflow ${ARGS_ALL//-severity $SEVERITY/-severity $SEVERITY_TPC} --input-type=$GPU_INPUT $DISABLE_MC --output-type $GPU_OUTPUT --pipeline gpu-reconstruction:$N_TPCTRK $GPU_CONFIG --configKeyValues \"$ARGS_ALL_CONFIG;GPU_global.deviceType=$GPUTYPE;GPU_proc.debugLevel=0;$GPU_CONFIG_KEY;$GPU_EXTRA_CONFIG\" | "
-has_detectors ITS TPC && WORKFLOW+="o2-tpcits-match-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output $DISABLE_MC --its-dictionary-path $FILEWORKDIR --pipeline itstpc-track-matcher:$N_TPCITS | "
-has_detector FT0 && WORKFLOW+="o2-ft0-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output $DISABLE_MC --pipeline ft0-reconstructor:$N_F_REST | "
-has_detector TOF && WORKFLOW+="o2-tof-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --input-type $TOF_INPUT --output-type clusters --disable-root-input --disable-root-output $DISABLE_MC --pipeline tof-compressed-decoder:$N_F_RAW,TOFClusterer:$N_F_REST | "
-has_detector TRD && WORKFLOW+="o2-trd-tracklet-transformer $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output $DISABLE_MC $TRD_TRANSFORMER_CONFIG --pipeline TRDTRACKLETTRANSFORMER:$N_TRDTRK | "
-has_detectors TRD TPC ITS && WORKFLOW+="o2-trd-global-tracking $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG;$TRD_CONFIG_KEY\" --disable-root-input --disable-root-output $DISABLE_MC $TRD_CONFIG | "
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Workflows disabled in sync mode
-if [ $SYNCMODE == 0 ]; then
- has_detectors TOF TRD TPC ITS && WORKFLOW+="o2-tof-matcher-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output $DISABLE_MC --track-sources \"TPC,ITS-TPC\" --pipeline tof-matcher:$N_TOFMATCH | "
- has_detector MID && WORKFLOW+="o2-mid-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-output $DISABLE_MC --pipeline MIDClusterizer:$N_F_REST,MIDTracker:$N_F_REST | "
- has_detector MCH && WORKFLOW+="o2-mch-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output $DISABLE_MC --pipeline mch-track-finder:$N_MCHTRK,mch-cluster-finder:$N_F_REST,mch-cluster-transformer:$N_F_REST | "
- has_detector MFT && WORKFLOW+="o2-mft-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --clusters-from-upstream $DISABLE_MC --disable-root-output --pipeline mft-tracker:$N_MFTTRK --mft-dictionary-path $FILEWORKDIR | "
- has_detectors ITS TPC TRD TOF FT0 MCH && WORKFLOW+="o2-primary-vertexing-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" $DISABLE_MC --disable-root-input --disable-root-output --validate-with-ft0 --pipeline primary-vertexing:$N_F_REST | "
- has_detectors ITS TPC TRD TOF FT0 MCH && WORKFLOW+="o2-secondary-vertexing-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output --pipeline secondary-vertexing:$N_F_REST | "
- has_detector FDD && WORKFLOW+="o2-fdd-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output | "
- has_detector ZDC && WORKFLOW+="o2-zdc-digits-reco $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output $DISABLE_MC | "
-fi
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Workflows disabled in async mode
-if [ $CTFINPUT == 0 ]; then
- # Reconstruction workflows
- if [ $SYNCMODE == 1 ]; then # Otherwise already present in async setup
- has_detectors TOF TRD TPC ITS && WORKFLOW+="o2-tof-matcher-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-input --disable-root-output $DISABLE_MC --track-sources \"ITS-TPC\" --pipeline tof-matcher:$N_TOFMATCH | "
- fi
- has_detector PHS && WORKFLOW+="o2-phos-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --input-type raw --output-type cells --disable-root-input --disable-root-output --pipeline PHOSRawToCellConverterSpec:$N_F_REST $DISABLE_MC | "
- has_detector CPV && WORKFLOW+="o2-cpv-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --input-type raw --output-type clusters --disable-root-input --disable-root-output --pipeline CPVRawToDigitConverterSpec:$N_F_REST,CPVClusterizerSpec:$N_F_REST $DISABLE_MC | "
- has_detector EMC && WORKFLOW+="o2-emcal-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --input-type raw --output-type cells --disable-root-output $DISABLE_MC --pipeline EMCALRawToCellConverterSpec:$N_EMC | "
-
- # Entropy encoder workflows
- has_detector MFT && WORKFLOW+="o2-itsmft-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --runmft true --pipeline mft-entropy-encoder:$N_F_CTF| "
- has_detector FT0 && WORKFLOW+="o2-ft0-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline ft0-entropy-encoder:$N_F_CTF| "
- has_detector FV0 && WORKFLOW+="o2-fv0-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline fv0-entropy-encoder:$N_F_CTF| "
- has_detector MID && WORKFLOW+="o2-mid-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline mid-entropy-encoder:$N_F_CTF| "
- has_detector MCH && WORKFLOW+="o2-mch-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline mch-entropy-encoder:$N_F_CTF| "
- has_detector PHS && WORKFLOW+="o2-phos-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline phos-entropy-encoder:$N_F_CTF| "
- has_detector CPV && WORKFLOW+="o2-cpv-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline cpv-entropy-encoder:$N_F_CTF| "
- has_detector EMC && WORKFLOW+="o2-emcal-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline emcal-entropy-encoder:$N_F_CTF| "
- has_detector ZDC && WORKFLOW+="o2-zdc-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline zdc-entropy-encoder:$N_F_CTF| "
- has_detector FDD && WORKFLOW+="o2-fdd-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline fdd-entropy-encoder:$N_F_CTF| "
- has_detector HMP && WORKFLOW+="o2-hmpid-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline hmpid-entropy-encoder:$N_F_CTF| "
- has_detector TOF && WORKFLOW+="o2-tof-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline tof-entropy-encoder:$N_F_CTF| "
- has_detector ITS && WORKFLOW+="o2-itsmft-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline its-entropy-encoder:$N_F_CTF| "
- has_detector TRD && WORKFLOW+="o2-trd-entropy-encoder-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --pipeline trd-entropy-encoder:$N_TRDENT | "
- has_detector TPC && WORKFLOW+="o2-tpc-reco-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --input-type compressed-clusters-flat --output-type encoded-clusters,disable-writer --pipeline tpc-entropy-encoder:$N_TPCENT | "
-
- # Calibration workflows
- has_detector_calib TPC && has_detectors TPC ITS TRD TOF && WORKFLOW+="o2-tpc-scdcalib-interpolation-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --disable-root-output --disable-root-input --pipeline tpc-track-interpolation:$N_F_REST | "
-
- # CTF / dictionary writer workflow
- if [ $SAVECTF == 1 ]; then
- mkdir -p $CTF_DIR
- fi
- if [ $CREATECTFDICT == 1 ] ; then
- mkdir -p $CTF_DICT_DIR;
- rm -f $CTF_DICT_DIR/ctf_dictionary.root
- fi
- CTF_OUTPUT_TYPE="none"
- if [ $CREATECTFDICT == 1 ] && [ $SAVECTF == 1 ]; then CTF_OUTPUT_TYPE="both"; fi
- if [ $CREATECTFDICT == 1 ] && [ $SAVECTF == 0 ]; then CTF_OUTPUT_TYPE="dict"; fi
- if [ $CREATECTFDICT == 0 ] && [ $SAVECTF == 1 ]; then CTF_OUTPUT_TYPE="ctf"; fi
- CMD_CTF="o2-ctf-writer-workflow $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --output-dir \"$CTF_DIR\" --ctf-dict-dir \"$CTF_DICT_DIR\" --output-type $CTF_OUTPUT_TYPE --min-file-size ${CTF_MINSIZE} --onlyDet $WORKFLOW_DETECTORS"
- if [ $CREATECTFDICT == 1 ] && [ $EXTINPUT == 1 ]; then CMD_CTF+=" --save-dict-after $NTIMEFRAMES"; fi
- WORKFLOW+="$CMD_CTF | "
-fi
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Event display
-workflow_has_parameter EVENT_DISPLAY && [ $NUMAID == 0 ] && WORKFLOW+="o2-eve-display $ARGS_ALL --configKeyValues \"$ARGS_ALL_CONFIG\" --display-tracks TPC --display-clusters TPC $EVE_CONFIG $DISABLE_MC | "
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Quality Control
-workflow_has_parameter QC && source $MYDIR/qc-workflow.sh
-
-# ---------------------------------------------------------------------------------------------------------------------
-# DPL run binary
-WORKFLOW+="o2-dpl-run $ARGS_ALL $GLOBALDPLOPT"
-
-# ---------------------------------------------------------------------------------------------------------------------
-# Run / create / print workflow
-if [ $WORKFLOWMODE == "print" ]; then
- echo Workflow command:
- echo $WORKFLOW | sed "s/| */|\n/g"
-else
- # Execute the command we have assembled
- WORKFLOW+=" --$WORKFLOWMODE"
- eval $WORKFLOW
-fi
-
-# ---------------------------------------------------------------------------------------------------------------------
diff --git a/production/full-system-test.desc b/production/full-system-test.desc
deleted file mode 100644
index bf3428f..0000000
--- a/production/full-system-test.desc
+++ /dev/null
@@ -1,3 +0,0 @@
-#Full system test workflows
-full-system-test-async: O2PDPSuite/latest reco,128,126,"CTFINPUT=1 SHMSIZE=64000000000 HOSTMEMSIZE=30000000000 production/full-system-test/dpl-workflow.sh"
-full-system-test-sync: O2PDPSuite/latest reco,128,126,"SYNCMODE=1 SHMSIZE=64000000000 HOSTMEMSIZE=30000000000 production/full-system-test/dpl-workflow.sh"
diff --git a/production/full-system-test/dpl-workflow.sh b/production/full-system-test/dpl-workflow.sh
deleted file mode 100755
index 27f659e..0000000
--- a/production/full-system-test/dpl-workflow.sh
+++ /dev/null
@@ -1,8 +0,0 @@
-#!/bin/bash
-
-if [ "0$O2_ROOT" == "0" ]; then
- echo O2 environment not loaded
- exit 1
-fi
-
-source $O2_ROOT/prodtests/full-system-test/dpl-workflow.sh
diff --git a/production/full-system-test/qc-workflow.sh b/production/full-system-test/qc-workflow.sh
deleted file mode 100644
index 37d9988..0000000
--- a/production/full-system-test/qc-workflow.sh
+++ /dev/null
@@ -1,5 +0,0 @@
-#!/bin/bash
-
-MYDIR="$(dirname $(readlink -f $0))"
-
-has_detector TPC && WORKFLOW+="o2-qc $ARGS_ALL --config json:///home/epn/odc/files/tpcQCTasks_multinode_ALL.json --local --host localhost | "
diff --git a/production/full-system-test/setenv.sh b/production/full-system-test/setenv.sh
deleted file mode 120000
index e5f7f7e..0000000
--- a/production/full-system-test/setenv.sh
+++ /dev/null
@@ -1 +0,0 @@
-../../common/setenv.sh
\ No newline at end of file
diff --git a/production/no-processing.desc b/production/no-processing.desc
deleted file mode 100644
index 188f3c5..0000000
--- a/production/no-processing.desc
+++ /dev/null
@@ -1,2 +0,0 @@
-# Empty workflow for no processing at all
-no-processing: ""
diff --git a/production/production.desc b/production/production.desc
deleted file mode 100644
index 4011a3a..0000000
--- a/production/production.desc
+++ /dev/null
@@ -1,2 +0,0 @@
-synchronous-workflow: "DataDistribution QualityControl" reco,128,128,"EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=0 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 INFOLOGGER_SEVERITY=warning production/dpl-workflow.sh" reco,128,128,"EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=1 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 INFOLOGGER_SEVERITY=warning production/dpl-workflow.sh"
-synchronous-workflow-1numa: "DataDistribution QualityControl" reco,128,128,"EXTINPUT=1 SYNCMODE=1 NUMAGPUIDS=1 NUMAID=0 SHMSIZE=128000000000 EPNPIPELINES=1 SHMTHROW=0 INFOLOGGER_SEVERITY=warning production/dpl-workflow.sh"
diff --git a/production/setenv.sh b/production/setenv.sh
deleted file mode 120000
index a3f9dc9..0000000
--- a/production/setenv.sh
+++ /dev/null
@@ -1 +0,0 @@
-full-system-test/setenv.sh
\ No newline at end of file
diff --git a/testing/detectors/CPV/workflows.desc b/testing/detectors/CPV/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/EMC/workflows.desc b/testing/detectors/EMC/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/FDD/workflows.desc b/testing/detectors/FDD/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/FT0/workflows.desc b/testing/detectors/FT0/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/FV0/workflows.desc b/testing/detectors/FV0/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/HMP/workflows.desc b/testing/detectors/HMP/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/ITS/workflows.desc b/testing/detectors/ITS/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/MCH/workflows.desc b/testing/detectors/MCH/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/MFT/workflows.desc b/testing/detectors/MFT/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/MID/workflows.desc b/testing/detectors/MID/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/PHS/workflows.desc b/testing/detectors/PHS/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/TOF/qc-full.json b/testing/detectors/TOF/qc-full.json
deleted file mode 100644
index 75c2da1..0000000
--- a/testing/detectors/TOF/qc-full.json
+++ /dev/null
@@ -1,142 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "qcdb.cern.ch:8083",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "influxdb-unix:///tmp/telegraf.sock"
- },
- "consul": {
- "url": "alio2-cr1-hv-aliecs.cern.ch:8500"
- },
- "conditionDB": {
- "url": "alio2-cr1-hv-aliecs.cern.ch:8083"
- }
- },
- "tasks": {
- "TaskRaw": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskRaw",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "raw-local"
- },
- "location": "local",
- "localMachines": [
- "alio2-cr1-flp178-ib",
- "alio2-cr1-flp179-ib"
- ],
- "remoteMachine": "localhost",
- "remotePort": "30132",
- "mergingMode": "delta"
- },
- "TaskDigits": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskDigits",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "digi-local"
- },
- "location": "local",
- "localMachines": [
- "epn"
- ],
- "remoteMachine": "alio2-cr1-qc03.cern.ch",
- "remotePort": "47708",
- "mergingMode": "delta",
- "localControl": "odc"
- }
- },
- "checks": {
- "CheckDiagnostics": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckDiagnostics",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "RDHCounterCrate0"
- ]
- }
- ]
- },
- "CheckCompressedData": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckCompressedData",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "checkParameters": {
- "DiagnosticThresholdPerSlot": "10"
- },
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "hDiagnostic"
- ]
- }
- ]
- },
- "CheckRawMultiplicity": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckRawMultiplicity",
- "moduleName": "QcTOF",
- "policy": "OnAny",
- "detectorName": "TOF",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskDigits",
- "MOs": [
- "TOFRawsMulti"
- ]
- }
- ]
- }
- }
- },
- "dataSamplingPolicies": [
- {
- "id": "digi-local",
- "active": "true",
- "machines": [
- "epn"
- ],
- "port": "30333",
- "query": "tofdigits:TOF/DIGITS/0;readoutwin:TOF/READOUTWINDOW/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/detectors/TOF/tof-epn-cosmics-dig.sh b/testing/detectors/TOF/tof-epn-cosmics-dig.sh
deleted file mode 100644
index 8f8614b..0000000
--- a/testing/detectors/TOF/tof-epn-cosmics-dig.sh
+++ /dev/null
@@ -1,30 +0,0 @@
-#!/usr/bin/env bash
-
-source common/setenv.sh
-
-calibration_node="epn003-ib:30453"
-
-SEVERITY=warning
-ARGS_ALL="--session default --severity $SEVERITY --shm-segment-id $NUMAID --shm-segment-size $SHMSIZE"
-ARGS_ALL+=" --infologger-severity $SEVERITY"
-#ARGS_ALL+=" --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
-ARGS_ALL_CONFIG="NameConf.mDirGRP=$FILEWORKDIR;NameConf.mDirGeom=$FILEWORKDIR;NameConf.mDirCollContext=$FILEWORKDIR;NameConf.mDirMatLUT=$FILEWORKDIR;keyval.input_dir=$FILEWORKDIR;keyval.output_dir=/dev/null"
-CTF_DICT="--ctf-dict $FILEWORKDIR/ctf_dictionary.root"
-PROXY_INSPEC="x:TOF/CRAWDATA;dd:FLP/DISTSUBTIMEFRAME/0"
-NTHREADS=2
-# Output directory for the CTF, to write to the current dir., remove `--output-dir $CTFOUT` from o2-ctf-writer-workflow or set to `CTFOUT=\"""\"`
-# The directory must exist
-CTFOUT="/home/fnoferin/public/out/"
-MYDIR="$(dirname $(readlink -f $0))"
-OUT_CHANNEL="name=downstream,method=connect,address=tcp://${calibration_node},type=push,transport=zeromq"
-PROXY_OUTSPEC="dd:FLP/DISTSUBTIMEFRAME;dig:TOF/DIGITS;head:TOF/DIGITHEADER;row:TOF/READOUTWINDOW;patt:TOF/PATTERNS"
-
-
-o2-dpl-raw-proxy ${ARGS_ALL} --dataspec "${PROXY_INSPEC}" \
---readout-proxy "--channel-config 'name=readout-proxy,type=pull,method=connect,address=ipc://@$INRAWCHANNAME,transport=shmem,rateLogging=1'" \
-| o2-tof-reco-workflow --input-type raw --output-type digits --disable-root-output \
-${ARGS_ALL} --configKeyValues "$ARGS_ALL_CONFIG;" \
---pipeline "tof-compressed-decoder:${NTHREADS}" \
-| o2-qc ${ARGS_ALL} --config json://${MYDIR}/qc-full.json --local --host epn \
-| o2-dpl-output-proxy ${ARGS_ALL} --channel-config ${OUT_CHANNEL} --dataspec ${PROXY_OUTSPEC} \
-| o2-dpl-run $ARGS_ALL $GLOBALDPLOPT --dds # option instead iof run to export DDS xml file
diff --git a/testing/detectors/TOF/tof-epn-cosmics-digNoQC.sh b/testing/detectors/TOF/tof-epn-cosmics-digNoQC.sh
deleted file mode 100644
index 52c895b..0000000
--- a/testing/detectors/TOF/tof-epn-cosmics-digNoQC.sh
+++ /dev/null
@@ -1,29 +0,0 @@
-#!/usr/bin/env bash
-
-source common/setenv.sh
-
-calibration_node="epn003-ib:30453"
-
-SEVERITY=warning
-ARGS_ALL="--session default --severity $SEVERITY --shm-segment-id $NUMAID --shm-segment-size $SHMSIZE"
-ARGS_ALL+=" --infologger-severity $SEVERITY"
-#ARGS_ALL+=" --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
-ARGS_ALL_CONFIG="NameConf.mDirGRP=$FILEWORKDIR;NameConf.mDirGeom=$FILEWORKDIR;NameConf.mDirCollContext=$FILEWORKDIR;NameConf.mDirMatLUT=$FILEWORKDIR;keyval.input_dir=$FILEWORKDIR;keyval.output_dir=/dev/null"
-CTF_DICT="--ctf-dict $FILEWORKDIR/ctf_dictionary.root"
-PROXY_INSPEC="x:TOF/CRAWDATA;dd:FLP/DISTSUBTIMEFRAME/0"
-NTHREADS=2
-# Output directory for the CTF, to write to the current dir., remove `--output-dir $CTFOUT` from o2-ctf-writer-workflow or set to `CTFOUT=\"""\"`
-# The directory must exist
-CTFOUT="/home/fnoferin/public/out/"
-MYDIR="$(dirname $(readlink -f $0))"
-OUT_CHANNEL="name=downstream,method=connect,address=tcp://${calibration_node},type=push,transport=zeromq"
-PROXY_OUTSPEC="dd:FLP/DISTSUBTIMEFRAME;dig:TOF/DIGITS;head:TOF/DIGITHEADER;row:TOF/READOUTWINDOW;patt:TOF/PATTERNS"
-
-
-o2-dpl-raw-proxy ${ARGS_ALL} --dataspec "${PROXY_INSPEC}" \
---readout-proxy "--channel-config 'name=readout-proxy,type=pull,method=connect,address=ipc://@$INRAWCHANNAME,transport=shmem,rateLogging=1'" \
-| o2-tof-reco-workflow --input-type raw --output-type digits --disable-root-output \
-${ARGS_ALL} --configKeyValues "$ARGS_ALL_CONFIG;" \
---pipeline "tof-compressed-decoder:${NTHREADS}" \
-| o2-dpl-output-proxy ${ARGS_ALL} --channel-config ${OUT_CHANNEL} --dataspec ${PROXY_OUTSPEC} \
-| o2-dpl-run $ARGS_ALL $GLOBALDPLOPT --dds # option instead iof run to export DDS xml file
diff --git a/testing/detectors/TOF/tof-epn-cosmics.sh b/testing/detectors/TOF/tof-epn-cosmics.sh
deleted file mode 100755
index d39a021..0000000
--- a/testing/detectors/TOF/tof-epn-cosmics.sh
+++ /dev/null
@@ -1,32 +0,0 @@
-#!/usr/bin/env bash
-
-source common/setenv.sh
-
-calibration_node="epn003-ib:30453"
-
-SEVERITY=warning
-ARGS_ALL="--session default --severity $SEVERITY --shm-segment-id $NUMAID --shm-segment-size $SHMSIZE"
-ARGS_ALL+=" --infologger-severity $SEVERITY"
-#ARGS_ALL+=" --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
-ARGS_ALL_CONFIG="NameConf.mDirGRP=$FILEWORKDIR;NameConf.mDirGeom=$FILEWORKDIR;NameConf.mDirCollContext=$FILEWORKDIR;NameConf.mDirMatLUT=$FILEWORKDIR;keyval.input_dir=$FILEWORKDIR;keyval.output_dir=/dev/null"
-CTF_DICT="--ctf-dict $FILEWORKDIR/ctf_dictionary.root"
-PROXY_INSPEC="x:TOF/CRAWDATA;dd:FLP/DISTSUBTIMEFRAME/0"
-NTHREADS=2
-# Output directory for the CTF, to write to the current dir., remove `--output-dir $CTFOUT` from o2-ctf-writer-workflow or set to `CTFOUT=\"""\"`
-# The directory must exist
-CTFOUT="/home/fnoferin/public/out/"
-MYDIR="$(dirname $(readlink -f $0))"
-OUT_CHANNEL="name=downstream,method=connect,address=tcp://${calibration_node},type=push,transport=zeromq"
-PROXY_OUTSPEC="dd:FLP/DISTSUBTIMEFRAME;calclus:TOF/INFOCALCLUS;cosmics:TOF/INFOCOSMICS;trkcos:TOF/INFOTRACKCOS;trksiz:TOF/INFOTRACKSIZE"
-
-
-o2-dpl-raw-proxy ${ARGS_ALL} --dataspec "${PROXY_INSPEC}" \
---readout-proxy "--channel-config 'name=readout-proxy,type=pull,method=connect,address=ipc://@$INRAWCHANNAME,transport=shmem,rateLogging=1'" \
-| o2-tof-reco-workflow --input-type raw --output-type clusters,ctf \
-${ARGS_ALL} ${CTF_DICT} --configKeyValues "$ARGS_ALL_CONFIG;" \
---disable-root-output --calib-cluster --cluster-time-window 10000 --cosmics \
---pipeline "tof-compressed-decoder:${NTHREADS},TOFClusterer:${NTHREADS},tof-entropy-encoder:${NTHREADS}" \
-| o2-ctf-writer-workflow ${ARGS_ALL} --configKeyValues "$ARGS_ALL_CONFIG;" --onlyDet TOF --output-dir $CTFOUT \
-| o2-qc ${ARGS_ALL} --config json://${MYDIR}/qc-full.json --local --host epn \
-| o2-dpl-output-proxy ${ARGS_ALL} --channel-config ${OUT_CHANNEL} --dataspec ${PROXY_OUTSPEC} \
-| o2-dpl-run $ARGS_ALL $GLOBALDPLOPT --dds # option instead iof run to export DDS xml file
diff --git a/testing/detectors/TOF/tof-epn-cosmicsNoQC.sh b/testing/detectors/TOF/tof-epn-cosmicsNoQC.sh
deleted file mode 100644
index 0170429..0000000
--- a/testing/detectors/TOF/tof-epn-cosmicsNoQC.sh
+++ /dev/null
@@ -1,31 +0,0 @@
-#!/usr/bin/env bash
-
-source common/setenv.sh
-
-calibration_node="epn003-ib:30453"
-
-SEVERITY=warning
-ARGS_ALL="--session default --severity $SEVERITY --shm-segment-id $NUMAID --shm-segment-size $SHMSIZE"
-ARGS_ALL+=" --infologger-severity $SEVERITY"
-#ARGS_ALL+=" --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
-ARGS_ALL_CONFIG="NameConf.mDirGRP=$FILEWORKDIR;NameConf.mDirGeom=$FILEWORKDIR;NameConf.mDirCollContext=$FILEWORKDIR;NameConf.mDirMatLUT=$FILEWORKDIR;keyval.input_dir=$FILEWORKDIR;keyval.output_dir=/dev/null"
-CTF_DICT="--ctf-dict $FILEWORKDIR/ctf_dictionary.root"
-PROXY_INSPEC="x:TOF/CRAWDATA;dd:FLP/DISTSUBTIMEFRAME/0"
-NTHREADS=2
-# Output directory for the CTF, to write to the current dir., remove `--output-dir $CTFOUT` from o2-ctf-writer-workflow or set to `CTFOUT=\"""\"`
-# The directory must exist
-CTFOUT="/home/fnoferin/public/out/"
-MYDIR="$(dirname $(readlink -f $0))"
-OUT_CHANNEL="name=downstream,method=connect,address=tcp://${calibration_node},type=push,transport=zeromq"
-PROXY_OUTSPEC="dd:FLP/DISTSUBTIMEFRAME;calclus:TOF/INFOCALCLUS;cosmics:TOF/INFOCOSMICS;trkcos:TOF/INFOTRACKCOS;trksiz:TOF/INFOTRACKSIZE"
-
-
-o2-dpl-raw-proxy ${ARGS_ALL} --dataspec "${PROXY_INSPEC}" \
---readout-proxy "--channel-config 'name=readout-proxy,type=pull,method=connect,address=ipc://@$INRAWCHANNAME,transport=shmem,rateLogging=1'" \
-| o2-tof-reco-workflow --input-type raw --output-type clusters,ctf \
-${ARGS_ALL} ${CTF_DICT} --configKeyValues "$ARGS_ALL_CONFIG;" \
---disable-root-output --calib-cluster --cluster-time-window 10000 --cosmics \
---pipeline "tof-compressed-decoder:${NTHREADS},TOFClusterer:${NTHREADS},tof-entropy-encoder:${NTHREADS}" \
-| o2-ctf-writer-workflow ${ARGS_ALL} --configKeyValues "$ARGS_ALL_CONFIG;" --onlyDet TOF --output-dir $CTFOUT \
-| o2-dpl-output-proxy ${ARGS_ALL} --channel-config ${OUT_CHANNEL} --dataspec ${PROXY_OUTSPEC} \
-| o2-dpl-run $ARGS_ALL $GLOBALDPLOPT --dds # option instead iof run to export DDS xml file
diff --git a/testing/detectors/TOF/workflows.desc b/testing/detectors/TOF/workflows.desc
deleted file mode 100644
index 724b1f4..0000000
--- a/testing/detectors/TOF/workflows.desc
+++ /dev/null
@@ -1,4 +0,0 @@
-tof-cosmics: "DataDistribution QualityControl" reco,10,10,"SHMSIZE=64000000000 testing/detectors/TOF/tof-epn-cosmics.sh"
-tof-cos-dig: "DataDistribution QualityControl" reco,10,10,"SHMSIZE=64000000000 testing/detectors/TOF/tof-epn-cosmics-dig.sh"
-tof-cosmicsNoQC: "DataDistribution QualityControl" reco,10,10,"SHMSIZE=64000000000 testing/detectors/TOF/tof-epn-cosmicsNoQC.sh"
-tof-cos-digNoQC: "DataDistribution QualityControl" reco,10,10,"SHMSIZE=64000000000 testing/detectors/TOF/tof-epn-cosmics-digNoQC.sh"
diff --git a/testing/detectors/TPC/tpc-workflow.sh b/testing/detectors/TPC/tpc-workflow.sh
deleted file mode 100755
index a421693..0000000
--- a/testing/detectors/TPC/tpc-workflow.sh
+++ /dev/null
@@ -1,75 +0,0 @@
-#!/usr/bin/env bash
-
-source common/setenv.sh
-
-ARGS_ALL="--session default --severity $SEVERITY --shm-segment-id $NUMAID --shm-segment-size $SHMSIZE"
-if [ $EPNMODE == 1 ]; then
- ARGS_ALL+=" --infologger-severity $INFOLOGGER_SEVERITY"
- #ARGS_ALL+=" --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
- ARGS_ALL+=" --monitoring-backend no-op://"
-else
- ARGS_ALL+=" --monitoring-backend no-op://"
-fi
-if [ $SHMTHROW == 0 ]; then
- ARGS_ALL+=" --shm-throw-bad-alloc 0"
-fi
-if [ $NORATELOG == 1 ]; then
- ARGS_ALL+=" --fairmq-rate-logging 0"
-fi
-if [ $NUMAGPUIDS != 0 ]; then
- ARGS_ALL+=" --child-driver 'numactl --membind $NUMAID --cpunodebind $NUMAID'"
-fi
-if [ $GPUTYPE != "CPU" ]; then
- ARGS_ALL+=" --shm-mlock-segment-on-creation 1"
-fi
-ARGS_ALL_CONFIG="NameConf.mDirGRP=$FILEWORKDIR;NameConf.mDirGeom=$FILEWORKDIR;NameConf.mDirCollContext=$FILEWORKDIR;NameConf.mDirMatLUT=$FILEWORKDIR;keyval.input_dir=$FILEWORKDIR;keyval.output_dir=/dev/null"
-
-if [ $GPUTYPE == "HIP" ]; then
- if [ $NUMAID == 0 ] || [ $NUMAGPUIDS == 0 ]; then
- export TIMESLICEOFFSET=0
- else
- export TIMESLICEOFFSET=$NGPUS
- fi
- GPU_CONFIG_KEY+="GPU_proc.deviceNum=0;GPU_global.mutexMemReg=true;"
- GPU_CONFIG+=" --environment \"ROCR_VISIBLE_DEVICES={timeslice${TIMESLICEOFFSET}}\""
- export HSA_NO_SCRATCH_RECLAIM=1
- #export HSA_TOOLS_LIB=/opt/rocm/lib/librocm-debug-agent.so.2
-else
- GPU_CONFIG_KEY+="GPU_proc.deviceNum=-2;"
-fi
-
-if [ $GPUTYPE != "CPU" ]; then
- GPU_CONFIG_KEY+="GPU_proc.forceMemoryPoolSize=$GPUMEMSIZE;"
- if [ $HOSTMEMSIZE == "0" ]; then
- HOSTMEMSIZE=$(( 1 << 30 ))
- fi
-fi
-if [ $HOSTMEMSIZE != "0" ]; then
- GPU_CONFIG_KEY+="GPU_proc.forceHostMemoryPoolSize=$HOSTMEMSIZE;"
-fi
-
-PROXY_INSPEC="A:TPC/RAWDATA;dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION"
-CALIB_INSPEC="A:TPC/RAWDATA;dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION"
-
-o2-dpl-raw-proxy $ARGS_ALL \
- --dataspec "$PROXY_INSPEC" \
- --readout-proxy "--channel-config 'name=readout-proxy,type=pull,method=connect,address=ipc://@$INRAWCHANNAME,transport=shmem,rateLogging=1'" \
- | o2-tpc-raw-to-digits-workflow $ARGS_ALL \
- --input-spec "$CALIB_INSPEC" \
- --remove-duplicates \
- --pipeline tpc-raw-to-digits-0:6 \
- --configKeyValues "$ARGS_ALL_CONFIG;TPCDigitDump.LastTimeBin=1000;" \
- | o2-tpc-reco-workflow $ARGS_ALL \
- --input-type digitizer \
- --output-type clusters,tracks,encoded-clusters disable-writer \
- --disable-mc \
- --pipeline tpc-tracker:4 \
- $GPU_CONFIG \
- --configKeyValues "$ARGS_ALL_CONFIG;$GPU_CONFIG_KEY;align-geom.mDetectors=none;GPU_global.deviceType=$GPUTYPE;GPU_proc.tpcIncreasedMinClustersPerRow=500000;GPU_proc.ignoreNonFatalGPUErrors=1;" \
- | o2-eve-display $ARGS_ALL --display-tracks TPC --display-clusters TPC --disable-mc --jsons-folder /home/ed/jsons --eve-dds-collection-index 0 --configKeyValues "$ARGS_ALL_CONFIG" \
- | o2-ctf-writer-workflow $ARGS_ALL --configKeyValues "$ARGS_ALL_CONFIG" --output-dir $CTF_DIR --ctf-dict-dir $FILEWORKDIR --output-type ctf --onlyDet TPC \
- | o2-dpl-run $ARGS_ALL --dds
-
-#HOST=localhost
-#| o2-qc $ARGS_ALL --config json:///home/epn/odc/files/tpcQCTasks_multinode_ALL.json --local --host $HOST \
-
diff --git a/testing/detectors/TPC/workflows.desc b/testing/detectors/TPC/workflows.desc
deleted file mode 100644
index 9b4ab72..0000000
--- a/testing/detectors/TPC/workflows.desc
+++ /dev/null
@@ -1,2 +0,0 @@
-ctf-and-display: "DataDistribution QualityControl" reco,128,128,"SHMSIZE=128000000000 INFOLOGGER_SEVERITY=warning testing/detectors/TPC/tpc-workflow.sh"
-ctf-and-display-gpu: "DataDistribution QualityControl" reco,128,128,"GPUTYPE=HIP SHMSIZE=128000000000 INFOLOGGER_SEVERITY=warning testing/detectors/TPC/tpc-workflow.sh"
diff --git a/testing/detectors/TRD/workflows.desc b/testing/detectors/TRD/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/detectors/ZDC/workflows.desc b/testing/detectors/ZDC/workflows.desc
deleted file mode 100644
index e69de29..0000000
diff --git a/testing/examples/example-workflow.sh b/testing/examples/example-workflow.sh
deleted file mode 100755
index f42c33e..0000000
--- a/testing/examples/example-workflow.sh
+++ /dev/null
@@ -1,20 +0,0 @@
-#!/usr/bin/env bash
-
-source common/setenv.sh
-
-SEVERITY=warning
-ARGS_ALL="--session default --severity $SEVERITY --shm-segment-size $SHMSIZE"
-ARGS_ALL+=" --infologger-severity $INFOLOGGER_SEVERITY"
-#ARGS_ALL+=" --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
-ARGS_ALL_CONFIG="NameConf.mDirGRP=$FILEWORKDIR;NameConf.mDirGeom=$FILEWORKDIR;NameConf.mDirCollContext=$FILEWORKDIR;NameConf.mDirMatLUT=$FILEWORKDIR;keyval.input_dir=$FILEWORKDIR;keyval.output_dir=/dev/null"
-
-PROXY_INSPEC="A:TPC/RAWDATA;dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION"
-
-o2-dpl-raw-proxy $ARGS_ALL \
- --dataspec "$PROXY_INSPEC" \
- --readout-proxy "--channel-config 'name=readout-proxy,type=pull,method=connect,address=ipc://@$INRAWCHANNAME,transport=shmem,rateLogging=1'" \
- | o2-tpc-raw-to-digits-workflow $ARGS_ALL \
- --input-spec "$PROXY_INSPEC" \
- --remove-duplicates \
- --configKeyValues "$ARGS_ALL_CONFIG;TPCDigitDump.LastTimeBin=1000;" \
- | o2-dpl-run $ARGS_ALL $GLOBALDPLOPT --dds
diff --git a/testing/examples/workflows.desc b/testing/examples/workflows.desc
deleted file mode 100644
index 12a5b54..0000000
--- a/testing/examples/workflows.desc
+++ /dev/null
@@ -1 +0,0 @@
-example-workflow: "DataDistribution QualityControl" reco,10,10,"SHMSIZE=128000000000 testing/examples/example-workflow.sh"
diff --git a/testing/private/README.md b/testing/private/README.md
deleted file mode 100644
index 2cb0e2d..0000000
--- a/testing/private/README.md
+++ /dev/null
@@ -1 +0,0 @@
-This folder is for private workflows of users
diff --git a/testing/private/shahoian/its-mft-tpc_reco_ctf_qc-uni.sh b/testing/private/shahoian/its-mft-tpc_reco_ctf_qc-uni.sh
deleted file mode 100755
index b24d194..0000000
--- a/testing/private/shahoian/its-mft-tpc_reco_ctf_qc-uni.sh
+++ /dev/null
@@ -1,107 +0,0 @@
-#!/bin/bash
-
-# accounts for externally set WORKFLOW_DETECTORS, SHMSIZE, SAVECTF, CTF_DIR, QCJSON, WORKFLOWMODE
-
-# HACK
-###WORKFLOW_DETECTORS=`echo $WORKFLOW_DETECTORS | tr _ ,`
-
-source /home/shahoian/alice/O2DataProcessing/common/setenv.sh
-
-# EPN script. Including CTF creation and QC.
-export GPUTYPE=HIP
-export GPUMEMSIZE=$(( 24 << 30 ))
-export HOSTMEMSIZE=$(( 5 << 30 ))
-
-SEVERITY=INFO
-INFOLOGGER_SEVERITY=WARNING
-
-# global args
-ARGS_ALL=" --session default --severity $SEVERITY --infologger-severity $INFOLOGGER_SEVERITY --shm-segment-size $SHMSIZE --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
-#ARGS_ALL=" --session default --severity $SEVERITY --infologger-severity $INFOLOGGER_SEVERITY --shm-segment-size $SHMSIZE "
-
-# raw input proxy channel
-PROXY_CHANNEL="name=readout-proxy,type=pull,method=connect,address=ipc://@tf-builder-pipe-0,transport=shmem,rateLogging=1"
-# raw input data filtered by the proxy
-PROXY_INSPEC="dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION"
-
-# add detectors
-has_detector ITS && PROXY_INSPEC+=";I:ITS/RAWDATA"
-has_detector MFT && PROXY_INSPEC+=";M:MFT/RAWDATA"
-has_detector TPC && PROXY_INSPEC+=";T:TPC/RAWDATA"
-
-TPC_INSPEC="dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION;T:TPC/RAWDATA"
-TPC_OUTPUT="clusters,tracks,disable-writer"
-if [ $SAVECTF == 1 ]; then
- TPC_OUTPUT+=",encoded-clusters"
-fi
-
-# directory for external files
-#FILEWORKDIR="/home/epn/odc/files"
-
-# Clusterization dictionaries path
-ITSCLUSDICT="${FILEWORKDIR}/ITSdictionary.bin"
-MFTCLUSDICT="${FILEWORKDIR}/MFTdictionary.bin"
-
-MFT_NOISE="${FILEWORKDIR}/mft_noise_220721_R3C-520.root"
-
-# CTF compression dictionary
-CTF_DICT="${FILEWORKDIR}/ctf_dictionary.root"
-# min file size for CTF (accumulate CTFs until it is reached)
-CTF_MINSIZE="2000000"
-# output directory for CTF files
-#CTF_DIR="/tmp/eosbuffer"
-
-# key/values config string
-CONFKEYVAL="NameConf.mDirGRP=${FILEWORKDIR};NameConf.mDirGeom=${FILEWORKDIR}"
-
-# number of decoding pipelines and threads per pipeline
-NITSDECPIPELINES=6
-NITSDECTHREADS=2
-NMFTDECPIPELINES=6
-NMFTDECTHREADS=2
-
-# number of reconstruction pipelines and threads per pipeline
-NITSRECPIPELINES=2
-NMFTRECPIPELINES=2
-
-# number of compression pipelines
-NITSENCODERPIPELINES=1
-NMFTENCODERPIPELINES=1
-
-# uncomment this to disable intermediate reconstruction output
-#DISABLE_RECO_OUTPUT=" --disable-root-output "
-
-HOST=localhost
-
-WORKFLOW="o2-dpl-raw-proxy -b ${ARGS_ALL} --dataspec \"${PROXY_INSPEC}\" --channel-config \"${PROXY_CHANNEL}\" | "
-has_detector ITS && WORKFLOW+="o2-itsmft-stf-decoder-workflow -b ${ARGS_ALL} --nthreads ${NITSDECTHREADS} --pipeline its-stf-decoder:${NITSDECPIPELINES} --configKeyValues \"${CONFKEYVAL}\" --dict-file \"${ITSCLUSDICT}\" | "
-has_detector ITS && WORKFLOW+="o2-its-reco-workflow -b ${ARGS_ALL} ${DISABLE_RECO_OUTPUT} --trackerCA --tracking-mode sync --disable-mc --clusters-from-upstream --pipeline its-tracker:${NITSRECPIPELINES} --its-dictionary-path \"${ITSCLUSDICT}\" --configKeyValues \"${CONFKEYVAL}\" | "
-#
-has_detector MFT && WORKFLOW+="o2-itsmft-stf-decoder-workflow -b ${ARGS_ALL} --nthreads ${NMFTDECTHREADS} --pipeline mft-stf-decoder:${NMFTDECPIPELINES} --configKeyValues \"${CONFKEYVAL}\" --dict-file \"${MFTCLUSDICT}\" --runmft --noise-file \"${MFT_NOISE}\" | "
-#
-has_detector TPC && WORKFLOW+="o2-tpc-raw-to-digits-workflow -b ${ARGS_ALL} --input-spec \"${TPC_INSPEC}\" --configKeyValues \"TPCDigitDump.LastTimeBin=1000\" --pipeline tpc-raw-to-digits-0:6 | "
-has_detector TPC && WORKFLOW+="o2-tpc-reco-workflow -b ${ARGS_ALL} --input-type digitizer --output-type $TPC_OUTPUT --disable-mc --pipeline tpc-tracker:4 --environment ROCR_VISIBLE_DEVICES={timeslice0} --configKeyValues \"align-geom.mDetectors=none;GPU_global.deviceType=$GPUTYPE;GPU_proc.forceMemoryPoolSize=$GPUMEMSIZE;GPU_proc.forceHostMemoryPoolSize=$HOSTMEMSIZE;GPU_proc.deviceNum=0;GPU_proc.tpcIncreasedMinClustersPerRow=500000;GPU_proc.ignoreNonFatalGPUErrors=1;GPU_proc.memoryScalingFactor=3;${CONFKEYVAL}\" | "
-#
-if [ $SAVECTF == 1 ]; then
- has_detector ITS && WORKFLOW+="o2-itsmft-entropy-encoder-workflow -b ${ARGS_ALL} --ctf-dict \"${CTF_DICT}\" --pipeline its-entropy-encoder:${NITSENCODERPIPELINES} | "
- has_detector MFT && WORKFLOW+="o2-itsmft-entropy-encoder-workflow -b ${ARGS_ALL} --ctf-dict \"${CTF_DICT}\" --pipeline mft-entropy-encoder:${NMFTENCODERPIPELINES} --runmft | "
- WORKFLOW+="o2-ctf-writer-workflow -b ${ARGS_ALL} --configKeyValues \"${CONFKEYVAL}\" --no-grp --onlyDet $WORKFLOW_DETECTORS --ctf-dict \"${CTF_DICT}\" --output-dir \"$CTF_DIR\" --min-file-size ${CTF_MINSIZE} | "
-fi
-
-if [ -n "$QCJSON" ]; then
- WORKFLOW+="o2-qc -b ${ARGS_ALL} --config json://$QCJSON --local --host $HOST | "
-fi
-
-WORKFLOW+=" o2-dpl-run ${ARGS_ALL} ${GLOBALDPLOPT}"
-
-if [ $WORKFLOWMODE == "print" ]; then
- echo Workflow command:
- echo $WORKFLOW | sed "s/| */|\n/g"
-else
- # Execute the command we have assembled
- WORKFLOW+=" --$WORKFLOWMODE"
- eval $WORKFLOW
-fi
-
-
-
diff --git a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus-tofglobalrun.json b/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus-tofglobalrun.json
deleted file mode 100644
index 6adc093..0000000
--- a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus-tofglobalrun.json
+++ /dev/null
@@ -1,444 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {
- "NRawDigitsNBins": "100",
- "NRawDigitsXMin": "0",
- "NRawDigitsXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "TimeBinNBins": "600",
- "TimeBinXMin": "0",
- "TimeBinXMax": "600"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue",
- "NClustersNBins": "100",
- "NClustersXMin": "0",
- "NClustersXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "QtotNBins": "600",
- "QtotXMin": "0",
- "QtotXMax": "600",
- "SigmaPadNBins": "200",
- "SigmaPadXMin": "0",
- "SigmaPadXMax": "2",
- "SigmaTimeNBins": "200",
- "SigmaTimeXMin": "0",
- "SigmaTimeXMax": "2",
- "TimeBinNBins": "1000",
- "TimeBinXMin": "0",
- "TimeBinXMax": "100000"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- },
- "QcMFTClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::mft::QcMFTClusterTask",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "cycleDurationSeconds": "60",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "mft-clusters"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32640",
- "localControl": "odc"
- },
- "TaskRaw": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskRaw",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "raw-local"
- },
- "location": "local",
- "localMachines": [
- "alio2-cr1-flp178-ib",
- "alio2-cr1-flp179-ib"
- ],
- "remoteMachine": "localhost",
- "remotePort": "30132",
- "mergingMode": "delta"
- },
- "TaskDigits": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskDigits",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "digi-local"
- },
- "location": "local",
- "localMachines": [
- "epn",
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "47708",
- "mergingMode": "delta",
- "localControl": "odc"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- },
- "QcMFTClusterCheck": {
- "active": "true",
- "dataSource": [
- {
- "type": "Task",
- "name": "QcMFTClusterTask",
- "MOs": [
- "mMFTClusterSensorIndex"
- ]
- }
- ],
- "className": "o2::quality_control_modules::mft::QcMFTClusterCheck",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "policy": "OnAny"
- },
- "CheckDiagnostics": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckDiagnostics",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "RDHCounterCrate0"
- ]
- }
- ]
- },
- "CheckCompressedData": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckCompressedData",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "checkParameters": {
- "DiagnosticThresholdPerSlot": "10"
- },
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "hDiagnostic"
- ]
- }
- ]
- },
- "CheckRawMultiplicity": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckRawMultiplicity",
- "moduleName": "QcTOF",
- "policy": "OnAny",
- "detectorName": "TOF",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskDigits",
- "MOs": [
- "TOFRawsMulti"
- ]
- }
- ]
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.005",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "mft-clusters",
- "active": "true",
- "machines": [],
- "query": "randomcluster:MFT/COMPCLUSTERS/0;clustersrof:MFT/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "digi-local",
- "active": "true",
- "machines": [
- "epn",
- "localhost"
- ],
- "port": "30333",
- "query": "tofdigits:TOF/DIGITS/0;readoutwin:TOF/READOUTWINDOW/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus.json b/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus.json
deleted file mode 100644
index d0658f8..0000000
--- a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus.json
+++ /dev/null
@@ -1,332 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {
- "NRawDigitsNBins": "100",
- "NRawDigitsXMin": "0",
- "NRawDigitsXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "TimeBinNBins": "600",
- "TimeBinXMin": "0",
- "TimeBinXMax": "600"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue",
- "NClustersNBins": "100",
- "NClustersXMin": "0",
- "NClustersXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "QtotNBins": "600",
- "QtotXMin": "0",
- "QtotXMax": "600",
- "SigmaPadNBins": "200",
- "SigmaPadXMin": "0",
- "SigmaPadXMax": "2",
- "SigmaTimeNBins": "200",
- "SigmaTimeXMin": "0",
- "SigmaTimeXMax": "2",
- "TimeBinNBins": "1000",
- "TimeBinXMin": "0",
- "TimeBinXMax": "100000"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- },
- "QcMFTClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::mft::QcMFTClusterTask",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "cycleDurationSeconds": "60",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "mft-clusters"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32640",
- "localControl": "odc"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- },
- "QcMFTClusterCheck": {
- "active": "true",
- "dataSource": [
- {
- "type": "Task",
- "name": "QcMFTClusterTask",
- "MOs": [
- "mMFTClusterSensorIndex"
- ]
- }
- ],
- "className": "o2::quality_control_modules::mft::QcMFTClusterCheck",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "policy": "OnAny"
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.005",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "mft-clusters",
- "active": "true",
- "machines": [],
- "query": "randomcluster:MFT/COMPCLUSTERS/0;clustersrof:MFT/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus_tofglobalrun.json b/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus_tofglobalrun.json
deleted file mode 100644
index 6ee585b..0000000
--- a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus_tofglobalrun.json
+++ /dev/null
@@ -1,443 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {
- "NRawDigitsNBins": "100",
- "NRawDigitsXMin": "0",
- "NRawDigitsXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "TimeBinNBins": "600",
- "TimeBinXMin": "0",
- "TimeBinXMax": "600"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue",
- "NClustersNBins": "100",
- "NClustersXMin": "0",
- "NClustersXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "QtotNBins": "600",
- "QtotXMin": "0",
- "QtotXMax": "600",
- "SigmaPadNBins": "200",
- "SigmaPadXMin": "0",
- "SigmaPadXMax": "2",
- "SigmaTimeNBins": "200",
- "SigmaTimeXMin": "0",
- "SigmaTimeXMax": "2",
- "TimeBinNBins": "1000",
- "TimeBinXMin": "0",
- "TimeBinXMax": "100000"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- },
- "QcMFTClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::mft::QcMFTClusterTask",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "cycleDurationSeconds": "60",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "mft-clusters"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32640",
- "localControl": "odc"
- },
- "TaskRaw": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskRaw",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "raw-local"
- },
- "location": "local",
- "localMachines": [
- "alio2-cr1-flp178-ib",
- "alio2-cr1-flp179-ib"
- ],
- "remoteMachine": "localhost",
- "remotePort": "30132",
- "mergingMode": "delta"
- },
- "TaskDigits": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskDigits",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "digi-local"
- },
- "location": "local",
- "localMachines": [
- "epn",
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "47708",
- "mergingMode": "delta",
- "localControl": "odc"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- },
- "QcMFTClusterCheck": {
- "active": "true",
- "dataSource": [
- {
- "type": "Task",
- "name": "QcMFTClusterTask",
- "MOs": [
- "mMFTClusterSensorIndex"
- ]
- }
- ],
- "className": "o2::quality_control_modules::mft::QcMFTClusterCheck",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "policy": "OnAny"
- },
- "CheckDiagnostics": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckDiagnostics",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "RDHCounterCrate0"
- ]
- }
- ]
- },
- "CheckCompressedData": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckCompressedData",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "checkParameters": {
- "DiagnosticThresholdPerSlot": "10"
- },
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "hDiagnostic"
- ]
- }
- ]
- },
- "CheckRawMultiplicity": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckRawMultiplicity",
- "moduleName": "QcTOF",
- "policy": "OnAny",
- "detectorName": "TOF",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskDigits",
- "MOs": [
- "TOFRawsMulti"
- ]
- }
- ]
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.005",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "mft-clusters",
- "active": "true",
- "machines": [],
- "query": "randomcluster:MFT/COMPCLUSTERS/0;clustersrof:MFT/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "digi-local",
- "active": "true",
- "machines": [
- "epn"
- ],
- "port": "30333",
- "query": "tofdigits:TOF/DIGITS/0;readoutwin:TOF/READOUTWINDOW/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-tofglobalrun.json b/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-tofglobalrun.json
deleted file mode 100644
index 403def5..0000000
--- a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-tofglobalrun.json
+++ /dev/null
@@ -1,391 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {
- "NRawDigitsNBins": "100",
- "NRawDigitsXMin": "0",
- "NRawDigitsXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "TimeBinNBins": "600",
- "TimeBinXMin": "0",
- "TimeBinXMax": "600"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue",
- "NClustersNBins": "100",
- "NClustersXMin": "0",
- "NClustersXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "QtotNBins": "600",
- "QtotXMin": "0",
- "QtotXMax": "600",
- "SigmaPadNBins": "200",
- "SigmaPadXMin": "0",
- "SigmaPadXMax": "2",
- "SigmaTimeNBins": "200",
- "SigmaTimeXMin": "0",
- "SigmaTimeXMax": "2",
- "TimeBinNBins": "1000",
- "TimeBinXMin": "0",
- "TimeBinXMax": "100000"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- },
- "TaskRaw": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskRaw",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "raw-local"
- },
- "location": "local",
- "localMachines": [
- "alio2-cr1-flp178-ib",
- "alio2-cr1-flp179-ib"
- ],
- "remoteMachine": "localhost",
- "remotePort": "30132",
- "mergingMode": "delta"
- },
- "TaskDigits": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::TaskDigits",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "cycleDurationSeconds": "10",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "digi-local"
- },
- "location": "local",
- "localMachines": [
- "epn",
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "47708",
- "mergingMode": "delta",
- "localControl": "odc"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- },
- "CheckDiagnostics": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckDiagnostics",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "RDHCounterCrate0"
- ]
- }
- ]
- },
- "CheckCompressedData": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckCompressedData",
- "moduleName": "QcTOF",
- "detectorName": "TOF",
- "policy": "OnAny",
- "checkParameters": {
- "DiagnosticThresholdPerSlot": "10"
- },
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskRaw",
- "MOs": [
- "hDiagnostic"
- ]
- }
- ]
- },
- "CheckRawMultiplicity": {
- "active": "true",
- "className": "o2::quality_control_modules::tof::CheckRawMultiplicity",
- "moduleName": "QcTOF",
- "policy": "OnAny",
- "detectorName": "TOF",
- "dataSource": [
- {
- "type": "Task",
- "name": "TaskDigits",
- "MOs": [
- "TOFRawsMulti"
- ]
- }
- ]
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.005",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "digi-local",
- "active": "true",
- "machines": [
- "epn",
- "localhost"
- ],
- "port": "30333",
- "query": "tofdigits:TOF/DIGITS/0;readoutwin:TOF/READOUTWINDOW/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2.json b/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2.json
deleted file mode 100644
index 9b96b8d..0000000
--- a/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2.json
+++ /dev/null
@@ -1,279 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {
- "NRawDigitsNBins": "100",
- "NRawDigitsXMin": "0",
- "NRawDigitsXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "TimeBinNBins": "600",
- "TimeBinXMin": "0",
- "TimeBinXMax": "600"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue",
- "NClustersNBins": "100",
- "NClustersXMin": "0",
- "NClustersXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "QtotNBins": "600",
- "QtotXMin": "0",
- "QtotXMax": "600",
- "SigmaPadNBins": "200",
- "SigmaPadXMin": "0",
- "SigmaPadXMax": "2",
- "SigmaTimeNBins": "200",
- "SigmaTimeXMin": "0",
- "SigmaTimeXMax": "2",
- "TimeBinNBins": "1000",
- "TimeBinXMin": "0",
- "TimeBinXMax": "100000"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.005",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc-tpcMNAll-mftClus.json b/testing/private/shahoian/qc/qc-tpcMNAll-mftClus.json
deleted file mode 100644
index 5bcd8cd..0000000
--- a/testing/private/shahoian/qc/qc-tpcMNAll-mftClus.json
+++ /dev/null
@@ -1,227 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {
- "NRawDigitsNBins": "100",
- "NRawDigitsXMin": "0",
- "NRawDigitsXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "TimeBinNBins": "600",
- "TimeBinXMin": "0",
- "TimeBinXMax": "600"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue",
- "NClustersNBins": "100",
- "NClustersXMin": "0",
- "NClustersXMax": "100",
- "QmaxNBins": "200",
- "QmaxXMin": "0",
- "QmaxXMax": "200",
- "QtotNBins": "600",
- "QtotXMin": "0",
- "QtotXMax": "600",
- "SigmaPadNBins": "200",
- "SigmaPadXMin": "0",
- "SigmaPadXMax": "2",
- "SigmaTimeNBins": "200",
- "SigmaTimeXMin": "0",
- "SigmaTimeXMax": "2",
- "TimeBinNBins": "1000",
- "TimeBinXMin": "0",
- "TimeBinXMax": "100000"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "QcMFTClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::mft::QcMFTClusterTask",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "cycleDurationSeconds": "60",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "mft-clusters"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32640",
- "localControl": "odc"
- }
- },
- "checks": {
- "QcMFTClusterCheck": {
- "active": "true",
- "dataSource": [
- {
- "type": "Task",
- "name": "QcMFTClusterTask",
- "MOs": [
- "mMFTClusterSensorIndex"
- ]
- }
- ],
- "className": "o2::quality_control_modules::mft::QcMFTClusterCheck",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "policy": "OnAny"
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.005",
- "seed": "0"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "mft-clusters",
- "active": "true",
- "machines": [],
- "query": "randomcluster:MFT/COMPCLUSTERS/0;clustersrof:MFT/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc_ITS_MFT.json b/testing/private/shahoian/qc/qc_ITS_MFT.json
deleted file mode 100644
index 34df6f7..0000000
--- a/testing/private/shahoian/qc/qc_ITS_MFT.json
+++ /dev/null
@@ -1,203 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "qcdb.cern.ch:8083",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "influxdb-unix:///tmp/telegraf.sock"
- },
- "consul": {
- "url": "alio2-cr1-flp187:8500"
- },
- "conditionDB": {
- "url": "qcdb.cern.ch:8083"
- }
- },
-"tasks": {
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "remote",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "remote"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- }
- }
- },
- "dataSamplingPolicies": [
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- }
- ]
-}
-
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "qcdb.cern.ch:8083",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "aliecs.cern.ch:8500"
- },
- "conditionDB": {
- "url": "qcdb.cern.ch:8083"
- }
- },
- "tasks": {
- "QcMFTClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::mft::QcMFTClusterTask",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "cycleDurationSeconds": "60",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "mft-clusters"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "remote"
- }
- },
- "checks": {
- "QcMFTClusterCheck": {
- "active": "true",
- "dataSource": [{
- "type": "Task",
- "name": "QcMFTClusterTask",
- "MOs": ["mMFTClusterSensorIndex"]
- }],
- "className": "o2::quality_control_modules::mft::QcMFTClusterCheck",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "policy": "OnAny"
- }
- }
- },
- "dataSamplingPolicies": [
- {
- "id": "mft-clusters",
- "active": "true",
- "machines": [],
- "query": "randomcluster:MFT/COMPCLUSTERS/0;clustersrof:MFT/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc_its_tpc.json b/testing/private/shahoian/qc/qc_its_tpc.json
deleted file mode 100644
index 003c3f2..0000000
--- a/testing/private/shahoian/qc/qc_its_tpc.json
+++ /dev/null
@@ -1,251 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul-test.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {},
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "remote",
- "remoteMachine": "epn102-ib"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.005",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc_its_tpcNoClus.json b/testing/private/shahoian/qc/qc_its_tpcNoClus.json
deleted file mode 100644
index 890cf45..0000000
--- a/testing/private/shahoian/qc/qc_its_tpcNoClus.json
+++ /dev/null
@@ -1,232 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul-test.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "false",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {},
- "location": "remote"
- },
- "Clusters_EPN": {
- "active": "false",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "remoteMachine": "epn102-ib",
- "location": "remote"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "false",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc_its_tpcNoDigi.json b/testing/private/shahoian/qc/qc_its_tpcNoDigi.json
deleted file mode 100644
index 151a200..0000000
--- a/testing/private/shahoian/qc/qc_its_tpcNoDigi.json
+++ /dev/null
@@ -1,232 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul-test.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "false",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {},
- "location": "remote"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "remoteMachine": "epn102-ib",
- "location": "remote"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32630",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn102-ib",
- "remotePort": "32631"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.3",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc_tpc_its_mft.json b/testing/private/shahoian/qc/qc_tpc_its_mft.json
deleted file mode 100644
index fa43196..0000000
--- a/testing/private/shahoian/qc/qc_tpc_its_mft.json
+++ /dev/null
@@ -1,286 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul-test.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {},
- "location": "remote"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "remote"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn160-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn160-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "ITSClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "180",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "compclus"
- },
- "location": "remote",
- "taskParameters": {
- "layer": "1111111",
- "clusterDictionaryPath": "/home/epn/odc/files/ITSdictionary.bin",
- "runNumberPath": "/home/its/QC/workdir/infiles/RunNumber.dat",
- "geomPath": "/home/epn/odc/files/o2sim_geometry.root",
- "nThreads": "4"
- }
- },
- "ITSTrackTask": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackTask",
- "moduleName": "QcITS",
- "detectorName": "ITS",
- "cycleDurationSeconds": "30",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "tracks"
- },
- "location": "remote"
- },
- "QcMFTClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::mft::QcMFTClusterTask",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "cycleDurationSeconds": "60",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "mft-clusters"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "remote"
- }
- },
- "checks": {
- "ITSClusterCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSClusterCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSClusterTask",
- "MOs": [
- "Layer0/AverageClusterSize"
- ]
- }
- ]
- },
- "ITSTrackCheck": {
- "active": "true",
- "className": "o2::quality_control_modules::its::ITSTrackCheck",
- "moduleName": "QcITS",
- "policy": "OnAny",
- "detectorName": "ITS",
- "dataSource": [
- {
- "type": "Task",
- "name": "ITSTrackTask",
- "MOs": [
- "NClusters"
- ]
- }
- ]
- },
- "QcMFTClusterCheck": {
- "active": "true",
- "dataSource": [
- {
- "type": "Task",
- "name": "QcMFTClusterTask",
- "MOs": [
- "mMFTClusterSensorIndex"
- ]
- }
- ],
- "className": "o2::quality_control_modules::mft::QcMFTClusterCheck",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "policy": "OnAny"
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "compclus",
- "active": "true",
- "machines": [],
- "query": "compclus:ITS/COMPCLUSTERS/0;clustersrof:ITS/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "tracks",
- "active": "true",
- "machines": [],
- "query": "tracks:ITS/TRACKS/0;rofs:ITS/ITSTrackROF/0;compclus:ITS/COMPCLUSTERS/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1441"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "mft-clusters",
- "active": "true",
- "machines": [],
- "query": "randomcluster:MFT/COMPCLUSTERS/0;clustersrof:MFT/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/qc/qc_tpc_mft.json b/testing/private/shahoian/qc/qc_tpc_mft.json
deleted file mode 100644
index 46d4b16..0000000
--- a/testing/private/shahoian/qc/qc_tpc_mft.json
+++ /dev/null
@@ -1,191 +0,0 @@
-{
- "qc": {
- "config": {
- "database": {
- "implementation": "CCDB",
- "host": "ccdb-test.cern.ch:8080",
- "username": "not_applicable",
- "password": "not_applicable",
- "name": "not_applicable"
- },
- "Activity": {
- "number": "42",
- "type": "2"
- },
- "monitoring": {
- "url": "infologger:///debug?qc"
- },
- "consul": {
- "url": "http://consul-test.cern.ch:8500"
- },
- "conditionDB": {
- "url": "ccdb-test.cern.ch:8080"
- }
- },
- "tasks": {
- "RawDigits_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::RawDigits",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-rawdata"
- },
- "taskParameters": {},
- "location": "remote"
- },
- "Clusters_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Clusters",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "random-cluster"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "remote"
- },
- "PID_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::PID",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn160-ib",
- "remotePort": "32625",
- "mergingMode": "delta"
- },
- "Tracks_EPN": {
- "active": "true",
- "className": "o2::quality_control_modules::tpc::Tracks",
- "moduleName": "QcTPC",
- "detectorName": "TPC",
- "cycleDurationSeconds": "30",
- "resetAfterCycles": "10",
- "maxNumberCycles": "-1",
- "dataSource": {
- "type": "direct",
- "query": "inputTracks:TPC/TRACKS/0"
- },
- "taskParameters": {},
- "location": "local",
- "localMachines": [
- "localhost"
- ],
- "remoteMachine": "epn160-ib",
- "remotePort": "32626",
- "mergingMode": "delta"
- },
- "QcMFTClusterTask": {
- "active": "true",
- "className": "o2::quality_control_modules::mft::QcMFTClusterTask",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "cycleDurationSeconds": "60",
- "maxNumberCycles": "-1",
- "dataSource_comment": "The other type of dataSource is \"direct\", see basic-no-sampling.json.",
- "dataSource": {
- "type": "dataSamplingPolicy",
- "name": "mft-clusters"
- },
- "taskParameters": {
- "myOwnKey": "myOwnValue"
- },
- "location": "remote"
- }
- },
- "checks": {
- "QcMFTClusterCheck": {
- "active": "true",
- "dataSource": [
- {
- "type": "Task",
- "name": "QcMFTClusterTask",
- "MOs": [
- "mMFTClusterSensorIndex"
- ]
- }
- ],
- "className": "o2::quality_control_modules::mft::QcMFTClusterCheck",
- "moduleName": "QcMFT",
- "detectorName": "MFT",
- "policy": "OnAny"
- }
- },
- "externalTasks": null,
- "postprocessing": null
- },
- "dataSamplingPolicies": [
- {
- "id": "random-cluster",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32627",
- "query": "inputClus:TPC/CLUSTERNATIVE",
- "outputs": "sampled-clusters:DS/CLUSTERNATIVE",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "random-rawdata",
- "active": "true",
- "machines": [
- "localhost"
- ],
- "port": "32628",
- "query": "inputRaw:TPC/RAWDATA",
- "outputs": "sampled-rawdata:DS/RAWDATA",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.1",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- },
- {
- "id": "mft-clusters",
- "active": "true",
- "machines": [],
- "query": "randomcluster:MFT/COMPCLUSTERS/0;clustersrof:MFT/CLUSTERSROF/0",
- "samplingConditions": [
- {
- "condition": "random",
- "fraction": "0.01",
- "seed": "1234"
- }
- ],
- "blocking": "false"
- }
- ]
-}
diff --git a/testing/private/shahoian/reco_ctf_qc-uni.sh b/testing/private/shahoian/reco_ctf_qc-uni.sh
deleted file mode 100755
index 93c81d0..0000000
--- a/testing/private/shahoian/reco_ctf_qc-uni.sh
+++ /dev/null
@@ -1,113 +0,0 @@
-#!/bin/bash
-
-# accounts for externally set WORKFLOW_DETECTORS, SHMSIZE, SAVECTF, CTF_DIR, QCJSON, WORKFLOWMODE
-
-# HACK
-###WORKFLOW_DETECTORS=`echo $WORKFLOW_DETECTORS | tr _ ,`
-
-source /home/shahoian/alice/O2DataProcessing/common/setenv.sh
-
-# EPN script. Including CTF creation and QC.
-export GPUTYPE=HIP
-export GPUMEMSIZE=$(( 24 << 30 ))
-export HOSTMEMSIZE=$(( 5 << 30 ))
-
-SEVERITY=INFO
-INFOLOGGER_SEVERITY=WARNING
-
-# global args
-ARGS_ALL=" --session default --severity $SEVERITY --infologger-severity $INFOLOGGER_SEVERITY --shm-segment-size $SHMSIZE --monitoring-backend influxdb-unix:///tmp/telegraf.sock"
-#ARGS_ALL=" --session default --severity $SEVERITY --infologger-severity $INFOLOGGER_SEVERITY --shm-segment-size $SHMSIZE "
-
-# raw input proxy channel
-PROXY_CHANNEL="name=readout-proxy,type=pull,method=connect,address=ipc://@tf-builder-pipe-0,transport=shmem,rateLogging=1"
-# raw input data filtered by the proxy
-PROXY_INSPEC="dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION"
-
-# add detectors
-has_detector ITS && PROXY_INSPEC+=";I:ITS/RAWDATA"
-has_detector MFT && PROXY_INSPEC+=";M:MFT/RAWDATA"
-has_detector TPC && PROXY_INSPEC+=";T:TPC/RAWDATA"
-has_detector TOF && PROXY_INSPEC+=";X:TOF/CRAWDATA"
-
-TPC_INSPEC="dd:FLP/DISTSUBTIMEFRAME/0;eos:***/INFORMATION;T:TPC/RAWDATA"
-TPC_OUTPUT="clusters,tracks,disable-writer"
-if [ $SAVECTF == 1 ]; then
- TPC_OUTPUT+=",encoded-clusters"
-fi
-
-# directory for external files
-#FILEWORKDIR="/home/epn/odc/files"
-
-# Clusterization dictionaries path
-ITSCLUSDICT="${FILEWORKDIR}/ITSdictionary.bin"
-MFTCLUSDICT="${FILEWORKDIR}/MFTdictionary.bin"
-
-MFT_NOISE="${FILEWORKDIR}/mft_noise_220721_R3C-520.root"
-
-# CTF compression dictionary
-CTF_DICT="${FILEWORKDIR}/ctf_dictionary.root"
-# min file size for CTF (accumulate CTFs until it is reached)
-CTF_MINSIZE="2000000"
-# output directory for CTF files
-#CTF_DIR="/tmp/eosbuffer"
-
-# key/values config string
-CONFKEYVAL="NameConf.mDirGRP=${FILEWORKDIR};NameConf.mDirGeom=${FILEWORKDIR}"
-
-# number of decoding pipelines and threads per pipeline
-NITSDECPIPELINES=6
-NITSDECTHREADS=2
-NMFTDECPIPELINES=6
-NMFTDECTHREADS=2
-
-# number of reconstruction pipelines and threads per pipeline
-NITSRECPIPELINES=2
-NMFTRECPIPELINES=2
-NTOFRECPIPELINES=1
-
-# number of compression pipelines
-NITSENCODERPIPELINES=1
-NMFTENCODERPIPELINES=1
-NTOFENCODERPIPELINES=1
-
-# uncomment this to disable intermediate reconstruction output
-#DISABLE_RECO_OUTPUT=" --disable-root-output "
-
-HOST=localhost
-
-WORKFLOW="o2-dpl-raw-proxy -b ${ARGS_ALL} --dataspec \"${PROXY_INSPEC}\" --channel-config \"${PROXY_CHANNEL}\" | "
-has_detector ITS && WORKFLOW+="o2-itsmft-stf-decoder-workflow -b ${ARGS_ALL} --nthreads ${NITSDECTHREADS} --pipeline its-stf-decoder:${NITSDECPIPELINES} --configKeyValues \"${CONFKEYVAL}\" --dict-file \"${ITSCLUSDICT}\" | "
-has_detector ITS && WORKFLOW+="o2-its-reco-workflow -b ${ARGS_ALL} ${DISABLE_RECO_OUTPUT} --trackerCA --tracking-mode sync --disable-mc --clusters-from-upstream --pipeline its-tracker:${NITSRECPIPELINES} --its-dictionary-path \"${ITSCLUSDICT}\" --configKeyValues \"${CONFKEYVAL}\" | "
-#
-has_detector MFT && WORKFLOW+="o2-itsmft-stf-decoder-workflow -b ${ARGS_ALL} --nthreads ${NMFTDECTHREADS} --pipeline mft-stf-decoder:${NMFTDECPIPELINES} --configKeyValues \"${CONFKEYVAL}\" --dict-file \"${MFTCLUSDICT}\" --runmft --noise-file \"${MFT_NOISE}\" | "
-#
-has_detector TPC && WORKFLOW+="o2-tpc-raw-to-digits-workflow -b ${ARGS_ALL} --input-spec \"${TPC_INSPEC}\" --configKeyValues \"TPCDigitDump.LastTimeBin=1000\" --pipeline tpc-raw-to-digits-0:6 | "
-has_detector TPC && WORKFLOW+="o2-tpc-reco-workflow -b ${ARGS_ALL} --input-type digitizer --output-type $TPC_OUTPUT --disable-mc --pipeline tpc-tracker:4 --environment ROCR_VISIBLE_DEVICES={timeslice0} --configKeyValues \"align-geom.mDetectors=none;GPU_global.deviceType=$GPUTYPE;GPU_proc.forceMemoryPoolSize=$GPUMEMSIZE;GPU_proc.forceHostMemoryPoolSize=$HOSTMEMSIZE;GPU_proc.deviceNum=0;GPU_proc.tpcIncreasedMinClustersPerRow=500000;GPU_proc.ignoreNonFatalGPUErrors=1;GPU_proc.memoryScalingFactor=3;${CONFKEYVAL}\" | "
-#
-has_detector TOF && WORKFLOW+="o2-tof-reco-workflow -b ${ARGS_ALL} --input-type raw --output-type clusters --pipeline TOFClusterer:${NTOFRECPIPELINES} --configKeyValues \"${CONFKEYVAL}\" | "
-
-if [ $SAVECTF == 1 ]; then
- has_detector ITS && WORKFLOW+="o2-itsmft-entropy-encoder-workflow -b ${ARGS_ALL} --ctf-dict \"${CTF_DICT}\" --pipeline its-entropy-encoder:${NITSENCODERPIPELINES} | "
- has_detector MFT && WORKFLOW+="o2-itsmft-entropy-encoder-workflow -b ${ARGS_ALL} --ctf-dict \"${CTF_DICT}\" --pipeline mft-entropy-encoder:${NMFTENCODERPIPELINES} --runmft | "
- has_detector TOF && WORKFLOW+="o2-tof-entropy-encoder-workflow -b ${ARGS_ALL} --ctf-dict \"${CTF_DICT}\" --pipeline tof-entropy-encoder:${NTOFENCODERPIPELINES} | "
- WORKFLOW+="o2-ctf-writer-workflow -b ${ARGS_ALL} --configKeyValues \"${CONFKEYVAL}\" --no-grp --onlyDet $WORKFLOW_DETECTORS --ctf-dict \"${CTF_DICT}\" --output-dir \"$CTF_DIR\" --min-file-size ${CTF_MINSIZE} | "
-fi
-
-if [ -n "$QCJSON" ]; then
- WORKFLOW+="o2-qc -b ${ARGS_ALL} --config json://$QCJSON --local --host $HOST | "
-fi
-
-WORKFLOW+=" o2-dpl-run ${ARGS_ALL} ${GLOBALDPLOPT}"
-
-if [ $WORKFLOWMODE == "print" ]; then
- echo Workflow command:
- echo $WORKFLOW | sed "s/| */|\n/g"
-else
- # Execute the command we have assembled
- WORKFLOW+=" --$WORKFLOWMODE"
- eval $WORKFLOW
-fi
-
-
-
diff --git a/testing/private/shahoian/run_ext.sh b/testing/private/shahoian/run_ext.sh
deleted file mode 100755
index 9a7f219..0000000
--- a/testing/private/shahoian/run_ext.sh
+++ /dev/null
@@ -1,35 +0,0 @@
-#!/bin/bash
-
-export GEN_TOPO_PARTITION=test # ECS Partition
-export DDMODE=processing # DataDistribution mode - possible options: processing, disk, processing-disk, discard
-
-# Use these settings to fetch the Workflow Repository using a hash / tag
-#export GEN_TOPO_HASH=1 # Fetch O2DataProcessing repository using a git hash
-#export GEN_TOPO_SOURCE=v0.5 # Git hash to fetch
-
-# Use these settings to specify a path to the workflow repository in your home dir
-export GEN_TOPO_HASH=0 # Specify path to O2DataProcessing repository
-export GEN_TOPO_SOURCE=/home/shahoian/alice/O2DataProcessing # Path to O2DataProcessing repository
-
-export GEN_TOPO_LIBRARY_FILE=testing/private/shahoian/workflows.desc # Topology description library file to load
-export WORKFLOW_DETECTORS=ALL # Optional parameter for the workflow: Detectors to run reconstruction for (comma-separated list)
-export WORKFLOW_DETECTORS_QC= # Optional parameter for the workflow: Detectors to run QC for
-export WORKFLOW_DETECTORS_CALIB= # Optional parameters for the workflow: Detectors to run calibration for
-export WORKFLOW_PARAMETERS= # Additional paramters for the workflow
-export RECO_NUM_NODES_OVERRIDE=0 # Override the number of EPN compute nodes to use (default is specified in description library file)
-export NHBPERTF=256 # Number of HBF per TF
-
-export GEN_TOPO_IGNORE_ERROR=1
-
-##---------------
-jq -n 'reduce inputs as $s (input; .qc.tasks += ($s.qc.tasks) | .qc.checks += ($s.qc.checks) | .qc.externalTasks += ($s.qc.externalTasks) | .qc.postprocessing += ($s.qc.postprocessing)| .dataSamplingPolicies += ($s.dataSamplingPolicies))' /home/epn/odc/files/tpcQCTasks_multinode_ALL.json /home/epn/jliu/itsEPNv2.json > /home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2.json
-jq -n 'reduce inputs as $s (input; .qc.tasks += ($s.qc.tasks) | .qc.checks += ($s.qc.checks) | .qc.externalTasks += ($s.qc.externalTasks) | .qc.postprocessing += ($s.qc.postprocessing)| .dataSamplingPolicies += ($s.dataSamplingPolicies))' /home/epn/odc/files/tpcQCTasks_multinode_ALL.json /home/epn/jliu/itsEPNv2.json /home/epn/odc/files/qc-mft-cluster.json > /home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus.json
-jq -n 'reduce inputs as $s (input; .qc.tasks += ($s.qc.tasks) | .qc.checks += ($s.qc.checks) | .qc.externalTasks += ($s.qc.externalTasks) | .qc.postprocessing += ($s.qc.postprocessing)| .dataSamplingPolicies += ($s.dataSamplingPolicies))' /home/epn/odc/files/tpcQCTasks_multinode_ALL.json /home/epn/odc/files/qc-mft-cluster.json > /home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-mftClus.json
-jq -n 'reduce inputs as $s (input; .qc.tasks += ($s.qc.tasks) | .qc.checks += ($s.qc.checks) | .qc.externalTasks += ($s.qc.externalTasks) | .qc.postprocessing += ($s.qc.postprocessing)| .dataSamplingPolicies += ($s.dataSamplingPolicies))' /home/epn/odc/files/tpcQCTasks_multinode_ALL.json /home/epn/jliu/itsEPNv2.json /home/epn/odc/files/qc-mft-cluster.json /home/fnoferin/public/tof-qc-globalrun.json > /home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus-tofglobalrun.json
-jq -n 'reduce inputs as $s (input; .qc.tasks += ($s.qc.tasks) | .qc.checks += ($s.qc.checks) | .qc.externalTasks += ($s.qc.externalTasks) | .qc.postprocessing += ($s.qc.postprocessing)| .dataSamplingPolicies += ($s.dataSamplingPolicies))' /home/epn/odc/files/tpcQCTasks_multinode_ALL.json /home/epn/jliu/itsEPNv2.json /home/fnoferin/public/tof-qc-globalrun.json > /home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-tofglobalrun.json
-
-for wf in "$@"
-do
- export GEN_TOPO_WORKFLOW_NAME=$wf
- /home/epn/pdp/gen_topo.sh > $HOME/gen_topo/test/${GEN_TOPO_WORKFLOW_NAME}.xml
-done
diff --git a/testing/private/shahoian/workflows.desc b/testing/private/shahoian/workflows.desc
deleted file mode 100644
index 292e1e5..0000000
--- a/testing/private/shahoian/workflows.desc
+++ /dev/null
@@ -1,57 +0,0 @@
-tpc-ctf-qcTPC-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-tpc-ctf-qcTPC-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-tpc-ctf2eos-qcTPC-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOW_PARAMETERS=CTF WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-ctf-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT SAVECTF=1 DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-ctf-qcITS-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT SAVECTF=1 QCJSON=/home/epn/jliu/itsEPNv2.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-ctf-qcMFT-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT SAVECTF=1 QCJSON=/home/epn/odc/files/qc-mft-cluster.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-ctf-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-ctf-qcTPC-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-its-tpc-ctf-qcTPC-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-mft-tpc-ctf-qcTPC-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-its-locrec-ctf-qcITS-20: "DataDistribution QualityControl" reco,20,20,"WORKFLOW_DETECTORS=ITS SAVECTF=1 QCJSON=/home/epn/jliu/itsEPNv2.json SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-locrec-qcITS-20: "DataDistribution QualityControl" reco,20,20,"WORKFLOW_DETECTORS=ITS SAVECTF=0 QCJSON=/home/epn/jliu/itsEPNv2.json SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-qcITS-20: "DataDistribution QualityControl" reco,20,20,"WORKFLOW_DETECTORS=ITS SAVECTF=0 QCJSON=/home/epn/jliu/itsEPNv2.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-tpc-ctf-qcTPC-58: "DataDistribution QualityControl" reco,58,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-tpc-ctf2eos-qcTPC-58: "DataDistribution QualityControl" reco,58,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOW_PARAMETERS=CTF WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-ctf-58: "DataDistribution QualityControl" reco,58,54,"WORKFLOW_DETECTORS=ITS,MFT SAVECTF=1 DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-ctf-qcITS-58: "DataDistribution QualityControl" reco,58,54,"WORKFLOW_DETECTORS=ITS,MFT SAVECTF=1 QCJSON=/home/epn/jliu/itsEPNv2.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-ctf-qcMFT-58: "DataDistribution QualityControl" reco,58,54,"WORKFLOW_DETECTORS=ITS,MFT SAVECTF=1 QCJSON=/home/epn/odc/files/qc-mft-cluster.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-ctf-58: "DataDistribution QualityControl" reco,58,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-ctf-qcTPC-58: "DataDistribution QualityControl" reco,58,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-#
-tpc-ctf-qcTPCnodigi-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-ctf-qcTPCnodigi-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-tpc-ctf-qcTPCnodigi-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-mft-tpc-ctf-qcTPCnodigi-59: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-tpc-ctf-qcTPCnodigi-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-ctf-qcTPCnodigi-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-tpc-ctf-qcTPCnodigi-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-mft-tpc-ctf-qcTPCnodigi-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL_no_digi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-its-tpc-ctf-qcITS_TPCnodigi-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc_its_tpcNoDigi.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-tpc-ctf-qcITS_TPC-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc_its_tpc.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-tpc-ctf-qcITS_TPCnoClus-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc_its_tpcNoClus.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-#
-
-tpc-ctf-qcTPCMNAll-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-tpc-ctf-qcTPCMNAll-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-mft-tpc-ctf-qcTPCMNAll-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-ist-mft-tpc-ctf-qcTPCMNAll-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 QCJSON=/home/epn/odc/files/tpcQCTasks_multinode_ALL.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-its-tpc-ctf-qcTPCMNAll-itsEPNv2-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-mft-tpc-ctf-qcTPCMNAll-mftClus-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=MFT,TPC SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-mftClus.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-ctf-qcTPCMNAll-itsEPNv2-mftClus-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-its-mft-tpc-tof-ctf-qcTPCMNAll-itsEPNv2-mftClus-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC,TOF SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-tpc-tof-ctf-qcTPCMNAll-itsEPNv2-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC,TOF SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-its-tpc-tof-ctf-qcTPCMNAll-itsEPNv2-tofglobalrun-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,TPC,TOF SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-tofglobalrun.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-its-mft-tpc-tof-ctf-qcTPCMNAll-itsEPNv2-mftClus-tofglobalrun-59mon: "DataDistribution QualityControl" reco,59,54,"WORKFLOW_DETECTORS=ITS,MFT,TPC,TOF SAVECTF=1 QCJSON=/home/shahoian/alice/O2DataProcessing/testing/private/shahoian/qc/qc-tpcMNAll-itsEPNv2-mftClus-tofglobalrun.json DISABLE_RECO_OUTPUT=\" --disable-root-output \" SHMSIZE=128000000000 WORKFLOWMODE=dds testing/private/shahoian/reco_ctf_qc-uni.sh"
-
-
diff --git a/tools/datadistribution_workflows/dd-discard.xml b/tools/datadistribution_workflows/dd-discard.xml
deleted file mode 100644
index 2ceb5db..0000000
--- a/tools/datadistribution_workflows/dd-discard.xml
+++ /dev/null
@@ -1,14 +0,0 @@
-
-
-
- /home/epn/odc/tfbuilder.sh standalone
-
- TfBuilderRequirement
-
-
-
-
- TfBuilderTask
-
-
-
diff --git a/tools/datadistribution_workflows/dd-disk.xml b/tools/datadistribution_workflows/dd-disk.xml
deleted file mode 100644
index 86383a7..0000000
--- a/tools/datadistribution_workflows/dd-disk.xml
+++ /dev/null
@@ -1,14 +0,0 @@
-
-
-
- /home/epn/odc/tfbuilder.sh disk
-
- TfBuilderRequirement
-
-
-
-
- TfBuilderTask
-
-
-
diff --git a/tools/datadistribution_workflows/dd-processing-disk.xml b/tools/datadistribution_workflows/dd-processing-disk.xml
deleted file mode 100644
index 3a9a093..0000000
--- a/tools/datadistribution_workflows/dd-processing-disk.xml
+++ /dev/null
@@ -1,14 +0,0 @@
-
-
-
- /home/epn/odc/tfbuilder.sh disk_data
-
- TfBuilderRequirement
-
-
-
-
- TfBuilderTask
-
-
-
diff --git a/tools/datadistribution_workflows/dd-processing.xml b/tools/datadistribution_workflows/dd-processing.xml
deleted file mode 100644
index eba9c80..0000000
--- a/tools/datadistribution_workflows/dd-processing.xml
+++ /dev/null
@@ -1,14 +0,0 @@
-
-
-
- /home/epn/odc/tfbuilder.sh data
-
- TfBuilderRequirement
-
-
-
-
- TfBuilderTask
-
-
-
diff --git a/tools/epn/gen_topo.sh b/tools/epn/gen_topo.sh
deleted file mode 100755
index 19427e1..0000000
--- a/tools/epn/gen_topo.sh
+++ /dev/null
@@ -1,27 +0,0 @@
-#!/bin/bash
-# Settings coming from AliECS via env variables
-if [ -z $GEN_TOPO_PARTITION ]; then echo \$GEN_TOPO_PARTITION missing; exit 1; fi # Partition
-if [ -z $GEN_TOPO_HASH ]; then echo \$GEN_TOPO_HASH missing; exit 1; fi # Flag whether source is a hash or a folder
-if [ -z $GEN_TOPO_SOURCE ]; then echo \$GEN_TOPO_SOURCE missing; exit 1; fi # O2DataProcessing repository source, either a commit hash or a path
-if [ -z $GEN_TOPO_LIBRARY_FILE ]; then echo \$GEN_TOPO_LIBRARY_FILE missing; exit 1; fi # Topology description library file in O2DataProcessing repository
-if [ -z $GEN_TOPO_WORKFLOW_NAME ]; then echo \$GEN_TOPO_WORKFLOW_NAME missing; exit 1; fi # Workflow name in library file
-if [ -z ${WORKFLOW_DETECTORS+x} ]; then echo \$WORKFLOW_DETECTORS missing; exit 1; fi # Comma-separated list of detectors to run processing for
-if [ -z ${WORKFLOW_DETECTORS_QC+x} ]; then echo \$WORKFLOW_DETECTORS_QC missing; exit 1; fi # Comma-separated list of detectors to run QC for
-if [ -z ${WORKFLOW_DETECTORS_CALIB+x} ]; then echo \$WORKFLOW_DETECTORS_CALIB missing; exit 1; fi # Comma-separated list of detectors to run calibration for
-if [ -z ${WORKFLOW_PARAMETERS+x} ]; then echo \$WORKFLOW_PARAMETERS missing; exit 1; fi # Additional parameters for workflow
-if [ -z ${RECO_NUM_NODES_OVERRIDE+x} ]; then echo \$RECO_NUM_NODES_OVERRIDE missing; exit 1; fi # Override number of nodes
-if [ -z $DDMODE ] && [ -z $DDWORKFLOW ]; then echo Either \$DDMODE or \$DDWORKFLOW must be set; exit 1; fi #Select data distribution workflow
-
-# Settings for some EPN paths / names / etc.
-export FILEWORKDIR=/home/epn/odc/files # Path to common grp / geometry / etc files
-export INRAWCHANNAME=tf-builder-pipe-0 # Pipe name to get data from TfBuilder
-export CTF_DIR=/tmp/datadist/ctf # Output directory for CTFs
-export GEN_TOPO_WORKDIR=/home/epn/gen_topo/$GEN_TOPO_PARTITION # Persistent working directory for checkout O2DataProcessing repository and for XML cache. Must be per partition. This script must not run twice in parallel with the same workdir
-
-# Load required module and run gen_topo_o2dataprocessing (PDP part of this script)
-module load ODC O2DataProcessing 1>&2 || { echo Error loading ODC / O2DataProcessing 1>&2; exit 1; }
-$O2DATAPROCESSING_ROOT/tools/epn/gen_topo_o2dataprocessing.sh
-if [ $? != 0 ]; then
- echo topology generation failed 1>&2
- exit 1
-fi
diff --git a/tools/epn/gen_topo_o2dataprocessing.sh b/tools/epn/gen_topo_o2dataprocessing.sh
deleted file mode 100755
index 6ef9486..0000000
--- a/tools/epn/gen_topo_o2dataprocessing.sh
+++ /dev/null
@@ -1,39 +0,0 @@
-#!/bin/bash
-mkdir -p $GEN_TOPO_WORKDIR/cache
-cd $GEN_TOPO_WORKDIR || { echo Cannot enter work dir 1>&2; exit 1; }
-if [ ! -d O2DataProcessing ]; then git clone https://github.com/AliceO2Group/O2DataProcessing.git 1>&2 || { echo O2DataProcessing checkout failed 1>&2; exit 1; }; fi
-if [ $GEN_TOPO_HASH == 1 ]; then
- export GEN_TOPO_CACHEABLE=1
- CACHE_HASH=`echo $GEN_TOPO_PARTITION $GEN_TOPO_SOURCE $GEN_TOPO_LIBRARY_FILE $GEN_TOPO_WORKFLOW_NAME $WORKFLOW_DETECTORS $WORKFLOW_DETECTORS_QC $WORKFLOW_DETECTORS_CALIB $WORKFLOW_PARAMETERS $RECO_NUM_NODES_OVERRIDE $DDMODE $DDWORKFLOW $INRAWCHANNAME $FILEWORKDIR $CTF_DIR | md5sum | awk '{print $1}'`
- if [ -f cache/$CACHE_HASH ]; then
- echo Reusing cached XML topology 1>&2
- touch cache/$CACHE_HASH
- cat cache/$CACHE_HASH
- exit 0
- fi
- cd O2DataProcessing
- git checkout $GEN_TOPO_SOURCE &> /dev/null
- if [ $? != 0 ]; then
- git fetch origin 1>&2 || { echo Repository update failed 1>&2; exit 1; }
- git checkout $GEN_TOPO_SOURCE &> /dev/null || { echo commit does not exist 1>&2; exit 1; }
- fi
- if ! git describe --exact-match --tags HEAD; then
- unset GEN_TOPO_CACHEABLE
- fi
-else
- cd $GEN_TOPO_SOURCE || { echo Directory missing 1>&2; exit 1; }
-fi
-export EPNMODE=1
-export O2DATAPROCESSING_ROOT=`pwd`
-echo Running topology generation to temporary file $GEN_TOPO_WORKDIR/output.xml 1>&2
-./tools/parse "$GEN_TOPO_LIBRARY_FILE" $GEN_TOPO_WORKFLOW_NAME $GEN_TOPO_WORKDIR/output.xml 1>&2 || { echo Error during workflow description parsing 1>&2; exit 1; }
-if [ "0$GEN_TOPO_CACHEABLE" == "01" ]; then
- cd $GEN_TOPO_WORKDIR
- if [ `ls cache/ | wc -l` -ge 100 ]; then
- ls -t cache/* | tail -n +100 | xargs rm
- fi
- cp $GEN_TOPO_WORKDIR/output.xml cache/$CACHE_HASH
-fi
-cat $GEN_TOPO_WORKDIR/output.xml
-echo Removing temporary output file $GEN_TOPO_WORKDIR/output.xml 1>&2
-rm $GEN_TOPO_WORKDIR/output.xml
diff --git a/tools/epn/run.sh b/tools/epn/run.sh
deleted file mode 100755
index f5a5393..0000000
--- a/tools/epn/run.sh
+++ /dev/null
@@ -1,23 +0,0 @@
-#!/bin/bash
-
-export GEN_TOPO_PARTITION=test # ECS Partition
-export DDMODE=processing # DataDistribution mode - possible options: processing, disk, processing-disk, discard
-
-# Use these settings to fetch the Workflow Repository using a hash / tag
-#export GEN_TOPO_HASH=1 # Fetch O2DataProcessing repository using a git hash
-#export GEN_TOPO_SOURCE=v0.5 # Git hash to fetch
-
-# Use these settings to specify a path to the workflow repository in your home dir
-export GEN_TOPO_HASH=0 # Specify path to O2DataProcessing repository
-export GEN_TOPO_SOURCE=/home/drohr/alice/O2DataProcessing # Path to O2DataProcessing repository
-
-export GEN_TOPO_LIBRARY_FILE=testing/detectors/TPC/workflows.desc # Topology description library file to load
-export GEN_TOPO_WORKFLOW_NAME=ctf-and-display # Name of workflow in topology description library
-export WORKFLOW_DETECTORS=ALL # Optional parameter for the workflow: Detectors to run reconstruction for (comma-separated list)
-export WORKFLOW_DETECTORS_QC= # Optional parameter for the workflow: Detectors to run QC for
-export WORKFLOW_DETECTORS_CALIB= # Optional parameters for the workflow: Detectors to run calibration for
-export WORKFLOW_PARAMETERS= # Additional paramters for the workflow
-export RECO_NUM_NODES_OVERRIDE=0 # Override the number of EPN compute nodes to use (default is specified in description library file)
-export NHBPERTF=256 # Number of HBF per TF
-
-/home/epn/pdp/gen_topo.sh > $HOME/gen_topo_output.xml
diff --git a/tools/parse b/tools/parse
deleted file mode 100755
index 2a3d63d..0000000
--- a/tools/parse
+++ /dev/null
@@ -1,129 +0,0 @@
-#!/usr/bin/env python
-import os
-import sys
-import shlex
-import tempfile
-if 'EPNMODE' in os.environ and int(os.environ['EPNMODE']):
- sys.path.insert(0, '/usr/share/Modules/init')
- import python as mod
-
-if len(sys.argv) != 4:
- print("Incorrect number of arguments provided, syntax is parse [description library file] [topology name] [output file name]")
- exit(1)
-
-if not "FILEWORKDIR" in os.environ:
- print("\$FILEWORKDIR env variable missing")
- exit(1)
-
-if not "DDWORKFLOW" in os.environ and not "DDMODE" in os.environ:
- print("Need either \$DDWORKFLOW or \$DDMODE env variable")
- exit(1)
-
-NO_PROCESSING_MODE=0
-if not "DDWORKFLOW" in os.environ:
- os.environ['DDWORKFLOW'] = "tools/datadistribution_workflows/dd-" + os.environ['DDMODE'] + ".xml"
- if os.environ['DDMODE'] == 'discard' or os.environ['DDMODE'] == 'disk':
- NO_PROCESSING_MODE=1
-
-print("Using topology", sys.argv[2], "of library", sys.argv[1])
-
-os.environ['WORKFLOWMODE'] = 'dds'
-if 'GLOBALDPLOPT' in os.environ:
- os.environ['GLOBALDPLOPT'] += " -b"
-else:
- os.environ['GLOBALDPLOPT'] = "-b"
-
-if 'RECO_NUM_NODES_OVERRIDE' in os.environ and os.environ['RECO_NUM_NODES_OVERRIDE'] != "" and int(os.environ['RECO_NUM_NODES_OVERRIDE']) > 0:
- reco_num_nodes_override = int(os.environ['RECO_NUM_NODES_OVERRIDE'])
- os.environ['RECO_NUM_NODES_WORKFLOW'] = str(reco_num_nodes_override)
-else:
- reco_num_nodes_override = 0
-
-f = open(sys.argv[1], "r")
-for line in f:
- line = line.strip()
- if len(line) == 0:
- continue
- if line[0] == '#':
- continue
- args = shlex.split(line)
- if len(args) <= 1:
- print("Toplogy must have at least name and O2 version")
- raise
- if len(args[0]) == 0:
- print("Empty topology name forbitten")
- raise
- if not args[0].endswith(':'):
- print("Topology name ", args[0], "not followed by ':'")
- raise
- if args[0] == sys.argv[2] + ":":
- reconodes = 0
- reconodesmin = 0
- recoworkflows = []
- calibworkflows = []
- print("Found topology", sys.argv[2], "-", args)
- if 'EPNMODE' in os.environ and int(os.environ['EPNMODE']):
- for i in args[1].split():
- if "GEN_TOPO_CACHEABLE" in os.environ and os.environ['GEN_TOPO_CACHEABLE'] == "1":
- if i.find("/") == -1 or i.find("/latest") != -1:
- print("Must not use non-versioned module", i, "in cacheable workflow (i.e. with repository hash)")
- raise
- print("Loading module", i)
- mod.module('load', i)
- if len(args) > 2 and not 'O2_ROOT' in os.environ:
- print("O2 not loaded")
- raise
- with tempfile.TemporaryDirectory(prefix="o2_workflow") as tmpdir:
- if NO_PROCESSING_MODE and len(args) > 2:
- print("Cannot use DPL workflow together with DD mode", os.environ['DDMODE'])
- raise
- for i in range(2, len(args)):
- filename = tmpdir + "/wf" + str(i) + ".dds"
- if args[i].startswith("reco"):
- wf = args[i].split(",", 3)
- recoworkflows.append(filename)
- elif args[i].startswith("calib"):
- wf = args[i].split(",", 2)
- wf[3] = wf[2]
- wf[2] = wf[1]
- calibworkflows.append(filename)
- else:
- print("Invalid workflow type", args[i])
- raise
- print("Adding", wf[0], "workflow (", wf[2], "-", wf[1], "nodes):", wf[3])
- reconodes = max(reconodes, int(wf[1]))
- reconodesmin = max(reconodesmin, int(wf[2]))
- if 'GEN_TOPO_IGNORE_ERROR' in os.environ and int(os.environ['GEN_TOPO_IGNORE_ERROR']):
- command_log_filter = "\"^\[\""
- else:
- command_log_filter = "\"^\[INFO\""
- command = wf[3] + " | grep -v " + command_log_filter + " > " + filename + " && [ `grep \"^\[\" " + filename + " | wc -l` == 0 ]"
- print("Running DPL command", command)
- if reco_num_nodes_override == 0:
- os.environ['RECO_NUM_NODES_WORKFLOW'] = wf[1]
- if os.system(command) != 0:
- print("Error running command", command)
- ftmp = open(filename, 'r')
- print(ftmp.read())
- raise
- if reco_num_nodes_override > 0:
- reconodes = reco_num_nodes_override
- odccommand = "odc-epn-topo"
- if reconodes:
- odccommand += " --dd " + os.environ['DDWORKFLOW']
- if len(recoworkflows):
- odccommand += " --reco " + " ".join(recoworkflows)
- odccommand += " --n " + str(reconodes)
- if len(calibworkflows):
- odccommand += " --calib " + " ".join(calibworkflows)
- if args[1] != "":
- odccommand += " --prependexe \"module load " + args[1] + "; \""
- odccommand += " -o " + sys.argv[3]
- if os.system(odccommand) != 0:
- print("\nError running odc: ", odccommand)
- raise
- print("Done")
- exit(0)
-
-print("Could not find workflow", sys.argv[2])
-exit(1)