Before Running GenPipes

We highly recommend that new users go through these checklists and address all the pre-requisites for running GenPipes successfully.

1. Check Environment & Setup

Ensure you have the GenPipes runtime environment setup appropriately. It may vary depending upon your GenPipes deployment type. For details on various deployment type options, see Deployment Options. The instructions below list key checklist items for various deployment types.

Compute Canada Deployment

Get a Compute Canada account if not deploying GenPipes locally or in the cloud. You can use GenPipes deployed by C3G on CC datacenter servers. Once you have the account, make sure you have your software environment setup for requisite GenPipes modules.

For details see Step 3: Setting up your user environment for GenPipes access section in the Accessing GenPipes on Compute Canada Servers documentation.

Local Deployment

For using GenPipes deployed locally on your servers, whether bare-metal or virtual servers, or in a container, ensure that the sufficient compute resources are available:

Hardware requirements

  • CPU

  • Cores

  • Memory

  • Disk speed / SSD capacity

Software requirements


Software Modules required for running GenPipes

Figure: Software Modules required for running GenPipes


2. Validate Deployment

Ensure that you can test run one of the GenPipes Pipeline. Simply issue the help option instead of running any jobs. This will confirm whether GenPipes can actually run and environment setup in terms of python modules is taken care of.

  • Check that GenPipes is deployed

    • For Compute Canada data centre users:

      <pipeline_name>.py –help

    • For local installation

      $MUGQIC_PIPELINES_HOME/pipelines/<pipeline_name>/<pipeline_name>.py –help

  • Ensure CVMFS is mounted

3. Check Input Files

Verify if the required input file(s) for the pipeline run can be accessed:

  • ini or configuration files

  • Readset file

  • Design file