### Pipeline run code and environment: * Command: `/home/mjs5kd/.local/bin/refgenie build hg18/cellranger_reference` * Compute host: udc-ba25-18 * Working dir: /sfs/qumulo/qproject/shefflab/deploy/rg.databio.org_full/rg.databio.org * Outfolder: /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/_refgenie_build/ * Pipeline started at: (04-07 20:46:16) elapsed: 0.0 _TIME_ ### Version log: * Python version: 3.6.6 * Pypiper dir: `/sfs/qumulo/qhome/mjs5kd/.local/lib/python3.6/site-packages/pypiper` * Pypiper version: 0.12.1 * Pipeline dir: `/sfs/qumulo/qhome/mjs5kd/.local/bin` * Pipeline version: None ### Arguments passed to pipeline: * `asset_registry_paths`: `['hg18/cellranger_reference']` * `assets`: `None` * `command`: `build` * `config_file`: `refgenie.yaml` * `docker`: `False` * `files`: `None` * `genome`: `None` * `genome_config`: `None` * `genome_description`: `None` * `logdev`: `False` * `new_start`: `False` * `outfolder`: `/project/shefflab/deploy/rg.databio.org_full/genomes/data` * `params`: `None` * `recipe`: `None` * `recover`: `False` * `requirements`: `False` * `silent`: `False` * `skip_read_lock`: `False` * `tag_description`: `None` * `verbosity`: `None` * `volumes`: `None` ---------------------------------------- Target to produce: `/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/_refgenie_build/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_cellranger_reference__default.flag` > `gunzip /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/gencode_gtf/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf.gz -c > /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf` (19877)

Command completed. Elapsed time: 0:00:05. Running peak memory: 0.002GB.  
  PID: 19877;	Command: gunzip;	Return code: 0;	Memory used: 0.002GB


> `cellranger mkgtf /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_filtered.gtf` (19901)
/opt/cellranger-3.1.0/cellranger-cs/3.1.0/bin
cellranger mkgtf (3.1.0)
Copyright (c) 2019 10x Genomics, Inc.  All rights reserved.
-------------------------------------------------------------------------------

Writing new genes GTF file (may take 10 minutes for a 1GB input GTF file)...
...done

Command completed. Elapsed time: 0:02:05. Running peak memory: 0.078GB. PID: 19901; Command: cellranger; Return code: 0; Memory used: 0.078GB > `rm /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf` (20423)

Command completed. Elapsed time: 0:00:00. Running peak memory: 0.078GB.  
  PID: 20423;	Command: rm;	Return code: 0;	Memory used: 0.001GB


> `cd /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default; cellranger mkref --genome=ref --fasta=/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/fasta/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.fa --genes=/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_filtered.gtf --nthreads=8` (20424)
/opt/cellranger-3.1.0/cellranger-cs/3.1.0/bin
cellranger mkref (3.1.0)
Copyright (c) 2019 10x Genomics, Inc.  All rights reserved.
-------------------------------------------------------------------------------

Apr 07 20:54:25 ..... Started STAR run
Apr 07 20:54:25 ... Starting to generate Genome files
Apr 07 20:56:08 ... starting to sort  Suffix Array. This may take a long time...
Apr 07 20:56:17 ... sorting Suffix Array chunks and saving them to disk...
Apr 07 21:42:50 ... loading chunks from disk, packing SA...
Apr 07 21:43:24 ... Finished generating suffix array
Apr 07 21:43:24 ... Generating Suffix Array index
Apr 07 21:46:34 ... Completed Suffix Array index
Apr 07 21:46:35 ..... Processing annotations GTF
Apr 07 21:46:54 ..... Inserting junctions into the genome indices
Apr 07 21:56:59 ... writing Genome to disk ...
Apr 07 21:57:17 ... writing Suffix Array to disk ...
Apr 07 21:57:50 ... writing SAindex to disk
Apr 07 21:57:58 ..... Finished successfully
Creating new reference folder at /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/ref
...done

Writing genome FASTA file into reference folder...
...done

Computing hash of genome FASTA file...
...done

Indexing genome FASTA file...
...done

Writing genes GTF file into reference folder...
...done

Computing hash of genes GTF file...
...done

Writing genes index file into reference folder (may take over 10 minutes for a 3Gb genome)...
...done

Writing genome metadata JSON file into reference folder...
...done

Generating STAR genome index (may take over 8 core hours for a 3Gb genome)...
...done.

>>> Reference successfully created! <<<

You can now specify this reference on the command line:
cellranger --transcriptome=/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/ref ...
Command completed. Elapsed time: 1:09:32. Running peak memory: 20.117GB. PID: 20424; Command: cd; Return code: 0; Memory used: 20.117GB > `touch /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/_refgenie_build/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_cellranger_reference__default.flag` (26772)

Command completed. Elapsed time: 0:00:00. Running peak memory: 20.117GB.  
  PID: 26772;	Command: touch;	Return code: 0;	Memory used: 0.001GB

Asset digest: 30fe9e8250482cfecba2801ef15d7c38
Default tag for '9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference' set to: default

### Pipeline completed. Epilogue
*        Elapsed time (this run):  1:12:27
*  Total elapsed time (all runs):  1:11:43
*         Peak memory (this run):  20.1174 GB
*        Pipeline completed time: 2021-04-07 21:58:42
Finished building 'cellranger_reference' asset
Created alias directories: 
 - /project/shefflab/deploy/rg.databio.org_full/genomes/alias/hg18/cellranger_reference/default