### Pipeline run code and environment: * Command: `/home/mjs5kd/.local/bin/refgenie build hg18/cellranger_reference` * Compute host: udc-ba25-18 * Working dir: /sfs/qumulo/qproject/shefflab/deploy/rg.databio.org_full/rg.databio.org * Outfolder: /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/_refgenie_build/ * Pipeline started at: (04-07 20:46:16) elapsed: 0.0 _TIME_ ### Version log: * Python version: 3.6.6 * Pypiper dir: `/sfs/qumulo/qhome/mjs5kd/.local/lib/python3.6/site-packages/pypiper` * Pypiper version: 0.12.1 * Pipeline dir: `/sfs/qumulo/qhome/mjs5kd/.local/bin` * Pipeline version: None ### Arguments passed to pipeline: * `asset_registry_paths`: `['hg18/cellranger_reference']` * `assets`: `None` * `command`: `build` * `config_file`: `refgenie.yaml` * `docker`: `False` * `files`: `None` * `genome`: `None` * `genome_config`: `None` * `genome_description`: `None` * `logdev`: `False` * `new_start`: `False` * `outfolder`: `/project/shefflab/deploy/rg.databio.org_full/genomes/data` * `params`: `None` * `recipe`: `None` * `recover`: `False` * `requirements`: `False` * `silent`: `False` * `skip_read_lock`: `False` * `tag_description`: `None` * `verbosity`: `None` * `volumes`: `None` ---------------------------------------- Target to produce: `/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/_refgenie_build/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_cellranger_reference__default.flag` > `gunzip /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/gencode_gtf/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf.gz -c > /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf` (19877)
Command completed. Elapsed time: 0:00:05. Running peak memory: 0.002GB. PID: 19877; Command: gunzip; Return code: 0; Memory used: 0.002GB > `cellranger mkgtf /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_filtered.gtf` (19901)
/opt/cellranger-3.1.0/cellranger-cs/3.1.0/bin cellranger mkgtf (3.1.0) Copyright (c) 2019 10x Genomics, Inc. All rights reserved. ------------------------------------------------------------------------------- Writing new genes GTF file (may take 10 minutes for a 1GB input GTF file)... ...doneCommand completed. Elapsed time: 0:02:05. Running peak memory: 0.078GB. PID: 19901; Command: cellranger; Return code: 0; Memory used: 0.078GB > `rm /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.gtf` (20423)
Command completed. Elapsed time: 0:00:00. Running peak memory: 0.078GB. PID: 20423; Command: rm; Return code: 0; Memory used: 0.001GB > `cd /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default; cellranger mkref --genome=ref --fasta=/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/fasta/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01.fa --genes=/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_filtered.gtf --nthreads=8` (20424)
/opt/cellranger-3.1.0/cellranger-cs/3.1.0/bin cellranger mkref (3.1.0) Copyright (c) 2019 10x Genomics, Inc. All rights reserved. ------------------------------------------------------------------------------- Apr 07 20:54:25 ..... Started STAR run Apr 07 20:54:25 ... Starting to generate Genome files Apr 07 20:56:08 ... starting to sort Suffix Array. This may take a long time... Apr 07 20:56:17 ... sorting Suffix Array chunks and saving them to disk... Apr 07 21:42:50 ... loading chunks from disk, packing SA... Apr 07 21:43:24 ... Finished generating suffix array Apr 07 21:43:24 ... Generating Suffix Array index Apr 07 21:46:34 ... Completed Suffix Array index Apr 07 21:46:35 ..... Processing annotations GTF Apr 07 21:46:54 ..... Inserting junctions into the genome indices Apr 07 21:56:59 ... writing Genome to disk ... Apr 07 21:57:17 ... writing Suffix Array to disk ... Apr 07 21:57:50 ... writing SAindex to disk Apr 07 21:57:58 ..... Finished successfully Creating new reference folder at /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/ref ...done Writing genome FASTA file into reference folder... ...done Computing hash of genome FASTA file... ...done Indexing genome FASTA file... ...done Writing genes GTF file into reference folder... ...done Computing hash of genes GTF file... ...done Writing genes index file into reference folder (may take over 10 minutes for a 3Gb genome)... ...done Writing genome metadata JSON file into reference folder... ...done Generating STAR genome index (may take over 8 core hours for a 3Gb genome)... ...done. >>> Reference successfully created! <<< You can now specify this reference on the command line: cellranger --transcriptome=/project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/ref ...Command completed. Elapsed time: 1:09:32. Running peak memory: 20.117GB. PID: 20424; Command: cd; Return code: 0; Memory used: 20.117GB > `touch /project/shefflab/deploy/rg.databio.org_full/genomes/data/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference/default/_refgenie_build/9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01_cellranger_reference__default.flag` (26772)
Command completed. Elapsed time: 0:00:00. Running peak memory: 20.117GB. PID: 26772; Command: touch; Return code: 0; Memory used: 0.001GB Asset digest: 30fe9e8250482cfecba2801ef15d7c38 Default tag for '9b7fd88cae1bd01bf53760fb426e2aeb299150cc64af2b01/cellranger_reference' set to: default ### Pipeline completed. Epilogue * Elapsed time (this run): 1:12:27 * Total elapsed time (all runs): 1:11:43 * Peak memory (this run): 20.1174 GB * Pipeline completed time: 2021-04-07 21:58:42 Finished building 'cellranger_reference' asset Created alias directories: - /project/shefflab/deploy/rg.databio.org_full/genomes/alias/hg18/cellranger_reference/default