Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE #312

Closed
1 task done
alexmascension opened this issue Feb 5, 2024 · 15 comments
Closed
1 task done

Error in NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE #312

alexmascension opened this issue Feb 5, 2024 · 15 comments
Labels
enhancement New feature or request

Comments

@alexmascension
Copy link

alexmascension commented Feb 5, 2024

Description of the bug

Im running the following command, using mirgenedb:

nextflow run nf-core/smrnaseq                                             
-r 2.2.4                                           
-profile docker                                             
-resume                                             
--max_cpus 9                                             
--max_memory 93.GB                                             
--max_time 500.h 
--skip_mirdeep 
--input work/test_human/samplesheets/SMRNASEQ_MIRGENE.csv 
--outdir results/test_human/SMRNASEQ_MIRGENE 
--genome GRCh38 
--mirgenedb 
--mirgenedb_gff database/smRNA/mirgenedb/hsa.gff 
--mirgenedb_mature $(pwd)/database/smRNA/mirgenedb/hsa.fas 
--mirgenedb_hairpin $(pwd)/database/smRNA/mirgenedb/hsa-pre.fas 
--fasta database/genomes/GRCh38/genome.fasta 
--bowtie_index database/indexes/GRCh38/BOWTIE

And I get the following error:

ERROR ~ Error executing process > 'NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE'

Caused by:
  Process `NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE` terminated with an error exit status (1)

Command executed:

  bowtie-build hsa.fas_igenome.fa_idx.fa fasta_bidx --threads 6
  
  cat <<-END_VERSIONS > versions.yml
  "NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE":
      bowtie: $(echo $(bowtie --version 2>&1) | sed 's/^.*bowtie-align-s version //; s/ .*$//')
  END_VERSIONS

Command exit status:
  1

Command output:
  Settings:
    Output files: "fasta_bidx.*.ebwt"
    Line rate: 6 (line is 64 bytes)
    Lines per side: 1 (side is 64 bytes)
    Offset rate: 5 (one in 32)
    FTable chars: 10
    Strings: unpacked
    Max bucket size: default
    Max bucket size, sqrt multiplier: default
    Max bucket size, len divisor: 24
    Difference-cover sample period: 1024
    Endianness: little
    Actual local endianness: little
    Sanity checking: disabled
    Assertions: disabled
    Random seed: 0
    Sizeofs: void*:8, int:4, long:8, size_t:8
  Input files DNA, FASTA:
    hsa.fas_igenome.fa_idx.fa
  Reading reference sizes
    Time reading reference sizes: 00:00:00
  Total time for call to driver() for forward index: 00:00:00

Command error:
  Settings:
    Output files: "fasta_bidx.*.ebwt"
    Line rate: 6 (line is 64 bytes)
    Lines per side: 1 (side is 64 bytes)
    Offset rate: 5 (one in 32)
    FTable chars: 10
    Strings: unpacked
    Max bucket size: default
    Max bucket size, sqrt multiplier: default
    Max bucket size, len divisor: 24
    Difference-cover sample period: 1024
    Endianness: little
    Actual local endianness: little
    Sanity checking: disabled
    Assertions: disabled
    Random seed: 0
    Sizeofs: void*:8, int:4, long:8, size_t:8
  Input files DNA, FASTA:
    hsa.fas_igenome.fa_idx.fa
  Unable to read file magic number
  Reading reference sizes
  Warning: Empty input file
  Error: No unambiguous stretches of characters in the input.  Aborting...
    Time reading reference sizes: 00:00:00
  Total time for call to driver() for forward index: 00:00:00
  Command: bowtie-build --wrapper basic-0 --threads 6 hsa.fas_igenome.fa_idx.fa fasta_bidx 

Work dir:
  /data/Proyectos/NGS_pipeline/work/63/d9ebec3de933d7351832840280886b

Tip: view the complete command output by changing to the process work dir and entering the command `cat .command.out`

 -- Check '.nextflow.log' file for details

The process works fine with mirtrace.

Command used and terminal output

No response

Relevant files

mirgene_db.zip
nextflow.log

System information

No response

Tasks

@alexmascension alexmascension added the bug Something isn't working label Feb 5, 2024
@apeltzer
Copy link
Member

apeltzer commented Feb 8, 2024

Please try using the devversion for now, this should resolve a number of issues / bugs.

@SoWhat1001
Copy link

I am running into the same problem even though I am using the dev version

@apeltzer
Copy link
Member

apeltzer commented Feb 8, 2024

Mirgenedb isn't clear to me. Looks like the input fastas are empty ?

@alexmascension
Copy link
Author

Hi! I get this error just by changing to dev:

ERROR ~ No such variable: index

The log says more specifically:

Feb-09 10:46:33.250 [main] DEBUG nextflow.Session - Session aborted -- Cause: No such property: index for class: nextflow.script.WorkflowBinding

@apeltzer
Copy link
Member

apeltzer commented Feb 9, 2024

Weird, apart from that no changes to what you described in your first posting? We should probably add a test case I fear :-(

@alexmascension
Copy link
Author

Yeap, nothing else has changed.

@christopher-mohr
Copy link
Contributor

Is there more in the nextflow.log on the error? Could you share that?

@alexmascension
Copy link
Author

Sure!

nextflow.log

@christopher-mohr
Copy link
Contributor

Hi @alexmascension, I cannot reproduce the error you posted five days ago using dev. I get the error you posted initially. Can you confirm this?

@alexmascension
Copy link
Author

Hi, I'm running the code again and I get the second error again.

------------------------------------------------------
                                        ,--./,-.
        ___     __   __   __   ___     /,-._.--~'
  |\ | |__  __ /  ` /  \ |__) |__         }  {
  | \| |       \__, \__/ |  \ |___     \`-._,-`-,
                                        `._,._,'
  nf-core/smrnaseq v2.3.0-g18ae224
------------------------------------------------------
Core Nextflow options
  revision           : dev
  runName            : nauseous_curie
  containerEngine    : docker
  launchDir          : /data/Proyectos/NGS_pipeline
  workDir            : /data/Proyectos/NGS_pipeline/work
  projectDir         : /home/nanoneuro/.nextflow/assets/nf-core/smrnaseq
  userName           : nanoneuro
  profile            : docker
  configFiles        : 

Input/output options
  input              : work/test_human/samplesheets/SMRNASEQ_MIRGENE.csv
  outdir             : results/test_human/SMRNASEQ_MIRGENE

Reference genome options
  genome             : GRCh38
  mirgenedb          : true
  mirtrace_species   : hsa
  fasta              : database/genomes/GRCh38/genome.fasta
  mirgenedb_gff      : database/smRNA/mirgenedb/hsa.gff
  mirgenedb_mature   : /data/Proyectos/NGS_pipeline/database/smRNA/mirgenedb/hsa.fas
  mirgenedb_hairpin  : /data/Proyectos/NGS_pipeline/database/smRNA/mirgenedb/hsa-pre.fas
  bowtie_index       : database/indexes/GRCh38/BOWTIE

Trimming options
  clip_r1            : 0
  three_prime_clip_r1: 0

Skipping pipeline steps
  skip_mirdeep       : true

Max job request options
  max_cpus           : 9
  max_memory         : 84.GB
  max_time           : 500.h

!! Only displaying parameters that differ from the pipeline defaults !!
------------------------------------------------------
If you use nf-core/smrnaseq for your analysis please cite:

* The pipeline
  https://zenodo.org/badge/latestdoi/140590861

* The nf-core framework
  https://doi.org/10.1038/s41587-020-0439-x

* Software dependencies
  https://github.com/nf-core/smrnaseq/blob/master/CITATIONS.md

ERROR ~ No such variable: index

 -- Check script '/home/nanoneuro/.nextflow/assets/nf-core/smrnaseq/./workflows/smrnaseq.nf' at line: 165 or see '.nextflow.log' file for more details

nextflow.log

However, nf-core continues if I remove the variable --bowtie_index database/indexes/GRCh38/BOWTIE, but it stops with the error I began with.

ERROR ~ Error executing process > 'NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE'

Caused by:
  Process `NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE` terminated with an error exit status (1)

Command executed:

  bowtie-build hsa.fas_igenome.fa_idx.fa fasta_bidx --threads 6
  
  cat <<-END_VERSIONS > versions.yml
  "NFCORE_SMRNASEQ:SMRNASEQ:MIRNA_QUANT:INDEX_MATURE":
      bowtie: $(echo $(bowtie --version 2>&1) | sed 's/^.*bowtie-align-s version //; s/ .*$//')
  END_VERSIONS

Command exit status:
  1

Command output:
  Settings:
    Output files: "fasta_bidx.*.ebwt"
    Line rate: 6 (line is 64 bytes)
    Lines per side: 1 (side is 64 bytes)
    Offset rate: 5 (one in 32)
    FTable chars: 10
    Strings: unpacked
    Max bucket size: default
    Max bucket size, sqrt multiplier: default
    Max bucket size, len divisor: 24
    Difference-cover sample period: 1024
    Endianness: little
    Actual local endianness: little
    Sanity checking: disabled
    Assertions: disabled
    Random seed: 0
    Sizeofs: void*:8, int:4, long:8, size_t:8
  Input files DNA, FASTA:
    hsa.fas_igenome.fa_idx.fa
  Reading reference sizes
    Time reading reference sizes: 00:00:00
  Total time for call to driver() for forward index: 00:00:00

Command error:
  Settings:
    Output files: "fasta_bidx.*.ebwt"
    Line rate: 6 (line is 64 bytes)
    Lines per side: 1 (side is 64 bytes)
    Offset rate: 5 (one in 32)
    FTable chars: 10
    Strings: unpacked
    Max bucket size: default
    Max bucket size, sqrt multiplier: default
    Max bucket size, len divisor: 24
    Difference-cover sample period: 1024
    Endianness: little
    Actual local endianness: little
    Sanity checking: disabled
    Assertions: disabled
    Random seed: 0
    Sizeofs: void*:8, int:4, long:8, size_t:8
  Input files DNA, FASTA:
    hsa.fas_igenome.fa_idx.fa
  Unable to read file magic number
  Reading reference sizes
  Warning: Empty input file
  Error: No unambiguous stretches of characters in the input.  Aborting...
  Command: bowtie-build --wrapper basic-0 --threads 6 hsa.fas_igenome.fa_idx.fa fasta_bidx 
    Time reading reference sizes: 00:00:00
  Total time for call to driver() for forward index: 00:00:00

Work dir:
  /data/Proyectos/NGS_pipeline/work/bf/a41903d3122c5f446a98faf0b75611

Tip: when you have fixed the problem you can continue the execution adding the option `-resume` to the run command line

 -- Check '.nextflow.log' file for details

nexflow.2.log

The contents of the folder are genome.1.ebwt genome.2.ebwt genome.3.ebwt genome.4.ebwt genome.rev.1.ebwt genome.rev.2.ebwt

If I change --bowtie_index database/indexes/GRCh38/BOWTIE with --bowtie_index database/indexes/GRCh38/BOWTIE/genome I get the same error.

@christopher-mohr
Copy link
Contributor

Okay, I think we might need a separate issue for the --bowtie_index error. Could you try running it again without --bowtie_index but add the following to your call --mirgenedb_species "Hsa" please.

@alexmascension
Copy link
Author

Hi!

With --mirgenedb_species "Hsa" the program works fine!

Do I open a new issue for the --bowtie_index error?

Thanks!

@christopher-mohr
Copy link
Contributor

Yes please, I will also leave this issue open and close it with a PR where I add a check to make sure the --mirgenedb_species parameter is set.

@christopher-mohr christopher-mohr added enhancement New feature or request and removed bug Something isn't working labels Feb 14, 2024
@alexmascension
Copy link
Author

Fine!

@apeltzer
Copy link
Member

Dev fixes this issue now, thanks for reporting @alexmascension

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants