我正在尝试将通过一次执行多个对齐生成的x个 bam 文件(对y个 fastq 文件的批次)合并到 Nextflow 中的一个 bam 文件中。
到目前为止,在执行对齐和排序/索引生成的 bam 文件时,我有以下内容:
//Run minimap2 on concatenated fastqs
process miniMap2Bam {
publishDir "$params.bamDir"
errorStrategy 'retry'
cache 'deep'
maxRetries 3
maxForks 10
memory { 16.GB * task.attempt }
input:
val dirString from dirStr
val runString from stringRun
each file(batchFastq) from fastqBatch.flatMap()
output:
val runString into stringRun1
file("${batchFastq}.bam") into bamFiles
val dirString into dirStrSam
script:
"""
minimap2 --secondary=no --MD -2 -t 10 -a $params.genome ${batchFastq} | samtools sort -o ${batchFastq}.bam
samtools index ${batchFastq}.bam
"""
}
${batchFastq}.bam
包含一批y个 fastq 文件的 bam 文件在哪里。
此管道完成得很好,但是,当尝试samtools merge
在另一个进程 (samToolsMerge) 中对这些 bam 文件执行时,该进程在每次运行对齐时运行(在本例中为 4),而不是为收集的所有 bam 文件运行一次:
//Run samtools merge
process samToolsMerge {
echo true
publishDir "$dirString/aligned_minimap/", mode: 'copy', overwrite: 'false'
cache 'deep'
errorStrategy 'retry'
maxRetries 3
maxForks 10
memory { 14.GB * task.attempt }
input:
val runString from stringRun1
file bamFile from bamFiles.collect()
val dirString from dirStrSam
output:
file("**")
script:
"""
samtools merge ${runString}.bam ${bamFile}
"""
}
输出为:
executor > lsf (9)
[49/182ec0] process > catFastqs (1) [100%] 1 of 1 ✔
[- ] process > nanoPlotSummary -
[0e/609a7a] process > miniMap2Bam (1) [100%] 4 of 4 ✔
[42/72469d] process > samToolsMerge (2) [100%] 4 of 4 ✔
Completed at: 04-Mar-2021 14:54:21
Duration : 5m 41s
CPU hours : 0.2
Succeeded : 9
如何仅从生成的 bam 文件中获取miniMap2Bam
并运行它们samToolsMerge
一次,而不是多次运行该进程?
提前致谢!
编辑:感谢 Pallie 在下面的评论中,问题是将先前进程中的 runString 和 dirString 值输入 miniMap2Bam,然后输入 samToolsMerge,导致每次传递值时该过程都会重复。
解决方案就像从 miniMap2Bam 中删除 vals 一样简单(如下):
//Run minimap2 on concatenated fastqs
process miniMap2Bam {
errorStrategy 'retry'
cache 'deep'
maxRetries 3
maxForks 10
memory { 16.GB * task.attempt }
input:
each file(batchFastq) from fastqBatch.flatMap()
output:
file("${batchFastq}.bam") into bamFiles
script:
"""
minimap2 --secondary=no --MD -2 -t 10 -a $params.genome ${batchFastq} | samtools sort -o ${batchFastq}.bam
samtools index ${batchFastq}.bam
"""
}