03. FASTQ format

The FASTA format is extremely simple with just two lines per sequence - the first is for the description, the other for the raw sequence. The simplicity is nice when running a quick pairwise alignment, but limiting when we need more information per sequence.

With next-generation sequencing instruments pumping out millions of reads per run, scientists needed a way to check the quality of each base call. To document both the sequence and the probability of each of being correct, scientists came up with the FASTQ format. The "Q" comes from quality, as in the quality of the read.

The file extension for FASTQ is .fq and .fastq.

Original development

The FASTQ format was developed by the Wellcome Trust Sanger Institute, and became the de facto standard for high-throughput sequencing instrument outputs.

In addition to storing biological sequence information, it also adds a line for the quality scores. Each score is encoded with a single ASCII character

Characteristics

Let's take a look at an example FASTQ format, then look at each line.

``````@SEQ_ID
TTCAACTCGTTAGTAAATATCAAACGATCAGTACCATTTTGGGGTTCAAAGTGACAGTTT
+
!'>>>>CCC'*((((***(***-+*'')+))%%%++))**55CCF>>%%%%).1CCCC65``````

1) Sequence identifier and description

The first line begins with an '@' character and contains the sequence identifier with an optional description. This is just like FASTA's first line.

Illumina sequence identifiers

Here is an example sequence identifier from Illumina

``@HWUSI-EAS100R:6:73:941:1973#0/1``
HSWUSI-EAS100R
Unique instrument name
6
Flowcell lane
73
Tile number within the flow cell lane
941
x-coordinate of teh cluster within the tile.
1973
y-coordinate of cluster within the tile.
#0
Index number for multiplexed sample
/1
Member of a pair

2) Raw sequence letters

The second line contains raw sequence reads, also similar to FASTA files.

3) + may have

Line three starts with a + character and is optionally followed by the same sequence identifier

4) Quality scores

The fourth line encodes the quality scores per each base call. This line must have the same length as the sequence in line 2.

Scores range from ! being the lowest quality and ~ being the highest. These values come from the ASCII table values 33-126.

The values are shifted down to 0 to 93, but we rarely have a Phred score of over 60.

Quality

To map the quality to the probability that a base call is correct, we use a bit of math.

$Q$sanger = -10 log10 p

The p is the probability that the corresponding base call is incorrect, and Q is the Phred quality score which can range from 0 to 93.

References

For a more complete guide on FASTQ, visit the FASTQ format Wikipedia page.

Learn to be a Pythonista!

Programming for Beginners

This book doesn't make any assumptions about your background or knowledge of Python or computer programming. You will be guided step by step using a logical and systematic approach. As new concepts, commands, or jargon are encountered they are explained in plain language, making it easy for anyone to understand.

\$ Check price
(124+ reviews)

Become a Bioinformatics Whiz!

Bioinformatics Data Skills

Learn the best practices used by academic and industry professionals. Bioinformatics Data Skills give a great overview to the Linux Command Line, Github, and other essential tools used in the trade. This book bridges the gap between knowing a few programming languages and being able to utilize the tools to analyze large amounts of biological data.

\$ Check price
(7+ reviews)