Scripting for large-scale sequencing based on Hadoop
Caricamento...
Data
2013
Autori
Schumacher, André
Pireddu, Luca
Kallio, Aleksi
Niemenmaa, Matti
Korpelainen, Eija
Zanetti, Gianluigi
Heljanko, Keijo
Titolo del periodico
ISSN
Titolo del volume
Editore
Abstract
The large volumes of data generated by modern sequencing experiments present significant challenges in their manipulation and analysis. Traditional approaches are often found to be complicated to scale. We describe our ongoing work on SeqPig, a tool that facilitates the use of the Pig Latin distributed scripting language to manipulate, analyze and query sequencing data applying the advances motivated by the “big data revolution” in data-intensive activities. SeqPig provides access to popular data formats and implements a number of custom sequencing-specific functions. Most importantly, it grants users access to the scalable Hadoop platform from a high level scripting language
Descrizione
Keywords
bioinformatics , ngs , data analysis , cloud computing , high-performance computing