Title |
SparkBLAST: scalable BLAST processing using in-memory operations
|
---|---|
Published in |
BMC Bioinformatics, June 2017
|
DOI | 10.1186/s12859-017-1723-8 |
Pubmed ID | |
Authors |
Marcelo Rodrigo de Castro, Catherine dos Santos Tostes, Alberto M. R. Dávila, Hermes Senger, Fabricio A. B. da Silva |
Abstract |
The demand for processing ever increasing amounts of genomic data has raised new challenges for the implementation of highly scalable and efficient computational systems. In this paper we propose SparkBLAST, a parallelization of a sequence alignment application (BLAST) that employs cloud computing for the provisioning of computational resources and Apache Spark as the coordination framework. As a proof of concept, some radionuclide-resistant bacterial genomes were selected for similarity analysis. Experiments in Google and Microsoft Azure clouds demonstrated that SparkBLAST outperforms an equivalent system implemented on Hadoop in terms of speedup and execution times. The superior performance of SparkBLAST is mainly due to the in-memory operations available through the Spark framework, consequently reducing the number of local I/O operations required for distributed BLAST processing. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
Japan | 1 | 17% |
Israel | 1 | 17% |
Unknown | 4 | 67% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Scientists | 4 | 67% |
Members of the public | 2 | 33% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Unknown | 51 | 100% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Master | 11 | 22% |
Researcher | 7 | 14% |
Student > Ph. D. Student | 7 | 14% |
Student > Bachelor | 7 | 14% |
Professor > Associate Professor | 5 | 10% |
Other | 7 | 14% |
Unknown | 7 | 14% |
Readers by discipline | Count | As % |
---|---|---|
Computer Science | 14 | 27% |
Agricultural and Biological Sciences | 13 | 25% |
Biochemistry, Genetics and Molecular Biology | 8 | 16% |
Engineering | 3 | 6% |
Immunology and Microbiology | 2 | 4% |
Other | 3 | 6% |
Unknown | 8 | 16% |