redbiom: a Rapid Sample Discovery and Feature Characterization System
ABSTRACT Meta-analyses at the whole-community level have been important in microbiome studies, revealing profound features that structure Earth’s microbial communities, such as the unique differentiation of microbes from the mammalian gut relative to free-living microbial communities, the separation...
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | article |
| Lenguaje: | EN |
| Publicado: |
American Society for Microbiology
2019
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/819025b2fe0c45ab9df37634162e59ae |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:819025b2fe0c45ab9df37634162e59ae |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:819025b2fe0c45ab9df37634162e59ae2021-12-02T19:46:18Zredbiom: a Rapid Sample Discovery and Feature Characterization System10.1128/mSystems.00215-192379-5077https://doaj.org/article/819025b2fe0c45ab9df37634162e59ae2019-08-01T00:00:00Zhttps://journals.asm.org/doi/10.1128/mSystems.00215-19https://doaj.org/toc/2379-5077ABSTRACT Meta-analyses at the whole-community level have been important in microbiome studies, revealing profound features that structure Earth’s microbial communities, such as the unique differentiation of microbes from the mammalian gut relative to free-living microbial communities, the separation of microbiomes in saline and nonsaline environments, and the role of pH in driving soil microbial compositions. However, our ability to identify the specific features of a microbiome that differentiate these community-level patterns have lagged behind, especially as ever-cheaper DNA sequencing has yielded increasingly large data sets. One critical gap is the ability to search for samples that contain specific features (for example, sub-operational taxonomic units [sOTUs] identified by high-resolution statistical methods for removing amplicon sequencing errors). Here we introduce redbiom, a microbiome caching layer, which allows users to rapidly query samples that contain a given feature, retrieve sample data and metadata, and search for samples that match specified metadata values or ranges (e.g., all samples with a pH of >7), implemented using an in-memory NoSQL database called Redis. By default, redbiom allows public anonymous sample access for over 100,000 publicly available samples in the Qiita database. At over 100,000 samples, the caching server requires only 35 GB of resident memory. We highlight how redbiom enables a new type of characterization of microbiome samples and provide tutorials for using redbiom with QIIME 2. redbiom is open source under the BSD license, hosted on GitHub, and can be deployed independently of Qiita to enable search of proprietary or clinically restricted microbiome databases. IMPORTANCE Although analyses that combine many microbiomes at the whole-community level have become routine, searching rapidly for microbiomes that contain a particular sequence has remained difficult. The software we present here, redbiom, dramatically accelerates this process, allowing samples that contain microbiome features to be rapidly identified. This is especially useful when taxonomic annotation is limited, allowing users to identify environments in which unannotated microbes of interest were previously observed. This approach also allows environmental or clinical factors that correlate with specific features, or vice versa, to be identified rapidly, even at a scale of billions of sequences in hundreds of thousands of samples. The software is integrated with existing analysis tools to enable fast, large-scale microbiome searches and discovery of new microbiome relationships.Daniel McDonaldBenjamin KaehlerAntonio GonzalezJeff DeReusGail AckermannClarisse MarotzGavin HuttleyRob KnightAmerican Society for Microbiologyarticledatabasemeta-analysismicrobiomeMicrobiologyQR1-502ENmSystems, Vol 4, Iss 4 (2019) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
EN |
| topic |
database meta-analysis microbiome Microbiology QR1-502 |
| spellingShingle |
database meta-analysis microbiome Microbiology QR1-502 Daniel McDonald Benjamin Kaehler Antonio Gonzalez Jeff DeReus Gail Ackermann Clarisse Marotz Gavin Huttley Rob Knight redbiom: a Rapid Sample Discovery and Feature Characterization System |
| description |
ABSTRACT Meta-analyses at the whole-community level have been important in microbiome studies, revealing profound features that structure Earth’s microbial communities, such as the unique differentiation of microbes from the mammalian gut relative to free-living microbial communities, the separation of microbiomes in saline and nonsaline environments, and the role of pH in driving soil microbial compositions. However, our ability to identify the specific features of a microbiome that differentiate these community-level patterns have lagged behind, especially as ever-cheaper DNA sequencing has yielded increasingly large data sets. One critical gap is the ability to search for samples that contain specific features (for example, sub-operational taxonomic units [sOTUs] identified by high-resolution statistical methods for removing amplicon sequencing errors). Here we introduce redbiom, a microbiome caching layer, which allows users to rapidly query samples that contain a given feature, retrieve sample data and metadata, and search for samples that match specified metadata values or ranges (e.g., all samples with a pH of >7), implemented using an in-memory NoSQL database called Redis. By default, redbiom allows public anonymous sample access for over 100,000 publicly available samples in the Qiita database. At over 100,000 samples, the caching server requires only 35 GB of resident memory. We highlight how redbiom enables a new type of characterization of microbiome samples and provide tutorials for using redbiom with QIIME 2. redbiom is open source under the BSD license, hosted on GitHub, and can be deployed independently of Qiita to enable search of proprietary or clinically restricted microbiome databases. IMPORTANCE Although analyses that combine many microbiomes at the whole-community level have become routine, searching rapidly for microbiomes that contain a particular sequence has remained difficult. The software we present here, redbiom, dramatically accelerates this process, allowing samples that contain microbiome features to be rapidly identified. This is especially useful when taxonomic annotation is limited, allowing users to identify environments in which unannotated microbes of interest were previously observed. This approach also allows environmental or clinical factors that correlate with specific features, or vice versa, to be identified rapidly, even at a scale of billions of sequences in hundreds of thousands of samples. The software is integrated with existing analysis tools to enable fast, large-scale microbiome searches and discovery of new microbiome relationships. |
| format |
article |
| author |
Daniel McDonald Benjamin Kaehler Antonio Gonzalez Jeff DeReus Gail Ackermann Clarisse Marotz Gavin Huttley Rob Knight |
| author_facet |
Daniel McDonald Benjamin Kaehler Antonio Gonzalez Jeff DeReus Gail Ackermann Clarisse Marotz Gavin Huttley Rob Knight |
| author_sort |
Daniel McDonald |
| title |
redbiom: a Rapid Sample Discovery and Feature Characterization System |
| title_short |
redbiom: a Rapid Sample Discovery and Feature Characterization System |
| title_full |
redbiom: a Rapid Sample Discovery and Feature Characterization System |
| title_fullStr |
redbiom: a Rapid Sample Discovery and Feature Characterization System |
| title_full_unstemmed |
redbiom: a Rapid Sample Discovery and Feature Characterization System |
| title_sort |
redbiom: a rapid sample discovery and feature characterization system |
| publisher |
American Society for Microbiology |
| publishDate |
2019 |
| url |
https://doaj.org/article/819025b2fe0c45ab9df37634162e59ae |
| work_keys_str_mv |
AT danielmcdonald redbiomarapidsamplediscoveryandfeaturecharacterizationsystem AT benjaminkaehler redbiomarapidsamplediscoveryandfeaturecharacterizationsystem AT antoniogonzalez redbiomarapidsamplediscoveryandfeaturecharacterizationsystem AT jeffdereus redbiomarapidsamplediscoveryandfeaturecharacterizationsystem AT gailackermann redbiomarapidsamplediscoveryandfeaturecharacterizationsystem AT clarissemarotz redbiomarapidsamplediscoveryandfeaturecharacterizationsystem AT gavinhuttley redbiomarapidsamplediscoveryandfeaturecharacterizationsystem AT robknight redbiomarapidsamplediscoveryandfeaturecharacterizationsystem |
| _version_ |
1718376036105715712 |