GenomePrep

Preprocess direct-to-consumer (DTC) genomes for research

Check it

Convert any DTC formats into 23andMe-like or VCF. A quality check is performed for genotyping genomes where a microarray version is identified.

Bulk download

Bulk downloads of preprocessed OpenSNP and PGP genotyping genomes.




Incentive

Two major forces have contributed to the fast growth of human genetic data. One from medical research supported by governments and academic institutes; the other from direct-to-consumer (DTC) sequencing companies. While the former benefits from meticulously designed sequencing standards and quality control procedures, the latter comes in various formats and sequencing methods which are subject to changes over time and the particular needs of various companies. Thanks to the general public who shared their DNA data without constraint, we were able to review over 7,000 genomes made public between 2011 and 2020, produced by over six DTC companies, from OpenSNP and PGP.


Summary

The open-source GenomePrep tool-kit, developed on the goodwill of open genome data, addresses the problem of processing raw DTC DNA data in the context of the present: genotype arrays. The output of GenomePrep are DNA datafiles of homogenous formats (23andMe-like or vcf), which enable further research analysis (example). A single combined data-freeze of genomes that passed checks is also available below.


Downloads

Source code can be found on Github. There is a copy of related files on Zenodo .

DataNum.Desc.Time generatedLinkSize
OpenSNP100Random 100 individual VCFs. example2022-04-04 684M
OpenSNP5081Individual VCFs2022-04-04 36G
PGP734Individual VCFs2022-04-04 5.6G
OpenSNP5393Combined, Plink input (bim, fam, bed)2020-10-19 570M

Quick check variants seen in the OpenSNP genomes: openSNP.bim

Additional data support can be requested by contacting my email.


Publication

C. Lu, B. Greshake Tzovaras, J. Gough, A survey of direct-to-consumer genotype data,and quality control tool (GenomePrep) for research, Computational and Structural Biotechnology Journal(2021), doi: https://doi.org/10.1016/j.csbj.2021.06.040

Please cite both the paper above and the OpenSNP or PGP accordingly when using data above.



Acknowledgements

 

Privacy-notice: UK Research and Innovation understands the importance of protecting personal information and is committed to complying with the General Data Protection Regulation 2016/679 (GDPR). It is committed to fostering a culture of transparency and accountability by demonstrating compliance with the principles set out in the Regulation – as laid out below and in the UKRI privacy policy. Your genotype data will be temporarily stored for processing, and permanently deleted after 12 hours and before 36 hours.

© 2021 Chang Lu