Komodo Health
Komodo Health

Building a Scalable Data Ingestion Architecture

June 12, 2019  |  Blog   |   Engineering

At Komodo Health, our Data Ingestion team is responsible for quickly incorporating new data sources into our expanding Healthcare Map.  One of our engineers, Johannes Leppä, PhD, gave a talk at the DataCouncil conference in San Francisco in April about how we build our scalable data ingestion architecture and some of the lessons learned along the way.   Some of the technologies we use are Spark, Airflow and Kuberenetes.

Here is the video of that talk

Enjoy!  If you are interested in working on this and many other interesting technical problems while helping reduce the global burden of disease we are hiring for a number of roles.

Komodo Health
  • San Francisco Office
  • 680 Folsom St., 5th Floor
    San Francisco, CA 94107
  • New York Office
  • 920 Broadway, 5th Floor
    New York, NY 10010
© 2019 Komodo Health. All Rights Reserved.