Position Description:
We’re looking for a brilliant, creative, ambitious Data-Engineer. If you’re all that and looking to lead, invent, and grow professionally you should definitely consider applying to join us on our journey!
Responsibilities
We are looking for an experienced Data Engineer to lead architecture and development work on our platform. Your role will include:
• Building pipelines to crawl, clean, and structure large datasets that form the basis of our platform and IP
• Define architecture, evaluate tools and open source projects to use within our environment
• Take a leading part in the development of our enterprise-grade technology platform and ecosystem
• Design and build a pipeline integrating many different data sources and forms
• Harmonize and clean large datasets from different sources
• Design, build and use an API that will be used by our customers to consume our data
Requirements :
• At least 3 years experience with data engineering in Python (or equivalent language)
• At least 3 years of experience with data projects from early-stage concept to production rollouts.
• Experience with cloud platforms (AWS, Google GCP, Azure), working on production payloads on large scale and complexity. Experience in working with Docker/Kubernetes a big plus.
• Hands-on experience with relevant tools (Jupyter notebooks, Anaconda, Vega, ..)
• Hands-on experience with data pipeline building specifically on cloud infrastructure
• Advantage: Hands-on experience with data science tools, packages, and frameworks
• Advantage: Hands-on experience with ETL Flow
