- What You%27ll Do
Take a major role in designing, architecting, and selecting technology for the next generation of the Data platform.
- You will recruit, establish, and manage a data engineering team responsible for all Datarails data %28Customer and business data%29, including Data Integrity, Data integrations, Pipelines, Data transformation, Data aggregation, Reports, Insights, Events, Monitoring, etc.
- You will define working methodology, KPIs for measuring success, and quality control measures.
- Design data profiling and monitoring to identify anomalies and maintain data integrity.
- Work closely with our AI and data scientists team, responsible for developing algorithms, analytical rules, and LLM/ML data models.
What We Offer
- We offer a supportive, agile, and creative work environment with brilliant colleagues%21
- Competitive compensation, ongoing recognition, and most of all, a chance to learn, contribute, and develop your skills.
- Opportunity to join an explosive industry, a successful and growing organization, and an unmatched leadership team that is passionate about their employees%21
- Most of all, we will give you fun, enthusiasm, support, a passion for healthy living, and never a dull moment%21
Requirements
- BSc in Computer Science or equivalent.
- 7+ years of experience as a Data Engineer
- 3+ years experience as a Data Engineering Manager
- Experience in building Data infrastructure.
- Experience and familiarity with the following tools:
- Big-data query engines %28Spark, Databricks, Presto%29
- Data lakes and data Lakehouse architecture
- Familiarity with Azure data stack – advantage.
- Experience creating and optimizing big data processes, pipelines, and architectures on cloud-native environments %28Spark/Databricks%29.
- Proficiency with SQL, Python, and one of Java/Scala/CPP.
- Understanding of how to build robust and reliable solutions
- Familiarity with cloud Databases %28Snowflake-Advantage%29
- Have a strong analytical mind with proven problem-solving abilities