Big Data Engineer

What You’ll Be Doing:
Be a significant part of our data operation – help our fraud detection engine make sub-second decisions, support our model training pipeline that ingests terabytes of data and provides near real-time BI and analytics to our customers
Architect highly scalable data solutions for diversified and complex data flows using Apache Spark
Build and develop high-performance, near real-time ETL processes incorporating Apache Kafka
 
Qualifications:
BSc Computer Science/Data Management or Mamram (IDF)
4+ years of experience as a software engineer
Experience working with NoSQL & SQL databases
Development experience with Spark or similar frameworks – big advantage
Experience with data lakes on Hadoop or cloud storage (S3 or similar)- an advantage
Experience with Scala – an advantage
Experience working with kubernetes/docker etc – an advantage
Experience in AWS cloud – an advantage