Responsibilities:
End-to-end development of Azure Data Platform.
Developing Big Data products based on Machine learning, AI and analytics .
Researching new technologies and adopting them for use in the company’s product
Working closely with the product, DevOps and security teams
Data preparation for ML/AI.
Requirements:
3+ years of experience as Data Engineer
Experience in designing and operating data pipeline solutions for a high volume data flow.
Hands-on experience with design and develop large-scale distributed systems.
Experience working with distributed messaging system (kafka , kinesis)
Good familiarity with Spark, Scala.
Experience with no-SQL DBs and relational DBs.
Solid understanding of Object-Oriented Programming and software engineering principles
Experience using multiple scripting languages (e.g. Sql Scripting, PowerShell, Jscript, Python, Ruby, etc.)
Advantage-
Familiar with Azure Data platform
Experience with front-end libraries/frameworks (e.g., Angular, React, Vue).
Experience working with Elastic search
A team player with excellent collaboration and communication skills.