In this role, you can expect to:
● Design, build, and optimize real-time data processing pipelines using Kafka, Flink,
Spark Streaming, and other relevant technologies.
● Develop efficient and scalable data processing workflows to ensure timely delivery
of actionable insights.
● Troubleshoot and resolve any performance, scalability, or availability issues that
arise in the real-time data processing infrastructure.
● Stay up to date with the latest advancements in real-time data processing
technologies and recommend improvements to enhance the system's capabilities.
Requirements:
● Bachelor's degree in Computer Science, Engineering, or a related field (advanced
degree preferred).
● Proven experience as a Data Engineer, specifically in real-time data processing.
● Strong proficiency in Kafka, Flink, Spark Streaming, and related technologies.
● Solid programming skills in Python and familiarity with CICD practices.
● Familiarity with AWS cloud platforms and containerization technologies (e.g.,Docker, Kubernetes) is a plus.
