Responsibilities:
- Lead big Data Design and Development Activities
- Design, Development and Maintenance of Big Data MIS Application while working in an Agile team.
- Work with system analysts/business analysts to understand business/functional requirements and implement those in Java Spark/Scala Spark
- Identify and implement non-functional requirements in Java Spark/Scala Spark
- Identify opportunities for automation and lead automation activities.
- Provide L3 Support for Big Data MIS Application
- Conduct peer code reviews and ensure High Quality releases in Production.
- Guide and mentor junior developers.
- Participate in the research, design and development of scaling strategies.
- Ensure compliance with company procedures and security policies.
Requirements:
- Bachelor’s or master’s
- Problem-Solver with analytical and lean-agile mindset
- Strong experience in Java Spark/Scala Spark programming
- Must have experience in debugging and performance tuning of Spark Jobs
- Experience across range of technologies/platforms/tools – Cloudera Hadoop, Spark, Hive, YARN, HDFS, MARIADB, Spark Streaming, Kafka, Spark SQL, Zeppelin, Grafana
- Experience in Git/Bitbucket/Jenkins & Linux shell scripting.
- Sound foundation in algorithms and data structures.
- Understanding of Agile SDLC, DevOps and Site Reliability Engineering (SRE)
- Strong experience with Visualization Tool such as Tableau is desirable.
