Job Summary:
We are looking for a highly skilled and experienced Senior ETL Developer with expertise in big data platforms and data processing frameworks. The successful candidate will have strong proficiency in ETL solutions such as Informatica BDM, experience with big data technologies like Cloudera, and advanced knowledge of programming languages such as Python, Scala, and Java. This role involves managing and optimizing large-scale data infrastructure, working independently in dynamic environments, and mentoring junior team members.
Key Responsibilities:
• Develop, optimize, and manage ETL workflows using Informatica BDM to transform and process large datasets.
• Maintain and manage big data environments, particularly on platforms like Cloudera.
• Design and implement scalable data processing frameworks using tools such as Apache Spark.
• Write and maintain complex Unix Shell scripts for automation and data manipulation tasks.
• Provide infrastructure management and administration support for Cloudera Admin and Informatica Admin.
• Collaborate with cross-functional teams to design, develop, and deploy data solutions.
• Conduct data quality checks to ensure accuracy and consistency in all data processing activities.
• Participate in code reviews, optimization, and performance tuning of data processing jobs.
• Troubleshoot and resolve any issues related to ETL processes and data pipelines.
• Mentor and guide junior developers in best practices for ETL development, data integration, and automation.
• Ensure adherence to project timelines while managing multiple priorities in a dynamic environment.
Skills and Qualifications:
• 5+ years of experience with ETL solutions such as Informatica BDM.
• Proven expertise in big data platforms, especially Cloudera.
• Strong knowledge of data processing frameworks such as Apache Spark.
• Proficiency in programming languages such as Python, Scala, and Java.
• Solid experience in Unix Shell scripting.
• Demonstrated problem-solving skills with a high level of accuracy and attention to detail.
• Strong ability to work independently while managing multiple tasks in a fast-paced environment.
• Demonstrated excellence in mentoring and team collaboration.
• Excellent written and verbal communication skills.
