Job Summary:
We are seeking a skilled Cloud Data Engineer to build and maintain a robust, secure, and high-performing data infrastructure leveraging AWS, Databricks, and Informatica IDMC. The ideal candidate will develop ETL processes, optimize data workflows, ensure compliance, and collaborate with cross-functional teams to deliver high-quality, scalable data solutions.
Key Responsibilities:
· Design and implement ETL pipelines using Databricks (Spark) and Informatica IDMC for data transformation and quality.
· Optimize data processing and query performance across AWS and Databricks environments.
· Ensure data security, compliance, and governance using Informatica IDMC tools.
· Automate data workflows with AWS Step Functions, Lambda, Databricks Jobs, and Informatica IDMC.
· Collaborate with data scientists, analysts, and engineers to address data requirements.
· Monitor and resolve data-related issues to ensure integrity and availability.
· Document data infrastructure, pipelines, and configurations for operational transparency.
· Stay current with AWS, Databricks, and Informatica technologies to recommend improvements.
Qualifications:
· Bachelor’s/master’s degree in computer science, Data Engineering, or related field.
· 4+ years of experience in data engineering, with expertise in AWS, Databricks, and Informatica IDMC.
· Proficiency in Python, Java, or Scala, with strong SQL/NoSQL database skills.
· Familiarity with data modelling, schema design, and performance tuning for complex transformations.
· Excellent problem-solving, communication, and collaboration abilities.
· AWS, Databricks, or Informatica certifications are a plus.
· Preferred Certifications: AWS, Databricks, Informatica IDMC certifications.
