Data Engineer - Databricks & INFORMATICA IDMC
3 months ago
Job Description
Create technical, functional, and operational documentation for data pipelines and applications.
Understand business requirements..
Job Description
- Create technical, functional, and operational documentation for data pipelines and applications.
- Understand business requirements to drive the design of data solutions/applications and technical architecture.
- Work with other developers, designers, and architects (local and remote) to ensure data applications meet requirement and performance, data security, and analytics goals.
- Lead the configuration, build, and testing of data applications and technical architecture.
- Establish and grow a data engineering framework to ensure the reliability, scalability, quality and efficiency of data pipelines, storage, processing and integration.
- Coordinate and participate in structured peer reviews / walkthroughs / code reviews.
- Maintain and/or update technical and/or industry knowledge and skills through continuous learning activities.
- Mentor and develop junior engineers.
Requirements & Qualifications
- Experience: 4 - 5 Years
- Has more than 2 Years of experience in developing data lakes, and datamarts on the Databricks/Hadoop platform.
- skills inSpark, Python, and SQL.
- Must be a have Certified Data Engineer from Databricks
- 1-3 years of experience in INFORMATICA IDMC Services
- Should possess a INFORMATICA Professional-level certificate on IDMC Integration Services (CDI or CAI)
- Good understanding of developing data warehouses, data marts, etc.
- Good presentation skills with the ability to convey complex ideas to peers and management.
Official account of Jobstore.
