Job Description:
We are seeking a skilled ETL Developer specializing in Talend to design, build, and maintain ETL jobs that facilitate efficient data extraction, transformation, and loading. This role will involve working with diverse data sources including Cloudera, PostgreSQL, and SQL Server, while collaborating with cross-functional teams to ensure data quality and integrity. The ideal candidate will have strong experience in using ETL tools and scripting languages like SQL and Python to clean, validate, and transform data as per business requirements.
Key Responsibilities:
ETL Development:
Design, develop, and maintain ETL jobs using the Talend ETL toolset to extract, transform, and load data from a variety of data sources such as Cloudera, PostgreSQL, and SQL Server.
Create and maintain database tables, including necessary constraints and indexes to meet the project requirements.
Data Transformation & Quality:
Implement data transformation logic using Talend or scripting languages such as SQL and Python to meet target schema and quality standards.
Collaborate with teams to design and execute data quality improvement initiatives.
Clean, validate, and normalize data to ensure accuracy, consistency, and completeness.
Collaboration & Troubleshooting:
Work closely with team members to understand source system structures, data retrieval methods, and organizational tools.
Provide troubleshooting support to ensure data integrity and resolve data processing issues to maintain the efficiency of ETL processes.
Process Improvement:
Participate in ongoing efforts to enhance ETL processes, identifying opportunities for optimization, automation, and improved scalability.
Required Skills & Qualifications:
Technical Expertise:
Proficiency with Talend ETL toolset for building and managing data pipelines.
Strong understanding of databases such as Cloudera, PostgreSQL, and SQL Server.
Advanced SQL skills for querying, transforming, and loading data.
Experience with scripting languages like Python for data transformation.
Data Management:
Experience in designing and developing database tables with appropriate constraints and indexes.
Strong knowledge of data cleansing, validation, and transformation techniques.
Collaboration & Communication:
Ability to work collaboratively with cross-functional teams to understand data sources and business requirements.
Strong problem-solving and troubleshooting skills to ensure data accuracy and process efficiency.
Preferred Qualifications:
· Experience working in a cloud-based environment (e.g., Cloudera, AWS, etc.).
· Familiarity with data quality improvement frameworks and tools.
· Understanding of data warehousing concepts and practices.
Educational & Professional Requirements:
· Bachelor’s degree in Computer Science, Information Systems, Data Analytics, or a related field.
· 3+ years of experience working with ETL tools (Talend) and database technologies.
· Certifications in Talend or related ETL tools are a plus.
