Job Summary:
We are seeking a talented and motivated Data Engineer to join our Software Engineering team. In this role, you will play a key part in designing, developing, and maintaining ETL processes using the Talend ETL toolset. You will work closely with team members to extract, transform, and load data from diverse sources, ensuring data integrity and quality. This position offers the opportunity to work on cutting-edge technologies like Hadoop, Spark, and Python, while contributing to impactful projects.
Key Responsibilities:
· Design, develop, and maintain ETL jobs using the Talend ETL toolset.
· Create ETL pipelines to extract, transform, and load data from multiple sources, including Cloudera, PostgreSQL, and SQL Server databases.
· Develop and optimize database tables and apply constraints to meet business requirements.
· Collaborate with team members to analyse source system structures and data retrieval methods.
· Support the development of data transformation logic using SQL, Python, and other scripting languages.
· Clean, validate, and transform data to meet schema and quality standards.
· Work with the team to implement data quality improvement plans.
· Troubleshoot data integrity and process issues to ensure efficiency and accuracy.
Technical Skills & Experience Required:
· Hands-on experience with Talend ETL tools (e.g., Talend Studio).
· Strong programming skills in Python and experience with Apache Spark.
· Proficiency with Hadoop ecosystem tools, including Hive, Impala, and HDFS.
· Solid understanding of data warehousing and data modelling techniques.
· Familiarity with relational databases such as PostgreSQL, SQL Server, and distributed systems like Cloudera.
· Experience with data visualization and analytics tools (e.g., Tableau, Power BI, etc.).
Qualifications:
· Bachelor’s degree in computer science, Mathematics, Engineering, or a related field.
· Strong interpersonal skills with a collaborative mindset.
· Excellent communication skills to interact with team members and projects effectively.
· A positive attitude and a proven ability to work within a team-oriented environment.
Soft Skills:
· Team player with strong problem-solving skills.
· Willingness to learn and adapt to evolving technologies.
· Ability to work under minimal supervision and meet project deadlines.
