Role : ETL -Data Engineer (Python Developer)
Contract : 12 months contract
Work Location : East Coast Road
Must have Skills : Python, AWS Glue, Athena, S3, PostgreSQL
We are seeking a talented Python Developer and BAU Analyst to join our dynamic team. In this role, you will be responsible for enhancing and maintaining critical systems for MAS 610 reporting while contributing to ongoing business-as-usual (BAU) operations. If you are passionate about leveraging Python and SQL to drive efficiency and innovation, this is the perfect opportunity for you.
Note: willing to participate in deployment activities and provide support for production environments, which may require work outside standard business hours, including nights, weekends, and holidays
Responsibilities:
Conduct research and development to optimize the performance of existing ETL pipelines for MAS 610 reporting, aiming for continuous improvement.
Manage and maintain MAS 610 BAU systems on AWS Glue, overseeing Trigger and Workflow creation, data upload, testing, and manipulation in Athena.
Develop and implement automation scripts to streamline processes, reducing support time for MAS reporting.
Identify and resolve bugs within existing JIRA tickets to ensure the smooth operation of systems.
Collaborate with cross-functional teams to develop Python and SQL scripts for enhancing new products such as Loans, debt security, and treasury.
Execute SQL queries in PostgreSQL to conduct data quality checks and validate data integrity.
Analyze error logs and rectify bugs in production environments to prevent errors and ensure system stability.
Conduct comprehensive testing of proposed solutions in System Integration Testing (SIT), User Acceptance Testing (UAT), and oversee successful deployment in the Production environment on Amazon Web Services (AWS).
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or related field.
Relevant experience in a bank, financial services
Proven experience as a Python Developer with expertise in SQL.
Strong understanding of ETL processes and experience with AWS services such as Glue, Athena, and related tools.
Proficiency in writing efficient, clean, and well-documented code.
Excellent problem-solving skills and attention to detail.
Ability to work effectively both independently and as part of a team.
Strong communication and interpersonal skills.
Willing to participate in deployment activities and provide support for production environments, which may require work outside standard business hours, including nights, weekends, and holidays