Responsiblities:
- Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.
- Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks
- Collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers and Data Analyst to build scalable data-driven products
- Work in an Agile Environment that practices Continuous Integration and Delivery
- Support and advise best practices in data management standards, policies and procedures
- Work closely with fellow developers through pair programming and code review process
- Integrate and collate data silos in a manner which is both scalable and compliant
- Be responsible for developing backend APIs working on databases to support the applications
Requirement/Skillset:
- To take up BAU Ops tasks for existing on-premise data warehouse
- Talend
- Tableau
- MS SQL
- Fresh graduates with good degree or mid-career conversion is welcome
EA License Number : 11C4879
