Job Description
- Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.
- Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks
- Collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers and Data Analyst to build scalable data-driven products
- Work in an Agile Environment that practices Continuous Integration and Delivery
- Support and advise best practices in data management standards, policies and procedures
- Work closely with fellow developers through pair programming and code review process
- Integrate and collate data silos in a manner which is both scalable and compliant
- Be responsible for developing backend APIs working on databases to support the applications.
Requirements
- To build POCs and prototypes on AWS, Proficient in AWS services
- Proficient in Python
- Proficient in SQL
- Good Knowledge of data warehousing.
- Good Knowledge of RESTful APIs
EA Number: 11C4879
