Our client, one of Asia-Pacific’s leading organizations is looking for:
Associate Data Engineer
Responsibilities:
- Perform data extraction, cleaning, transformation, and flow; Web scraping may be also a part of the work scope in data extraction
- Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks
- Collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers and Data Analyst to build scalable data-driven products
- Work in an Agile Environment that practices Continuous Integration and Delivery
- Support and advise best practices in data management standards, policies and procedures
Requirements:
- Interest in being the bridge between engineering and analytics; Knowledge about system design, data structure and algorithms
- Familiar with data modelling, data access, and data storage infrastructure like Data Mart, Data Lake, and Data Warehouse
- Proficient in general data cleaning and transformation (e.g. SQL, pandas, R, etc), and AWS
- Proficient with processing data from open-standard file format or data interchange format (e.g. XML, JSON)
- Good in building ETL pipeline (eg. Talend Data Integration, Informatica PowerCenter, IBM DataStage, SAS Data Integration)
- Good in database design and various databases (e.g. MS SQL Server, Oracle RDBMS, IBM DB2, Postgres etc)
- Comfortable in at least one scripting language (eg. Python)
-------------------------------------------------------------------------------------------------------
Interested applicants can also email CV at [email protected] (for faster processing, please state the exact job / position title applied “Associate Data Engineer”
Only shortlisted candidates will be notified.
-------------------------------------------------------------------------------------------------------
EA License Number: 10C3636
EA Personnel Name: Arora, Hardeep
EA Personnel Registration Number: R1111454