Our client, one of Asia-Pacific’s leading organizations is looking for:
Data Engineer
Responsibilities:
- Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.
- Design, build, launch and maintain efficient and reliable large-scale batch and real- time data pipelines with data processing frameworks
- Integrate and collate data silos in a manner which is both scalable and compliant
- Collaborate with Project Manager, Frontend Developers, UX Designers and Data Analyst to build scalable data-driven products
- Responsible for developing backend APIs & working on databases to support the applications
- Work in an Agile Environment that practices Continuous Integration and Delivery
Requirements:
- Degree in Statistics, Analytics, Applied Mathematics, Computer Science, Information Technology, Engineering or equivalent
- Proficient in general data cleaning and transformation (e.g. pandas, R, etc); Experience with building production-grade data pipelines, ETL/ELT data integration
- Proficient in building ETL pipeline; Proficient in database design and various databases (e.g. MongoDB, Postgres, MySQL, SQLite, Cassandra, etc)
- Comfortable in at least one scripting language (eg. Python)
- Experience in cloud technologies such as GPC, GCC (i.e. AWS, Azure, Google Cloud); Expertise in utilizing AWS tools and services such as Glue, DMS, and RedShift
- Familiar with Big Data frameworks and tools (eg. Hadoop, Spark, Kafka, RabbitMQ)
-------------------------------------------------------------------------------------------------------
Interested applicants can also email CV at [email protected] (for faster processing, please state the exact job / position title applied “Data Engineer”
Only shortlisted candidates will be notified.
-------------------------------------------------------------------------------------------------------
EA License Number: 10C3636
EA Personnel Name: Arora, Hardeep
EA Personnel Registration Number: R1111454
