Morgan McKinley is seeking a Data Engineer for a 6 month contract assignment with a possibility to extend or to go perm!
Responsibilities:
- Collaborate across multiple workstreams to gather and support data requirements for reports and dashboards.
- Analyze and perform data profiling to identify data patterns and discrepancies, adhering to Data Quality and Data Management processes.
- Follow best practices in designing and developing end-to-end data pipelines, including data transformation, ingestion, processing, and surfacing of data for large-scale applications.
- Utilize Azure technology stack to develop and automate data pipelines with Databricks and Data Factory.
- Translate business requirements into technical specifications for system analysts and technical teams to facilitate project design and delivery.
- Conduct source data analysis and perform data ingestion in both batch and real-time patterns using various methods such as file transfers, APIs, and data streaming (Kafka and Spark Streaming).
- Develop ETL processes with Spark to transform and standardize data according to business needs.
- Create data exports, data APIs, and data visualizations using tools like Power BI, Tableau, or other visualization platforms.
Qualifications:
- 3 to 5 years of experience in data engineering, specifically with Databricks and Python.
- Strong proficiency in Python and Databricks is essential.
- Experience with AWS cloud technologies is preferred.
- Familiarity with data processing, ETL development, and data visualization tools.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills to collaborate with technical and non-technical teams.
Interested candidates may apply through the application system or send it to [email protected]. Shortlisted candidates will be notified.
By sending us your personal data and curriculum vitae (CV), you are deemed to consent to Morgan Mckinley Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.morganmckinley.com/sg/privacy-policy. You acknowledge that you have read, understood, and agree with the Privacy Policy.
Morgan McKinley Pte Ltd
Koh Boon Sien
EA Licence No: 11C5502
EA Registration No. R1110345
