COMPANY OVERVIEW
Our client is a leading entity in the energy trading sector. The organization operates on a global scale, providing trading and risk management solutions tailored to the energy market's dynamic nature. With a focus on optimizing energy supply chains, the company plays a pivotal role in connecting energy producers with consumers, ensuring the efficient and reliable distribution of energy resources worldwide. Their strategic approach combines deep market insights with advanced technology, making them a key player in the global energy landscape.
They are in search of a Data Engineer.
JOB RESPONSIBILITIES
· The Data Engineer role is part of the L3 squad within the Data Team at IT Department.
· The L3 squad focuses on designing, building, and testing complex data ingestion and processing pipelines.
· L3 squad works closely with the L2 squad, which handles platform administration, operational support, small changes, and release management.
· Heavily investing in Data and Analytics to support data-driven commercial decision-making, risk management, and operations.
· The Data Team is leading the creation of a modern data platform using Azure services and Databricks.
· Key deliverables include a central data warehouse for trade, valuation, and risk data, and a central hub for sharing market fundamentals in commodity markets.
· The team also builds data pipelines for scraping, ingesting, and analyzing various data sources, along with tools for data governance and discovery.
· The Data Engineer role is part of a skilled team based primarily in Singapore, working within an agile framework and following DevOps principles.
· The team values fast-paced, iterative development, with an emphasis on collaboration, autonomy, and ownership.
· The Data Engineer will be involved in designing and delivering data solutions, collaborating on technical architecture, and ensuring high-quality, production-ready data pipelines.
· The role includes around 80% focus on Data Engineering tasks, with 20% dedicated to supporting production deployments and resolving production issues.
JOB REQUIREMENTS
· Approximately 5 years of experience in a similar role, focusing on cloud technologies and data architecture.
· Extensive experience with Azure cloud services and modern cloud-based data architectures.
· Advanced skills in Python and SQL programming languages.
· Hands-on experience with Databricks or similar platforms like Spark, including advanced knowledge of Databricks features like Unity Catalog, Delta Live Tables, and platform administration.
· Proficient in using Azure services such as VNET, Key Vaults, Azure Data Factory, ADLS Gen2, Virtual Machines, App Services, Storage Accounts, and Azure Active Directory.
· Skilled in dimensional modeling techniques, including star and snowflake schema design.
· Experienced in orchestrating data pipelines using Azure Data Factory or Airflow.
· Knowledgeable in Python libraries like Pandas, Numpy, and Seaborn for data analysis.
· Strong understanding of Big Data concepts, including MapReduce, Spark, and file formats like Parquet, Avro, and ORC.
· Familiarity with reporting tools like Power BI or Tableau for data visualization.
· Proficient in source code management using tools like Azure DevOps and Git.
· Experienced in Agile delivery methodologies such as SCRUM or Kanban.
· Familiar with work management tools like JIRA and Confluence.
· Certified in Data Engineering, demonstrating a strong foundation in the field.
· Possesses a strong academic background with a relevant degree or professional qualification.
· Analytical, flexible, and open to diverse opinions, with a commitment to continuous learning and engineering excellence.
· Highly organized, detail-oriented, and capable of working independently or in team settings.
· Effective communicator, confident in contributing to meetings and discussions.
· Collaborative, Agile, and takes ownership with a proactive, "get things done" attitude.
Working Location: Singapore
Apply online or feel free to contact me directly (via email:[email protected]) for more information about this opportunity. Due to the high volume of applicants, we regret to inform that only shortlisted candidates will be notified. Thank you for your understanding.
Syahirah Binte Ahmad Ja'afar (R22105331)
JAC Recruitment Pte. Ltd. (90C3026)
