Responsibilities
Design, implement, and maintain scalable data pipelines using Azure Data Factory (ADF) to extract, transform.
Develop and optimize solutions using Azure Synapse Analytics for large-scale data processing and analytics.
Utilize Azure Databricks for advanced analytics, machine learning, and collaborative data exploration.
Leverage Python for scripting and automation in data processing tasks.
Design and implement data models to support business requirements and optimize data storage.
Optimize data processing performance, troubleshoot bottlenecks, and ensure efficient data flow.
Requirements
Bachelor’s degree in computer science, Information Technology, or a related field.
Proven experience as a Data Engineer with expertise in Azure Data Factory, Azure Synapse, Databricks, and Python and SQL.
Proficient in Azure Data Factory, Azure Synapse, and Databricks.
Strong programming skills in Python for data engineering tasks.
Experience with data modelling and optimization techniques.
Knowledge of data security and compliance in cloud environments.
Excellent problem-solving and analytical skills.
