Responsibilities:
- Azure Data Platform Design and Implementation:Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions.
Implement and optimize data storage, processing, and analytics solutions on Azure, leveraging services such as Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics. - Infrastructure as Code (IaC) with Terraform:Develop, maintain, and enhance Terraform scripts for automating the provisioning and configuration of Azure infrastructure components.
Ensure IaC best practices are followed to achieve consistency, repeatability, and version control in infrastructure deployment. - Data Security and Compliance:Implement security best practices for Azure data services and infrastructure components.
Ensure compliance with data governance policies and industry regulations. - Performance Optimization:Monitor and optimize the performance of data platform components to meet scalability and efficiency requirements.
Troubleshoot and resolve performance issues in collaboration with the operations and support teams. - Collaboration and Documentation:Collaborate with data engineers, architects, and other stakeholders to understand data requirements and provide technical expertise.
Create and maintain comprehensive documentation for data platform architecture, configurations, and processes.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum 8+ years of experience
- Proven experience as a Data Platform Engineer with a focus on Azure services.
- Strong proficiency in Terraform for automating infrastructure deployment.
- In-depth knowledge of Azure data services, including Data Lake Storage, Azure SQL Database, and Synapse Analytics.
- Experience with data modeling, ETL processes, and data warehousing.
- Familiarity with data security and compliance standards.
- Excellent problem-solving and troubleshooting skills.
- Effective communication and collaboration skills.
Preferred Skills:
- Microsoft Azure certifications (e.g., Azure Data Engineer, Azure Solutions Architect).
- Experience with other infrastructure as code tools and technologies.
- Knowledge of DevOps practices and CI/CD pipelines