We are seeking a highly skilled Data Engineer with over 10 years of experience in Big Data Analytics, Data Engineering, and Cloud Technologies. The candidate will be proficient in working with large datasets and possess deep expertise in Apache Spark, PySpark, HDFS, Kafka, and Azure Databricks.
Key responsibilities include designing, developing, and maintaining data pipelines using tools such as Azure Data Factory, Azure SQL Data Warehouse, and PL/SQL. The role involves working with both structured and unstructured data, performing ETL/ELT workflows, and developing solutions that provide business insights. Experience with Informatica, SAS, and data lakes is highly desirable.
The ideal candidate will have a proven track record of working in Agile/Scrum environments, collaborating with cross-functional teams, and managing production issues within SLAs. Strong experience with predictive modeling, data quality checks, and dashboard reporting is essential.
Certifications Highly Desirable:
Databricks Certified Data Engineer Professional
Azure Data Engineer
Azure Fundamentals
