Job Description:
We are looking for a highly skilled and motivated Platform Engineer to join our data team. The ideal candidate will have extensive experience with PySpark, Spark, Hive, ETL processes, and SQL. As a Platform Engineer, you will be responsible for designing, developing, and optimizing our data pipelines and ensuring the efficient and reliable extraction, transformation, and loading (ETL) of data across various platforms.
Requirement:
• Proven 4+ Years of experience as a Platform Engineer or in a similar role.
• Strong expertise in PySpark and Spark for data processing and transformation.
• Proficiency in writing and optimizing SQL queries.
• Experience with Hive and other big data technologies.
• Solid understanding of ETL processes and tools.
• Familiarity with data warehousing concepts and best practices.
• Knowledge of data modelling and schema design.
