Job Description:
• We are looking for a highly skilled and motivated Platform Engineer to join our data team. The ideal candidate will have extensive experience with PySpark, Spark, Hive, ETL processes, and SQL. As a Platform Engineer, you will be responsible for designing, developing, and optimizing our data pipelines and ensuring the efficient and reliable extraction, transformation, and loading (ETL) of data across various platforms.
Requirement:
• Proven 4+ Years of experience as a Platform Engineer or in a similar role.
• Utilize principles of computer science, engineering, and mathematical analysis in software development.
• Strong expertise in PySpark and Spark for data processing and transformation.
• Analyse user needs and requirements to develop effective software solutions.
• Enhance existing software functionalities and update software to meet evolving user needs.
• Proficiency in writing and optimizing SQL queries.
• Develop specifications and performance requirements for software and system integration
• Experience with Hive and other big data technologies.
• Solid understanding of ETL processes and tools.
• Familiarity with data warehousing concepts and best practices.
• Knowledge of data modelling and schema design.
