Key Responsibilities:
• Lead the data and business intelligence team within the department
• Establish data engineering competency framework and best practices for the department
• Build up the projects pipeline for the data and BI team
• Mentor junior data engineers on enterprise data engineering best practices
• Contribute to the design and integration of data management & data governance capabilities for a data analytics platform product built by the product team within the department
• Assist in the setup and maintenance of big data, machine learning and Kubernetes clusters
• Participate in data engineering projects as technical lead and work with other stakeholders - Data Scientists, Data Analysts, etc. to assist with data-related technical issues and support their data pipeline infrastructure and data preparation needs Job
Requirements:
• Bachelor or Master’s degree in computer science, software engineering, information systems or related field
• The candidate should have at least 8 years of technical experience in Information Technology with preferably 6 years in Big Data, Data Warehousing or Business Intelligence technology with knowledge of analytics and AI technologies
• Broad knowledge of various aspects of Big Data with good understanding and hands-on experience in Hadoop based technologies such as HDFS, Hive, Spark, Kafka etc.
• Deep understanding of relational, NoSQL, NewSQL database technologies such as PostgreSQL, Oracle DB, CitusDB, SingleStore, Cassandra, MongoDB, Neo4J etc.
• Good knowledge of programming languages such as Java, Python or Scala on Linux/Windows platforms
• Experienced in Kubernetes and Kubeflow is a plus point
• Familiar with visualization and reporting software.
• Experienced in designing production grade ETL/BI solutions.
• Experienced in DevOps and DataOps
• Familiar with Linux/UNIX system administration
• Experienced in operational support for Big Data solutions
• Effective oral and written communication with strong analytical, problem solving, multitasking and project management skills are essential on the job
