Job Description Summary
The Manager of Data Engineering and Systems, you lead a team of data engineers and Architects in designing, implementing, and maintaining robust data infrastructure and systems. The person will collaborate with cross-functional teams to ensure data availability, integrity, and security, and will play a key role in shaping the overall data strategy of the organization.
Manager of Data Engineering and Systems is a crucial role within an organization responsible for overseeing the development, implementation, and maintenance of data architecture, infrastructure, and processes. This role requires a combination of technical expertise, leadership skills, and a deep understanding of data management principles.
- Team Leadership:
• Lead, mentor, and manage a team of data engineers, Data and Solution Architect, providing guidance on technical projects, best practices, and professional development.
• Foster a collaborative and innovative team culture, encouraging continuous learning and improvement.2 - Data Architecture and Design:
• Collaborate with stakeholders to understand data requirements and work with the Data Architects to design scalable, efficient, and maintainable data architecture.
• Oversee the development and maintenance of data models, ETL (Extract, Transform, Load) processes, and data pipelines.3 - Data Infrastructure Management:
• Manage and optimize data storage, processing, and retrieval systems, ensuring high performance, scalability, and reliability.
• Evaluate and implement new technologies to enhance data engineering capabilities.4 - Data Management and Security:
• Establish and enforce data Management policies, ensuring data quality, consistency, and compliance with regulatory requirements.
• Implement and monitor data security measures to protect sensitive information.5 - Collaboration:
• Work closely with data scientists, analysts, and other stakeholders to understand their data needs and provide effective solutions.
• Collaborate with Dataworks, IT and other departments to integrate data engineering solutions into broader organizational initiatives.6 - Performance Monitoring and Optimization:
• Implement monitoring and logging systems to track data pipeline performance and troubleshoot issues promptly.
• Continuously optimize data engineering processes to improve efficiency and reduce latency.
- Qualifications:Bachelor’s or master’s degree in computer science, Information Systems, or a related field.
Proven experience (5 years) in data engineering, with a strong understanding of database management, ETL processes, and data modeling.
Previous experience in a leadership or management role, with a demonstrated ability to lead and develop high-performing teams.
Proficiency in programming languages such as Python, Java, or Scala.
Knowledge of big data technologies (e.g., Hadoop, Spark), cloud platforms (e.g., AWS, Azure, GCP), and database systems (e.g., SQL, NoSQL).
A good understanding of fundamental business principles and problems
Preferred Skills:Experience with data warehousing solutions.
Familiarity with machine learning and data science concepts.
Strong communication and stakeholder management skills.
Certifications in relevant technologies.
