Job Summary
The Application and Data Engineer is responsible for for Identifying, designing, and implementing process improvements that include building/re-engineering data models, data architectures, pipelines, and data applications. Continuously look for data optimization processes and oversee data management, governance, security, and analysis.
This role requires you take lead and drive projects and manage it well.
Job Responsibilities
Data Management
- Lead the development and optimization of our data pipelines, databases, and systems for serving data to our customers, ensuring scalability, efficiency, and reliability.
- Work in close collaboration with stakeholders and analysts to design and implement robust data models.
- Drive innovation by staying updated with the latest in data engineering practices, tools, and technologies, applying them to solve complex business and data challenges.
- Design, construct, install, test and maintain a highly scalable data platform.
- Analyze business requirements and create conceptual, logical, and physical data models.
- Design database tables, columns, and relationships, and document data flow and dependencies.
- Build high-performance algorithms, prototypes, models and proof of concepts.
- Develop data set processes for data modeling, mining, and production.
- Integrate new data management technologies and software engineering tools into existing structures.
- Research opportunities for data acquisition and new uses for existing data.
- Create custom software components and analytics applications.
- Collaborate with IT team members on project and technology related goals.
Impact and Scope
- This role covers the overall companies’ Data Architectures. Owning the framework that enables data to flow from its source to its destination, ensuring it’s stored securely and efficiently. Developing and constructing data pipeline for systems to collect, store and analyze at scale. Maintaining its accuracy and integrity and transforming data into useful format for analysis.
Education & Qualifications
- Degree in Computer Science/Information Technology or equivalent data-related fields, such as data science, data engineering, data management, data governance, data analytics etc
- Minimum 5 years of relevant experience in areas such as data management, engineering, extract, transfer and load data.
- Strong SQL skills, on MS SQL server environment, for querying and managing data.
- Proficiency in Python and SQL.
- Strong understanding of object-oriented programming (OOP) and design patterns.
- Proficiency in programming languages such as .NET and Python.
- Experience with software development frameworks and libraries.
- Familiarity with version control systems such as Git or Azure Devops.
- Knowledge of software testing and debugging methodologies.
- Ability to write clean, maintainable, and efficient code.
- Experience with agile development methodologies.
- Skills in systems problem-solving and conflict resolution.
- Ability to work as part of a team, independently and make decisions.
Behavioral Competency
- Ethical and able to organize and complete tasks to expected standards and on-time.
- Trustworthy and accountable to deliver quality results.
- Adaptability to changing requirements and circumstances.
Skills & Knowledge
- Preferably candidates with expertise in designing and implementing data pipelines, ETL processes, and data storage solutions on Azure. Proficient in programming languages such as Python, SQL, and relevant Azure services (e.g., Azure Data Factory, Azure Databricks, Azure SQL Database) and Sharepoint experience.
- Display Leadership skills in managing stakeholders.
- Proactive in finding solutions for stakeholders.
- Strong written and verbal communication skills.
- Ability to manage time effectively.
- Self Driven.
- Ability to travel and take on short overseas assignments on an as needed basis.
Applying for this role
- Candidates who wish to apply are encouraged to submit their updated resume along with details of their notice period, their most recent salary and expected remuneration.
- Salary commensurates with experience.
- We regret that we are unable to sponsor any work pass applications, and only shortlisted candidates will be notified.
Thank you for your interest.
