Job Description: Data Engineer / DevOps Specialist
Position: Data Engineer / DevOps Specialist
Location: Singapore
Job Type: Contract
Job Overview:
We are seeking a skilled Data Engineer / DevOps Specialist to join our growing team. The ideal candidate will have experience working with big data engineering, DevOps deployment, data virtualization, and analytics tools. This role involves managing large-scale data platforms, optimizing data pipelines, and ensuring system reliability, security, and performance. The candidate should have experience working with data visualization tools and strong data modeling and SQL skills. You will collaborate with cross-functional teams to implement scalable and secure systems across cloud and on-premise environments.
Key Responsibilities:
- Project Implementation:
- Lead or contribute to projects using both waterfall and Agile methodologies, ensuring successful delivery within scope, time, and budget.
- Implement systems using Hive, Impala, and Cloudera Data Platform for optimized big data solutions.
- Utilize DevOps deployment practices to automate processes, ensuring scalability, efficiency, and integration with existing infrastructure.
- Data Virtualization & Analytics:
- Implement data virtualization tools like Denodo to enhance data accessibility and performance across multiple systems.
- Work with reporting and data visualization tools such as SAP BO and Tableau to create dashboards and reports, ensuring data-driven decision-making across the organization.
- Big Data Engineering & ETL:
- Develop and optimize big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica to manage and transform large datasets.
- Maintain strong SQL skills to build and optimize queries, perform data modeling, and ensure high-quality data analysis.
- System Troubleshooting & Optimization:
- Troubleshoot and resolve complex system issues, including application stack traces and system resource bottlenecks.
- Implement and optimize high availability, high performance, and high-security systems hosted in data centers or hybrid cloud environments.
- Data Warehouse & Analytics:
- Play a key role in the design, development, and implementation of data warehouse solutions and analytics platforms, ensuring alignment with business requirements.
- Ensure best practices for data modeling and data management are followed, and solutions are optimized for performance and scalability.
Required Skills and Experience:
- DevOps & Virtualization: Hands-on experience with DevOps deployment and data virtualization tools like Denodo.
- Big Data & ETL: Strong experience in big data technologies, including Python, Pyspark, Linux, and ETL tools like Informatica.
- Analytics Tools: Understanding of reporting and visualization tools such as SAP BO and Tableau.
- Data Platforms: Track record of working with systems using Hive, Impala, and Cloudera Data Platform.
- Data Modeling & SQL: Strong skills in SQL, data modeling, and data analysis.
- Troubleshooting: Ability to troubleshoot complex system and application issues.
- System Implementation: Experience in implementing high availability, high performance, and high-security systems in hybrid environments.
Education & Certification:
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Relevant certifications in DevOps, Big Data, or related fields would be an advantage.
Preferred Skills:
- Experience working with hybrid cloud environments and large-scale data centers.
- Familiarity with Agile methodology and collaboration tools.
This role is ideal for a proactive and detail-oriented individual with strong technical skills in data engineering, DevOps, and data analytics. If you're passionate about creating efficient, secure, and scalable data platforms, we encourage you to apply.
When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the Tech Aalto Privacy Policy, a copy of which is published at Tech Aalto’s website (https://www.techaalto.com/privacy/)
Confidentiality is assured, and only shortlisted candidates will be notified for interviews.
