1. Data Pipeline Construction
• Design, develop, and maintain data pipelines, ensuring a smooth flow of data from multiple sources to data warehouses or lakes.
• Enable, maintain, and support pipelines to provide unified and reliable data sources.
2. Data Architecture Design
• Responsible for designing and maintaining data architecture.
• Use technologies, databases, and storage solutions to handle data efficiently and securely.
3. ETL Processes
• Perform Extract, Transform, Load (ETL) operations: - Extracting data from various sources - Transforming raw data into a structured format - Loading the processed data into storage systems for analysis
4. Data Quality Assurance
• Implement data cleaning and validation processes to enhance data accuracy and consistency.
• Monitor data quality and optimize performance to ensure reliable and usable data for analysts and data scientists.
5. Scalability and Optimization
• Design systems that can handle large volumes of data,
• Ensure scalability of data infrastructure.
• Improve and optimize data storage and retrieval.
6. Data Governance
• Implement data governance and security measures to ensure compliance
• Create, manage, and implement policies, standards, and documentation
7. Data Analytics & Reporting
• Project Management of Data Analytics deliverables
• Create, publish, and admin Power BI reports and dashboards
• Delegate, Manage, and Coordinate with the extended Data Analytics team
Mandatory Skills
1. Programming
• Python
• SQL
• ETL
2. Database Management
• MS SQL Server Environment
• Data integration tools such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
3. Power BI Expertise:
• DAX, Power Query, and creating advanced data visualizations.
• Experience in Data Modelling techniques 4. Azure Cloud Environment
• Proficiency in Azure cloud platform, including
• Azure SQL Database, Azure Data Lake Storage
• Azure Analysis Services
• Azure Data Studio
5. Useful experiences
• Machine Learning
• Artificial Intelligence
6. Required Soft Skills
• Problem-solving
• Collaboration
• Communication
Qualifications and Experience
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• Strong programming skills in languages such as Python, Java, or Scala
• Expertise in SQL and experience with both relational and NoSQL databases
• Proficiency in data modeling and database management
• Experience with big data technologies like Hadoop, Spark, and Kafka
• Strong experience in Azure cloud platforms
• Knowledge of data warehousing concepts and technologies
• Experience with ETL tools and processes
• Strong analytical and problem-solving skills
• Excellent communication and collaboration abilities
• 5+ years of relevant experience in data engineering, data analytics or must have been in a similar role
Preferred Skills
• Azure Data Engineer certification
• Azure Data Analytics and PowerBI certifications
• Experience with AI/ML will be advantageous
• Strong experience in data visualization tools and techniques
• Familiarity with agile delivery methodologies
Interested applicants please send your resume to [email protected]
Venessa Goh Wee Ni
R24124686
Recruit Express Pte Ltd
EA License No: 99C4599
RCB No.: 199601303W
