Job Scope:
Data Collection:
- Identify and gather data from various sources including excels , databases, APIs, and third-party services.
- Ensure the quality, consistency, and integrity of collected data.
- Automate data collection processes where applicable.
Data Pipeline Design:
- Architect, design, and implement scalable data pipelines for efficient data processing.
- Develop ETL (Extract, Transform, Load) processes to clean, transform, and load data into storage solutions such as data lakes or warehouses.
- Ensure the pipeline is optimized for performance, reliability, and security.
- Implement monitoring and logging to maintain pipeline health.
Data Storage and Management:
- Design and manage data storage solutions, ensuring data is stored in a manner that supports easy access and retrieval.
- Optimize data storage for both cost-effectiveness and query performance.
- Implement data governance practices to ensure compliance with organizational and legal requirements.
Data Visualization and Dashboard Development:
- Develop interactive dashboards using tools such as Tableau, Power BI, or similar platforms.
- Collaborate with stakeholders to understand their needs and tailor visualizations to support decision-making.
- Ensure dashboards are user-friendly, visually appealing, and provide real-time or near-real-time data updates.
Insight Generation and Reporting:
- Analyze data to uncover trends, patterns, and anomalies that provide actionable insights.
- Prepare and present reports to stakeholders, translating complex data into clear and concise narratives.
- Provide recommendations based on data analysis to inform strategic initiatives.
Requirements:
- At least 1-2 years’ experience in data analyst/engineer role.
- Good English language skills (spoken and written)
- Ability to self-drive the initiative with limited guidance and ability to coordinate with multiple parties with problem solving skills.
- Experience in designing, building, and maintaining batch and real-time data pipelines .
- Experience with Databricks.
- Experience with Data visualization tools such as tableau.
- Experience with implementing technical processes to enforce data security, data quality, and data governance.
