Responsibilities:
- Work closely with data stewards, data analysts, and business end users to implement and support data solutions.
- Design and build robust and scalable data ingestion and data management solutions for batch loading and streaming data sources using Python.
- Familiar with SDLC process: Requirement gathering, design and development, SIT testing, support UAT and CICD deployment for enhancement and new ingestion pipeline.
- Ensure compliance with IT security standards, policies, and procedures.
- Provide BAU support in terms of production job monitoring, issue resolution, and bug fixes.
- Enable ingestion checks and data quality checks for all data sets in the data platform and ensure the data issues are actively detected, tracked, and fixed without breaching SLA.
Requirement
- Bachelors degree in Computer Science, Engineering, or a related field. Masters degree preferred.
- 4+ years of experience in Python development.
- Strong knowledge of Python frameworks such as Django, Flask, or FastAPI.
- Experience with RESTful API design and development.
- Proficiency in database systems such as PostgreSQL, MySQL, or MongoDB.
- Familiarity with data manipulation and analysis libraries such as NumPy and pandas.
- Familiarity with front-end technologies (e.g., HTML, CSS, JavaScript) and modern front-end frameworks (e.g., React, Angular, Vue.js) is a plus.
- Experience with version control systems, particularly Git.
- Understanding of containerization and orchestration tools like Docker and Kubernetes.
- Knowledge of cloud platforms such as AWS, Azure, or Google Cloud is desirable.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
- Ability to work in a fast-paced, agile environment.
