Data Engineer with Java Microservices
Job Summary
We are seeking a highly skilled Senior Data Engineer with a strong foundation in Java and a proven track record in building and deploying microservices. The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines and microservices to support our data-driven initiatives. This role requires a combination of data engineering expertise, software development skills, and a deep understanding of cloud platforms.
Responsibilities
- Design, develop, and deploy scalable data pipelines using Java and relevant frameworks (Spring Boot, Spring Data, etc.)
- Build and maintain microservices architecture for data processing and transformation.
- Extract, transform, and load (ETL) data from various sources into data warehouses and data lakes.
- Develop data ingestion and streaming pipelines using technologies like Kafka Spark, or Flink.
- Optimize data pipelines for performance and efficiency.
- Collaborate with data analysts and scientists to understand data requirements and translate them into technical solutions.
- Implement data quality checks and monitoring.
- Deploy and manage data infrastructure in cloud environments (AWS, GCP, Azure).
- Stay up-to-date with the latest data engineering technologies and trends.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 5+ years of experience as a Data Engineer.
- Strong proficiency in Java and related frameworks (Spring Boot, Spring Data).
- Experience in designing and developing microservices architectures.
- Expertise in SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra).
- Knowledge of data warehousing and data lake concepts.
- Experience with cloud platforms (AWS, GCP, Azure) and related data services.
- Strong understanding of data modeling and data warehousing principles.
- Proficiency in data ingestion and processing tools (Kafka, Spark, Flink).
- Experience with CI/CD pipelines and DevOps practices.
