Summary: We are seeking a highly skilled software Engineer with extensive experience in designing, developing, and maintaining data solutions. The ideal candidate will have a strong background in ETL processes, data migration, and data quality assurance. You will be responsible for creating efficient data pipelines, ensuring data integrity and security, and collaborating with cross-functional teams to implement robust data solutions.
Key Responsibilities:
- Design and develop data solutions for data generation, collection, and processing.
- Create and maintain efficient ETL processes to migrate and deploy data across systems.
- Ensure data quality and integrity through validation, testing, and monitoring.
- Collaborate closely with cross-functional teams including data scientists, analysts, and software engineers to integrate data-driven solutions.
- Gather requirements and create detailed data mapping documents.
- Develop and maintain data models and entity-relationship diagrams (ERDs).
- Utilize SQL Server Integration Services (SSIS) and other ETL tools to build scalable data pipelines.
- Experience in AWS Cloud environments, specifically with SSIS on AWS and SQL Server RDS.
- Experience in code migration and deployment, ensuring version control and code promotion pipelines.
- Proficiency in Python for scripting and automation tasks related to data engineering.
- Serve as a subject matter expert (SME) in data migrations, providing guidance and support to project teams.
- Maintain up-to-date knowledge of industry trends and advancements in data engineering and ETL technologies.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field. Master’s degree preferred.
- Minimum 8 years of experience in data engineering roles, with at least 3 years specifically using SQL Server Integration Services (SSIS).
- Extensive experience with MS SQL Server, including T-SQL, Tables, Stored Procedures, Triggers, Indexes, and Performance Optimization.
- Proven track record of working on multiple data migration projects using ETL tools such as Talend or Informatica.
- Strong understanding of data modeling principles and entity-relationship diagrams (ERDs).
- Proficiency in AWS Cloud services and experience with SSIS on AWS and SQL Server RDS.
- Experience in gathering requirements and creating data mapping documents.
- Advanced proficiency in Python programming for data engineering tasks.
- Familiarity with Salesforce data migration tools such as Salesforce Data Loader is a plus.
- Knowledge of Government Commercial Cloud (GCC) environments is advantageous.
- Excellent communication skills with the ability to collaborate effectively across teams and stakeholders.
- Strong analytical and problem-solving abilities with keen attention to detail.
Good to Have:
- Experience in migrating data to Salesforce and utilizing Salesforce Data Loader.
- Familiarity with building SSIS code promotion pipelines.
- Certification in relevant cloud platforms (AWS Certified Data Analytics – Specialty, etc.).
