- Develope complex ETL solution to migrate the SAP to Azure using modern technologies such as Synapse Pipeline, Databricks, Azure SQL, Azure Data Lake Storage.
- Troubleshoot data issue encountered in the Databricks and determine the code fix which resulted to the alignment of data between Databricks and SAS in Production environment.
- Implement utility pipeline to transport the large xml file to file server of the client wherein a workaround is needed as there is no out-of-the-box functionality of Synapse to perform the activity.
- Perform dual role as developer to generate ETL pipelines and conduct testing as part of QA team.
- Interact directly with the clients to gather requirements needed for development and troubleshooting. Conducted analysis to enhance the performance of multiple jobs and shared the findings to the team to plan out the implementation.
- Troubleshoot data issue encountered in the Azure and determine the code fix which resulted to the alignment of data between Azure and SAP in QA and Production environments
x
