Experience: 10+ Years
Role: Software Developer or Senior Software Developer
Key Skills:
o Hadoop Ecosystem: Hadoop 2.x, HBase, Apache Spark 1.x/ 2.x, Apache Phoenix, Apache Zookeeper, Apache Hive, Apache Storm.
o Cloud: AWS [AWS EMR, Kinesis, EC2, Redshift, Cloud watch, I AM], GCP
o Programming Languages: Python, Scala, Java.
o Databases: MS SQL Server, PL/ SQL, OLTP and OLAP/DW Systems
o Pipeline: Spark, Kafka, control-m
o NoSQL: HBase
Key Responsibilities:
· Experience with Content management system to target 1=1 customer as part of the Personalized Interactions for customers.
· Experience on Data governance and data lineage using Collibra.
· Experience as Product lead to interact between the different teams to achieve the business end goal.
· Experience on AWS S3, EMR and EC2 services. Understanding on the kinesis, solution architect using AWS services.
· Experience on Alluxio as Data orchestration on AWS S3.
· Knowledge on Graph database like Neo4J and Orient DB.
· Wide experience in AWS cloud platform.
· Experience in Hadoop framework and Hadoop Eco Systems.
· Experience working on Spring Boot, Mongo DB, Angular 5/6, and Restful API
· Experience on Message broker such as Kafka.
· Experience in building Data Pipeline for Nielsen Data Lake
· Experience working on Hadoop and HBase distributed environment setup of around 10 node clusters
· Experience installing, configuring and supporting Linux and Microsoft Windows Servers for Single node and Multi-node of Master - Salve architecture.
· Experience in setting up DNS, Jboss, Tomact servers.
· Experience in modern observability tools such as ELK stack, Prometheus.
· Understanding of Elastic-search Search API query string format
· DevOps and testing tools such as Git, Jira, Confluence
· Able to work independently on individual assignments, while collectively with a team on larger projects.
· Experience in working on Proof of Concept on Kubernetes and Docker using DevOps.
