Responsibility
- Create frameworks, technical features which helps in faster operationalisation of Data models, Analytical models(including AI/ML) and user generated contents (dashboards, reports etc)
- Effectively partner with data scientists in enabling faster adoption of AL/ML model based systems
- Independently install, customise and integrate software packages and programs
- Design and develop application frameworks for data integration
- Create technical documents such as solution design, program specifications for target solutions
- Perform design and development of applications which may not be limited to: Software Applications, Data Integration, User Interfaces, Automation
- Maintain and recommend software improvements to ensure a platform centric management of software applications
- Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform unit testing
Requirement
- 8+ years of experience with application development in Big Data Ecosystem (such as Cloudera, ElasticSearch, Spark, Presto, Hive, Impala, Kibana, Logstash, Hbase, Kafka),
- Expertise in building applications using Java, Scala, Python, Shell scripting
- Experience in large scale implementations and performance optimizations in the Big Data Ecosystem using Spark, Hive, Impala, Apache Kudu, Ozone, Presto, Tez, Iceberg etc
- Knowledge of frameworks such as Spring, Struts, Hibernate etc.
- Knowledge of Object Oriented Programming, Multi-threading, Containerization, etc
- Knowledge of related technologies such as HTML, Javascript, CSS, React, Jquery, node.js, docker
- Knowledge of Elastic, Kibana, Logstash, Hive, Sqoop, MongoDB, Oozie, Flume, Kafka
- Expertise in integrating applications with Devops tools
