Job Scope:
- Commercial software engineering: Have strong professional software development experience in multiple programming languages, including modern virtual-machine languages such as Java, as well as common scripting and glue languages such as Python and version control (git), with good analytical & debugging skills.
- Experience performing root-cause analysis on bugs and performance problems in distributed systems, including network and source-level debugging
- Big data: You have extensive experience with data analytics and working knowledge of big data infrastructure such as Google Cloud, Big Query, Data Flow, Hadoop Eco System, HDFS, Apache Storm, Apache Spark
- You've routinely built data pipelines with gigabytes/terabytes of data and understand the challenges of manipulating such large datasets
- Cloud Exposure: Strong experience implementing systems and applications using distributed and cloud infrastructure. GCP preferred, but AWS or Azure are also okay
- Data Modeling: Flair for data, schema, data model, PL/SQL, Star & snowflake schema, how to bring efficiency in data modeling for efficient querying data for analysis, understands criticality TDD and develops data validation techniques
- Working knowledge of distributed relational and tabular data stores, message queues, stream processing facilities, and other scalable big-data platform technologies
Job Requirements:
- Responsible for integration and deployment of the Data Ingestion & machine learning pipelines into production where your ideas can come to life
- Work with stakeholders including the Data Science teams, Business Systems Analysts, and Architecture teams to assist with data platform technical and organizational issues and support the company's data and analytics needs
- Experience in designing and developing data warehouse workflows and big data development using Informatica PowerCenter or BDM
- Experience in working on Big Data Platform such as Cloudera/Hortonworks or Databricks or using Spark. • Experience in SQL using Oracle or MS SQL Server
- Good working knowledge in Big Data Technologies such as Hive, Hdfs
- Experience in data visualization development using Power BI, QlikView/QlikSense or Tableau
