Responsibilities:
- Responsible for Hadoop development and implementation for data ingestion on Hadoop technologies
- Required to have sound knowledge and implementation experience to build Data warehouse / Data Mart using structured / unstructured data for both near real-time & batch processing
- Hands on experience in complex code development and performance tuning
- Need to fine tune applications and systems for high performance and higher volume throughput Translate, load and exhibit unrelated data sets in various formats and sources like JSON, text files, Kafka queues, and log dataKey responsibility is to own the development of the Cloud migration of the data warehouse
- Supporting the Testing activities and user validation
- Coordination during User testing
- Developing the user documents post the business go live
Requirements:
- Bachelor’s degree in computer science, Engineering, or a related field.
- Must have 5+years’ hands-on experience in complex code development and performance tuning skills in programming languages like Hive, spark, python, scala, Unix/Linux and RDBMS SQL (Mysql), Cloudera
- Must have strong experience with design, development, and analytical skills in handling both structured and unstructured data ingestion and processing in Hadoop ecosystem
- Hadoop development and implementation for data ingestion on Hadoop technologies like HDFS, Hive, Sqoop, Spark, MapReduce, Zookeeper, YARN, HBase, Tez, Kafka, kibana, solr, elastic search
- Should have led the design and implementation of an E2E Big Data-warehousing platform including source system integration and data lake implementation
Disclaimer: The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfill our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg)
