About the client:
Reputed Consulting Company
Responsibilities:
· Create and maintain optimal data pipeline architecture,
· Assemble large, complex data sets that meet functional / non-functional business requirements.
· Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
· Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’
· Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
· Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
· Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
· Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
· Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
· Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
· Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Skills/Requirement:
· Minimum 5 years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
· Experience with big data tools: Hadoop, Spark, Kafka, etc.
· Working experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
· Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
· Required to have experience with AWS cloud services: EC2, EMR, RDS, Redshift
· Experience with stream-processing systems: Storm, Spark-Streaming, etc.
· Good understanding about object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Interested candidates, who wish to apply for the above position, please send in your resume to [email protected]
We regret to inform that only shortlisted candidates will be contacted.
PERSOLKELLY Singapore Pte Ltd EA License No. 01C4394 EA Reg No: R23118975 (ABDUL RAHMAN ANSARI RAJA)
**********************************
The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.
By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOLKELLY Singapore Pte Ltd and its local and overseas subsidiaries and affiliates collecting, using and disclosing your personal data to prospective employers/companies based in any country for purposes of evaluating suitability for employment, conducting reference checks, administering employment related services and such other purposes stated in our privacy policy. Our full privacy policy is available at www.persolkelly.com.sg. If you wish to withdraw your consent, please drop us an emailto let us know. Please feel free to contact us if you have any queries.
All parties involved in any form of workforce engagement are to strictly adhere to prevailing regulations and laws that govern local fair employment practices, and to invest reasonable efforts in building a strong Singaporean core workforce, recruit and select candidates based on merit and prohibit discrimination based on age, race, gender, religion, marital status and family responsibility or disability. For more information, please refer to MOM and TAFEP websites.
**********************************
