Responsibilities
- Architecture design. While designing a company's data architecture is sometimes the work of a data architect, in many cases, the data engineer is the person in charge. This involves being fluent with different types of databases, warehouses, and analytical systems.
- ETL processes. Collecting data from different sources, processing it, and storing it in a ready-to-use format in the company’s data warehouse are some of the most common activities of data engineers.
- Data pipeline management. Data pipelines are data engineers’ best friends. The ultimate goal of data engineers is automating as many data processes as possible, and here data pipelines are key. Data engineers need to be fluent in developing, maintaining, testing, and optimizing data pipelines.
- Machine learning model deployment. While data scientists are responsible for developing machine learning models, data engineers are responsible for putting them into production.
- Cloud management. Cloud-based services are rapidly becoming a go-to option for many companies that want to make the most out of their data infrastructure. As an increasing number of data activities take place in the cloud, data engineers have to be able to work with cloud tools hosted in cloud providers, such as AWS, Azure, and Google Cloud.
- Data monitoring. Ensuring data quality is crucial to make every data process work smoothly. Data engineers are responsible for monitoring every process and routines and optimizing their performance.
Requirements:
- Advanced SQL skills and relational database management
- Object-oriented programming languages, like Python, Java, and Scala.
- Experience with distributed computing frameworks, such as Hadoop or Spark
- Data pipelines and workflow management tools (e.g. Airflow)
- Cloud-based solutions (e.g. AWS, Azure, Google Cloud)
Interested candidates who wish to apply for the advertised position, please email us an updated copy of your resume.
Email Address: [email protected]
EA License No.: 13C6305
Reg No: R1770654
For candidate who applied for the advertised position is deemed to have consented to us that we may collect, use or disclose your personal information for purpose in connection with the services provided by us.
