We are looking for an experienced Data Engineer to take overall responsibility for film and television show production:/
Responsibilities:
- Responsible for implementing robust data pipelines using Microsoft and Databricks technical Stack
- Responsible for building Azure Devops to deploy the ADF pipelines.
- Ability to talk to Business clients, understand the requirements and convert them to technical specification documents.
- Provide technical design, pyspark coding to accomplish the project deliverables as planned/scoped
Requirements:
- Bachelor’s Degree preferably Information Technology
- 5 years’ experience in Data Engineering
- Advanced working knowledge and experience with relational and non-relational databases
- Experience building and optimizing Big Data data pipelines, architectures and data sets
- Strong analytic skills related to working with unstructured datasets