Lead Data Engineer / Salt Search

  • Full Time
  • Dubai
  • Posted 2 months ago

Salt Search

Job Responsibilities:

  • Partner with business stakeholders to understand their needs and build impactful analytics solutions
  • Design and build data pipelines to support data science projects following software engineering best practices
  • Use state of the art technologies to acquire, ingest and transform big datasets
  • Design and build Data/Analytics platform
  • Map data fields to hypothesis, curate, wrangle and prepare data to be used in advanced analytics models
  • Create and manage data environments in the cloud or on premise

Job Requirements:

  • Degree educated in computer science, engineering, mathematics, or equivalent experience
  • 7+ years of previous commercial experience as a leader in a data-driven role
  • 3+ years of experience as a leader in Data/Analytics platform architecture design
  • 3+ years of hands-on experience building data pipelines in production and ability to work across structured, semi-structured and unstructured data
  • 3+ years of experience in ML pipeline for streaming/batch workflow
  • Ability to write clean, maintainable, and robust code in Python, Scala, Java or similar languages
  • Deep understanding and expertise of software engineering concepts and best practices
  • Deep knowledge and expertise of testing frameworks and libraries

Technical skills:

  • Python
  • Spark (PySpark)
  • Pandas
  • Jupyter
  • SQL and No-SQL DBMS
  • Git (as source code versioning and CI/CD)
  • Exploratory Data Analysis (EDA)
  • Imputation Techniques,
  • Data Linking / Cleansing
  • Feature Engineering
  • Jenkins
  • CI/CD
  • Power BI (Optional)

To apply for this job please visit www.careerjet.ae.

Job Overview
Job Location