Senior Data Engineer (2393786)

Job Title Senior Data Engineer (2393786)

What you'll bring:

• Proven working experience as a Senior Data Engineer with a  6 to 10 years in the field.

• Strong programming skills in Scala/Java and experience with Spark for data processing and analytics

• Familiarity with Google Cloud Platform (GCP) services such as BigQuery, GCS, Dataproc etc.

• Experience of developing near real-time ingestion pipelines using kafka and spark structured streaming.

• Proven experience in designing and developing APIs.

• Experience with Data modelling, Data warehousing and ETL processes

• Understanding of data warehousing concepts and best practices

• Strong knowledge of SQL and NoSQL systems

• Proficiency in version control systems, particularly Git.

• Proficiency in working with large-scale data sets and distributed computing frameworks

• Familiarity with CI/CD pipelines and tools such as Jenkins or GitLab CI.

• Proficiency with schedulers like Airflow.

• Strong problem-solving and analytical skills

• Familiarity with BI and Visualisation tools like Tableau or Looker

• Strong Understanding in Generative Artificial Intelligence (Gen AI), Agentic AI is desirable but not essential