Job Description
- Lead a data engineering team on a modern AWS-based data platform. - Gain exposure to emerging AI and GenAI initiatives alongside core data work. About Our Client Our client is a technology-focused organisation operating a modern cloud data environment. The team works closely with business and technical stakeholders to deliver data, analytics, and machine learning capabilities through scalable engineering solutions. Job Description - Lead and develop a team of data engineers, providing coaching to strengthen technical capability and delivery excellence. - Offer hands-on technical direction by defining engineering best practices, reviewing solution designs and code, and promoting high-quality outcomes. - Propose and detail solution designs that align with established architecture standards, governance requirements, and delivery frameworks. - Communicate technical approaches effectively to stakeholders and project teams, explaining key design choices and associated trade-offs. - Guide the development and optimisation of Apache Spark workloads on AWS EMR for both batch and real-time data processing. - Oversee the design and management of streaming API solutions supporting real-time ingestion, consumption, and data delivery. - Support self-service data access for data science users through curated data assets and governed delivery mechanisms, recommending suitable implementation approaches. - Advocate strong MLOps practices, including model deployment, monitoring, and lifecycle support within the platform environment. - Contribute to the delivery of lightweight user-facing and service-layer components using React and Node.js within a Backend-for-Frontend architecture. - Collaborate with stakeholders, data science teams, and platform specialists to convert business requirements into scalable, secure, and cost-efficient solutions. - Drive best practices in data governance, covering data quality, lineage, integrity, and security throughout the data lifecycle. - Participate in emerging AI and generative AI-related initiatives, contributing ideas and technical input where appropriate. The Successful Applicant - Bachelor's degree in Computer Science, Engineering, Data Science, or a related technical discipline, or equivalent industry experience. - At least 6 years of experience in data engineering, including demonstrated experience leading and mentoring engineering teams. - Strong technical leadership capabilities with experience establishing standards, mentoring engineers, and reviewing designs and code. - Ability to communicate and present technical solutions effectively to both technical and non-technical audiences. - Proven hands-on expertise with Apache Spark running on AWS EMR, including pipeline architecture, performance optimisation, and cost management. - Experience designing and supporting streaming API services for real-time data ingestion, consumption, and API-driven delivery. - Solid experience across AWS data services including S3, Glue, Lake Formation, Athena, Redshift, Step Functions, and Lambda. - Proficiency in Python, with additional expertise in technologies such as React and Node.js within a Backend-for-Frontend architecture preferred. - Ability to contribute solution concepts and detailed designs within defined architecture standards, delivery patterns, and governance frameworks. - Understanding of MLOps principles and experience supporting self-service capabilities for data science teams. - Experience with streaming and messaging technologies such as Kafka or Spark Streaming, along with strong SQL and data modelling skills. - Interest in or exposure to AI and generative AI technologies is advantageous but not a primary requirement. - Excellent communication, stakeholder engagement, and coaching abilities. - Fluent Cantonese and English language skills are required; Mandarin is an advantage. - Previous experience within a consulting, professional services, or technology services environment is preferred. What's on Offer - Competitive monthly salary. - Usual contractor benefits offered by the organization. If you are interested in this Data Engineer Lead role in Hong Kong, we encourage you to apply. Contact Quote job ref: JN-092026-7094945
Similar jobs
- Security Engineer (Data & Endpoint Security)
OKX · Hong Kong, Hong Kong SAR
- Senior Data Engineer
Hong Kong, Hong Kong SAR
- Java Data Engineer | Real-Time Market & Trading Data | Hong Kong or Shenzhen
BAH Partners · Hong Kong, Hong Kong SAR
- Staff/Senior Staff Web3 Big Data Engineer
OKX · Hong Kong, Hong Kong SAR
- Data Engineer
Central & Western District, Hong Kong SAR
- Senior Data Engineer, Compliance Data Platform
OKX · Hong Kong, Hong Kong SAR