Job Description
Key Responsibilities • Design, develop, and implement scalable data and platform solutions across AWS and hybrid/on-premises environments. • Build and maintain robust data pipelines, platform services, and automation frameworks using Python, PySpark, SQL, and cloud-native technologies. • Support and enhance enterprise capabilities including data lakes, metadata management, search platforms, and AI services. • Develop and maintain CI/CD pipelines, automated testing frameworks, and deployment processes. • Implement, integrate, and support technologies such as OpenSearch, Bedrock, AgentCore, MCP, and related platform services. • Monitor and improve platform reliability, security, performance, observability, and cost efficiency. • Troubleshoot and resolve production issues while ensuring platform stability and operational excellence. • Collaborate with cross-functional teams to drive platform modernization and continuous improvement initiatives. Mandatory Requirements ⭐3-5+ years of hands-on experience building and supporting production-grade data pipelines using SQL, Python, and cloud technologies. ⭐Hands-on experience with AWS and/or hybrid cloud environments. ⭐Strong Linux/Unix administration and scripting experience with production support capabilities. Detailed Requirements Data Engineering: Strong understanding of ETL/ELT processes, Data Lake/Lakehouse architectures, and distributed data processing frameworks. Cloud & Platform Engineering: Experience with AWS Glue, EMR, S3, Redshift, Lambda, Apache Spark, Airflow, DBT, Kafka/MSK, Apache Iceberg, OpenSearch, Hive, Trino, Presto, Bedrock, AgentCore and MCP. Platform Operations: Proficiency with Git, CI/CD pipelines, DevOps practices, Infrastructure as Code (IaC), and enterprise-scale platform support.
Similar jobs
- Data centre Resident Engineer
Tap Growth ai · Singapore, Singapore
- Engineer, Data Centre Facility Management
ENGIE Southeast Asia · Singapore, Singapore
- Data Centre Resident Engineer
Tap Growth ai · Singapore, Singapore
- T&T Data Platform Engineer - Artificial Intelligence & Data - GPS - SG
Deloitte · Singapore, Singapore
- Data Centre Resident Engineer
RAPSYS TECHNOLOGIES PTE LTD · Singapore, Singapore
- Practice Customer Engineer, Migrations, Database and Data Analytics, Google Cloud
Google · Singapore