Senior Assoc, Application Developer, Middle Office Technology - Finance Platform, Group Technology
DBS BankJob Description
Business Function Group Technology enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group Technology, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels. Responsibilities - Design, develop, and maintain scalable data pipelines and applications within the Hadoop ecosystem. - Perform performance tuning of SQL and Spark ETL processing to optimize system efficiency and reduce latency. - Implement batch automation using Shell scripts and REST APIs, including job triggering and result parsing. - Manage data storage, ingestion, and retrieval processes using HDFS and Parquet - Develop robust scripts using Shell, Python, and Scala to automate operational workflows and system integrations. - Utilize AWS products, such as S3 Storage, for cloud-based data management and integration. - Troubleshoot, debug, and resolve complex technical issues within Linux/Unix environments. Requirements - Proven experience in application development within a large-scale enterprise technology environment. - Strong technical expertise in Hadoop, HDFS, Hive, and Impala. - Proficiency in Spark (Scala/Java) and SQL. - Hands-on experience with data serialization and storage formats including Parquet - Demonstrated ability in the performance tuning of SQL and Spark ETL processing. - Strong command of Linux/Unix systems and command-line tools. - Expertise in scripting using Shell, Python, and Scala. - Experience in batch automation using Shell scripts and REST APIs, including triggering and result parsing. - Familiarity with cloud technologies, specifically AWS products such as S3 Storage. - Strong problem-solving skills and a can-do attitude, with the ability to develop solutions. Location: DBS Asia Hub Job: Technology Schedule: Regular Employee Status: Full time