Streaming Platform Developer (Apache Kafka)
EJADAJob Description
Job Purpose: The Kafka Streaming Platform Developer is responsible for designing, developing, and maintaining real-time streaming data solutions using Apache Kafka and related technologies. The role enables reliable, scalable, and low-latency data integration across enterprise systems by building event-driven architectures, stream-processing applications, and real-time data pipelines that support analytics, operational, and business-critical use cases. Key Accountabilities: - Design, develop, and maintain real-time data streaming solutions using Apache Kafka and related ecosystem components. - Build and support Kafka producers, consumers, and stream-processing applications using industry best practices. - Develop event-driven integration solutions to facilitate real-time data exchange across enterprise platforms. - Implement and maintain Kafka Connect integrations with databases, applications, cloud services, and enterprise platforms. - Design and manage data contracts, schema governance, and serialization standards using Schema Registry, Avro, and Protobuf. - Develop stream-processing use cases including real-time enrichment, transformation, aggregation, filtering, and analytics. - Integrate Kafka with data platforms, cloud services, and Change Data Capture (CDC) solutions. - Collaborate with architects, administrators, developers, and business teams to define streaming requirements and integration strategies. - Optimize streaming application performance, scalability, fault tolerance, and reliability. - Perform troubleshooting, root cause analysis, and production support activities for streaming applications. - Implement CI/CD practices, automated testing, and deployment pipelines for data streaming solutions. - Participate in code reviews and ensure adherence to development standards and security requirements. - Maintain technical documentation, integration specifications, and operational procedures. - Contribute to continuous improvement initiatives related to data engineering, streaming technologies, and platform modernization. Minimum Qualifications: - Bachelor's Degree in Computer Science, Software Engineering, Computer Engineering, Information Systems, or a related field. - Confluent Certified Developer for Apache Kafka or equivalent certification. - Additional certifications in Data Engineering, Cloud Technologies, Kubernetes, or Software Development. Minimum Experience: - +4 years of software development experience. - Hands-on experience developing real-time streaming solutions using Apache Kafka. - Experience building and supporting enterprise integration and event-driven architectures. - Experience working within banking, financial services, fintech, telecommunications, or other highly regulated environments is preferred. - Experience developing and supporting production-grade distributed systems and data pipelines. Job-Specific Skills: - Apache Kafka Development. - Kafka Connect. - Kafka Streams. - ksqlDB. - Confluent Platform. - Schema Registry. - Event-Driven Architecture. - Real-Time Data Streaming. - Change Data Capture (CDC). - Debezium. - Java, Scala, or Python Development. - REST API Development and Integration. - Avro, Protobuf, and JSON Serialization. - Data Integration and Messaging Patterns. - Microservices Architecture. - Apache Cloudera and Enterprise Data Platforms. - Cloud Data Services (AWS, Azure, or GCP). - CI/CD Tools and DevOps Practices. - Git Version Control. - Docker and Kubernetes. - Troubleshooting and Performance Tuning. - Application Monitoring and Root Cause Analysis. - Data Pipeline Design and Optimization.
Similar jobs
- Streaming Platform Administrator (Apache Kafka)
EJADA · Riyadh, Saudi Arabia