Kafka Engineer

Job Description

Job Description

Support the architecture team in designing and validating an event-driven integration model using Apache Kafka. This role focuses on PoC development, schema design, and end-to-end messaging flows across PFS layer and backend systems.

Key Responsibilities

1. Evaluate current data flows and recommend Kafka topic structure and partition strategy.
2. Design event schemas (Avro/JSON) and data contracts between microservices.
3. Build PoC to demonstrate real-time communication between mobile, PFS, and backend systems.
4. Implement message delivery guarantees, error handling, and retry mechanisms.
5. Work with Platform Architect to ensure events align with API contracts and security requirements.
6. Document Kafka design patterns and operational runbook for future implementation.

Required Skills & Experience

1. 8–10 years in integration engineering with at least 3–5 years hands-on Kafka experience.
2. Strong in Kafka Core, Connect, Schema Registry, Streams, and KSQL.
3. Experience with AWS MSK and event-driven microservices.
4. Understanding of CDC patterns and real-time integration across retail systems.
5. Familiarity with PFS architecture concepts (to integrate streaming with API layer).
6. Comfortable building lightweight PoCs and documenting results for architecture reviews.

Nice to Have Skills

1. Experience in an agile development environment.
2. Understanding of CI/CD workflows.
3. Retail Knowledge will be added advantage.