Staff Engineer - Kafka Codebase and Internals
Job Description
Company Description
Our goal is to make digital payments so easy, safe and universally accepted that people never feel the need to carry cash or cards again. We believe India is at the cusp of a new mobile revolution, which will change the way we manage our money on the go. We see ourselves facilitating this change, through technology and dogged customer centricity.
At PhonePe, we take extra care to make sure you give your best at work, Everyday! And creating the right environment for you is just one of the things we do. We empower people and trust them to do the right thing. Here, you own your work from start to finish, right from day one.
Being enthusiastic about tech is a big part of being at PhonePe.
If you like building technology that impacts millions, ideating with some of the best minds in the country and executing on your dreams with purpose and speed, join us!
Job Description
About the Role
We are building an in-house team to maintain and contribute to our internal Apache Kafka distribution. This is not an operations role — you will work on the Kafka codebase itself: the broker, the KRaft controller, the protocol, the clients, and the storage layer. You will be our technical anchor for all things Kafka internals, driving upstream contributions, backporting critical fixes, and shaping our internal distribution to meet the needs of a large-scale production fleet.
We already do this successfully with GlusterFS, where we maintain an in-house distribution backed by deep upstream expertise. We want to replicate that model for Kafka.
Key Responsibilities
- Own our internal Kafka distribution: branch management, patch curation, release cutting, upgrade planning
- Contribute upstream to Apache Kafka — bug fixes, KIPs, code reviews, design discussions
- Diagnose and fix deep broker/controller issues: replication, partition reassignment, KRaft consensus, log storage, ISR management, protocol handling
- Build custom patches for production needs that aren't suitable for upstream (performance tuning for our workload profile, observability hooks, operational safety valves)
- Establish engineering practices for Kafka development within the team: how we test, how we benchmark, how we validate patches before rolling them out
- Mentor a supporting engineer and grow the team's capability over time
- Act as the internal authority on Kafka internals — advise platform teams on configuration, capacity planning, and architectural decisions that require knowledge of broker behavior
- Act as the primary interface for audit and compliance teams, ensuring PhonePe Kafka distribution meets various compliance and regulatory standards
Qualifications
What are we looking for?
- Deep familiarity with the Kafka codebase — you have read, modified, and debugged the broker, controller, or client internals. Not just operated Kafka, but worked on it.
- Track record of upstream contribution — committed patches, participated in KIP discussions, reviewed PRs, or equivalent engagement with the Apache Kafka community. Active committer/PMC status is strongly preferred but not strictly required if your contribution history demonstrates equivalent depth.
- Strong distributed systems fundamentals — consensus protocols, replication, exactly-once semantics, log-structured storage, distributed state machines. You understand these not as buzzwords but as engineering tradeoffs you've navigated.
- Systems-level programming comfort — JVM internals (GC tuning, memory layout, JIT behavior), OS-level I/O (page cache, fsync semantics, zero-copy), networking (TCP tuning, socket buffers). Kafka performance work lives at this layer.
- Experience maintaining a fork or distribution — you've managed the tension between carrying local patches and staying mergeable with upstream. You know what it costs to diverge and how to minimize that cost. •
- 8+ years of experience in systems/infrastructure software engineering, with a meaningful portion spent on Kafka or comparable distributed systems (Pulsar, Bookkeeper, Zookeeper, etcd, CockroachDB, etc.)
Additional Information
Good to have
- Apache Kafka Committer or PMC member
- Experience with KRaft (the ZooKeeper-free controller)
- Authored or co-authored a KIP
- Experience with Kafka Streams or Kafka Connect internals (not just usage)`
- Familiarity with Kafka's test infrastructure (system tests, Trogdor, ducktape)
Active jobs at PhonePe
About us
PhonePe is India's largest digital payments platform and a Bengaluru-headquartered financial-services group. Founded in 2015 by Sameer Nigam, Rahul Chari and Burzin Engineer, it launched the PhonePe app on 28 August 2016 and built it around UPI payments.
Since then PhonePe has expanded beyond payments into insurance, lending, wealth (PhonePe Invest, including mutual funds and gold), merchant solutions such as its payment gateway and offline payment devices, and the PhonePe Appstore. The company, now PhonePe Limited, operates from its Bengaluru registered and corporate office and a network of 118 offices and facilities across 54 Indian cities, and had 12,338 employees as of 30 September 2025.
Benefits & perks
- Medical, accidental and life insurance
- Leave policy and career break policy
- Primary and secondary caregiver benefits, adoption assistance and day-care support
- PF, flexible PF, gratuity, NPS and leave encashment
- Employee Wellbeing Assistance Program, onsite medical center and emergency support
- Learning Assistance Program
- Car lease program and salary advance policy
- Referral policy
Why explore a career with us
Autonomy: Work with a sense of ownership, while taking decisions to accelerate results.
Learning built into daily work: Impactful, accessible learning through PhonePe University and Manager Development Programs.
Impact at India scale: Work to make a difference at India's largest digital payments platform.
High trust, no politics: PhonePe does not tolerate politics, shares data and learnings openly, and never says 'this is not my job'.
A real community: Hackathons, dance, music, quiz and book clubs, a Midnight Marathon, Sports Fest and Carnivals.
Interview process
Summary based on PhonePe's published statements: the process varies by role.
Role-based process: The selection process varies from role to role and is holistic and multidimensional.
Cross-functional panel: Every candidate meets a cross-functional team to ensure the right fit.
Competency-based rounds: Each round assesses competencies the interviewers agreed on in advance.
Design roles: A portfolio review, then rounds with future colleagues including technical, whiteboarding and craft sessions.
First week: After joining, a guided first week with a buddy or mentor and a manager check-in.
Company stack
Java, Dropwizard, Kotlin, Jetpack Compose, Swift, Go, Python, Kafka, HBase, Aerospike, Apache Druid, Docker
Company media gallery
Life at PhonePe — office, team & culture.

Your go-to guide for career, growth, and mentorship. Real insights from founders, Leaders, Industry Experts & CXOs to land dream jobs and win big.





