From Tool-Hopping to Talking: Reimagining Datacenter Observability with NETRA
It’s 3:00 AM. The glare of a monitor cuts through a pitch-black room as a critical alert pierces your sleep. Seconds later, you’re locked in a familiar, exhausting ritual: eight browser tabs open, bouncing frantically from Grafana metrics to Loki log streams, then over to Jira…
From Experimentation to Scale: PhonePe’s AI Journey in HR
At PhonePe, our strategy for AI in HR was never about deploying a single, generic solution. Instead, we set out to build a fit for purpose ecosystem prioritizing speed, flexibility, and accuracy embedded directly into daily workflows. AI Readiness began before AI. We have been…
Zoomable RecyclerView: Enabling Pinch-to-Zoom and Panning in Android RecyclerViews
Introduction Android’s native RecyclerView is exceptionally efficient at handling large datasets through item recycling, but it lacks native support for spatial interactions like pinch-to-zoom and canvas-level panning. For complex layouts—such as interactive retail grids or…
Lens: Give Your Entire Team X-Ray Vision Into Your Android App
Lens lets your team see what is happening inside a running mobile app—from a normal web browser. You Know This Bug, Right? It is Friday afternoon. QA tells you that the profile screen is blank after login. You open the same app, follow the same steps, and everything works. The…
TraceMind: Automating the Chaos of Crash Debugging
The Debugging Dilemma: Why TraceMind? In a complex mobile ecosystem, debugging a single production crash is rarely a straightforward task. Historically, developers at PhonePe faced a fragmented landscape of data points. When a crash alert hit, an engineer would often spend…
From Gatekeeper to Strategic Catalyst: How GenAI is Transforming Compliance at PhonePe
India is undergoing a massive digital transformation, and at the heart of this revolution is PhonePe, enabling seamless payments and financial services for over 700 million registered users across Bharat. When you build at this kind of population scale, handling millions of…
How AI-Driven Automation is Scaling PhonePe’s Customer Support Framework
At PhonePe, we process a staggering 400 million transactions a day—amounting to over 10 billion monthly, operating at a scale that places it among the largest payment platforms globally. Managing such scale would typically require a massive customer support infrastructure for…
Engineering Agent Hub: How PhonePe Built a Production-Grade Internal AI Platform
Over the past couple of years, PhonePe’s journey toward operationalizing AI began with a search for external platforms capable of automating complex, cognitive business processes. However, as we tested various AI tools for our engineering and operational requirements, we…
When processing billions of transactions in a system as large as PhonePe, underlying databases go through constant querying, repairs and management. While a set of these tasks are automated, some are managed by human users. This leaves a potential risk of unauthorised/untracked…
Beyond IaC: Engineering a solution to Guarantee What Actually Is in Production
Infrastructure as Code (IaC) is often treated as the holy grail of Site Reliability Engineering (SRE). We use tools like SaltStack and Ansible, alongside golden images and post-install scripts, to define our ideal state. But here is the hidden secret of infrastructure…
Optimizing Merchandising: Machine Learning for Real-Time App Experience and LTV Maximization
At PhonePe Limited (“PhonePe”), the top banner on our platform’s homepage (the “masthead”) isn’t just an ad slot—it’s the important real estate we have. However, delivering real-time, personalized recommendations at a scale of hundreds of millions of users presents a complex…
Powering Real-Time Decisions with PhonePe’s Garfield Platform and Apache Druid
At PhonePe’s scale, handling millions of transactions and user interactions every hour requires an analytics platform that’s not just fast, but instant. When every millisecond counts — both for user experience and incident detection — batch processing simply doesn’t cut it.…
Pincode Migration Journey with Compose Multiplatform
In today’s diverse technological landscape, the ability to create applications that seamlessly operate across multiple platforms is a significant advantage. At Pincode, our seller app, was initially created using Android SDKs with Compose UI in Kotlin, and catered exclusively to…
Problem Statement PhonePe, as a payments platform, has an essential feature that allows users to check all past transactions. When payments are made to businesses/merchants, users have access to a historical view of all such transactions. For peer to peer transactions, however,…
In the early days of PhonePe, we started with just one application. Our pace was fast, almost like a race against time, and our initial engineers managed to keep things tidy. Colors, typography, and size constants were well-organized, ensuring a cohesive look and feel. Our small…
Vulnerability Management & Risk Scoring for Business Services
In the rapidly evolving FinTech sector, PhonePe Private Limited, an India-born leader in financial services, stands out for its innovative range of products and services. Offering everything from UPI transactions and bill payments to stock market investments, personal finance…
All an SRE needs to know : Automation ERA in Distributed Datastores
– Elasticsearch Upgrade for a cluster takes more than 10hrs by 2SREs manually and entails considerable back and forth. – SRE has automated the entire flow for rolling upgrades without downtime along with strict guardrails, killswitch, regular slack bots. – Automation has…
Virtual Machine Provisioning and Management in PhonePe
This blog post provides a high-level overview of PPeC (PhonePe Cloud) Agent’s architecture, its interaction with other key components like the PPeC API and PPeC Proxy, and how it optimizes tasks such as VM creation, resource allocation, and dynamic disk management. Evolution and…
Edge Framework: Powering On-Device ML for Smarter, Safer Experiences
In a world where every delivery is 2 minutes away, and every service is only a tap away, the need for devices to be smarter, faster, and more secure constantly is high. At the same time, users are more aware of their data privacy and expect seamless experiences without the lag…
Intro PhonePe’s apps have over 560m registered users, and are built by 250+ mobile engineers. The company ships 7 different apps (10, if you count Android and iOS separately). Operating at this scale, it’s been necessary to invest in and build a solid app platform. This blog…
Demystifying TStore: The Backbone of Billions of Transactions at PhonePe – Chapter 2
Chapter 2 : A Deeper Dive In chapter 1, we explored TStore’s functionalities like high-velocity ingestion, efficient reads, and flexible querying, its core concepts like Entities, Units, and Views and finally components like the Client Bundle, Schema Registry, Entity Ingestor…
Demystifying TStore: The Backbone of Billions of Transactions at PhonePe
Chapter 1 : Unveiling TStore Introduction You are standing in the queue at a billing counter of a grocery store, and when your turn comes, you bill your items and make a scanned payment using the PhonePe app. Typically, you witness the green screen instantly and the latest…
LiquidUI – PhonePe’s Server-Driven UI Framework – Part 2
In our previous blog, we explored the numerous benefits of using Server-Driven UI (SDUI) over traditional native approaches. We also briefly discussed the three core components of LiquidUI – Server Driven UI Framework at PhonePe.
As PhonePe continues to grow rapidly, the scale and reliability of our infrastructure becomes more important. By developing our own infrastructure, we’re able to adapt quickly while keeping our services reliable. In order to meet our deployment needs, we use specialized in-house…
Building the Pincode Android App on Jetpack Compose: A Journey
This blog narrates our team’s journey with Compose, detailing its inception at PhonePe, its adoption by the Pincode team, our experiences, and the challenges we faced. The Pincode Android app UI is built using Jetpack Compose. As of July 2024, the app has over 2.5 million…
Introducing LiquidUI – PhonePe’s Server-Driven UI Framework – Part 1
In the fast-paced world of digital payments, delivering seamless and dynamic user experiences across platforms is crucial. At PhonePe, we are excited to introduce LiquidUI, our in-house built Server-Driven UI (SDUI) framework.
Managing Elasticsearch at scale at PhonePe – Part 3
In this article, we will discuss the optimizations we did to reduce the footprints of our Elasticsearch. We optimized write throughput and reduced disk storage by leveraging query patterns and tuning indexing and doc_values for fields in elastic search.
Managing Elasticsearch at scale at PhonePe — Part 2
In the previous article, I provided a concise overview of PhonePe’s Elasticsearch architecture and outlined the diverse strategies employed to efficiently scale our cluster in order to manage millions of writes.
Managing Elasticsearch at scale at PhonePe — Part 1
Real time analytics platform at PhonePe handles more than 100 billion events a day. We store this data for approximately 30 days which is equivalent to almost 3 trillion events in the Elasticsearch cluster.
Enhancing Chat Performance on PhonePe Android: Strategies & Insights – Part 2
If you read our previous blog, we deep dive into how we optimized the chat experience performance via DB queries, protoBuf, and pagination. In the second part of the blog series, we shift our focus to CPU profiling and thread utilization.
Module Sandboxing: Elevating Security and Isolation Within App Ecosystem – Part 3
In the previous part, we delved into the different steps of achieving isolation between the module sandbox and the host app during the development phase.
Enhancing Chat Performance on PhonePe Android: Strategies & Insights
Have you ever used the PhonePe app to send money to a friend via their phone number? If you did, you’ve definitely come across the P2P flow. Read this blog to understand how we made one of the most important features of the PhonePe app faster by reducing latency significantly.
Clockwork: The Backbone of PhonePe’s 2 Billion Daily Jobs
Have you ever had an alarm fail to wake you up, causing a ripple effect of chaos in your morning? At PhonePe, we understand the criticality of such ‘alarms’ in our digital ecosystem. Take, for instance, our daily Merchant Settlements process. A merchant receives multiple…
Module Sandboxing: Elevating Security and Isolation Within App Ecosystem – Part 2
In the initial segment of this blog series, we explored the concepts of application and module sandboxing, identified scenarios that necessitate a module sandboxing solution, and highlighted its advantages.
Embracing SwiftUI: PhonePe’s journey building ONDC-powered Pincode
Setting context: Adoption of SwiftUI by PhonePe Since PhonePe’s inception in 2015, its mobile ecosystem has primarily consisted of the PhonePe app, the PhonePe Business app, and a payment gateway SDK for third-party apps. Over the years, we have managed to grow the PhonePe app…
The Kafka Edge: Managing 100 Billion Daily Events at PhonePe
Kafka, a distributed streaming platform, has become the backbone of PhonePe’s data infrastructure, enabling them to seamlessly handle the staggering flow of information.
Module Sandboxing: Elevating Security and Isolation Within App Ecosystem – Part 1
Module Sandboxing is a fundamental concept that fortifies application security by isolating it from the underlying operating system and other applications.
PhonePe’s Server State Management via Senzu and PIOUS: An Overview
Following up on the blog about PhonePe’s Internal Cloud Provisioning service, this blog addresses inventory addition flow management that makes it easier for the Procurement team, Site Operations (Siteops) team and the Tools team to track assets coming into our data centers,…
As PhonePe continues to scale, the tech that goes behind each division also needs to scale and meet the requirements of all stakeholders involved. Bullzeye addresses a few challenges faced in managing ads such as issues with scalability of reporting modules and frequency cap…
Building PhonePe’s Real-Time Transaction Model to prevent Frauds: A Journey
The Trust and Safety team at PhonePe are problem-solvers and a team of analysts, engineers, and product folks. They are the subject matter experts in this field who combine domain expertise, statistical knowledge, and computer science skills to solve various problems around…
Here’s everything you need to know about PhonePe’s Internal Cloud Provisioning service
PhonePe Cloud, commonly referred to as PPEC, is PhonePe’s internal cloud provisioning service that has, with many years of learning, adapted to its internal network architecture, as well as the way teams are set up and execute their daily work.
SecurEdge: The Linearly Scalable Edge Firewall Architecture for Data Centers
Background / Problem Statement: Being a Fin-Tech organization with payments as the core offering, at PhonePe we focus on securing our network perimeter with ultra-tight security measures. However, traditional approaches of implementing / securing the edge, like the one shown…
Engineering the product on Day 1 to handle hyper-growth in the future Every entrepreneur in the technology space, starts his or her journey with the dream of building a product or providing a solution that addresses a strong need, or solves a fairly pervasive problem using…
An Overview of Building the PhonePe App The PhonePe app has expanded from 0 to 150M+ in less than 30 months. Our app is growing uniquely in multiple dimensions. It’s not only adding more business-verticals, but every vertical is adding more features, which in turn are getting…
We recently welcomed our new batch of 25 engineers from premier institutes. Our fresh from campus hires, went through the coveted on-boarding program “Bootcamp 2019.” The Bootcamp saw them learn about server side architecture, the tech stack and the engineering design philosophy…
Building a highly scalable infrastructure to power Microservices Solving payments for the world’s largest democracy is not easy. Enabling access to payment as a first class service to applications, platforms and consumers in the most predictable, responsive and resilient manner…
As we complete three years and begin our fourth, I can’t help but feel proud of the immense success we have achieved with our product – over 150+ million users on our platform have translated into 50+ million daily app sessions, totaling an incredible 500,000 hours on PhonePe…