Data Science

Analytics, experimentation, data platforms and pipelines.

754 stories

Compass: an AI navigation agent for everyone
Groww

You already have the data. Compass is how everyone asks it. You already know the question. What was DAU today? What’s the order’s success rate over the last few months? How many new users did X and Y, and are they sitting at the stage of doing Z? This escalation just landed.…

Search That Gets You: Inside Instamart’s LLM-Powered Search
Swiggy

How large language models help shoppers find what they mean, not just what they type. Author: Aarav Nigam Introduction Every search box eventually hits a wall where traditional search stops being useful. Searching tide powder 100g on Instamart works seamlessly. Exact keywords…

Nobody Knows What's in the Wire: How Groww Moves Money Between India and Wall Street
Groww

How Groww tracks cross-border payments between India and the US, ensuring every dollar is accounted for. Author: Aditi Gour Introduction Every business day, SWIFT wires cross between India and the US, and each one carries many people's money in a single lump. Deposits travel out…

How We Deploy Reliably at Razorpay
Razorpay

Most production incidents do not begin with a server dying. They begin with a deployment: dozens a day, across hundreds of services, each the moment risk enters the system. We run payments infrastructure at Razorpay. When a payments system degrades, transactions fail: merchants…

Inside Razorpay’s RTO Model: The Engineering Behind its ML Lifecycle
Razorpay

Contributor: Abhik Debnath In this article, we use Razorpay’s Return to Origin (RTO) risk model to explain the ML lifecycle: how we build a reproducible release, deploy it into checkout, monitor its behaviour, and use later outcomes to evaluate whether it needs retraining. We…

Cost-Optimized Kafka Architecture on GCP Storage Pools
Groww

This article explains how multiple Kafka clusters went on a storage diet when we moved from a traditional fixed-cost disk architecture to a Storage Pool model. We will follow Kafka from its recovery and performance requirements through Strimzi KafkaNodePools, zonal placement,…

Building Scalable Real-Time Live Streaming Systems
Walmart Global Tech

Synchronizing Video, Audio, Whiteboard Events, and Distributed Backends at Scale What happens when thousands of students join a live classroom, rewind a lecture by 30 seconds, and still expect the teacher’s whiteboard drawings, voice, and video to remain perfectly…

Kafka Inconsistencies and the Silent Failures Behind Real-Time Decision Platforms
Walmart Global Tech

A field guide to the duplicate events, stale state, rebalances, and deployment traps that quietly distort real-time decisions — told through one decision that should have fired and didn’t. Note: This piece assumes working familiarity with Kafka and event-streaming fundamentals —…

Migrating Swiggy Partner App’s Deep Link Engine at Scale
Swiggy

The OS decides whether your app may open a URL — before any of your code runs. We swapped the SDK underneath that, without republishing the links we already owned.A partner taps a link in an SMS, a push, a share sheet — and lands on the exact screen they needed. We changed the…

Compass: an AI navigation agent for everyone
Groww

You already have the data. Compass is how everyone asks it. You already know the question. What was DAU today? What’s the order's success rate over the last few months. How many new users did X and Y, and are they sitting at the stage of doing Z? This escalation just landed.…

Five Years of Kafka at Razorpay’s UPI Switch
Razorpay

Preface The UPI Switch at Razorpay has evolved significantly in the five years since we started building it. The Switch is the platform that enables real-time payment processing with NPCI. When the team began, it was little more than an idea. Today it powers more than 70% of…

Stop Reacting to Data Problems. Here’s the Architecture That Prevents Them.
Walmart Global Tech

Coauthored by Satyajeet Coordinating Data Evolution at Enterprise Scale When you operate data platforms on a global enterprise scale, hundreds of engineering teams ship improvements every week, each moving independently to deliver value at the pace of the business demands. This…

Holding Revamp Went Live. Then Reality Check Hit Hard
Groww

Introduction In the previous article, we shared how we redesigned Holdings retrieval to eliminate unnecessary work. The architecture looked solid, and the rollout was ready. Then we deployed it. With millions of users accessing Holdings every day, the rollout looked healthy…

CI Doesn’t Need On-Demand: Moving Our Build Pipelines to Spot Instances
Razorpay

Contributors: Guptaanuj CI/CD pipelines have always had a money-vs-stability problem. Run on-demand AWS instances and your build infrastructure is rock solid, expensive, and predictable. Run on spot instances and your costs drop 70–90%, but AWS can pull the rug with 2 minutes of…

LLMs for Relevance: Automating High-Quality Product Relevance Labeling in Flipkart Search
Flipkart

Amey Patil , Shreya Malani· November 2025 Every product you see on a Flipkart search results page is there because a system decided it was relevant to what you typed. But how do we know those decisions are good? Someone — or something — has to look at a query and a product and…

blog.flipkart.tech
Refusing the Haystack: How Groww’s Cyber Defence Team Scales Detection and Response
Groww

There’s a version of a security operations centre that exists mainly to be pointed at. It ingests every log it can reach, lights up a wall of dashboards, and staffs a rotation around the clock so that, if anyone asks, the answer is “yes, someone is watching.” It satisfies an…

Decoding Customer Value: pLTV Models for India’s Quick Commerce Delivery Wars — part 1
Swiggy

Author: Jayshmi A Special thanks to soumyajyoti banerjee , Meghana Negi, Shaik Masihullah, Akash Deep for their contributions throughout this project and Sunil Rathee for his guidance. The counterintuitive story of how 350+ carefully engineered features + a simple MLP matched…

DE Dost: Teaching Machines to Be a Friend on the Last Mile
Swiggy

Building Swiggy’s AI onboarding companion for delivery executives, where accuracy alone wasn’t enough and mentorship had to scale.For a new Delivery Executive (DE) joining Swiggy, the experience is often overwhelming, throwing a world of SOPs, incentive structures, zone…

How We Made All Swiggy Apps Operations AI-Native
Swiggy

Engineering across all Swiggy Apps has always had a simple problem with a very large surface area: we ship fast, but every release, every production signal, and every operational review touches too many systems. For a single release manager or on-call engineer, the day could…

How We Refresh Razorpay's Data Warehouse 10x Faster with Graphs and Indexes
Razorpay

Contributors: Utkarsh Koppikar Rohan Background Razorpay provides the payment infrastructure for millions of merchants globally. Behind every payment, settlement, and refund is a microservices architecture where each service owns its own database. While this keeps services…

Improving the Efficiency of Rendering User Holdings
Groww

Introduction At 9:15 AM IST, the opening bell rings on the Indian stock market — and millions of investors reach for the same screen. Within seconds, millions of investors open the Holdings page. They want to know how overnight news has impacted their stocks, whether they’re in…

Running Hermes at Razorpay: a Network-isolated, Self-improving “Second Brain” for every Employee
Razorpay

How we run a personal AI agent for everyone at Razorpay: always on, multi-model, and safe by construction. Contributors: Siddharth Tripathi Today, more than 220 Razorpay employees each have their own always-on AI agent. On a typical day, about 84 of them are actively working.…

How Swiggy Saved 3.7 MB by Solving a Vector Drawable Mystery
Swiggy

🎭 The Mystery Begins Picture this: You’re a responsible Android developer. You’ve done everything right. You’ve replaced those bulky PNGs with lighter, elegant, scalable SVGs. You’ve patted yourself on the back. You’ve probably even tweeted about it. Then one day, you open the…

How Swiggy Migrated from protobuf-java to Square Wire
Swiggy

At Swiggy, we use Protocol Buffers everywhere. Nearly every message exchanged between our backend services and our mobile apps is a protobuf. On Android, the default and most widely adopted way to work with those schemas was protobuf-java, Google’s official Java runtime, with…

Scaling Android CI: From 44 → 10 minutes — A Deep Dive into Build Time Optimization and Best…
Swiggy

Scaling Android CI: From 44 → 10 minutes — A Deep Dive into Build Time Optimization and Best Practices Android monorepos get expensive and slow as they scale. We re-architected CI/CD caching, trimmed the Gradle graph, tuned the JVM, modernized the toolchain, and finally moved to…

Nostalgia, Coupons, and a State Machine: The Swiggy Mother’s Day Story
Swiggy

You did something wrong as a kid. You knew you weren’t supposed to. And somewhere in the house, your mom just found out. Your heart is going faster than it ever has. You’re calculating exit routes. And then you hear it: the slap of a chappal being picked up. You’ve accepted your…

SpectrePaste
Walmart Global Tech

by Joshua Platt and Jason Reaves [TLP:CLEAR] Earlier this year, Google Threat Intelligence[1] reported threat actors are increasingly deploying novel, AI-enabled malware in active operations[2]. While investigating a recent OSINT article[3] on malware campaign activity reported…

How a Custom Keyboard Transformed Our App Experience
Groww

Author: Nishant Kumar Delivering a seamless, fast, and reliable user experience is at the core of everything we do at Groww. In trading and investing, every second and every user action counts, so optimising even the smallest interface element can make a meaningful difference.…

Turning Scattered Data Into Queryable Segments at Scale: How Razorpay Built Its Customer Data…
Razorpay

Turning Scattered Data Into Queryable Segments at Scale: How Razorpay Built Its Customer Data Platform A consent-native CDP that serves audience segments across 500M+ user profiles in under 30ms, with PII isolated to the source systems. The Problem We Were Solving A customer…

MetaStealer traffic, new DGAs and analyzing the “tracker” backdoor DGA with AI
Walmart Global Tech

By: Jason Reaves and Joshua Platt In this blog we simply want to highlight a few new additions to what appears to be related to MetaStealer, one is a new wordlist based DGA used by MetaStealer. We also want to highlight that MetaStealer’s proxies or ‘gates’ don’t actually care…

One RecyclerView to Rule Them All — Custom LayoutManager for Option Chain : Pt 1
Groww

Quick primer for non-traders: an option chain is the core screen option traders live on. The middle column is a list of strike prices (the price at which a contract can be exercised). To the left sit the Call contracts for each strike (used to bet on the price going up); to the…

From Build to Adoption: A Playbook for Driving Platform Migration
Walmart Global Tech

What 18 months of building an internal platform — and driving tenant adoption — have taught me. The common mistakes, and six phases for doing it right. The strange quiet after launch Six months after we built and launched an internal platform, I thought adoption would be easy.…

From Rigid Rules to Empathetic Agents: Rebuilding Swiggy’s Order Cancellation Experience with LLMs
Swiggy

IWTCIntroduction If you have ever typed “I want to cancel my order” into a support chat, you were probably not looking for a workflow. You were looking for clarity, speed, and some assurance that the platform understood what had gone wrong. At Swiggy, this seemingly simple…

Explaining Every Rupee: How We Built Reliable LLM Support Bots for Delivery Partners
Swiggy

The Problem A Delivery Executive (DE) finishes their day, opens the app, and expects a clear breakdown of what they earned. Instead, they often see a payout that does not fully match their expectations — an incentive missing, a deduction they do not recognise, or a credited…

Teaching a Geocoder What Every Delivery Agent Already Knows
Meesho

This is Part 2 of our GeoIndia series, which follows Part 1’s introduction of GeoIndia, the Seq2Seq model that converts messy Indian addresses into precise map locations. In this post, we go one level deeper: what we learned from running GeoIndia in the wild, and how that pushed…