Data Science

Analytics, experimentation, data platforms and pipelines.

754 stories

Teaching a Machine to Read Indian Addresses: How We Built GeoIndia
Meesho

GeoIndia: A Seq2Seq Geocoding Approach for Indian Addresses Download to access the research paper GEOINDIA_V1.pdf 5 MB download-circle Type an address into any major mapping service and you'll get a pin dropped on a map in seconds. It feels effortless. But under the…

The Pulse of India’s Supply Chain: How Flipkart Plans for 500 Million Customers — Part 1
Flipkart

In the world of e-commerce, a click of a “Buy Now” button starts an invisible race. Across India (metro cities or remote villages) millions of customers expect their packages to arrive with a speed that feels like magic. But behind that “magic” is a monumental logistical puzzle.…

blog.flipkart.tech
When Graphs Aren't Enough: How We Used Hypergraph Neural Networks to Predict Return-to-Origin at Meesho
Meesho

A Dual Perspective Hypergraph Neural Networks Download to access the research paper DPHGNN.pdf 2 MB download-circle Every e-commerce company has a version of this problem: an order gets placed, the delivery is attempted, and the package comes back. Return-to-Origin, or…

Razorpay Oncall Agent: From 30-Minute Investigations to 90-Second AI Analysis
Razorpay

Our on-call engineers were spending 30 minutes investigating every production alert. Here’s what happened when we automated it. At 3 AM, alerts don’t care about your sleep schedule. When our payment infrastructure threw an error last month, our on-call engineer spent 32 minutes…

From Products to Inspiration: Inside the Engine of Occasion-based outfit visualiser
Myntra

Ankit Kumar | Oct 2025 · 6 min read The “Why”: Moving Beyond the Grid Picture this: A white background. A shirt. Fabric details. Fit specs. A price tag. For decades, this has been the status quo of online shopping. It is clinical, clear, and — let’s be honest — completely…

The Race Against the Clock: Optimizing Supply Chain Capacity for Faster Deliveries — Part 1…
Flipkart

The Race Against the Clock: Optimizing Supply Chain Capacity for Faster Deliveries — Part 1 (Capacity Management Series) In the hyper-competitive landscape of online retail, delivery speed is often the sole differentiator between a confirmed sale and an abandoned cart. For…

blog.flipkart.tech
Shub Stealers Fake Crypto Apps
Walmart Global Tech

By: Jason Reaves Shub Stealer[1] which looks very similar to MacSync also leveraged the same obfuscator on their shellscript[2] that is very popular lately. Shell script: fd674425d3fc0d95bbc90dcd598eabdb2ddd77037954c8a1d1175f118d1e8dddAfter decoding however it is a bit different…

Mapping Ottercookie Infrastructure
Walmart Global Tech

By: Jason Reaves A lot of focus specifically surrounding DPRK has been on IT workers but there are multiple entities performing various schemes. One of the more prolific ones being interviewing developers and having them work on TA supplied code repositories from various sites.…

Building a Multi-Provider Rewards Platform: An E-Commerce Approach to Rewards at Scale
Razorpay

We built a multi-provider rewards platform using e-commerce patterns. Here’s why that matters. You’re running a loyalty program. Customers are redeeming points for gift cards, ongoing offers, memberships, or experiences. Then your provider’s API times out. You refresh. Try…

From Single Instance to Split-Brain: A Database Scaling Journey
Walmart Global Tech

I used to think adding a ‘Read Replica’ was a magic button for scaling applications. I was wrong. While splitting read and write traffic is a standard system design pattern, implementing it introduces a world of pain – from stale reads to the dreaded Split-Brain problem. Here is…

Revamping Myntra App Analytics persistence with KMP and SQLite
Myntra

Introduction In the dynamic landscape of e-commerce, data is the bedrock of decision-making, and app stability is the foundation of user experience. At Myntra, where millions of users engage with our platform daily, ensuring the reliability of both is paramount. This necessity…

Processing Millions of Records Using Spring Batch
Groww

In financial systems, a lot of critical work happens quietly after market hours. Once the stock market closes, exchanges share multiple large files with brokers. These include trade files, contract details, holding updates, and daily charges. These files contain thousands, and…

Rewriting Legacy Systems: The Safe and Calm Way
Groww

Author: Rijul Gupta In a fast-growing product company, engineering teams are expected to move quickly and ship confidently. Even with solid engineering practices, every mature system reaches a stage where the cost of change rises steadily — both in terms of risk and time to…

How Preview Environments Transformed Frontend Delivery at Freshworks Analytics
Freshworks

“If you can test it before you merge it, you can trust it when you ship it.” by Arvindan Frontend teams typically are efficient if they handle PR in different manners. Classical PR reviews slow down when reviewers can’t open the change in the browser and try it like an end user.…

Modularizing SOLR Query Creation for Multi-Market Scale
Walmart Global Tech

Introduction When the SOLR query logic expanded into a 12,000-line monolithic implementation, each modification introduced significant risk, making every change feel akin to defusing a critical system. Adding a market-specific override required yet another if block, compounding…

White Paper on Data Science Technical Program Management
Walmart Global Tech

1. Abstract Managing Data Science programs requires a structured approach to handle the complexities of data, model development, and business alignment. This whitepaper provides a comprehensive guide on the effective program management of Data Science programs by technical…

Mastering Cloud Cost Optimization: Lessons from Scaling Trino, Spark and S3
Slice

Cost management is a critical factor in the implementation and maintenance of a data platform, as it often accounts for a significant share of an organization’s overall infrastructure costs and must consistently deliver strong return on investment. As data platforms scale to…

slice-engineering.medium.com
Modernizing Events Platform At ShareChat
ShareChat

At ShareChat’s Central Data Platform (CDP) team, we cater to more than 1000 different event types from 5 different apps, receiving and ingesting more than 80 billion events per day on a regular basis.

Our Obsession with Merchant Experience: Breaking the Risk Review Black Box
Razorpay

Contributor : Yashshree Shinde When merchants couldn’t see why their funds were on hold, trust broke down. Here’s how we rebuilt the entire experience. You’ve shipped your products, paid your delivery partners, and you’re waiting for settlement. Then you receive a notification:…

Inside Meesho’s Real-Time Analytics Platform: A Deep Dive into Driving Performance at Scale
Meesho

At Meesho, we are constantly striving to understand our users better and enhance their experience. Every day, users can generate billions of events on our platform from browsing products to completing purchases and we aim to translate these signals into insights instantly. From…

Keeping Java as the Core, Python to Lead Agentic Systems
Walmart Global Tech

We’ve been a Java shop for years, and now agentic AI demands us to rethink. How I got here? I’ve been in the Java world for more than 30 years. Java has been my default answer to “what should we build this in?” for most of my career. I’ve seen it grow from applets and early web…

APACHE SPARK OPTIMISATIONS
Flipkart

Context Ambitious goal and the scope of the problem We were chasing a critical, futuristic business requirement for our big data pipelines achieving “1-day planning,” defined as a total execution window of 24 hours or less. The entire process is extensive, processing a 7TB data…

blog.flipkart.tech
Beyond the Context Window: A New Approach to Summarizing Big Data
Flipkart

Image Source: Google Nano BananaTL;DR LLMs struggle to summarize the thousands of reviews for a single product because of context window limits and conflicting opinions. The proposed solution, XL-OPSUMM, is a scalable framework that summarizes reviews incrementally (in chunks)…

blog.flipkart.tech
Powering Real-Time Decisions with PhonePe’s Garfield Platform and Apache Druid
PhonePe

At PhonePe’s scale, handling millions of transactions and user interactions every hour requires an analytics platform that’s not just fast, but instant. When every millisecond counts — both for user experience and incident detection — batch processing simply doesn’t cut it.…

Choosing between Maestro and Detox on Jupiter | QA Automation
Jupiter Money

Choosing between Maestro and Detox for our app QA Automation needs At Jupiter, we continuously strive to deliver a seamless and reliable experience to our users, which makes testing a critical part of our development process. Shipping high-quality mobile apps is brutal with…

Building Meesho's ML Platform: Scaling Model Inference & Real-Time Embedding Search (Part 3)
Meesho

By mid-2023, we had transformed our ML stack—building a real-time feature store, optimizing model retrieval, and fine-tuning ranking. But two critical gaps remained: 🔹 Scaling model inference without hitting infrastructure roadblocks 🔹 Moving embedding search from batch to…

Building Meesho’s ML Platform: Lessons from the First-Gen System (Part 2)
Meesho

By late 2022, we had built something we were truly proud of—a real-time ML serving system with a DAG-based executor, a feature store, and an interaction store powering key ranking and personalization models. It was a major milestone, the culmination of months of effort from data…

Enhancing Myntra App performance: Transitioning from GIFs to Videos
Myntra

Introduction In the fast-paced world of e-commerce, every millisecond and every pixel counts. At Myntra, where visual content drives discovery and engagement, we embarked on a critical mission: to revolutionise how animations are delivered in our Android and iOS apps. This…

Evolving Search Ranking: From XGBoost to Multi-Task Deep Learning with Knowledge Distillation
Meesho

Search at Meesho For an e-commerce platform like Meesho, optimizing Search is pivotal to enhancing the user experience, improving product visibility and faster discovery, and eventually increasing conversion rates. Users search in multiple Indian languages looking for quality…

Personalization from Day One: Solving the Cold Start Problem at Meesho
Meesho

New users rarely give second chances. If their first experience on the app, especially the homepage product feed, feels irrelevant then they leave quickly. At Meesho, we noticed that our static homepage product feed for new users was causing high bounce rates and a poor first…

Quality Focused Feed Re-ranking
Meesho

What is Feed Re-ranking? Online shopping platforms face intense competition, where the ability to deliver the most relevant products to customers is crucial. A well-organized and relevant product feed, which inherently is a list of products, forms the backbone of any E-commerce…

Building Meesho’s ML Platform: From Chaos to Cutting-Edge (Part 1)
Meesho

The Genesis: How a Friday Night Roast Sparked Meesho’s ML Platform It all started in early 2022, over a casual Friday evening catch-up. Like many great origin stories, this one began with friendly banter between a group of backend engineers and data scientists. As the…