AI & ML

Machine learning, LLMs, recommendations and applied AI.

107 stories

Search That Gets You: Inside Instamart’s LLM-Powered Search
Swiggy

How large language models help shoppers find what they mean, not just what they type. Author: Aarav Nigam Introduction Every search box eventually hits a wall where traditional search stops being useful. Searching tide powder 100g on Instamart works seamlessly. Exact keywords…

Inside Razorpay’s RTO Model: The Engineering Behind its ML Lifecycle
Razorpay

Contributor: Abhik Debnath In this article, we use Razorpay’s Return to Origin (RTO) risk model to explain the ML lifecycle: how we build a reproducible release, deploy it into checkout, monitor its behaviour, and use later outcomes to evaluate whether it needs retraining. We…

Scaling ML Model Inference through architectural separation
CRED

The model is only one part of the inference pipeline. At scale, the work happening around it, from routing requests to coordinating downstream dependencies, can have a much bigger impact on latency and efficiency. We addressed this by separating model execution from request…

engineering.cred.club
From Gatekeeper to Strategic Catalyst: How GenAI is Transforming Compliance at PhonePe
PhonePe

India is undergoing a massive digital transformation, and at the heart of this revolution is PhonePe, enabling seamless payments and financial services for over 700 million registered users across Bharat. When you build at this kind of population scale, handling millions of…

Explaining Every Rupee: How We Built Reliable LLM Support Bots for Delivery Partners
Swiggy

The Problem A Delivery Executive (DE) finishes their day, opens the app, and expects a clear breakdown of what they earned. Instead, they often see a payout that does not fully match their expectations — an incentive missing, a deduction they do not recognise, or a credited…

Finding the Needle in the Stack: How We Built Khoj.AI for Automated Root Cause Detection
Meesho

Part 1 of a multi-part series. A quick note before we begin: the first chapter of Khoj.AI was built before the generative AI wave really took off, so some early choices reflect the tooling of that time. This post walks through how the system has evolved over the last 1 year,…

Modernizing Events Platform At ShareChat
ShareChat

At ShareChat’s Central Data Platform (CDP) team, we cater to more than 1000 different event types from 5 different apps, receiving and ingesting more than 80 billion events per day on a regular basis.

Optimizing Merchandising: Machine Learning for Real-Time App Experience and LTV Maximization
PhonePe

At PhonePe Limited (“PhonePe”), the top banner on our platform’s homepage (the “masthead”) isn’t just an ad slot—it’s the important real estate we have. However, delivering real-time, personalized recommendations at a scale of hundreds of millions of users presents a complex…

Building Meesho's ML Platform: Scaling Model Inference & Real-Time Embedding Search (Part 3)
Meesho

By mid-2023, we had transformed our ML stack—building a real-time feature store, optimizing model retrieval, and fine-tuning ranking. But two critical gaps remained: 🔹 Scaling model inference without hitting infrastructure roadblocks 🔹 Moving embedding search from batch to…

Building Meesho’s ML Platform: Lessons from the First-Gen System (Part 2)
Meesho

By late 2022, we had built something we were truly proud of—a real-time ML serving system with a DAG-based executor, a feature store, and an interaction store powering key ranking and personalization models. It was a major milestone, the culmination of months of effort from data…

Evolving Search Ranking: From XGBoost to Multi-Task Deep Learning with Knowledge Distillation
Meesho

Search at Meesho For an e-commerce platform like Meesho, optimizing Search is pivotal to enhancing the user experience, improving product visibility and faster discovery, and eventually increasing conversion rates. Users search in multiple Indian languages looking for quality…

Building Meesho’s ML Platform: From Chaos to Cutting-Edge (Part 1)
Meesho

The Genesis: How a Friday Night Roast Sparked Meesho’s ML Platform It all started in early 2022, over a casual Friday evening catch-up. Like many great origin stories, this one began with friendly banter between a group of backend engineers and data scientists. As the…

Cost-effective Inference for Ranker Models
ShareChat

Modern recommender system models can be very compute- and memory-intensive and expensive to serve. In this post, we’ll go over some of the things we did at ShareChat to make our inference more cost effective.

Size Recommendation System at Myntra
Myntra

In recent years, online shopping has surged, revolutionizing how people purchase products and services. E-commerce’s convenience has reshaped consumer behaviour and the retail landscape. Unlike traditional stores, online shoppers often face sizing challenges, leading to…