War stories of scaling to millions and billions.
This is Part 2 of our GeoIndia series, which follows Part 1’s introduction of GeoIndia, the Seq2Seq model that converts messy Indian addresses into precise map locations. In this post, we go one level deeper: what we learned from running GeoIndia in the wild, and how that pushed…
The concept of hackathons is well-established and has proven to be very popular among tech enthusiasts across India. These intensive two or three-day events bring people together who are passionate about technology to work on software-related challenges, often provided by…
Imagine you're a seller on Meesho. You shipped a bedsheet. A few days later, a return arrives at your door. You open it and find a bar of soap. What comes back isn't what was shipped. The seller is left with dead inventory, and to be compensated, they have to prove what went…
There's a moment every HR professional knows well. It's 2:30 on a Monday, you're mid- way through something that actually matters, and someone pings you asking what the casual leave policy is. You answer. An hour later, someone else asks the same thing. This isn't a failure of…
When processing billions of transactions in a system as large as PhonePe, underlying databases go through constant querying, repairs and management. While a set of these tasks are automated, some are managed by human users. This leaves a potential risk of unauthorised/untracked…
Part 1 of a multi-part series. A quick note before we begin: the first chapter of Khoj.AI was built before the generative AI wave really took off, so some early choices reflect the tooling of that time. This post walks through how the system has evolved over the last 1 year,…
Author: Kartik Ukhalkar In a typical SOA, if your service is misbehaving, what is the most efficient way to detect it while minimising the noise? Whether you are an administrator or developer, you would have thought about this problem a few times. We asked ourselves the same…
Introduction As JioHotstar serves a vast, diverse audience, generative AI is crucial for fast, scalable content creation across languages and formats, capabilities that traditional methods cannot match. Content systems are rapidly shifting to generative-first architectures,…
GeoIndia: A Seq2Seq Geocoding Approach for Indian Addresses Download to access the research paper GEOINDIA_V1.pdf 5 MB download-circle Type an address into any major mapping service and you'll get a pin dropped on a map in seconds. It feels effortless. But under the…
In the world of e-commerce, a click of a “Buy Now” button starts an invisible race. Across India (metro cities or remote villages) millions of customers expect their packages to arrive with a speed that feels like magic. But behind that “magic” is a monumental logistical puzzle.…
Picture this: Your favorite batsman is on strike, two runs needed off the last ball — and you’re starving. Continue reading on Swiggy Bytes — Tech Blog »
A Dual Perspective Hypergraph Neural Networks Download to access the research paper DPHGNN.pdf 2 MB download-circle Every e-commerce company has a version of this problem: an order gets placed, the delivery is attempted, and the package comes back. Return-to-Origin, or…
Every week I meet a few analysts during my office hours and they talk about a number of things like- careers, hobbies, dreams, managers, colleagues, family, higher education, fitness, balancing priorities and off course, Bangalore traffic. Of late, one common theme is about AI…
We’ve built a suite of AI-assisted tools for designers to validate their work, for developers to meet visual standards, and for teams to measure design system adoption in real time.
The Problem With Assumed Security As systems scale, security shifts from a one-time setup to an ongoing architectural responsibility that needs continuous attention as infrastructure evolves and teams change. A key risk in this environment is the gap between assumed and actual…
Infrastructure as Code (IaC) is often treated as the holy grail of Site Reliability Engineering (SRE). We use tools like SaltStack and Ansible, alongside golden images and post-install scripts, to define our ideal state. But here is the hidden secret of infrastructure…
The Race Against the Clock: Optimizing Supply Chain Capacity for Faster Deliveries — Part 1 (Capacity Management Series) In the hyper-competitive landscape of online retail, delivery speed is often the sole differentiator between a confirmed sale and an abandoned cart. For…
At ShareChat, we recently overhauled the architecture for the data ingestion system. As part of this exercise, we also moved 100% of our event data contracts from JSON to Protobuf.
In the world of live sports streaming, there is no “undo” button. Live events bring out emotions in viewers and any minor buffering or failure can cause disappointment in our customers, especially if it happens in crunch moments of the live event. Our Live video validation has…
How We Solved a Kafka Freeze, 5x-ed Throughput, and Right-Sized Our Partitions — Lessons from Production at Scale At Slice, we run a high-throughput event-driven backend. Kafka is at the center of it, processing payments, order lifecycle events, and downstream integrations…
By: Jason Reaves Shub Stealer[1] which looks very similar to MacSync also leveraged the same obfuscator on their shellscript[2] that is very popular lately. Shell script: fd674425d3fc0d95bbc90dcd598eabdb2ddd77037954c8a1d1175f118d1e8dddAfter decoding however it is a bit different…
By: Jason Reaves A lot of focus specifically surrounding DPRK has been on IT workers but there are multiple entities performing various schemes. One of the more prolific ones being interviewing developers and having them work on TA supplied code repositories from various sites.…
We built a multi-provider rewards platform using e-commerce patterns. Here’s why that matters. You’re running a loyalty program. Customers are redeeming points for gift cards, ongoing offers, memberships, or experiences. Then your provider’s API times out. You refresh. Try…
I used to think adding a ‘Read Replica’ was a magic button for scaling applications. I was wrong. While splitting read and write traffic is a standard system design pattern, implementing it introduces a world of pain – from stale reads to the dreaded Split-Brain problem. Here is…
Archana opened her WhatsApp on a Monday morning. Among her messages sat one from Meesho: a sale announcement with a single product image. A kitchen mixer. She scrolled past without clicking. Here's what we didn't know: Archana had spent the previous week browsing ethnic wear.…
At Meesho, reviews are one of the strongest drivers of trust. They influence not just what users buy, but how sellers build reputation and how product quality is interpreted relative to price. But building a review system at scale quickly stops being a UI problem. It becomes a…
AI Video Generation at Scale — Prompts Don’t Scale AI video generation has rapidly moved from a mere novelty to a practical tool, allowing users to easily create brief video clips from text prompts. While generating a single, impressive video is straightforward, the true…
Introduction Ever wondered why your backend slows to a crawl when comparing massive sets of strings? Here’s how we turned a bottleneck into a lightning-fast operation using bitsets. Efficiently checking for overlaps between large sets of strings is a common challenge in…
SDE-II Interview Experience at Swiggy Continue reading on Swiggy Bytes — Tech Blog »
There was a time when we thought uptime was simple. If dashboards were green, APIs were healthy, and latency looked good, we believed the system was doing its job. If something slipped, uptime was considered impacted — end of story. As Meesho grew, that definition started to…
At ShareChat's Central Data Platform (CDP) team, we handle more than 1,000 different event types across 5 apps, ingesting upward of 80 billion events per day.
If you’ve ever streamed a high-stakes match on JioHotstar, the experience probably felt like a simple “tap and play”. It’s a seamless transition from the app icon to the stadium; a flick of a finger and you’re right there, cheering for your players to hit another six. Beneath…
An OOM (Out of Memory) crash is simply when the app runs out of space to think — and shuts down. Every byte counts when your users span across Bharat. At Meesho, we build for everyone in India, including people using budget phones with limited memory. When an app runs out of…
Client Side Ad Insertion(CSAI) levels up using multi-period DASH in the Android ecosystem. This is our journey to upgrade ExoPlayer to leverage multi-period DASH.Introduction Multi-period DASH is a variant of DASH format that offers significant advantages, such as the ability to…
Introduction When the SOLR query logic expanded into a 12,000-line monolithic implementation, each modification introduced significant risk, making every change feel akin to defusing a critical system. Adding a market-specific override required yet another if block, compounding…
A Story from the Frontlines of Threat Intelligence The identification of cyber threats in e-commerce is challenging because discussions on topics like gift cards and discounts, when found on underground forums, can signal fraud yet closely resemble normal customer behavior. For…
1. Abstract Managing Data Science programs requires a structured approach to handle the complexities of data, model development, and business alignment. This whitepaper provides a comprehensive guide on the effective program management of Data Science programs by technical…
Why DICE Exists? DICE stands for Democratizing Internet Commerce for Everyone. This is our mission as an organization to make e-commerce accessible to every corner of India, empowering sellers, delivery partners, and users who were previously left out of the digital economy.…
Cost management is a critical factor in the implementation and maintenance of a data platform, as it often accounts for a significant share of an organization’s overall infrastructure costs and must consistently deliver strong return on investment. As data platforms scale to…
Brand Self Serve (BSS) is a core web application within Flipkart(https://advertising.flipkart.com/), designed for advertisers (Brands and Sellers) to create and manage advertisements in multiple formats. These ads are strategically placed on designated slots across flipkart.com…
Re-architecting Flipkart’s Rate Card Engine: The Journey to Building a High-Scale, Generic Rate Card Platform Introduction In the hyper-competitive world of e-commerce every cent matters. How marketplace fees are calculated, charged and displayed to millions of sellers at…
At ShareChat’s Central Data Platform (CDP) team, we cater to more than 1000 different event types from 5 different apps, receiving and ingesting more than 80 billion events per day on a regular basis.
Gen AI Video — Building A Scalable Validation Framework We discuss building strong eval frameworks as part of our Generative AI studio to ensure that generated video maintains a high quality bar.Introduction As JioHotstar scales to serve one of the world’s largest streaming…
At PhonePe Limited (“PhonePe”), the top banner on our platform’s homepage (the “masthead”) isn’t just an ad slot—it’s the important real estate we have. However, delivering real-time, personalized recommendations at a scale of hundreds of millions of users presents a complex…
Modernizing Dependency Management: Beyond CocoaPods (Part 2 — The Execution) Recap In Part 1, we shared the strategy — why we had to move away from CocoaPods, how we evaluated our options, and the phased migration plan we designed to modernize 60 pods over 2 quarters without…
Most career decisions are shaped by people and perspectives beyond ourselves. We speak to friends, seniors, and ex-colleagues. We Google. We read. And almost always, we look for one thing: other people's experiences. When someone considers joining a company, they aren't just…
Modernizing Dependency Management: Beyond CocoaPods (Part 1 — The Strategy) CocoaPods formed the spine of our iOS build workflow. In this two part blog, we’re sharing our journey to transparently switch away from CocoaPods to SPM, minus the drama, but plus all the scars!Where We…
Postman recently rolled out Organizations, a new set of features designed to allow Enterprise plan customers to set up multiple Teams under...