Scale

War stories of scaling to millions and billions.

231 stories

Deployment At Scale: Story Behind Dream11’s In-House Blue-Green Deployment Platform ‘OneClick’.
Dream11

~By Ritesh Sharma & Lijo Abraham. Introduction As a part of the agile-based development revolution, organizations have believed in rolling small and quick changes into the market. The theory of building fast-shipping fast plays a significant role in upgrading any product by…

blog.dream11engineering.com
‘doc-coverage’ — A Documentation Coverage Tool for Javascript
ShareChat

‘doc-coverage’ — A Documentation Coverage Tool for Javascript Witten by Shivani Sehgal It’s been rightly said that what gets measured gets managed! A few months ago, we at ShareChat decided to go on a documentation coverage spree. Not long into the journey we realised the…

Leveraging Dynamic Programming to Improve Player Performance in Rummy
ShareChat

Written by Shubham Sharma “Are data structures and algorithms even useful in a software engineering job?”Over the past few years, there has been a drift towards people assuming that algorithms and data structures are useless and are asked by tech companies just as a thoughtless…

ShareChat AI @ EMNLP 2021
ShareChat

ShareChat AI team has embarked on a journey of conducting cutting-edge AI research and building AI-powered solutions for providing best-in-class and safe user experience to our users. Our endeavour is to build solutions that can scale across diverse geographies and cultures…

Neural Network Compression Using Quantization
ShareChat

Written by Akash Manna, Vikram Gupta, Debdoot Mukherjee Every day, ShareChat and Moj receive millions of User Generated Content (UGC) pieces. To derive insights from these content pieces and recommend relevant and interesting content to our users, we require accurate, fast and…

Introducing Moj For Creators (MFC)
ShareChat

Written by Sumit Malpani, Sumit Agrawal, Sidharth Mishra, Nitesh Jain “Creator Economy”, led by the rise of short-form videos, has become a global phenomenon in recent years. Today, there are more than 100M+ content creators globally, with increasing numbers of short video first…

How We Improved Virtual Gifting Experience in Audio Chatroom
ShareChat

Written by Gulzar Ahmed, Chetan Potnuru We recently shipped out a new Virtual Gifting experience for our ShareChat’s Audio Chatroom- a core feature where the audience can support the creators by sending them virtual gifts. In this blog, we’ll talk about why and how we revamped…

ShareOCR: The end-to-end OCR for Indic content: Part 2
ShareChat

Written by Rishabh Jain, Praveen Dhinwa, Vikram Gupta, Hastagiri Vanchinathan, Debdoot Mukherjee ShareChat is India’s leading social media platform & Moj is India’s number one short video platform with one of the highest monthly active users. Both allow users to share their…

Demystifying ShareChat Creators
ShareChat

Written by Tejas Singh, Devyani Jain, Shivani Nayaka, Rishabh Dsouza and Anish Pratik Yayavaram One of the questions that we are often asked is, ‘Who is a ShareChat creator?’ And to be honest, it would be pretty hard to answer this question in a sentence or two. Rather, it would…

Lessons learned from running GraphQL at scale
Dream11

— By Shrey Mehta, Kaushik Barodiya At Dream11, we have experienced tremendous growth from just 300,000 users in 2015 to over 110 million users at present. To grow at this blazingly fast pace, we moved to a microservice architecture for developing backend systems. As the number…

blog.dream11engineering.com
Scaling with common sense #2: Being future ready.
Zerodha

Over the last year, owing to the unexpected rally in capital markets, Zerodha’s customer base has more than tripled, significantly increasing the number of concurrent users on our platforms along with the traffic and load they generate on numerous systems in the background. For…

Case Study: YCombinator Startup Athlane Uses Hasura Cloud to Increase Their Developer Velocity 200%
Hasura

Athlane, an alumnus of YCombinator 2019, provides esports athletes and gamers a marketing, analytics, and e-commerce platform. Utilizing Hasura Cloud and GraphQL,they were able to quickly scale and enable their team of five developers to quickly build the leading platform in the…

Working with PostgreSQL
Zerodha

This post is in the context of the large, data heavy PostgreSQL instances that store historical transactional data and reports, the databases that power Console and its large scale number crunching and reporting. It talks about how we self-host, tune, and manage all our DB…

TimescaleDB 2.0 with Hasura
Hasura

TimescaleDB 2.0 is a major version upgrade that has many improvements from version 1. It introduces new interesting features and capabilities, especially horizontal multi-node scaling. Because it is a PostgreSQL extension, it mostly works well with Hasura.

A lesson in creating and using niche business DSLs at scale
Zerodha

At Zerodha, we process millions of trades in real-time, where each trade comes into the system as concurrent high throughput HTTP requests. Each trade increases the latency for subsequent orders in the queue that are under processing at the same time at our OMS (Order Management…

Alar: The making of an open source dictionary
Zerodha

ನಮಸ್ಕಾರ (Namaskāra)! This is not a post on fintech, or even technology for that matter. This is the story of a product of tenacity, selflessness, and passion; a product that will transcend and outlive most technology we know of. This is the story of a massive dictionary that…

Scaling with common sense
Zerodha

“Scaling” is not a specific technique but an entire spectrum that stretches all the way from “Google scale” to the K8s cluster Karan runs on a Raspberry Pi plugged into a 12V shaver outlet in his bathroom to encrypt his DNS queries for peak privacy, while he asks Alexa to dim…

Infrastructure monitoring with Prometheus at Zerodha
Zerodha

On any given day, we handle around 15% of daily retail trading volume across all stock exchanges in India. Billions of requests generated in the process are handled by a suite of systems we have built in-house. Also, we are very particular on self-hosting as many dependencies as…

Technology Catch-22
PhonePe

Engineering the product on Day 1 to handle hyper-growth in the future Every entrepreneur in the technology space, starts his or her journey with the dream of building a product or providing a solution that addresses a strong need, or solves a fairly pervasive problem using…

Hello, World!
Zerodha

Zerodha, now India’s largest stock broker, bootstrapped and profitable, turns ten years old this year. The Zerodha tech team turns seven years old. The tech team has remained largely elusive over the course of our existence. While we have pondered starting a tech blog for more…

Zero to 150Mn+ Users in 3 years!
PhonePe

An Overview of Building the PhonePe App The PhonePe app has expanded from 0 to 150M+ in less than 30 months. Our app is growing uniquely in multiple dimensions. It’s not only adding more business-verticals, but every vertical is adding more features, which in turn are getting…

The PhonePe Bootcamp
PhonePe

We recently welcomed our new batch of 25 engineers from premier institutes. Our fresh from campus hires, went through the coveted on-boarding program “Bootcamp 2019.” The Bootcamp saw them learn about server side architecture, the tech stack and the engineering design philosophy…

Living on the ‘Edge’
PhonePe

Building a highly scalable infrastructure to power Microservices Solving payments for the world’s largest democracy is not easy. Enabling access to payment as a first class service to applications, platforms and consumers in the most predictable, responsive and resilient manner…

Chronicling our Technology Journey
PhonePe

As we complete three years and begin our fourth, I can’t help but feel proud of the immense success we have achieved with our product – over 150+ million users on our platform have translated into 50+ million daily app sessions, totaling an incredible 500,000 hours on PhonePe…

Projects
Zerodha

Apps libredesk ★ 3102 Go Open-source, self-hosted customer support desk in a single binary. A lightweight alternative to Intercom, Zendesk, Chatwoot. GNU Affero General Public License v3.0 Last updated on November 1, 2026 listmonk ★ 24103 Go High performance, self-hosted,…

Zerodha's FOSS stack
Zerodha

Languages Go Python Java JavaScript Dart Databases PostgreSQL ClickHouse Redis SSDB ScyllaDB DuckDB MySQL Webservers and proxies Nginx HAProxy Kong Streams & Queues NATS Kafka Redpanda Console UI Benthos Observability & Monitoring Vector Grafana VictoriaMetrics Alertmanager…