Scale

War stories of scaling to millions and billions.

231 stories

Building the Pincode Android App on Jetpack Compose: A Journey
PhonePe

This blog narrates our team’s journey with Compose, detailing its inception at PhonePe, its adoption by the Pincode team, our experiences, and the challenges we faced. The Pincode Android app UI is built using Jetpack Compose. As of July 2024, the app has over 2.5 million…

Improving load time of a Production React App
Urban Company

🎤 10x Engineering Tech Talks This talk by Kanav Arora will draw on our learnings from the efforts that we undertook earlier this year to improve Urban Company’s website performance, resulting in a 60% reduction in load time. All the efforts towards performance engineering can…

Data Privacy & Security — Detecting & Encrypting PII
Urban Company

Data Privacy & Security — Detecting & Encrypting PII 🎤 10x Engineering Tech Talks Ever wondered why PII encryption is crucial or how to effectively detect PII in your databases? In this insightful talk, Jatin Gupta (Tech Lead, Infra & Security) delves into the importance of PII…

Modern Data Analytics | Data Democratization: From Silos to Standardization
Urban Company

🎤 10x Engineering Tech Talks Can traditional data management handle modern analytics? In this insightful talk, Abhishek Pathania (Tech Lead, Data Platform) explores the challenges Urban Company faced as their data needs expanded. He highlights the need for a robust,…

Managing Elasticsearch at scale at PhonePe – Part 3
PhonePe

In this article, we will discuss the optimizations we did to reduce the footprints of our Elasticsearch. We optimized write throughput and reduced disk storage by leveraging query patterns and tuning indexing and doc_values for fields in elastic search.

Boost Your Reach: How Urban Company Mastered Push Notification Delivery
Urban Company

By — Rounak Saha (Engineer, Platform) Push Notifications (PNs) are an efficient mode of in-app communication for an organisation to engage with its user-base. It is not only cost-effective, but also facilitates convenient real-time updates to users. This blog describes the…

Leveraging LLMs at scale for real-time business critical decisioning
Urban Company

By — Saumil Shah (Engineer, Marketplace) P.C. Adobe stock photoUrban Company (UC) professionals deliver services across a wide spectrum of categories. Over the course of a request journey, right from a booking being made to a service starting, the request may get cancelled under…

How Urban Company uses Machine Learning to improve reliability of the marketplace
Urban Company

By — Resham Wadhwa ( Data Scientist, Data) At Urban Company, we act as a matchmaker between customers and service professionals for home services like salons and cleaning. Our goal is to find the right professional, ensure they accept the request, arrive on time, and deliver…

Hasura DDN: The most incredible API for ClickHouse
Hasura

Our commitment has always been to empower developers to build and scale applications effortlessly. As part of that commitment, we ensured Hasura’s Data Delivery Network (DDN) can harness the strength of the world's most advanced real-time analytics database, ClickHouse.

The remoteness of remote work
Zerodha

TL;DR Like numerous other orgs, we transitioned (actually, flipped overnight) to being fully remote during the first COVID pandemic lockdown in 2020. It worked out great in the first year, started losing its sheen in the second year, and became detrimental to creativity and…

Clockwork: The Backbone of PhonePe’s 2 Billion Daily Jobs
PhonePe

Have you ever had an alarm fail to wake you up, causing a ripple effect of chaos in your morning? At PhonePe, we understand the criticality of such ‘alarms’ in our digital ecosystem. Take, for instance, our daily Merchant Settlements process. A merchant receives multiple…

1.5+ million PDFs in 25 minutes
Zerodha

At Zerodha, many million users login and use our financial platforms every day. Over the recent months, on an average day, 1.5+ million users have been executing stock and derivative transactions. On a volatile day, this number could easily double. After a trading session…

From Silos to Standardization: Leveraging DBT for a Democratized Data Framework
Urban Company

By — Abhishek Pathania (Engineer, Platform) Urban Company’s growth over the last few years has resulted in an increased volume and reliance on data to fulfill product & business use-cases. Data-driven decisions across teams have played a pivotal role in this journey; but it came…

Enabling IOT for UC’s Native RO
Urban Company

By — Avantika Dwivedi (Product Ordering Ecosystem, Engineering) After servicing over 10 Lakh ROs of every possible brand, we realised that the high cost of maintaining a water purifier was due to the frequent wear and tear of filters, leading to expensive yearly RO water…

Case Study on Large Scale Re-architecture: Evolution of Order Management System at CRED — Part 1
CRED

Case Study on Large Scale Re-architecture: Evolution of Order Management System at CRED — Part 1 CRED was launched almost 5 years back as a platform to track and manage credit card statements and bill payments. Today, it provides variety of other offerings as well to its members…

engineering.cred.club
Maintainability: Behaviour vs Structure
Urban Company

By — Aman Singh (Order, Request Management Ecosystem) Introduction There has been a lot of confusion between behaviour and structure over the years and many freshers faced this issue. What is the behaviour? What is the structure? What are the differences between the two? Who had…

Bullzeye: Powering Ads on PhonePe
PhonePe

As PhonePe continues to scale, the tech that goes behind each division also needs to scale and meet the requirements of all stakeholders involved. Bullzeye addresses a few challenges faced in managing ads such as issues with scalability of reporting modules and frequency cap…

Logging at Zerodha
Zerodha

At Zerodha, we run a multitude of internal and public-facing services that generate copious amounts of logs. While developers use these logs to debug or troubleshoot incidents, some services also emit logs that must be persisted for prolonged periods to comply with numerous…

The rise of GraphQL APIs on data warehouses
Hasura

In this article, we will talk about the drivers behind the rise of data APIs in data warehouses, challenges with current approaches to building, operating, and scaling data APIs, and how Hasura addresses those challenges for our customers.

Hasura and Well-Typed collaborate on Haskell tooling
Hasura

Well-Typed and Hasura have been working together since 2020 to improve Haskell tooling for commercial Haskell users, taking advantage of Well-Typed's expertise maintaining the Glasgow Haskell Compiler and Hasura's experience using Haskell in production at scale.

User disengagement
Zerodha

Over time, I have come to realise that the term user “engagement” in software, more often than not, is a thinly veiled proxy for user entrapment, whether intentional on the part of software designers or not. The trend of shallow user numbers and “engagement” metrics taking…

Streaming Aggregations at Scale
ShareChat

Being a social media company we maintain a lot of counters; from views and likes to many more internal ones related to revenue spending etc. Updating a count might seem simple but as always the real problems come with scale.

Recommended — Just For You: How We Handle Personalisation at Scale
ShareChat

Recommended — Just For You: How We Handle Personalisation at Scale Written by Srijan Saket, Aravindh R, Subham Todi, Brihati Jain Our Mission Ever wondered how you are able to find relevant and entertaining content every time you go to the Moj or ShareChat “Home” page? Machine…

From Native to React Native to Flutter
Zerodha

At Zerodha, the first mobile version our flagship trading platform Kite was written as a native Android app in 2015. After building a cross-platform version in React Native in 2017, we finally settled for a full rewrite in Flutter in 2018, a choice that has paid off really well…

How we Created Dynamic Custom Audiences on ShareChat to be Used Across Campaigns for Advertising
ShareChat

Written by Mohit Dubey ShareChat is on a rapid growth path with 180 Mn monthly active users. Advertisers want to run their advertisement campaigns on ShareChat in order to reach these target audiences. Our aim is to show the advertisement to the most relevant audience so that…