Scaling ML Model Inference through architectural separation
The model is only one part of the inference pipeline. At scale, the work happening around it, from routing requests to coordinating downstream dependencies, can have a much bigger impact on latency and efficiency. We addressed this by separating model execution from request…
How CRED made disaster recovery drills push-button simple
Our members trust CRED with their money. They rely on us to clear bills, manage credit, and track their financial lives. This means that if we go down, someone’s EMI is late, someone’s credit score takes a hit, someone’s financial plan falls apart. With over 1,000 microservices…
As CRED grew, so did the invisible machinery behind it. Scaling from 100 to over 400 database instances pushed our monolithic Percona Monitoring Management (PMM) to its breaking point. This is the story of how we decoupled our observability stack, pivoting to VictoriaMetrics…
Introduction CRED has a large number of services powered by gRPC technology and we rely on it for fast, reliable communication between our different systems. These suites of microservices power our financial services platform that is leveraged by many consumer-facing teams…
Navigating Android’s video playback functionality is an accomplishment that significantly enhances user interaction. In our context, it’s integral to building smoother user experiences. Multi-video playback forms an essential part of enhancing user experience. This blog offers…
Pareto Principle in Action: Boosting Performance with Smart Caching Caching — the superhero of speedy apps. It’s the secret sauce that saves us from constant database calls, making our applications faster and cutting down on infrastructure costs. But, let’s face it, caching…
Securing the Cloud: Migrating to IMDSv2 for AWS Compute Workloads
CRED has evolved to be a multi-product platform, and that necessitates the use of multiple microservices. The microservices we have run primarily on AWS ECS (Elastic Container Service). Within our ecosystem, these microservices predominantly operate on AWS ECS (Elastic Container…
Case Study on Large Scale Re-architecture: Evolution of Order Management System at CRED — Part 1
Case Study on Large Scale Re-architecture: Evolution of Order Management System at CRED — Part 1 CRED was launched almost 5 years back as a platform to track and manage credit card statements and bill payments. Today, it provides variety of other offerings as well to its members…
CRED curious with Kailash NathIn the latest episode of CRED Curious, Kailash Nadh, CTO of Zerodha, sat down with Kunal Shah to discuss A.I’s inevitable impact, serendipity, climate change and why life goals are irrelevant in a universe that prefers chance. Intrigued? Then head…
an explainer on Soundpool framework in Android -its features, limitations. The challanges we faced and the framework we built on the top of it to make it more efficient.Sound plays an important role in enhancing our members’ experience on our app. As a multi-product platform,…
In 2006, British mathematician Clive Humby declared “data is the new oil.”Like oil, data in raw form — sans insights and analysis has limited use. To harness the potential on data, organizations are constantly seeking ways to leverage their data to gain a competitive edge. This…