Building Meesho's ML Platform: Scaling Model Inference & Real-Time Embedding Search (Part 3)
By mid-2023, we had transformed our ML stack—building a real-time feature store, optimizing model retrieval, and fine-tuning ranking. But two critical gaps remained: 🔹 Scaling model inference without hitting infrastructure roadblocks 🔹 Moving embedding search from batch to…
Elastic Spark: Autoscaling Structured Streaming at Sharechat
At ShareChat — a leading social media platform with over 200M monthly active users (MAU) — our data platform ingests and processes more than 1 million events per second. However, this event load isn't constant.
Building Meesho’s ML Platform: Lessons from the First-Gen System (Part 2)
By late 2022, we had built something we were truly proud of—a real-time ML serving system with a DAG-based executor, a feature store, and an interaction store powering key ranking and personalization models. It was a major milestone, the culmination of months of effort from data…
Enhancing Myntra App performance: Transitioning from GIFs to Videos
Introduction In the fast-paced world of e-commerce, every millisecond and every pixel counts. At Myntra, where visual content drives discovery and engagement, we embarked on a critical mission: to revolutionise how animations are delivered in our Android and iOS apps. This…
Realtime Content Deduplication At Scale: How We Cut Cost By 86%
Every time a user views a post, an event is fired to inform us. We feed this real‑time stream into our recommendation system, e.g. analytics pipelines, feature computations, and view counters.
The Creative Intelligence Unit (CIU): Meesho’s Playbook for Scalable, AI-First Creativity
At Meesho, creativity isn’t about out of the box ideas, it’s about building messages grounded in our user’s truth. We speak in the language of our users, shaped by insight, and designed to deliver impact. For us, creativity is a powerful loop. It begins with a user's insight,…
Evolving Search Ranking: From XGBoost to Multi-Task Deep Learning with Knowledge Distillation
Search at Meesho For an e-commerce platform like Meesho, optimizing Search is pivotal to enhancing the user experience, improving product visibility and faster discovery, and eventually increasing conversion rates. Users search in multiple Indian languages looking for quality…
Pincode Migration Journey with Compose Multiplatform
In today’s diverse technological landscape, the ability to create applications that seamlessly operate across multiple platforms is a significant advantage. At Pincode, our seller app, was initially created using Android SDKs with Compose UI in Kotlin, and catered exclusively to…
Revealing the Hidden Links: How We Break Down Complex Fraud Networks
The Rising Tide of E-commerce Fraud We are deeply aligned with our aim to democratize our platform—with new entrepreneurs joining and logistics partners working across pin codes in India. This inclusivity is our biggest strength—and also the reason why we need to be extra…
Scaling Deployments at Meesho: How We Built a Custom Rollout Service to Replace Our Existing System
Introduction: The Need for Bulletproof Deployments at Scale As our platform scaled and user expectations rose, so did the need for rock-solid infrastructure. One critical challenge surfaced: ensuring zero-downtime deployments while rolling out new features at speed. Despite…
Building Slice’s Chatbot: An Engineering Journey (Series 1)
Building slice’s Chatbot: An Engineering Journey (Series 1) Tags: MQTT, EMQX, Kafka, Real-Time System, Event-Driven Systems Introduction As our chatbot requirements grew, we transitioned from a managed chatbot solution to an in-house system. This blog highlights the challenges…
Personalization from Day One: Solving the Cold Start Problem at Meesho
New users rarely give second chances. If their first experience on the app, especially the homepage product feed, feels irrelevant then they leave quickly. At Meesho, we noticed that our static homepage product feed for new users was causing high bounce rates and a poor first…
Scaling Secret Detection at Meesho: Building a Pre-Commit Workflow with TruffleHog
The Challenge: Scaling Secure Development As engineering teams and codebases grow, managing sensitive information like API keys, tokens, and config files becomes increasingly challenging. These secrets can occasionally slip through, and resolving such issues like rotating…
Problem Statement PhonePe, as a payments platform, has an essential feature that allows users to check all past transactions. When payments are made to businesses/merchants, users have access to a historical view of all such transactions. For peer to peer transactions, however,…
What is Feed Re-ranking? Online shopping platforms face intense competition, where the ability to deliver the most relevant products to customers is crucial. A well-organized and relevant product feed, which inherently is a list of products, forms the backbone of any E-commerce…
Supercharging ShareChat ML Feature System with Flink DataStream
At ShareChat, our in-house ML feature system powers personalized feed recommendations across the platform.Built on Apache Flink, it serves as a feature-as-a-service platform for scalable computation
Building Meesho’s ML Platform: From Chaos to Cutting-Edge (Part 1)
The Genesis: How a Friday Night Roast Sparked Meesho’s ML Platform It all started in early 2022, over a casual Friday evening catch-up. Like many great origin stories, this one began with friendly banter between a group of backend engineers and data scientists. As the…
Scaling Seamless Communication: How Meesho Powers 10B+ Messages Daily with Multi-Tenancy
Revolutionizing Communication at Scale At Meesho, seamless communication is at the heart of our user experience. Whether it’s an OTP for login, an order update, or a personalized shopping recommendation, our platform ensures timely and reliable messaging across multiple…
Scaling Seamless Communication: How Meesho Powers 10B+ Messages Daily with Multi-Tenancy
Revolutionizing Communication at Scale At Meesho, seamless communication is at the heart of our user experience. Whether it’s an OTP for login, an order update, or a personalized shopping recommendation, our platform ensures timely and reliable messaging across multiple…
Building WebRTC Recording Infrastructure using GStreamer and Temporal
Our recording infrastructure focuses on WebRTC video and audio. The goal is to allow moderation teams to access clean, archived footage—composite or individual—for compliance, post-production, or analysis.
The Journey to Faster Android Builds: How We Slashed Our Build Times at slice
As an Android developer at slice, watching our app evolve from a simple financial product to a full fledged bank has been exciting. But this growth came with a challenge familiar to many developers: increasingly painful build times. What started as a minor inconvenience…
In the early days of PhonePe, we started with just one application. Our pace was fast, almost like a race against time, and our initial engineers managed to keep things tidy. Colors, typography, and size constants were well-organized, ensuring a cohesive look and feel. Our small…
Android Network Observability: Shedding Light on Performance Blind Spots
Introduction In Android development, network performance issues can be notoriously hard to debug. While tools like Firebase Performance Monitoring provide high-level insights like error rates and latency, they fall short in providing granular visibility into each stage of the…
Data access layer: Unlocking the full potential of financial data
The final piece of the puzzle: Data access layer In the previous installments of this series (part 1 [https://hasura.io/blog/escaping-the-data-doom-loop-in-financial-services], part 2…
Time-traveling through your data architecture: Using data agents to understand change
Learn why tracking the evolution of your data architecture in Hasura's Data Delivery Network (DDN) isn't just nice to have – it's essential for robust governance and intelligence.
Data products, data contracts: A new model for data management in financial services
In Part 1, we covered the data doom loop [https://hasura.io/blog/escaping-the-data-doom-loop-in-financial-services] – the cycle of complexity, inefficiency, and eroding trust in financial data that persists despite massive investments. The solution isn’t another sweeping…
How PromptQL achieves 100% accuracy for AI on enterprise data
PromptQL addresses the limitations of traditional approaches like RAG, Text-to-SQL, and Tool Calling. PromptQL provides measurable improvements in accuracy (with a clear path to reaching 100% accuracy) when connecting LLMs to enterprise data.
How ShareChat built a scalable cost efficient ML Feature system
At ShareChat, Machine Learning models form the backbone of our recommendation system, playing a pivotal role in delivering the most relevant and engaging content to our users.
Across industries – and especially in highly regulated sectors like healthcare, financial services, and government – MongoDB has been a preferred database solution for organizations handling large volumes of sensitive data that require strict compliance adherence. In such…
Building a powerful customer support AI assistant with PromptQL in 5 minutes
In today's data-driven world, connecting AI to your organization's data remains a significant challenge. What if you could build AI assistants that can query databases, access customer support tickets, and even take actions—all using natural language?
Integrate real-time web search and enrich your private data with PromptQL
By integrating web search in PromptQL, you can enrich your private data – stored in any systems like Snowflake, BigQuery, PostgreSQL, MongoDB, or accessed through APIs – with current real-time details from the web.
The primary goal of a recommendation system is to identify and deliver the most relevant content for a user. To achieve this, it must not only identify high-quality content but also ensure diversity
Seamlessly Migrating from MongoDB to PostgreSQL: Leveraging Data Platform for Scalable Success
Freaking hard Migration from MongoDB to PostgreSQL: Leveraging Data Platform for Scalable Success Introduction In today’s fast-paced digital landscape, selecting the right database technology is a crucial decision for any organisation’s success. Initially, MongoDB’s flexible…
Navigating data governance with Hasura: Building trust, streamlining operations, and powering AI
Hasura’s metadata-based approach is a data governance solution, acting as a semantic layer for your data, preserving clear lineage and robust governance.
Modern recommender system models can be very compute- and memory-intensive and expensive to serve. In this post, we’ll go over some of the things we did at ShareChat to make our inference more cost effective.
Overview Analysing bundle load times is essential for optimising the performance of React Native applications. This guide outlines how to track and analyse the loading times of modules within your app by modifying the Metro bundler. In the context of JavaScript, including…
In recent years, online shopping has surged, revolutionizing how people purchase products and services. E-commerce’s convenience has reshaped consumer behaviour and the retail landscape. Unlike traditional stores, online shoppers often face sizing challenges, leading to…
Empowering observability: New Platform Dashboard for Hasura DDN
We’re thrilled to introduce the Platform Dashboard for Hasura Data Delivery Network (DDN) – a comprehensive solution to elevate your operational efficiency, data observability, and decision-making.
DRS: Making high-impact & informed decisions with Dream11’s In-house Experimentation Platform!
With millions of Indian sports fans across our Dream Sports ecosystem, it takes a highly data-driven team to understand what is required for great fan engagement and ultimately making sports better through our various brands. At Dream11 too, we have been on a constant mission to…
Vulnerability Management & Risk Scoring for Business Services
In the rapidly evolving FinTech sector, PhonePe Private Limited, an India-born leader in financial services, stands out for its innovative range of products and services. Offering everything from UPI transactions and bill payments to stock market investments, personal finance…
Build safer AI assistants with PromptQL and human-in-the-loop guardrails
One of the most effective guardrails in AI systems today is human-in-the-loop (HITL). This blog explores why HITL systems are crucial, how they align with the principles of agentic AI, and how PromptQL simplifies their implementation in the AI Assistant interface.
Towards delivering world-class recommendations at the lowest possible cost
Sharechat is India’s largest homegrown social media company with native and regional user generated image and video content. Our two apps, ShareChat and Moj, are used by over 325 million users in 15 regional languages across India.
In this blog post, we’ll explore the features and limitations of the current monitoring setup, how we’re leveraging Grafana, Prometheus, and Hasura’s Data Delivery Network (DDN) to offer a more comprehensive solution, and what this means for the future of monitoring in Hasura…
What’s new in PromptQL: Managed LLM keys, Collaboration and Automation with APIs
Over the past few weeks, we’ve introduced a series of exciting updates to PromptQL that enhance its power, accessibility, and collaboration capabilities. These enhancements are focused on simplifying workflows. Everything is now live and ready to explore!
Introduction CRED has a large number of services powered by gRPC technology and we rely on it for fast, reliable communication between our different systems. These suites of microservices power our financial services platform that is leveraged by many consumer-facing teams…