“How we architected an AI system with async + spark distribution to mine millions of data points for patterns in under an hour.” by Sriharan Manogaran, Rahul Misra, Anand Chiddarwar Introduction As businesses grow, so does the amount of data they generate. Every click, purchase,…
How Bitsets Supercharged Our Backend: Faster String Overlap Checks at Scale
Introduction Ever wondered why your backend slows to a crawl when comparing massive sets of strings? Here’s how we turned a bottleneck into a lightning-fast operation using bitsets. Efficiently checking for overlaps between large sets of strings is a common challenge in…
How Preview Environments Transformed Frontend Delivery at Freshworks Analytics
“If you can test it before you merge it, you can trust it when you ship it.” by Arvindan Frontend teams typically are efficient if they handle PR in different manners. Classical PR reviews slow down when reviewers can’t open the change in the browser and try it like an end user.…
by Anush Arvind Incorporating AI into the software development lifecycle has transformed how high quality applications are built and shipped. What once took weeks of iteration, debugging, and context switching can now be achieved in hours, with AI assisting in design, coding,…
How We Saved Our Chat App from PostgreSQL Transaction Wraparound Disaster
by Anish Gopalan The 3 AM Wake-Up Call Nobody Wants It’s 3 AM. Your phone buzzes. The chat app you’ve built is down. Completely down. PostgreSQL has shut itself down to prevent data corruption, and millions of users are unable to send messages. The culprit? Something called…
Modularizing SOLR Query Creation for Multi-Market Scale
Introduction When the SOLR query logic expanded into a 12,000-line monolithic implementation, each modification introduced significant risk, making every change feel akin to defusing a critical system. Adding a market-specific override required yet another if block, compounding…
From Noise to Insight: How LLMs Are Transforming Threat Intelligence Analysis
A Story from the Frontlines of Threat Intelligence The identification of cyber threats in e-commerce is challenging because discussions on topics like gift cards and discounts, when found on underground forums, can signal fraud yet closely resemble normal customer behavior. For…
White Paper on Data Science Technical Program Management
1. Abstract Managing Data Science programs requires a structured approach to handle the complexities of data, model development, and business alignment. This whitepaper provides a comprehensive guide on the effective program management of Data Science programs by technical…
Brand Self Serve (BSS) is a core web application within Flipkart(https://advertising.flipkart.com/), designed for advertisers (Brands and Sellers) to create and manage advertisements in multiple formats. These ads are strategically placed on designated slots across flipkart.com…
Re-architecting Flipkart’s Rate Card Engine: The Journey to Building a High-Scale, Generic Rate…
Re-architecting Flipkart’s Rate Card Engine: The Journey to Building a High-Scale, Generic Rate Card Platform Introduction In the hyper-competitive world of e-commerce every cent matters. How marketplace fees are calculated, charged and displayed to millions of sellers at…
Gen AI Video — Building Scalable Validation Framework
Gen AI Video — Building A Scalable Validation Framework We discuss building strong eval frameworks as part of our Generative AI studio to ensure that generated video maintains a high quality bar.Introduction As JioHotstar scales to serve one of the world’s largest streaming…
High-Risk, High-Scale: Guaranteeing Ad Budget Precision at 1 Million Events/Second
Flipkart serves thousands of sponsored ads across various pages and with search queries. Advertisers are charged based on the impression views or clicks generated by their campaign content. In the high-velocity domain of AdTech, the latency between an ad impression/click and a…
Keeping Java as the Core, Python to Lead Agentic Systems
We’ve been a Java shop for years, and now agentic AI demands us to rethink. How I got here? I’ve been in the Java world for more than 30 years. Java has been my default answer to “what should we build this in?” for most of my career. I’ve seen it grow from applets and early web…
Triksha — Securing AI with AI at Flipkart TL;DR GenAI apps introduce a new attack surface where prompts become the primary vector of exploitation, making generic application security ineffective for real-world, fine-tuned LLMs like e-commerce support bots. Triksha, Flipkart’s…
Context Ambitious goal and the scope of the problem We were chasing a critical, futuristic business requirement for our big data pipelines achieving “1-day planning,” defined as a total execution window of 24 hours or less. The entire process is extensive, processing a 7TB data…
Beyond the Context Window: A New Approach to Summarizing Big Data
Image Source: Google Nano BananaTL;DR LLMs struggle to summarize the thousands of reviews for a single product because of context window limits and conflicting opinions. The proposed solution, XL-OPSUMM, is a scalable framework that summarizes reviews incrementally (in chunks)…
Product Security Scorecards: Coupling Security Issues with Preventative Controls to Drive Security Maturity
Postman’s commitment to Product Security begins with our approach to Application Security. Every engineering team in Postman has an assigned Security Engineer...
At Postman, we are committed to delivering simple, practical and easy-to-use tools that make building and testing APIs efficient and effortless. Postman...
Revealing the Hidden Links: How We Break Down Complex Fraud Networks
The Rising Tide of E-commerce Fraud We are deeply aligned with our aim to democratize our platform—with new entrepreneurs joining and logistics partners working across pin codes in India. This inclusivity is our biggest strength—and also the reason why we need to be extra…
Scaling Deployments at Meesho: How We Built a Custom Rollout Service to Replace Our Existing System
Introduction: The Need for Bulletproof Deployments at Scale As our platform scaled and user expectations rose, so did the need for rock-solid infrastructure. One critical challenge surfaced: ensuring zero-downtime deployments while rolling out new features at speed. Despite…
Problem Statement PhonePe, as a payments platform, has an essential feature that allows users to check all past transactions. When payments are made to businesses/merchants, users have access to a historical view of all such transactions. For peer to peer transactions, however,…
Supercharging ShareChat ML Feature System with Flink DataStream
At ShareChat, our in-house ML feature system powers personalized feed recommendations across the platform.Built on Apache Flink, it serves as a feature-as-a-service platform for scalable computation
Scaling Seamless Communication: How Meesho Powers 10B+ Messages Daily with Multi-Tenancy
Revolutionizing Communication at Scale At Meesho, seamless communication is at the heart of our user experience. Whether it’s an OTP for login, an order update, or a personalized shopping recommendation, our platform ensures timely and reliable messaging across multiple…
Scaling Seamless Communication: How Meesho Powers 10B+ Messages Daily with Multi-Tenancy
Revolutionizing Communication at Scale At Meesho, seamless communication is at the heart of our user experience. Whether it’s an OTP for login, an order update, or a personalized shopping recommendation, our platform ensures timely and reliable messaging across multiple…
Data access layer: Unlocking the full potential of financial data
The final piece of the puzzle: Data access layer In the previous installments of this series (part 1 [https://hasura.io/blog/escaping-the-data-doom-loop-in-financial-services], part 2…
Time-traveling through your data architecture: Using data agents to understand change
Learn why tracking the evolution of your data architecture in Hasura's Data Delivery Network (DDN) isn't just nice to have – it's essential for robust governance and intelligence.
Data products, data contracts: A new model for data management in financial services
In Part 1, we covered the data doom loop [https://hasura.io/blog/escaping-the-data-doom-loop-in-financial-services] – the cycle of complexity, inefficiency, and eroding trust in financial data that persists despite massive investments. The solution isn’t another sweeping…
How PromptQL achieves 100% accuracy for AI on enterprise data
PromptQL addresses the limitations of traditional approaches like RAG, Text-to-SQL, and Tool Calling. PromptQL provides measurable improvements in accuracy (with a clear path to reaching 100% accuracy) when connecting LLMs to enterprise data.
Across industries – and especially in highly regulated sectors like healthcare, financial services, and government – MongoDB has been a preferred database solution for organizations handling large volumes of sensitive data that require strict compliance adherence. In such…
Building a powerful customer support AI assistant with PromptQL in 5 minutes
In today's data-driven world, connecting AI to your organization's data remains a significant challenge. What if you could build AI assistants that can query databases, access customer support tickets, and even take actions—all using natural language?
Integrate real-time web search and enrich your private data with PromptQL
By integrating web search in PromptQL, you can enrich your private data – stored in any systems like Snowflake, BigQuery, PostgreSQL, MongoDB, or accessed through APIs – with current real-time details from the web.
Seamlessly Migrating from MongoDB to PostgreSQL: Leveraging Data Platform for Scalable Success
Freaking hard Migration from MongoDB to PostgreSQL: Leveraging Data Platform for Scalable Success Introduction In today’s fast-paced digital landscape, selecting the right database technology is a crucial decision for any organisation’s success. Initially, MongoDB’s flexible…
Navigating data governance with Hasura: Building trust, streamlining operations, and powering AI
Hasura’s metadata-based approach is a data governance solution, acting as a semantic layer for your data, preserving clear lineage and robust governance.
Empowering observability: New Platform Dashboard for Hasura DDN
We’re thrilled to introduce the Platform Dashboard for Hasura Data Delivery Network (DDN) – a comprehensive solution to elevate your operational efficiency, data observability, and decision-making.
DRS: Making high-impact & informed decisions with Dream11’s In-house Experimentation Platform!
With millions of Indian sports fans across our Dream Sports ecosystem, it takes a highly data-driven team to understand what is required for great fan engagement and ultimately making sports better through our various brands. At Dream11 too, we have been on a constant mission to…
Build safer AI assistants with PromptQL and human-in-the-loop guardrails
One of the most effective guardrails in AI systems today is human-in-the-loop (HITL). This blog explores why HITL systems are crucial, how they align with the principles of agentic AI, and how PromptQL simplifies their implementation in the AI Assistant interface.
In this blog post, we’ll explore the features and limitations of the current monitoring setup, how we’re leveraging Grafana, Prometheus, and Hasura’s Data Delivery Network (DDN) to offer a more comprehensive solution, and what this means for the future of monitoring in Hasura…
What’s new in PromptQL: Managed LLM keys, Collaboration and Automation with APIs
Over the past few weeks, we’ve introduced a series of exciting updates to PromptQL that enhance its power, accessibility, and collaboration capabilities. These enhancements are focused on simplifying workflows. Everything is now live and ready to explore!
Introducing PromptQL Program API: Dynamic Integrations made simple
With the PromptQL Program API, you can now trigger PromptQL programs via HTTP, bringing flexibility and intelligence to your business workflows. The API ensures seamless integration outside the chat interface of the PromptQL Playground.