How Apache YuniKorn Taught Our Kubernetes Cluster to Play Tetris
A story about Spark, scheduling, and a cloud bill that refused to make sense. Chapter 1: A Fresh Start on Kubernetes Every migration story starts with optimism, and ours was no different. We had just moved our Spark workloads from EMR to Kubernetes (EKS). On paper, it was…
The JioHotstar platform receives in excess of 40TB data every day. At 2.1 million messages per second. At this scale, every superflous byte is costly, like real money costly. In this blog, we cover strategies that helped us optimise our ingest workflow which ultimately saved…
What We Learned from Benchmarking Knowledge Bases for Coding Agents
Introduction/TL;DR At JioHotstar, we have been thinking a lot about how to give developers a better AI-assisted engineering experience. Once coding agents started becoming useful for day-to-day work, the next natural question was: how do we help those agents understand our…
The 9-Second Delay: How a Default Kubernetes Setting Choked Our CoreDNS
by Divakar Raju The panicked messages started rolling in from all our dev and application teams, outbound calls in our staging environment were randomly timing out, and some external requests were inexplicably taking over 9 seconds to complete. In a modern microservices…
Moving from Panic to Process: Testing Your Way to a Successful K8s Migration
by Keerthivaasan K In the season finale of Silicon Valley, there’s a classic scene: Pied Piper is live-streaming a rescue, traffic is melting the servers, and the team is pulling a “heroic save” at the 11th hour. It makes for great TV. It makes for a terrible career as an SRE.…
Advertising is a key source of revenue in most businesses. It certainly forms a key pillar for JioHotstar. There is so much technology hidden under the surface. In this blog, we will cover some of the complexity that gets unlocked when we render an ad on our content. Every…
How AI-Driven Automation is Scaling PhonePe’s Customer Support Framework
At PhonePe, we process a staggering 400 million transactions a day—amounting to over 10 billion monthly, operating at a scale that places it among the largest payment platforms globally. Managing such scale would typically require a massive customer support infrastructure for…
Running Hermes at Razorpay: a Network-isolated, Self-improving “Second Brain” for every Employee
How we run a personal AI agent for everyone at Razorpay: always on, multi-model, and safe by construction. Contributors: Siddharth Tripathi Today, more than 220 Razorpay employees each have their own always-on AI agent. On a typical day, about 84 of them are actively working.…
Consistent Generative Video: Building Video Models That Remember
Introduction Generative AI offers a path to content creation at speeds and scales that traditional pipelines cannot match. One high-value use case: making existing IP characters-sports presenters, show hosts, brand ambassadors -deliver new scripts in their own likeness, without…
Network Tokenization vs PCI Tokenization: Differences, Architecture, and Which One Lifts Authorization Rates
Network tokenization vs PCI tokenization: how they differ at the architecture level, what each does to authorization rates, fraud, PCI scope, and vendor lock-in
Beyond Imitation: Teaching AI to Speak Like a Character in Hindi
Introduction As JioHotstar serves a vast, diverse audience, generative AI is crucial for fast, scalable content creation across languages and formats, capabilities that traditional methods cannot match. Content systems are rapidly shifting to generative-first architectures,…
Designing Edge Security That Actually Holds at Scale
The Problem With Assumed Security As systems scale, security shifts from a one-time setup to an ongoing architectural responsibility that needs continuous attention as infrastructure evolves and teams change. A key risk in this environment is the gap between assumed and actual…
Beyond IaC: Engineering a solution to Guarantee What Actually Is in Production
Infrastructure as Code (IaC) is often treated as the holy grail of Site Reliability Engineering (SRE). We use tools like SaltStack and Ansible, alongside golden images and post-install scripts, to define our ideal state. But here is the hidden secret of infrastructure…
Beyond Manual Checks: How We Built a 24/7 “Watchdog” for Live Sports Streaming
In the world of live sports streaming, there is no “undo” button. Live events bring out emotions in viewers and any minor buffering or failure can cause disappointment in our customers, especially if it happens in crunch moments of the live event. Our Live video validation has…
By: Jason Reaves A lot of focus specifically surrounding DPRK has been on IT workers but there are multiple entities performing various schemes. One of the more prolific ones being interviewing developers and having them work on TA supplied code repositories from various sites.…
AI Video Generation at Scale — Prompts Don’t Scale
AI Video Generation at Scale — Prompts Don’t Scale AI video generation has rapidly moved from a mere novelty to a practical tool, allowing users to easily create brief video clips from text prompts. While generating a single, impressive video is straightforward, the true…
Orchestrating JioHotstar Traffic: The Difference Between a Loading Spinner and a Winning Six
If you’ve ever streamed a high-stakes match on JioHotstar, the experience probably felt like a simple “tap and play”. It’s a seamless transition from the app icon to the stadium; a flick of a finger and you’re right there, cheering for your players to hit another six. Beneath…
Client Side Ad Insertion(CSAI) levels up using multi-period DASH in the Android ecosystem. This is our journey to upgrade ExoPlayer to leverage multi-period DASH.Introduction Multi-period DASH is a variant of DASH format that offers significant advantages, such as the ability to…
Mastering Cloud Cost Optimization: Lessons from Scaling Trino, Spark and S3
Cost management is a critical factor in the implementation and maintenance of a data platform, as it often accounts for a significant share of an organization’s overall infrastructure costs and must consistently deliver strong return on investment. As data platforms scale to…
Gen AI Video — Building Scalable Validation Framework
Gen AI Video — Building A Scalable Validation Framework We discuss building strong eval frameworks as part of our Generative AI studio to ensure that generated video maintains a high quality bar.Introduction As JioHotstar scales to serve one of the world’s largest streaming…
Modernizing Dependency Management: Beyond CocoaPods (Part 2 — The Execution)
Modernizing Dependency Management: Beyond CocoaPods (Part 2 — The Execution) Recap In Part 1, we shared the strategy — why we had to move away from CocoaPods, how we evaluated our options, and the phased migration plan we designed to modernize 60 pods over 2 quarters without…
Modernizing Dependency Management: Beyond CocoaPods (Part 1 — The Strategy) CocoaPods formed the spine of our iOS build workflow. In this two part blog, we’re sharing our journey to transparently switch away from CocoaPods to SPM, minus the drama, but plus all the scars!Where We…
How we achieved 40% cloud cost reduction with Dragonfly Cloud
At ShareChat, Redis APIs were embedded in almost everything: caches,recommendation delivery systems,deduplication queues, ranking pipelines, counters, you name it.
Scaling Deployments at Meesho: How We Built a Custom Rollout Service to Replace Our Existing System
Introduction: The Need for Bulletproof Deployments at Scale As our platform scaled and user expectations rose, so did the need for rock-solid infrastructure. One critical challenge surfaced: ensuring zero-downtime deployments while rolling out new features at speed. Despite…
Building WebRTC Recording Infrastructure using GStreamer and Temporal
Our recording infrastructure focuses on WebRTC video and audio. The goal is to allow moderation teams to access clean, archived footage—composite or individual—for compliance, post-production, or analysis.
Android Network Observability: Shedding Light on Performance Blind Spots
Introduction In Android development, network performance issues can be notoriously hard to debug. While tools like Firebase Performance Monitoring provide high-level insights like error rates and latency, they fall short in providing granular visibility into each stage of the…
Time-traveling through your data architecture: Using data agents to understand change
Learn why tracking the evolution of your data architecture in Hasura's Data Delivery Network (DDN) isn't just nice to have – it's essential for robust governance and intelligence.
Modern recommender system models can be very compute- and memory-intensive and expensive to serve. In this post, we’ll go over some of the things we did at ShareChat to make our inference more cost effective.
Empowering observability: New Platform Dashboard for Hasura DDN
We’re thrilled to introduce the Platform Dashboard for Hasura Data Delivery Network (DDN) – a comprehensive solution to elevate your operational efficiency, data observability, and decision-making.
In this blog post, we’ll explore the features and limitations of the current monitoring setup, how we’re leveraging Grafana, Prometheus, and Hasura’s Data Delivery Network (DDN) to offer a more comprehensive solution, and what this means for the future of monitoring in Hasura…
Virtual Machine Provisioning and Management in PhonePe
This blog post provides a high-level overview of PPeC (PhonePe Cloud) Agent’s architecture, its interaction with other key components like the PPeC API and PPeC Proxy, and how it optimizes tasks such as VM creation, resource allocation, and dynamic disk management. Evolution and…
We’re excited to announce that Hasura Data Delivery Network (DDN) now offers GraphQL subscriptions, making it easy for developers to build real-time features into their applications.
Introducing plugins for Hasura DDN: An easy, modular framework to customize your API
We are excited to introduce plugins to Hasura Data Delivery Network (DDN), a powerful framework designed to let you easily extend the capabilities of your API with custom logic via HTTP webhooks.
Diagnosing common issues in building healthcare data and API platforms
Whether you’re modernizing your infrastructure, enabling telehealth, or building AI-driven solutions, Hasura DDN ensures your platform is ready to meet the data challenges of today and tomorrow.
As PhonePe continues to grow rapidly, the scale and reliability of our infrastructure becomes more important. By developing our own infrastructure, we’re able to adapt quickly while keeping our services reliable. In order to meet our deployment needs, we use specialized in-house…
A new framework for building and evolving your APIs for MongoDB
We are excited to announce the release of Hasura’s native data connector for MongoDB. With this connector, users are able to rapidly author extremely capable APIs for data stored in MongoDB using Hasura’s Data Delivery Network (DDN).
Hasura DDN: The most incredible API for ClickHouse
Our commitment has always been to empower developers to build and scale applications effortlessly. As part of that commitment, we ensured Hasura’s Data Delivery Network (DDN) can harness the strength of the world's most advanced real-time analytics database, ClickHouse.
OpusFlow: Enterprise resource planning software brought to life fast with Hasura
The Dutch cloud-based enterprise resource planning (ERP) system uses Hasura to offload tedious backend development. With Hasura in its tech stack and handling so much of the backend, the OpusFlow team can focus on its core work of streamlining business operations for its clients.
Securing the Cloud: Migrating to IMDSv2 for AWS Compute Workloads
CRED has evolved to be a multi-product platform, and that necessitates the use of multiple microservices. The microservices we have run primarily on AWS ECS (Elastic Container Service). Within our ecosystem, these microservices predominantly operate on AWS ECS (Elastic Container…
We are excited to unveil the alpha version of Hasura Data Delivery Network (DDN) and share key features of our new platform building on the advancements introduced in Hasura version 3.
The Kafka Edge: Managing 100 Billion Daily Events at PhonePe
Kafka, a distributed streaming platform, has become the backbone of PhonePe’s data infrastructure, enabling them to seamlessly handle the staggering flow of information.
Last year, we announced the Hasura Data Connector framework, which lets you build connectors and bring your own data sources to Hasura. Today, we are now excited to announce a way to deploy these data connectors you build to Hasura Cloud.