Infrastructure

Cloud, compute, networking and foundational platform infrastructure.

129 stories

How Apache YuniKorn Taught Our Kubernetes Cluster to Play Tetris
Slice

A story about Spark, scheduling, and a cloud bill that refused to make sense. Chapter 1: A Fresh Start on Kubernetes Every migration story starts with optimism, and ours was no different. We had just moved our Spark workloads from EMR to Kubernetes (EKS). On paper, it was…

slice-engineering.medium.com
The Kafka Optimization That Saved Us $350K a Year
JioHotstar

The JioHotstar platform receives in excess of 40TB data every day. At 2.1 million messages per second. At this scale, every superflous byte is costly, like real money costly. In this blog, we cover strategies that helped us optimise our ingest workflow which ultimately saved…

What We Learned from Benchmarking Knowledge Bases for Coding Agents
JioHotstar

Introduction/TL;DR At JioHotstar, we have been thinking a lot about how to give developers a better AI-assisted engineering experience. Once coding agents started becoming useful for day-to-day work, the next natural question was: how do we help those agents understand our…

Moving from Panic to Process: Testing Your Way to a Successful K8s Migration
Freshworks

by Keerthivaasan K In the season finale of Silicon Valley, there’s a classic scene: Pied Piper is live-streaming a rescue, traffic is melting the servers, and the team is pulling a “heroic save” at the 11th hour. It makes for great TV. It makes for a terrible career as an SRE.…

Journey of an Ad Request: The Hidden Engineering
JioHotstar

Advertising is a key source of revenue in most businesses. It certainly forms a key pillar for JioHotstar. There is so much technology hidden under the surface. In this blog, we will cover some of the complexity that gets unlocked when we render an ad on our content. Every…

Running Hermes at Razorpay: a Network-isolated, Self-improving “Second Brain” for every Employee
Razorpay

How we run a personal AI agent for everyone at Razorpay: always on, multi-model, and safe by construction. Contributors: Siddharth Tripathi Today, more than 220 Razorpay employees each have their own always-on AI agent. On a typical day, about 84 of them are actively working.…

Consistent Generative Video: Building Video Models That Remember
JioHotstar

Introduction Generative AI offers a path to content creation at speeds and scales that traditional pipelines cannot match. One high-value use case: making existing IP characters-sports presenters, show hosts, brand ambassadors -deliver new scripts in their own likeness, without…

Beyond Imitation: Teaching AI to Speak Like a Character in Hindi
JioHotstar

Introduction As JioHotstar serves a vast, diverse audience, generative AI is crucial for fast, scalable content creation across languages and formats, capabilities that traditional methods cannot match. Content systems are rapidly shifting to generative-first architectures,…

Designing Edge Security That Actually Holds at Scale
Meesho

The Problem With Assumed Security As systems scale, security shifts from a one-time setup to an ongoing architectural responsibility that needs continuous attention as infrastructure evolves and teams change. A key risk in this environment is the gap between assumed and actual…

Beyond Manual Checks: How We Built a 24/7 “Watchdog” for Live Sports Streaming
JioHotstar

In the world of live sports streaming, there is no “undo” button. Live events bring out emotions in viewers and any minor buffering or failure can cause disappointment in our customers, especially if it happens in crunch moments of the live event. Our Live video validation has…

Mapping Ottercookie Infrastructure
Walmart Global Tech

By: Jason Reaves A lot of focus specifically surrounding DPRK has been on IT workers but there are multiple entities performing various schemes. One of the more prolific ones being interviewing developers and having them work on TA supplied code repositories from various sites.…

AI Video Generation at Scale — Prompts Don’t Scale
JioHotstar

AI Video Generation at Scale — Prompts Don’t Scale AI video generation has rapidly moved from a mere novelty to a practical tool, allowing users to easily create brief video clips from text prompts. While generating a single, impressive video is straightforward, the true…

Orchestrating JioHotstar Traffic: The Difference Between a Loading Spinner and a Winning Six
JioHotstar

If you’ve ever streamed a high-stakes match on JioHotstar, the experience probably felt like a simple “tap and play”. It’s a seamless transition from the app icon to the stadium; a flick of a finger and you’re right there, cheering for your players to hit another six. Beneath…

Monetisation : Multi-period DASH x ExoPlayer
JioHotstar

Client Side Ad Insertion(CSAI) levels up using multi-period DASH in the Android ecosystem. This is our journey to upgrade ExoPlayer to leverage multi-period DASH.Introduction Multi-period DASH is a variant of DASH format that offers significant advantages, such as the ability to…

Mastering Cloud Cost Optimization: Lessons from Scaling Trino, Spark and S3
Slice

Cost management is a critical factor in the implementation and maintenance of a data platform, as it often accounts for a significant share of an organization’s overall infrastructure costs and must consistently deliver strong return on investment. As data platforms scale to…

slice-engineering.medium.com
Gen AI Video — Building Scalable Validation Framework
JioHotstar

Gen AI Video — Building A Scalable Validation Framework We discuss building strong eval frameworks as part of our Generative AI studio to ensure that generated video maintains a high quality bar.Introduction As JioHotstar scales to serve one of the world’s largest streaming…

Modernizing Dependency Management: Beyond CocoaPods (Part 2 — The Execution)
JioHotstar

Modernizing Dependency Management: Beyond CocoaPods (Part 2 — The Execution) Recap In Part 1, we shared the strategy — why we had to move away from CocoaPods, how we evaluated our options, and the phased migration plan we designed to modernize 60 pods over 2 quarters without…

Dependency Management: Our Journey Beyond CocoaPods (Part 1 — The Strategy)
JioHotstar

Modernizing Dependency Management: Beyond CocoaPods (Part 1 — The Strategy) CocoaPods formed the spine of our iOS build workflow. In this two part blog, we’re sharing our journey to transparently switch away from CocoaPods to SPM, minus the drama, but plus all the scars!Where We…

Scaling Deployments at Meesho: How We Built a Custom Rollout Service to Replace Our Existing System
Meesho

Introduction: The Need for Bulletproof Deployments at Scale As our platform scaled and user expectations rose, so did the need for rock-solid infrastructure. One critical challenge surfaced: ensuring zero-downtime deployments while rolling out new features at speed. Despite…

Cost-effective Inference for Ranker Models
ShareChat

Modern recommender system models can be very compute- and memory-intensive and expensive to serve. In this post, we’ll go over some of the things we did at ShareChat to make our inference more cost effective.

New observability dashboard for Hasura Cloud
Hasura

In this blog post, we’ll explore the features and limitations of the current monitoring setup, how we’re leveraging Grafana, Prometheus, and Hasura’s Data Delivery Network (DDN) to offer a more comprehensive solution, and what this means for the future of monitoring in Hasura…

Virtual Machine Provisioning and Management in PhonePe
PhonePe

This blog post provides a high-level overview of PPeC (PhonePe Cloud) Agent’s architecture, its interaction with other key components like the PPeC API and PPeC Proxy, and how it optimizes tasks such as VM creation, resource allocation, and dynamic disk management. Evolution and…

Nimbus: Flexible BareMetal Provisioning
PhonePe

As PhonePe continues to grow rapidly, the scale and reliability of our infrastructure becomes more important. By developing our own infrastructure, we’re able to adapt quickly while keeping our services reliable. In order to meet our deployment needs, we use specialized in-house…

Hasura DDN: The most incredible API for ClickHouse
Hasura

Our commitment has always been to empower developers to build and scale applications effortlessly. As part of that commitment, we ensured Hasura’s Data Delivery Network (DDN) can harness the strength of the world's most advanced real-time analytics database, ClickHouse.

Securing the Cloud: Migrating to IMDSv2 for AWS Compute Workloads
CRED

CRED has evolved to be a multi-product platform, and that necessitates the use of multiple microservices. The microservices we have run primarily on AWS ECS (Elastic Container Service). Within our ecosystem, these microservices predominantly operate on AWS ECS (Elastic Container…

engineering.cred.club
Deploy Data Connectors to Hasura Cloud
Hasura

Last year, we announced the Hasura Data Connector framework, which lets you build connectors and bring your own data sources to Hasura. Today, we are now excited to announce a way to deploy these data connectors you build to Hasura Cloud.