Performance Testing a data pipeline at scale

Introduction At VWO, we get traffic at a very high throughput (22K req/sec) to our servers. The data pipeline crunches and transforms the data into meaningful information and stores it in the database. We recently started building another data pipeline to scale things up. Apart from the functional aspects, the QA team must ensure that the data pipeline performs well without compromising the…

This is an excerpt. The full article continues at Wingify.