How WebSockets cost us $1M on our AWS bill

BRANK

IPC is something that is rarely top-of-mind when it comes to optimising cloud costs. But it turns out that if you IPC 1TB of video per second on AWS it can result in enormous bills when done inefficiently.Join us in this deep dive where we unexpectedly discover how using WebSockets over loopback was ultimately costing us $1M/year in AWS spend and the quest for an efficient high-bandwidth, low-latency IPC.Recall.ai powers meeting bots for hundreds of companies. We capture millions of meetings per month, and operate enormous infrastructure to do so.We run all this infrastructure on AWS. Cloud computing is enormously convenient, but also notoriously expensive, which means performance and efficiency is very important to us.In order to deliver a cost-efficient service to our customers, we're determined to squeeze every ounce of performance we can from our hardware.We do our video processing on the CPU instead of on GPU, as GPU availability on the cloud providers has been patchy in the last…