Thunder Compute — Cloud Computing Technology to virtualize GPUs over TCP.
Location: Atlanta, GA, USA
Industry: B2B -> Infrastructure
Tags: Developer Tools, B2B, Cloud Computing, Infrastructure, AI
YC batch: S24 | Status: Active | Team size: 2
Former names: Thunder

Thunder Compute has created virtual GPU-over-TCP technology (think PCI-express over a network). This technology creates a new cloud instance with virtual, on-demand GPUs. 

What this means for developers is one cloud instance now accommodates any development workflow. A developer can build and debug in a CPU-only dev machine, then scale to a massive cluster with one command. This flexibility saves time spent configuring instances and cost of paying for idle compute during development.

In the background, our technology dramatically cuts CapEx for cloud providers. It does this by:

1) Placing multiple workloads on a single GPU with dynamic memory sharing, similar to vCPUs on AWS, improving utilization

2) Allowing CPU-only instances to share pooled GPU resources rather than dedicated cards that can't be accessed by other machines, further improving utilization

GPU virtualization also saves OpEx by reducing IT and procurement processes required to get developers access to GPUs.

Notably, this appears to be the most efficient technology for serverless GPU computing, achieving instantaneous cold starts by decoupling the GPU environment from the physical GPU.