marksmith.dev

My Thoughts

Exploring web development, design patterns, and the future of technology.

1 articleSearchable archiveTagged topics

Tag: #GPU

Official RunPod GPU cloud pricing page screenshot

4/3/2026AI InfrastructureLLM

Running LLMs Locally vs Renting Cloud GPUs: The Real Cost Breakdown

As of April 8, 2026, the current official numbers are stark. AWS On-Demand shared GPU capacity ranges from $10.49264/hour for g6e.12xlarge to $55.04/hour for p5.48xlarge, while current public marketplace listings from RunPod and Lambda sit much lower for narrower GPU slices. The right answer is still utilisation: rent for bursts, buy for steady workloads that fit your hardware.