Blog

Thoughts on cloud, AI and DevOps

Practical write-ups for small teams, in plain English. A new post every week.

Browse by topic

Start here: hands-on guides

Hands-on guide · AWS · US infrastructure

How to Deploy Llama 3.1 on AWS EC2 (g4dn.xlarge) for Under $1/Hour

A complete walkthrough with measured results: 34 tokens per second at about $0.53 an hour.

Hands-on guide · UpCloud · European infrastructure

Deploying Llama 3.1 on UpCloud (NVIDIA L4) with llama.cpp

The same model on EU-hosted hardware: 50.5 tokens per second, for clients who can’t use US infrastructure.

All posts

Describe your problem. I’ll reply within 24 hours with a plan.