How to run (any) open LLM with Ollama on Google Cloud Run [Step-by-step]

Ollama is a great way to run many open Large Language Models (LLMs). You can run Google Gemma 2, Phi 4, Mistral, and Llama 3 on your machine or the cloud with Ollama . You can also host these open LLMs as APIs using Ollama. In this post, you will learn how to host Gemma 2 (2b) with Ollama 0.5.x on Google Cloud Run; let’s get started! Table of contents # Why Google Cloud Run Create a GCS bucket…