# Gemma on Google Cloud

Google Cloud offers several routes for deploying, serving and fine-tuning Gemma 4. Pick by what
you are doing, not by product name — each card jumps to the detail below.

### Serve it

<div class="card-grid">
<a class="card" href="google-cloud.md#cloud-run">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-play gemma-icon" viewBox="0 0 24 24"><path d="M5 5a2 2 0 0 1 3.008-1.728l11.997 6.998a2 2 0 0 1 .003 3.458l-12 7A2 2 0 0 1 5 19z"/></svg></span>
  <div class="card-title">Cloud Run</div>
  <p class="card-desc">Fully managed, scale-to-zero, pay-per-use GPU inference.</p>
</a>
<a class="card" href="google-cloud.md#google-kubernetes-engine-gke">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-boxes gemma-icon" viewBox="0 0 24 24"><path d="M2.97 12.92A2 2 0 0 0 2 14.63v3.24a2 2 0 0 0 .97 1.71l3 1.8a2 2 0 0 0 2.06 0L12 19v-5.5l-5-3zM7 16.5l-4.74-2.85M7 16.5l5-3M7 16.5v5.17M12 13.5V19l3.97 2.38a2 2 0 0 0 2.06 0l3-1.8a2 2 0 0 0 .97-1.71v-3.24a2 2 0 0 0-.97-1.71L17 10.5zM17 16.5l-5-3M17 16.5l4.74-2.85M17 16.5v5.17"/><path d="M7.97 4.42A2 2 0 0 0 7 6.13v4.37l5 3 5-3V6.13a2 2 0 0 0-.97-1.71l-3-1.8a2 2 0 0 0-2.06 0zM12 8 7.26 5.15M12 8l4.74-2.85M12 13.5V8"/></svg></span>
  <div class="card-title">GKE</div>
  <p class="card-desc">Your own serving cluster on TPUs or GPUs, for high throughput and low latency.</p>
</a>
<a class="card" href="google-cloud.md#vllm-with-tpus">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-zap gemma-icon" viewBox="0 0 24 24"><path d="M4 14a1 1 0 0 1-.78-1.63l9.9-10.2a.5.5 0 0 1 .86.46l-1.92 6.02A1 1 0 0 0 13 10h7a1 1 0 0 1 .78 1.63l-9.9 10.2a.5.5 0 0 1-.86-.46l1.92-6.02A1 1 0 0 0 11 14z"/></svg></span>
  <div class="card-title">vLLM on TPUs</div>
  <p class="card-desc">State-of-the-art serving performance on Cloud TPUs.</p>
</a>
<a class="card" href="google-cloud.md#sovereign-cloud">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-shield gemma-icon" viewBox="0 0 24 24"><path d="M20 13c0 5-3.5 7.5-7.66 8.95a1 1 0 0 1-.67-.01C7.5 20.5 4 18 4 13V6a1 1 0 0 1 1-1c2 0 4.5-1.2 6.24-2.72a1.17 1.17 0 0 1 1.52 0C14.51 3.81 17 5 19 5a1 1 0 0 1 1 1z"/></svg></span>
  <div class="card-title">Sovereign Cloud</div>
  <p class="card-desc">Extra control and compliance for sensitive workloads.</p>
</a>
</div>

### Build with it

<div class="card-grid">
<a class="card" href="google-cloud.md#gemini-enterprise-agent-platform">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-layout-grid gemma-icon" viewBox="0 0 24 24"><rect width="7" height="7" x="3" y="3" rx="1"/><rect width="7" height="7" x="14" y="3" rx="1"/><rect width="7" height="7" x="14" y="14" rx="1"/><rect width="7" height="7" x="3" y="14" rx="1"/></svg></span>
  <div class="card-title">Agent Platform</div>
  <p class="card-desc">Test and deploy straight from Model Garden in the console.</p>
</a>
<a class="card" href="google-cloud.md#agent-development-kit-adk">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-wrench gemma-icon" viewBox="0 0 24 24"><path d="M14.7 6.3a1 1 0 0 0 0 1.4l1.6 1.6a1 1 0 0 0 1.4 0l3.106-3.105c.32-.322.863-.22.983.218a6 6 0 0 1-8.259 7.057l-7.91 7.91a1 1 0 0 1-2.999-3l7.91-7.91a6 6 0 0 1 7.057-8.259c.438.12.54.662.219.984z"/></svg></span>
  <div class="card-title">Agent Development Kit</div>
  <p class="card-desc">Orchestrate agents around Gemma's reasoning and function calling.</p>
</a>
</div>

### Train it

<div class="card-grid">
<a class="card" href="google-cloud.md#gemini-enterprise-agent-platform-training-clusters">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-graduation-cap gemma-icon" viewBox="0 0 24 24"><path d="M21.42 10.922a1 1 0 0 0-.019-1.838L12.83 5.18a2 2 0 0 0-1.66 0L2.6 9.08a1 1 0 0 0 0 1.832l8.57 3.908a2 2 0 0 0 1.66 0zM22 10v6"/><path d="M6 12.5V16a6 3 0 0 0 12 0v-3.5"/></svg></span>
  <div class="card-title">Training Clusters</div>
  <p class="card-desc">Managed infrastructure for large-scale fine-tuning of open models.</p>
</a>
<a class="card" href="google-cloud.md#maxtext">
  <span class="card-icon"><svg aria-hidden="true" xmlns="http://www.w3.org/2000/svg" fill="none" stroke="currentColor" stroke-linecap="round" stroke-linejoin="round" stroke-width="2" class="lucide lucide-cpu gemma-icon" viewBox="0 0 24 24"><path d="M12 20v2M12 2v2M17 20v2M17 2v2M2 12h2M2 17h2M2 7h2M20 12h2M20 17h2M20 7h2M7 20v2M7 2v2"/><rect width="16" height="16" x="4" y="4" rx="2"/><rect width="8" height="8" x="8" y="8" rx="1"/></svg></span>
  <div class="card-title">MaxText</div>
  <p class="card-desc">High-performance JAX implementation for Cloud TPUs.</p>
</a>
</div>

## Gemini Enterprise Agent Platform

[Gemini Enterprise Agent Platform](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/open-models/use-gemma) is a Google Cloud platform for rapidly
building and scaling machine learning projects. Gemma 4 is available in [Model
Garden](https://console.cloud.google.com/agent-platform/publishers/google/model-garden/gemma4), a curated collection of models on Gemini Enterprise Agent Platform.
You can test and deploy models directly from the console.

To learn more, refer to the following pages:

- [Agent Platform overview](https://docs.cloud.google.com/gemini-enterprise-agent-platform/overview): Get started with Gemini Enterprise Agent Platform.
- [Gemma with Gemini Enterprise Agent Platform](https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/open-models/use-gemma): Use Gemma open models with Gemini Enterprise Agent Platform.

## Cloud Run

[Cloud Run](https://cloud.google.com/run) is a fully managed platform to run your code or containers on
top of Google's highly scalable infrastructure.
[Deploy Gemma 4 on Cloud Run](https://docs.cloud.google.com/run/docs/run-gemma-on-cloud-run) using GPUs for scale-to-zero, pay-per-use
inference.

For larger mode sizes, [leverage advanced configurations](https://codelabs.developers.google.com/codelabs/cloud-run/cloud-run-gpu-rtx-pro-6000-gemma4-vllm){ data-model="gemma-4" } with RTX 6000 Pro
GPUs and Model Streaming.

## Google Kubernetes Engine (GKE)

[Google Kubernetes Engine](https://cloud.google.com/kubernetes-engine) (GKE) is a managed Kubernetes service from Google
Cloud. [Run Gemma 4 on GKE](https://cloud.google.com/kubernetes-engine/docs/tutorials/serve-gemma-gpu-vllm) for enterprise-grade container orchestration.
Use TPUs and GPUs to serve models with high throughput and low latency.

## Agent Development Kit (ADK)

Build and orchestrate AI agents with Gemma 4 and the [Agent Development Kit
(ADK)](https://adk.dev/agents/models/google-gemma/). Gemma 4's strong reasoning and function-calling capabilities make it
ideal for agentic workflows.

## Gemini Enterprise Agent Platform Training Clusters

[Fine-tune Gemma 4 using Gemini Enterprise Agent Platform Training
Clusters](https://discuss.google.dev/t/end-to-end-guide-fine-tuning-and-serving-gemma-4-on-vertex-ai/345865). Training Clusters provides optimized infrastructure for
large-scale training and fine-tuning of open models.

## vLLM with TPUs

[Serve Gemma 4 on Google Cloud TPUs](https://docs.vllm.ai/projects/recipes/en/latest/Google/Gemma4.html#cloud-tpu-deployment-via-docker){ data-model="gemma-4" } for state-of-the-art serving
performance.

## MaxText

Gemma 4 is supported in [MaxText](https://github.com/google/maxtext), a high-performance, arbitrary-sized JAX
LLM implementation for Google Cloud TPUs.

## Sovereign Cloud

Gemma 4 is available on [Sovereign Cloud](https://cloud.google.com/sovereign-cloud) solutions, providing enhanced
control and compliance for sensitive workloads.
