vLLM Now Serves Gemma 4 via Rust Frontend on AWS Graviton2 GPU Instances

A technical guide details how to build and run vLLM's Rust-based server component, vllm-rs, on an AWS G5g instance equipped with a Graviton2 (aarch64) processor and an NVIDIA T4G GPU. Since the merge of PR #40848, vLLM includes a 14-crate Rust workspace that replaces the Python FastAPI server with an Axum-based binary, making the Rust toolchain a mandatory build dependency. The setup requires rustc 1.97.1, setuptools-rust, and protobuf-compiler, as vLLM's setup.py imports Rust build tooling at module scope with no opt-out. Two artifacts are produced during the build: the vllm-rs frontend binary and a PyO3 Python extension module for tool parsing. The configuration was tested on EC2 g5g.xlarge and g5g.4xlarge instances in us-east-1a using vLLM version 0.27.2rc1.