SDKs and Samples for Google Cloud Service Extensions
-
Updated
Jul 25, 2026 - Python
#
ext-proc
Here are 8 public repositories matching this topic...
A simple GCP traffic extension in C++
-
Updated
Jan 29, 2025 - C++
KV-cache-aware inference router for self-hosted LLM pools. Envoy ext_proc Endpoint Picker + standalone proxy, in Go.
kubernetes golang simulation routing inference load-balancer envoy gateway-api kv-cache llm ext-proc llm-serving vllm llm-inference prefix-caching
-
Updated
Jul 30, 2026 - Go
Envoy-powered LLM traffic gateway with dynamic provider routing, transparent fallback, and local E2E tests.
go docker-compose api-gateway fallback grpc openai envoy playwright llm ext-proc anthropic llm-gateway model-routing
-
Updated
Jul 20, 2026 - Go
Example of Envoy External Processor
-
Updated
Apr 14, 2026 - Go
Architectural Reference and System Flow Documentation for Distributed LLM Inference. Mapping the control-plane integration between the Kubernetes Gateway API Inference Extension and the LLM-D Inference Scheduler data-plane.
-
Updated
Mar 9, 2026 - Mermaid
Improve this page
Add a description, image, and links to the ext-proc topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ext-proc topic, visit your repo's landing page and select "manage topics."