Catalog Details

Design Snapshot

Related Designs

deployment
vault-0.30.1.tgz
MESHERY40c7

What This Design Does:

Deploy torchserve inference server with prepared T5 model and Client Application. Manifests were tested against GKE Autopilot Kubernetes cluster.

Caveats and Consideration:

To configure HPA base on metrics from torchserve you need to: Enable Google Manager Prometheus or install OSS Prometheus. Install Custom Metrics Adapter. Apply pod-monitoring.yaml and hpa.yaml

Compatibility: