Catalog Details

• CATEGORY

  scaling

• CREATED BY

  Shubham Pandey

• UPDATED AT

  September 08, 2024

• VERSION

  0.0.1

Pattern Snapshot

Related Patterns

scaling

Pod Resource Request

MESHERY4a23

What this pattern does:

This design outlines a Kubernetes architecture tailored for online serving workloads that require GPU acceleration. This design is optimized for Google Kubernetes Engine (GKE), leveraging a single GPU instance to enhance computational performance for machine learning inference, real-time analytics, or other GPU-intensive tasks.

Caveats and Consideration:

Continuous monitoring and optimization of GPU utilization and workload distribution are necessary to maintain optimal performance and avoid resource contention among Pods sharing GPU resources.

Compatibility:

Recent Discussions with "meshery" Tag

• Sep 05 | Which projects (github repos) are included in Layer5.io internships Kunyue Xing
• Apr 16 | Help needed for setup of meshery cli Pratiksha Sankhe
• Aug 25 | Meshery UI local changes is not reflecting in localhost Chhanda Naskar
• Jan 09 | I am facing following issue in my local setup Roshan Goswami
• Aug 14 | Meshery Development Meeting (Aug. 14th, 2024) Vivek Vishal
• Aug 11 | Meshery containers are not stopping properly Devesh
• Aug 04 | Unable to run Meshery locally Anuj Agrawal
• Aug 04 | How to setup e2e testing environment with playwright and docker for Meshery Jerens Lensun
• Aug 09 | Help needed to setup Meshery locally Hritesh Goldar
• Aug 07 | Trying to build server on meshery is failing Devesh