Catalog Details

• CATEGORY

  scaling

• CREATED BY

  Shubham Pandey

• UPDATED AT

  November 26, 2024

• VERSION

  0.0.1

Pattern Snapshot

Related Patterns

scaling

Pod Resource Request

MESHERY4a23

What this pattern does:

This design outlines a Kubernetes architecture tailored for online serving workloads that require GPU acceleration. This design is optimized for Google Kubernetes Engine (GKE), leveraging a single GPU instance to enhance computational performance for machine learning inference, real-time analytics, or other GPU-intensive tasks.

Caveats and Consideration:

Continuous monitoring and optimization of GPU utilization and workload distribution are necessary to maintain optimal performance and avoid resource contention among Pods sharing GPU resources.

Compatibility:

Recent Discussions with "meshery" Tag

• Nov 25 | T.roles_names is undefined ( permission path is not provided ) Shlok Mishra
• Nov 25 | Issue: Unable to Run make server-local in Meshery Cloud Setup Due to Soda CLI Dependency Md Kaif Ansari
• Nov 22 | Meshery CI Maintainer: Sangram Rath Vivek Vishal
• Dec 04 | Link Meshery Integrations and Github workflow or local code Shlok Mishra
• Nov 20 | Meshery Development Meeting | Nov 20th 2024 Vivek Vishal
• Nov 10 | Error in "make server" and "make ui-server" Aadarsh Shekhar
• Nov 11 | Difference in dev Environments on port 9081 and 3000 Divyansh Khatri
• Nov 10 | npm run lint:fix error Sankarshan Mishra
• Oct 30 | Getting Meshery locally using Docker Desktop for Meshery UI contribution Davidudale
• Nov 07 | Meshery + GCP Connector Santosh Kumar Doodala