Workspace Operator: Seamless resource management tool
Requirement:
Customer needed a robust solution for their server with 8 A100 GPUs, capable of handling 56 users simultaneously, each accessing a specific portion of the GPU. Additionally, the requirement included the use of custom environments like YOLO and ESRT.
Solution Provided:
We developed the Workspace Operator, a tailored application offering pre-configured environments (YOLO, ESRT, BCSCN Super Resolution) and addressing the specified needs.
This solution efficiently manages GPU resources through Multi-Instance GPU (MIG) integration, ensuring fair and optimized distribution among concurrent users. The user-friendly Workspace Operator simplifies the deployment of custom environments, enabling easy switching between YOLO, ESRT, and BCSCN. Moreover, a secure Tunnel application has been integrated, providing a VPN connection to safeguard customer’s server, ensuring the privacy and integrity of their data.