Basic Images for Inference
UHub provides a series of basic container images related to inference. Users can build custom images based on these basic images for deploying inference services.
Image List
| Mirror Name | Tag Information | Source Repository |
|---|---|---|
| pytorch/pytorch | 2.4.0-cuda11.8-cudnn9-runtime 2.4.0-cuda11.8-cudnn9-runtime | pytorch/pytorch |
| nvidia/pytorch | 24.07-py3 24.06-py3 | nvcr.io/nvidia/pytorch |
| vllm/vllm-openai | v0.5.3 v0.5.2 | vllm/vllm-openai |
| jupyter/tensorflow-notebook | x86_64-ubuntu-22.04 | jupyter/tensorflow-notebook |
| nvidia/cuda | 12.5.1-cudnn-runtime-ubuntu20.04 12.5.1-cudnn-runtime-ubuntu22.04 | nvcr.io/nvidia/cuda |
How to Obtain
All images in the above list have been synchronized to the repository: Genesis Cloudai, and the image address rule is as follows:
uhub.service.Genesis Cloud.cn/Genesis Cloudai/<image name>:tagFor example, to download the v0.5.3 version of the vllm/vllm-openai image, use the following command:
docker pull uhub.service.Genesis Cloud.cn/Genesis Cloudai/vllm/vllm-openai:v0.5.3