huggingface-pytorch-inference
Last changed
Request a free trial
Contact our team to test out this image for free. Please also indicate any other images you would like to evaluate.
Tag: latest
| Has apk? | no |
| Has a shell? | yes |
| User | 0 |
| Environment variables | CUDA_VERSION=12.9DEBIAN_FRONTEND=noninteractiveDLC_CONTAINER_TYPE=inferenceHF_HUB_ENABLE_HF_TRANSFER=1HF_HUB_USER_AGENT_ORIGIN=aws:sagemaker:gpu-cuda:inference:regularLANG=C.UTF-8LC_ALL=C.UTF-8LD_LIBRARY_PATH=/opt/conda/lib:/usr/local/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/home/.openmpi/lib/LD_PRELOAD=/usr/local/lib/libnccl.soMKL_THREADING_LAYER=GNUNVARCH=x86_64NVIDIA_DRIVER_CAPABILITIES=compute,utilityNVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536NVIDIA_VISIBLE_DEVICES=allNV_CUDA_COMPAT_PACKAGE=cuda-compat-12-9NV_CUDA_CUDART_VERSION=12.9PATH=/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/.openmpi/binPYTHONDONTWRITEBYTECODE=1PYTHONIOENCODING=UTF-8PYTHONUNBUFFERED=1SSL_CERT_FILE=/etc/ssl/certs/ca-certificates.crtTEMP=/tmpTORCH_CUDA_ARCH_LIST=5.0 7.0+PTX 7.5+PTX 8.0 8.6 9.0 |
| Entrypoint | python /usr/local/bin/dockerd-entrypoint.py |
| CMD | serve |
| Volumes | — |
| Working directory | / |
| Stop signal | — |
{
"User": "0",
"Env": [
"CUDA_VERSION=12.9",
"DEBIAN_FRONTEND=noninteractive",
"DLC_CONTAINER_TYPE=inference",
"HF_HUB_ENABLE_HF_TRANSFER=1",
"HF_HUB_USER_AGENT_ORIGIN=aws:sagemaker:gpu-cuda:inference:regular",
"LANG=C.UTF-8",
"LC_ALL=C.UTF-8",
"LD_LIBRARY_PATH=/opt/conda/lib:/usr/local/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/home/.openmpi/lib/",
"LD_PRELOAD=/usr/local/lib/libnccl.so",
"MKL_THREADING_LAYER=GNU",
"NVARCH=x86_64",
"NVIDIA_DRIVER_CAPABILITIES=compute,utility",
"NVIDIA_REQUIRE_CUDA=cuda>=12.4 brand=tesla,driver>=470,driver<471 brand=unknown,driver>=470,driver<471 brand=nvidia,driver>=470,driver<471 brand=nvidiartx,driver>=470,driver<471 brand=geforce,driver>=470,driver<471 brand=geforcertx,driver>=470,driver<471 brand=quadro,driver>=470,driver<471 brand=quadrortx,driver>=470,driver<471 brand=titan,driver>=470,driver<471 brand=titanrtx,driver>=470,driver<471 brand=tesla,driver>=525,driver<526 brand=unknown,driver>=525,driver<526 brand=nvidia,driver>=525,driver<526 brand=nvidiartx,driver>=525,driver<526 brand=geforce,driver>=525,driver<526 brand=geforcertx,driver>=525,driver<526 brand=quadro,driver>=525,driver<526 brand=quadrortx,driver>=525,driver<526 brand=titan,driver>=525,driver<526 brand=titanrtx,driver>=525,driver<526 brand=tesla,driver>=535,driver<536 brand=unknown,driver>=535,driver<536 brand=nvidia,driver>=535,driver<536 brand=nvidiartx,driver>=535,driver<536 brand=geforce,driver>=535,driver<536 brand=geforcertx,driver>=535,driver<536 brand=quadro,driver>=535,driver<536 brand=quadrortx,driver>=535,driver<536 brand=titan,driver>=535,driver<536 brand=titanrtx,driver>=535,driver<536",
"NVIDIA_VISIBLE_DEVICES=all",
"NV_CUDA_COMPAT_PACKAGE=cuda-compat-12-9",
"NV_CUDA_CUDART_VERSION=12.9",
"PATH=/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/.openmpi/bin",
"PYTHONDONTWRITEBYTECODE=1",
"PYTHONIOENCODING=UTF-8",
"PYTHONUNBUFFERED=1",
"SSL_CERT_FILE=/etc/ssl/certs/ca-certificates.crt",
"TEMP=/tmp",
"TORCH_CUDA_ARCH_LIST=5.0 7.0+PTX 7.5+PTX 8.0 8.6 9.0"
],
"Entrypoint": [
"python",
"/usr/local/bin/dockerd-entrypoint.py"
],
"Cmd": [
"serve"
],
"WorkingDir": "/",
"Labels": {
"dev.chainguard.image.title": "huggingface-pytorch-inference",
"dev.chainguard.package.main": "huggingface-pytorch-inference-cuda-12.9",
"org.opencontainers.image.authors": "Chainguard Team https://www.chainguard.dev/",
"org.opencontainers.image.created": "2025-10-22T19:44:56Z",
"org.opencontainers.image.source": "https://github.com/chainguard-images/images-private/tree/main/images/huggingface-pytorch-inference",
"org.opencontainers.image.title": "huggingface-pytorch-inference",
"org.opencontainers.image.url": "https://images.chainguard.dev/directory/image/huggingface-pytorch-inference/overview",
"org.opencontainers.image.vendor": "Chainguard"
}
}Safe Source for Open Source™