tritonserver-trtllm-backend
Last changed
Request a free trial
Contact our team to test out this image for free. Please also indicate any other images you would like to evaluate.
Tag: latest
| Has apk? | no |
| Has a shell? | yes |
| User | 65532 |
| Environment variables | CUDA_VERSION=12.4LD_LIBRARY_PATH=/opt/tensorrt_llm/libsNVIDIA_REQUIRE_CUDA=cuda>=9.0PATH=/opt/tritonserver/venv/bin:/opt/tritonserver/bin:/usr/local/cuda-12.4/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/binPYTHONPATH=/opt/tritonserver/venv/lib/python-3.10/site-packagesSSL_CERT_FILE=/etc/ssl/certs/ca-certificates.crtTRT_ROOT=/usr/local/tensorrt |
| Entrypoint | /opt/tritonserver/bin/tritonserver |
| CMD | — |
| Volumes | — |
| Working directory | /opt/tritonserver |
| Stop signal | — |
{
"User": "65532",
"Env": [
"CUDA_VERSION=12.4",
"LD_LIBRARY_PATH=/opt/tensorrt_llm/libs",
"NVIDIA_REQUIRE_CUDA=cuda>=9.0",
"PATH=/opt/tritonserver/venv/bin:/opt/tritonserver/bin:/usr/local/cuda-12.4/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
"PYTHONPATH=/opt/tritonserver/venv/lib/python-3.10/site-packages",
"SSL_CERT_FILE=/etc/ssl/certs/ca-certificates.crt",
"TRT_ROOT=/usr/local/tensorrt"
],
"Entrypoint": [
"/opt/tritonserver/bin/tritonserver"
],
"WorkingDir": "/opt/tritonserver",
"Labels": {
"org.opencontainers.image.authors": "Chainguard Team https://www.chainguard.dev/",
"org.opencontainers.image.created": "2025-10-23T09:36:19Z",
"org.opencontainers.image.source": "https://github.com/chainguard-images/images-private/tree/main/images/tritonserver-trtllm-backend",
"org.opencontainers.image.url": "https://images.chainguard.dev/directory/image/tritonserver-trtllm-backend/overview",
"org.opencontainers.image.vendor": "Chainguard",
"dev.chainguard.package.main": "tritonserver-2.45"
}
}Safe Source for Open Source™