Dominic

0 Followers · 0 Following

• Joined on 2024-12-03

Repositories Projects Packages Public Activity Starred Repositories

vllm (latest)

Published 2026-05-13 13:35:52 +02:00 by Dominic

Installation

Pull the image from the command line:

docker pull www.git.xn--spp-hoa.li/dominic/vllm:latest

Digest

sha256:1c2fc0b4fac2b3dfdbc8bae6cb60ff19934221cd160aa0f195722b9405561783

For more information on the Container registry, see the documentation.

Image Layers

ARG RELEASE

ARG LAUNCHPAD_BUILD_ARCH

LABEL org.opencontainers.image.ref.name=ubuntu

LABEL org.opencontainers.image.version=24.04

ADD file:3f78aa860931e0853077f09eb31eddbeeef8a9dd70977305b4876aa176770721 in /

CMD ["/bin/bash"]

ARG PYTORCH_VERSION=2.11.0

ARG TRITON_VERSION=

ARG TARGETPLATFORM=linux/amd64

ARG CUDA_VERSION=13.0.2

LABEL com.nvidia.volumes.needed=nvidia_driver

RUN |4 PYTORCH_VERSION=2.11.0 TRITON_VERSION= TARGETPLATFORM=linux/amd64 CUDA_VERSION=13.0.2 /bin/sh -c apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends ca-certificates libjpeg-dev libpng-dev python-is-python3 python3 python3-dev python3-pip && rm -rf /var/lib/apt/lists/* # buildkit

COPY /usr/local/lib/python3.12 /usr/local/lib/python3.12 # buildkit

COPY /usr/local/bin /usr/local/bin # buildkit

RUN |4 PYTORCH_VERSION=2.11.0 TRITON_VERSION= TARGETPLATFORM=linux/amd64 CUDA_VERSION=13.0.2 /bin/sh -c if test -n "${CUDA_VERSION}" -a "${TARGETPLATFORM}" != "linux/arm64"; then apt-get update -qq && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends gcc && rm -rf /var/lib/apt/lists/*; fi # buildkit

ENV NVIDIA_VISIBLE_DEVICES=all

ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility

ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64

ENV PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

ENV PYTORCH_VERSION=2.11.0

WORKDIR /workspace

WORKDIR /app

COPY /uv /uvx /bin/ # buildkit

RUN /bin/sh -c apt-get update && apt-get install -y --no-install-recommends libglib2.0-0 curl && rm -rf /var/lib/apt/lists/* # buildkit

COPY pyproject.toml uv.lock ./ # buildkit

RUN /bin/sh -c uv export --frozen --no-dev -o /tmp/requirements.txt && uv pip install --system --no-cache --break-system-packages -r /tmp/requirements.txt # buildkit

COPY app/ ./app/ # buildkit

EXPOSE [8000/tcp]

HEALTHCHECK &{["CMD-SHELL" "curl -f http://localhost:8000/health || exit 1"] "30s" "10s" "1m0s" "0s" '\x03'}

CMD ["uvicorn" "app.main:app" "--host" "0.0.0.0" "--port" "8000"]

Labels

Key	Value
com.nvidia.volumes.needed	nvidia_driver
org.opencontainers.image.ref.name	ubuntu
org.opencontainers.image.version	24.04

Details

Container

2026-05-13 13:35:52 +02:00

7

OCI / Docker

linux/amd64

2.9 GiB

Versions (2) View all

buildcache 2026-05-13

latest 2026-05-13