Chainguard Container for librechat-fips

A FIPS-compliant AI chat application.

Chainguard Containers are regularly-updated, secure-by-default container images.

Download this Container Image

For those with access, this container image is available on cgr.dev:

docker pull cgr.dev/ORGANIZATION/librechat-fips:latest

Be sure to replace the ORGANIZATION placeholder with the name used for your organization's private repository within the Chainguard Registry.

Compatibility Notes

LibreChat is an open-source AI chat application that allows users to interact with various AI models through a unified interface. Chainguard's librechat-fips container image is a FIPS-compliant version comparable to the upstream LibreChat image available on Docker Hub.

Important:* When deploying the Chainguard LibreChat image to Kubernetes, you must use the Chainguard IAMGuarded MongoDB Helm chart as a separate installation:

# Deploy MongoDB using Chainguard IAMGuarded chart
helm install mongodb oci://cgr.dev/$ORGANIZATION/iamguarded-charts/mongodb \
  --namespace librechat \
  --create-namespace \
  --set auth.rootPassword=PASSWORD

# Then deploy LibreChat with mongodb.enabled=false
helm install librechat oci://ghcr.io/danny-avila/librechat-chart/librechat \
  --namespace librechat \
  --values values.yaml  # mongodb.enabled: false in values

FIPS Compliance

These FIPS-compliant images include OpenSSL FIPS provider and are built with FIPS-validated cryptographic modules. Key FIPS features include:

• FIPS-validated OpenSSL provider - Uses OpenSSL FIPS provider for cryptographic operations
• Approved algorithms only - Restricted to FIPS-approved cryptographic algorithms
• FIPS mode enforcement - Cryptographic operations automatically use FIPS-validated modules
• Enhanced TLS security - TLS configurations restricted to FIPS-approved ciphers and algorithms (TLS 1.2/1.3 with AES-GCM)

The FIPS version is rigorously tested with TLS-enabled Redis connections to ensure all cryptographic operations comply with FIPS 140-2 requirements.

Getting Started

LibreChat FIPS requires a MongoDB database and several environment variables for encryption and authentication. Below are examples for both Docker and Kubernetes deployments.

Running with Docker

Basic Setup (Non-TLS)

First, start a MongoDB container:

docker run -d --name librechat-mongo \
  -e MONGO_INITDB_DATABASE=LibreChat \
  -p 27017:27017 \
  cgr.dev/ORGANIZATION/mongodb:latest

Generate required secrets:

JWT_SECRET=$(openssl rand -base64 32)
JWT_REFRESH_SECRET=$(openssl rand -base64 32)
CREDS_KEY=$(openssl rand -base64 32)
CREDS_IV=$(openssl rand -base64 16)

Run LibreChat FIPS:

docker run -d --name librechat-fips \
  --link librechat-mongo:mongo \
  -p 3080:3080 \
  -e MONGO_URI=mongodb://mongo:27017/LibreChat \
  -e JWT_SECRET="${JWT_SECRET}" \
  -e JWT_REFRESH_SECRET="${JWT_REFRESH_SECRET}" \
  -e CREDS_KEY="${CREDS_KEY}" \
  -e CREDS_IV="${CREDS_IV}" \
  cgr.dev/ORGANIZATION/librechat-fips:latest

Access the application at http://localhost:3080.

Advanced Setup with TLS Redis

For production deployments requiring FIPS-compliant TLS connections with Redis:

Start Redis with TLS:

docker run -d --name librechat-redis \
  -v "${CERTS_DIR}:${CERTS_DIR}:ro" \
  -v "/tmp/redis-tls.conf:/tmp/redis-tls.conf:ro" \
  -p 6380:6380 \
  cgr.dev/ORGANIZATION/redis:latest \
  redis-server /tmp/redis-tls.conf

Start LibreChat FIPS with TLS Redis:

docker run -d --name librechat-fips \
  --link librechat-mongo:mongo \
  --link librechat-redis:redis \
  -v "${CERTS_DIR}:${CERTS_DIR}:ro" \
  -p 3080:3080 \
  -e MONGO_URI=mongodb://mongo:27017/LibreChat \
  -e JWT_SECRET="${JWT_SECRET}" \
  -e JWT_REFRESH_SECRET="${JWT_REFRESH_SECRET}" \
  -e CREDS_KEY="${CREDS_KEY}" \
  -e CREDS_IV="${CREDS_IV}" \
  -e USE_REDIS=true \
  -e REDIS_URI=rediss://redis:6380 \
  -e REDIS_CA="${CERTS_DIR}/ca-cert.pem" \
  cgr.dev/ORGANIZATION/librechat-fips:latest

Verify TLS connection:

# Test Redis TLS connectivity
docker exec librechat-redis redis-cli -p 6380 \
  --tls --cacert "${CERTS_DIR}/ca-cert.pem" ping

# Verify TLS protocol version
echo 'QUIT' | openssl s_client -connect localhost:6380 \
  -tls1_2 -CAfile "${CERTS_DIR}/ca-cert.pem" 2>&1 | grep "Protocol"

Deploying with Helm on Kubernetes

LibreChat FIPS can be deployed to Kubernetes using the official Helm chart with Chainguard FIPS images.

First, create a values file with your configuration:

# values.yaml
image:
  registry: cgr.dev
  repository: ORGANIZATION/librechat-fips
  tag: latest
  pullPolicy: Always

mongodb:
  enabled: false  # Use external MongoDB

librechat:
  configEnv:
    MONGO_URI: "mongodb://root:PASSWORD@mongodb:27017/LibreChat?authSource=admin"
    CREDS_KEY: ""  # Set via secret
    CREDS_IV: ""   # Set via secret
    JWT_SECRET: ""  # Set via secret
    JWT_REFRESH_SECRET: ""  # Set via secret
    ALLOW_REGISTRATION: "true"
    ALLOW_SOCIAL_LOGIN: "true"

Create Kubernetes secrets for sensitive values:

# Generate secret values
JWT_SECRET=$(openssl rand -base64 32)
JWT_REFRESH_SECRET=$(openssl rand -base64 32)
CREDS_KEY=$(openssl rand -base64 32)
CREDS_IV=$(openssl rand -base64 16)

# Create the secret
kubectl create secret generic librechat-credentials-env \
  --namespace=librechat \
  --from-literal=JWT_SECRET="${JWT_SECRET}" \
  --from-literal=JWT_REFRESH_SECRET="${JWT_REFRESH_SECRET}" \
  --from-literal=CREDS_KEY="${CREDS_KEY}" \
  --from-literal=CREDS_IV="${CREDS_IV}"

Deploy MongoDB using Helm (if not using an external database):

helm install mongodb oci://cgr.dev/$ORGANIZATION/iamguarded-charts/mongodb \
  --namespace librechat \
  --create-namespace \
  --set auth.rootPassword=PASSWORD

Install LibreChat FIPS:

helm install librechat oci://ghcr.io/danny-avila/librechat-chart/librechat \
  --namespace librechat \
  --create-namespace \
  --values values.yaml

Verify the deployment:

kubectl get pods -n librechat
kubectl logs -n librechat -l app.kubernetes.io/name=librechat-librechat

You should see logs indicating:

• Connected to MongoDB
• Server listening on all interfaces at port 3080

Required Environment Variables

LibreChat FIPS requires the following environment variables:

Optional environment variables for Redis and additional configuration:

Documentation and Resources

• LibreChat Official Documentation
• LibreChat GitHub Repository
• LibreChat Redis TLS Configuration
• LibreChat Helm Chart

What are Chainguard Containers?

Chainguard's free tier of Starter container images are built with Wolfi, our minimal Linux undistro.

All other Chainguard Containers are built with Chainguard OS, Chainguard's minimal Linux operating system designed to produce container images that meet the requirements of a more secure software supply chain.

The main features of Chainguard Containers include:

• Minimal design, without unnecessary software bloat
• Daily builds to ensure container images are up-to-date with available security patches
• High quality build-time SBOMs attesting to the provenance of all artifacts within the image
• Verifiable signatures provided by Sigstore
• Reproducible builds with Cosign and apko (read more about reproducibility)

For cases where you need container images with shells and package managers to build or debug, most Chainguard Containers come paired with a development, or -dev, variant.

In all other cases, including Chainguard Containers tagged as :latest or with a specific version number, the container images include only an open-source application and its runtime dependencies. These minimal container images typically do not contain a shell or package manager.

Although the -dev container image variants have similar security features as their more minimal versions, they include additional software that is typically not necessary in production environments. We recommend using multi-stage builds to copy artifacts from the -dev variant into a more minimal production image.

Need additional packages?

To improve security, Chainguard Containers include only essential dependencies. Need more packages? Chainguard customers can use Custom Assembly to add packages, either through the Console, chainctl, or API.

To use Custom Assembly in the Chainguard Console: navigate to the image you'd like to customize in your Organization's list of images, and click on the Customize image button at the top of the page.

Learn More

Refer to our Chainguard Containers documentation on Chainguard Academy. Chainguard also offers VMs and Libraries — contact us for access.

Trademarks

This software listing is packaged by Chainguard. The trademarks set forth in this offering are owned by their respective companies, and use of them does not imply any affiliation, sponsorship, or endorsement by such companies.