Join our Discord Server

vLLM

Running Qwen3.6-35B-A3B (FP8) on NVIDIA DGX Spark GB10: A Complete Technical Tutorial

Learn how to run Qwen3.6-35B-A3B (FP8) on the NVIDIA DGX Spark GB10 Grace Blackwell supercomputer using vLLM. Step-by-step guide covering single...
Collabnix Team
5 min read

Running vLLM on NVIDIA DGX Spark with Docker: Zero-Compilation Guide for CUDA 13

Users on the NVIDIA Developer Forums regularly report that getting pre-built vLLM Docker images running on DGX Spark was tricky in...
Collabnix Team
2 min read

Building AI Agents on DGX Spark with Kubernetes: A Complete Tutorial

The NVIDIA DGX Spark is a compact, personal AI supercomputer powered by the GB10 Grace Blackwell Superchip. With 128GB of unified...
Collabnix Team
6 min read

From Prototype to Production: Scaling LLM Applications in Kubernetes

Learn to scale LLM applications from prototype to production with Kubernetes, vLLM, and best practices for GPU resource management and cost...
Collabnix Team
5 min read

Building a Multi-Tenant LLM Platform on Kubernetes: Complete Guide

Learn how to build a production-ready multi-tenant LLM platform on Kubernetes with isolation, resource management, and scaling. Includes YAML configs and...
Collabnix Team
5 min read

How vLLM and Docker are Changing the Game for LLM Deployments

Have you ever wanted to deploy a large language model (LLM) that doesn’t just work well but also works lightning-fast? Meet...
Tanvir Kour
2 min read

Exploring LLMs: Ollama, vLLM, Hugging Face, LangChain, and Open WebUI

The world of large language models (LLMs) is evolving rapidly, offering diverse tools for developers to integrate powerful AI into their...
Tanvir Kour
2 min read

Ollama vs. vLLM: Choosing the Best Tool for AI Model Workflows

As AI models grow in size and complexity, tools like vLLM and Ollama have emerged to address different aspects of serving and interacting with large...
Tanvir Kour
2 min read

Running OpenLLM on GPUs using PyTorch and vLLM backend in a Docker Container

OpenLLM is a powerful platform that simplifies deploying open-source large language models (LLMs). With integrations like OpenAI's Compatible Endpoints and Transformers...
Ajeet Raina
5 min read

What is vLLM and what problem does it solve?

Large language models (LLMs) have taken the world by storm, generating human-quality text, translating languages, and writing different kinds of creative...
Avinash Bendigeri
2 min read
Join our Discord Server