Join our Discord Server

GPU

NVIDIA Nemotron 3.5 Lighting is available on Ollama

Most of what your coding agent does all day is boring. It reads a file. It runs git status. It greps...
Collabnix Team
9 min read

Deploying LLM Inference on Kubernetes with the NVIDIA GPU Operator: A Step-by-Step Tutorial

Serving large language models efficiently is one of the dominant themes at recent KubeCon and CloudNativeCon events, and the NVIDIA GPU...
Collabnix Team
1 min read

MCP + Kubernetes: A Step-by-Step Tutorial on Connecting AI Agents to Your Cluster

The Model Context Protocol (MCP) has quickly become one of the most talked-about topics at recent CNCF and KubeCon hallway tracks....
Collabnix Team
2 min read
How to Run GPU Workloads on Kubernetes with NVIDIA: A Step-by-Step Guide

How to Run GPU Workloads on Kubernetes with NVIDIA: A Step-by-Step Guide

Learn how to leverage NVIDIA GPUs to run high-performance workloads on Kubernetes clusters.
Collabnix Team
7 min read
Ollama Python Library tutorial - running LLMs locally

Fine-Tuning Open Source LLMs: Complete Infrastructure Guide 2024

Master LLM fine-tuning infrastructure with Kubernetes, GPU optimization, and distributed training. Includes YAML configs, troubleshooting, and cost optimization.
Collabnix Team
5 min read

From Prototype to Production: Scaling LLM Applications in Kubernetes

Learn to scale LLM applications from prototype to production with Kubernetes, vLLM, and best practices for GPU resource management and cost...
Collabnix Team
5 min read

Kubernetes Autoscaling for LLM Inference: Complete Guide (2024)

Master Kubernetes autoscaling for LLM inference workloads. Learn HPA, KEDA, VPA configuration with practical examples for efficient GPU utilization.
Collabnix Team
5 min read

Is NPU better than GPU?

When discussing hardware acceleration for AI workloads, both Neural Processing Units (NPUs) and Graphics Processing Units (GPUs) are leading technologies. However,...
Adesoji Alu
4 min read

Using Docker GenAI Stack with GPU for Generative AI Models

Introducing the Docker GenAI Stack, a set of open-source tools that simplify the development and deployment of Generative AI applications. With...
Ajeet Raina
5 min read

Docker, Prometheus & Pushgateway for NVIDIA GPU Metrics & Monitoring

In my last blog post, I talked about how to get started with NVIDIA docker & interaction with NVIDIA GPU system. I...
Ajeet Raina
3 min read
Join our Discord Server