Guides & Benchmarks

Hardware benchmarks, VRAM sizing and compliance playbooks for running private AI in regulated industries.

Phase 1: Local AI & Hardware

Phase 1: Local AI & HardwareKD 4

Qwen3-32B VRAM Calculator: FP16 vs Q8_0 vs Q4_K_M Memory Math and GPU Benchmarks

Qwen3-32B VRAM calculator: FP16, Q8_0 and Q4_K_M memory math, KV cache sizing, RTX 5090/4090 and Mac Studio estimates, plus Ollama and vLLM commands.

Phase 2: Regulated RAG & Compliance

Phase 2: Regulated RAG & ComplianceKD 4

Docling vs PyMuPDF4LLM for Financial Tables: Multi-Column Statements and Tax Audit PDFs

Docling vs PyMuPDF4LLM on financial statements and tax audit PDFs: speed, merged-cell table handling, licensing, Python code and local RAG tips.