Posts

TL;DR Migrating Docker workloads from macOS (Apple Silicon/ARM64) development machines to Linux (x86_64) production servers requires translating platform-specific paths, architecture-dependent images, and development shortcuts into production-ready configurations. macOS developers often rely on Docker Desktop features, /Users/... volume paths, and ARM64-native images that break silently on Linux hosts. AI tools like Claude can parse Docker Compose files and Dockerfiles to flag architecture mismatches, translate volume paths, and generate multi-platform build configs. Feed your existing configurations to the API and get back an annotated migration plan. ...

Running Claude-Style Coding Models Locally with Ollama TL;DR You can run Claude-quality coding models on your own hardware using Ollama and Open WebUI, keeping your code and conversations completely private. This guide walks you through deploying models like DeepSeek Coder, Qwen2.5-Coder, and CodeLlama that rival proprietary services for code generation, debugging, and refactoring tasks. ...

Fine-Tuning AI for Small Business: Real Examples and ROI TL;DR Generic AI chatbots give generic answers. Fine-tuned AI models sound like your business, know your products, and follow your rules. For small businesses, this means 24/7 customer support that actually represents your company accurately. The business case: Cost to fine-tune: Varies by model size and provider – expect a modest one-time investment Monthly hosting: Depends on hardware or cloud choice What it replaces: Hours of daily repetitive customer inquiries Typical ROI: Many businesses recoup costs within a few months Who it works for: Any business that answers the same types of questions repeatedly — service companies, professional firms, retail, healthcare, real estate. ...

RTX 3090 for AI: Best Value GPU for Local LLM Hosting TL;DR The NVIDIA RTX 3090 is the best price-to-performance GPU for local AI work in 2026. At $700-900 used, it delivers 24GB of VRAM — the same amount as GPUs costing 2-3x more. That 24GB is the critical spec: it determines which models you can run and how many customers you can serve. ...

Running a Private AI API for Your Business TL;DR You can run your own OpenAI-compatible API on a single machine with a GPU. Your data never leaves your hardware, costs are fixed instead of per-token, and you can serve custom fine-tuned models. What you get: A drop-in replacement for the OpenAI API (change one line of code to switch) Complete data privacy — nothing sent to external servers Fixed monthly cost instead of unpredictable per-token billing Custom models fine-tuned on your business data No per-seat licensing Minimum setup: ...

How to Fine-Tune Llama 3 on Your Business Data with QLoRA TL;DR Fine-tuning takes a general-purpose AI model like Llama 3 and trains it further on your business data. The result is a model that responds in your company’s voice, knows your products, and follows your rules — not a generic chatbot. ...

TL;DR Modern backup strategies combine traditional Linux tools with AI-powered intelligence to predict failures, optimize storage, and automate recovery workflows. This guide demonstrates integrating LLMs with rsync, Restic, BorgBackup, and ZFS to create self-healing backup systems that adapt to your infrastructure’s behavior patterns. Key takeaways: Use Claude/GPT-4 APIs to analyze backup logs and predict disk failures before they occur. Implement AI-driven deduplication strategies that learn from your data patterns. Automate backup verification through LLM-powered log analysis that catches corruption early. Deploy intelligent retention policies that adjust based on data access patterns and compliance requirements. ...

Jan AI: Guide to Self-Hosting LLMs on Your Machine TL;DR Jan AI is an open-source desktop application that lets you run large language models entirely on your local machine—no cloud dependencies, no data leaving your network. Think of it as a polished alternative to Ollama with a ChatGPT-like interface built in. ...

GPU vs CPU Inference with Ollama: Performance Guide TL;DR GPU inference with Ollama delivers dramatically faster token generation compared to CPU-only setups on consumer hardware. The exact speedup depends on your specific GPU, CPU, and model, but the difference is immediately noticeable. The performance gap widens with larger models. Key takeaways for your hardware decisions: ...

How to Set Up a Local AI Assistant That Works Offline TL;DR This guide walks you through deploying a fully offline AI assistant using Ollama and Open WebUI on a Linux system. You’ll run models like Llama 3.1, Mistral, or Qwen locally without internet connectivity or cloud dependencies. What you’ll accomplish: Install Ollama as a systemd service, download AI models for offline use, deploy Open WebUI as your chat interface, and configure everything to work without external network access. The entire stack runs on your hardware—a laptop with 16GB RAM handles 7B models, while 32GB+ systems can run 13B or larger models. ...