LLMs with 8GB / 16GB
Can a modern
Dave tests llama3.1 and llama3.2 using Ollama on a Raspberry Pi, a Herk Orion Mini PC, a 3970X, an M2 Mac Pro, and a ... Here's the one change that took mine...
Can a modern
Dave tests llama3.1 and llama3.2 using Ollama on a Raspberry Pi, a Herk Orion Mini PC, a 3970X, an M2 Mac Pro, and a ...
Here's the one change that took mine from ~120 tok/s to 1200+ without a new GPU. TryHackMe just launched Cyber Security 101 ...
my latest project: Intuitive AI Academy, learn modern AI/
Is
Unlock the power of large language models on your CPU! This video showcases LamaFile, a revolutionary tool that lets you run ...
Running local AI on an
Stop sending your private data to giant tech companies and start running powerful AI models locally on your own hardware.
Stop wasting your hardware—here is how to 2x or 3x your local
SmartStack is a technical showcase of local AI. All scripts, research, benchmarks, and video editing are completely human-made.
Can you actually run an 80B parameter AI model on a
A 110 billion parameter AI model running on a laptop that even a 5090 can't handle. PLAUD NotePin ($10 OFF with the code ...
In this video, we explore the various Ollama models available and help you determine which one is best for your custom needs.