The "Holy Crap, AI Runs
On MY Computer?!"
Guide to Ollama

What Even Is Ollama?

Imagine ChatGPT… but it lives on your computer. No internet needed. No subscriptions. No one reading your prompts. Just you and a very smart llama.

Ollama is a free, open-source tool that lets you download and run powerful AI models (called LLMs — Large Language Models) right on your own hardware. Your data never leaves your machine. It's like having a tiny genius living inside your PC.

Before We Start: Do You Have the Goods?

Let's make sure your PC can handle this:

---

1 Download Ollama

1. Open your browser and go to ollama.com/download
2. Click the big "Download for Windows" button
3. A file called OllamaSetup.exe will land in your Downloads folder

---

2 Install It (Still Easy)

1. Double-click OllamaSetup.exe
2. If Windows Defender pops up with "Windows protected your PC" — click "More info" → "Run anyway" (it's safe, promise)
3. Follow the installer — it's basically just clicking "Next" a few times
4. When it's done, Ollama will appear as a little llama icon in your system tray (bottom-right of your taskbar, near the clock)

---

3 Open a Terminal (Don't Panic)

You're about to use the command line. Deep breaths. It's just typing words. You've got this.

Option A — PowerShell (Recommended)

Press Win + X → click "Terminal" or "Windows PowerShell"

Option B — Command Prompt

Press Win + R, type cmd, hit Enter

You should see a dark window with a blinking cursor. This is where the magic happens.

---

4 Pull Your First Model

"Pulling" a model means downloading an AI brain to your computer. Let's start with a great all-rounder:

ollama pull llama3.2

Hit Enter and watch it download. This grabs Meta's Llama 3.2 model (~2 GB for the 3B version).

What You'll See

pulling manifest
pulling abc123def456... 100% ▕████████████████▏ 2.0 GB
pulling 987654fedcba... 100% ▕████████████████▏ 1.5 KB
verifying sha256 digest
success

---

5 Talk to Your AI!

This is the moment. Type:

ollama run llama3.2

You'll see a prompt that says >>>. That means the AI is listening. Try:

>>> Hey there! What can you help me with?

>>> Explain quantum physics like I'm a golden retriever

>>> Write me a haiku about debugging code

>>> What's a good recipe for someone who only has
    eggs, cheese, and sadness?

>>> Pretend you're a pirate who's also a life coach

AND IT RESPONDS. Right there. On YOUR computer. No cloud. No API key. No monthly fee. Just raw, local AI power.

To exit the chat, type:

>>> /bye

---

6 Try More Models

Here's the fun part — there's a whole buffet of AI models. Each one has different strengths:

Model	Command	Size	Good For
Llama 3.2	ollama pull llama3.2	~2 GB	General chat, everyday tasks
Llama 3.1 8B	ollama pull llama3.1	~4.7 GB	Smarter general purpose
Mistral	ollama pull mistral	~4 GB	Fast, great at reasoning
Code Llama	ollama pull codellama	~3.8 GB	Writing & explaining code
Phi-3	ollama pull phi3	~2.2 GB	Surprisingly smart for its size
Gemma 2	ollama pull gemma2	~5.4 GB	Google's model, great quality
Llama 3.1 70B	ollama pull llama3.1:70b	~40 GB	The big brain (needs 64 GB+ RAM)

---

⌨️ Commands Cheat Sheet

Keep this taped to your monitor.

ollama list              # See all your downloaded models
ollama pull <model>      # Download a new model
ollama run <model>       # Start chatting with a model
ollama rm <model>        # Delete a model (free up space)
ollama show <model>      # See model details
ollama ps                # See what's currently running
ollama serve             # Manually start the Ollama server
ollama --version         # Check your Ollama version

---

🎨 Bonus: Use It With a Pretty UI

Typing in a terminal is cool and all, but what if you want a ChatGPT-like interface? Two popular free options:

Option A — Open WebUI (Most Popular)

If you have Docker installed (or want to install it):

docker run -d -p 3000:8080 --name open-webui \
  ghcr.io/open-webui/open-webui:main

Then visit http://localhost:3000 in your browser. ChatGPT vibes, but local.

Option B — Chatbox (Easiest)

1. Go to chatboxai.app
2. Download the Windows version
3. In settings, select "Ollama" as your AI provider
4. Set the API URL to http://localhost:11434
5. Pick your model and start chatting

---

🔧 Troubleshooting (Because Computers)

"ollama is not recognized…"

Close and reopen your terminal. If still broken, restart your PC. Ollama needs to be in your system PATH (the installer does this, but sometimes Windows needs a nudge).

Everything is super slow

You might be running on CPU only. Check if you have an NVIDIA GPU by typing nvidia-smi in your terminal. If you do, make sure your NVIDIA drivers are up to date.

Model won't load / out of memory

The model is too big for your RAM. Try a smaller model like llama3.2 or phi3.

Ollama icon not in system tray

Search "Ollama" in the Start menu and launch it. It should appear in the tray.

---

What You Just Accomplished

Let's take a moment to appreciate what you did:

• ✓ Installed a local AI runtime
• ✓ Downloaded a large language model
• ✓ Had a conversation with AI running entirely on YOUR hardware
• ✓ Kept your data 100% private
• ✓ Paid exactly $0.00

You're not just "using AI" anymore — you're running AI. On your own terms. Welcome to the club. 🦙

---

Want to Go Deeper?

Now go forth and chat with your llama. 🦙