Local AI: Ollama, GPT4All + Open WebUI

 Exploring Local LLM Managers: LMStudio, Ollama, GPT4All, and AnythingLLM : r/LocalLLM

There are a few programs that let you run AI language models locally on your own computer. LM Studio, Ollama, GPT4All, and AnythingLLM are some options.

These programs make it easier for regular people to experiment with and use advanced AI language models on their home PCs.

Jan: Open source ChatGPT-alternative that runs 100% offline - Jan.ai
Jan is an open source ChatGPT-alternative that runs 100% offline.

host ALL your AI locally - YouTube

Ollama vs GPT4All on Ubuntu Linux: Discover The Truth - YouTube

Llama 3.2 Vision + Ollama: Chat with Images LOCALLY - YouTube

Download Ollama on Windows

ollama/ollama: Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models. @GitHub

Running Meta Llama on Windows | Llama Everywhere

Running Meta Llama on Mac | Llama Everywhere

Hardware costs to run 90B llama at home? : r/LocalLLaMA

ollama/ollama: Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models. @GitHub

Ollama @GitHub (go app, node.js, python)

ollama/docs/gpu.md at main · ollama/ollama 
"Ollama supports (some) Nvidia GPUs"
"Ollama supports the (some) AMD GPUs"

Ollama models search

llama3.1 is a state-of-the-art model from Meta available in 8B, 70B and 405B parameter sizes.
size: from 4.7GB

Vision Capabilities | How-to guides

Ollama - MindsDB

A working Ollama installation: For 7B models, at least 8GB RAM is recommended. For 13B models, at least 16GB RAM is recommended. For 70B models, at least 64GB RAM is recommended.

> ollama run llama3.1:8b  

# 4.7GB, parameters 8B params, quantization 4_0

>>> tell me all tom hanks movies

/bye

> ollama pull codegemma

🏡 Home | Open WebUI

docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway \ -v open-webui:/app/backend/data --name open-webui \ --restart always ghcr.io/open-webui/open-webui:main

open http://localhost:3000/

Is Ollama supposed to run on your GPU? : r/LocalLLaMA

Force Ollama to Use Your AMD GPU (even if it's not officially supported) - YouTube

mini PC: AI TOPS: AMD Ryzen AI 9

What is TOPS and why is it important for AI? | Windows Central

TOPS denotes how many trillions of operations a system can perform per second. TOPS can be used to measure overall system performance, but it can also be split up for specific hardware... 

NVIDIA's RTX 4090 desktop graphics card (GPU) can offer more than 1,300 TOPS

The Copilot+ PC brand is used for laptops capable of running the features locally with the help of a powerful NPU with at least 40 TOPS.

Beelink SER9 AMD Ryzen™ AI 9 HX 370 Processor 12C/24T AI PC Turbo Freq

Amazon.com: Beelink AI Mini PC SER9 with AMD Ryzen AI 9 HX 370 Mini Computer(12C/24T, up to 5.1GHz), 32GB LPDDR5X 1TB PCIe4.0 x4 SSD, AI PC 4K UHD Triple Display HDMI/DP1.4/USB4/MIC/Speakers/WiFi 6/BT5.2/2.5Gbps

80 AI TOPS (NPU up to 50 TOPS)
$949 prime deal or with coupon 

AMD Ryzen™ AI 9 HX 370 @amd.com

AMD Ryzen™ AI 9 HX 370 CPU and AMD Radeon™ 890M GPU
32dB Near-Silent Operation
PDDR5X 7500MHz RAM of 32GB(8GB*4)
up to triple 4K displays.

 Amazon.com: Beelink SER9 AI Mini PC, AMD Ryzen AI 9 HX 370 (12C/24T, up to 5.1GHz), 32GB DDR5 RAM 1TB PCle 4.0 SSD, SER9 Mini Desktop Computer with 4K UHD Triple Display/Speakers/Mic Voice Interaction : Electronics

AMD Ryzen™ AI - Windows PCs with AI Built In @ amd.com

This is the world's most powerful Mini PC and I can't wait to test it: Beelink's tiny computer packs the Ryzen AI 9 HX 370 CPU and promises to deliver the GPU performance of an RTX 3050 with a whopping 50 TOPS | TechRadar

AMD Ryzen AI 9 HX 370 "Zen 5" APU Showcases Strong Single-Core Performance In Benchmark Leak, Nears Top Zen 4 Mobile Chip

previous generation, less AI performance, better price

Amazon.com: Beelink SER8 Mini PC, AMD Ryzen 7 8845HS(up to 5.1GHz) 8C/16T, Mini Computer 32GB DDR5 RAM 1TB NVMe PCIE 4.0 SSD, Mini Desktop Computer 4K Triple Screen Display WiFi6/BT5.2/WOL/W-11 Pro : Sports & Outdoors

$599 (on sale)

38 AI TOPS

AMD Ryzen™ 7 8845HS @AMD.com

and another variant with less performance and slightly lover price

AMD Ryzen 7 8745H/HS "Zen 4" APU Launched: Hawk Point Minus The AI NPU

APU that wouldn't feature any AI acceleration in the form of an NPU. The said APU is the Ryzen 7 8745H/HS which will pack a similar configuration as the Ryzen 7 8845HS but come with lower clock speeds on the CPU and the GPU.

The AMD Ryzen 7 8845HS "Hawk Point" APU features an integrated NPU with 16 TOPS and offers up to 38 platform TOPS. Since the Ryzen 7 8745HS won't feature the same AI NPU, its total TOPS will be 25 (GPU+CPU). These will be even lower TOPS than Intel's Meteor Lake "Core Ultra" CPUs which max out at a total of 34 platform TOPS.

Amazon.com: Beelink SER8 Mini PC, AMD Ryzen 7 8745HS(8C/16T, up to 4.9GHz), 32GB DDR5 RAM 1TB PCle4.0 SSD, SER8 Mini Computer Support 4K@144Hz, Tirple Display, HDMI+DP, WiFi6, BT5.2, USB4 : Electronics

$499   25 AI TOPS

previous gen

AMD Ryzen™ 7 7735HS

Ryzen 7 7735U vs Ryzen AI 9 HX 370 [10-Benchmark Showdown]

Beelink SER9 vs GTi14 Ultra and SER8 - YouTube

Amazon.com: ASUS TUF Gaming A16 (2024) Copilot+ PC Gaming Laptop, 16” 16:10 165Hz Display, AMD Ryzen™ AI 9 HX 370, NVIDIA® GeForce RTX™ 4070, 32GB LPDDR5X, 1TB PCIe Gen 4.0 SSD, Wi-Fi 6E, Windows 11, FA608WI-AB96 : Electronics

$1799 gaming laptop: with Nvidia GPU, much more AI power, 402 TOPS

   

Steps to Miles/Km Calculator

Steps to Miles Calculator

A person of average height and weight has a step length of between 2.1 and 2.5 feet,
meaning they take around 2,250 steps to walk one mile
at a moderate pace of about 3 mph (4.8 kph).

A half-mile = 1,125 walking steps.
A quarter-mile = 560 walking steps.
5,000 steps = around 2 ¼ miles.
10,000 steps = around 4 ½ miles.
15,000 steps = around 6 ¾ miles.
20,000 steps = around 9 miles.