Wednesday, April 30, 2025

Local AI: Ollama + OpenWebUI; LM Studio

I'm running my LLMs locally now! - YouTube by Maximilian Schwarzmüller

new course, $9.99 only

Local LLMs via Ollama & LM Studio - The Practical Guide | Udemy


"run free" is relative... need a powerful (enough) computer to run local, and that is not free


Run any LLM Model Locally for FREE (Ollama + OpenWebUI) - YouTube





LM Studio GUI app itself is not open source, but several components are. LM Studio's CLI (lms), Core SDK, and the MLX inferencing engine are open source under an MIT license. This allows for contributions to the core development of these components. 

LM Studio @GitHub







Kubernetes vCluster

"virtual k8s clusters" => using "classic" k8s cluster for managing "nodes" (servers for deployment)

useful for "multi-tenant" deployments.

 SE Radio 649: Lukas Gentele on Kubernetes vClusters – Software Engineering Radio

vClusters 101 — Getting started securely | by Imran Roshan | Google Cloud - Community | Medium


vCluster Deep Dive - Powering Kubernetes Environments | by Jitendra Gupta | Cloud Experts Hub | Medium


loft-sh/vcluster: vCluster - Create fully functional virtual Kubernetes clusters - Each vcluster runs inside a namespace of the underlying k8s cluster. It's cheaper than creating separate full-blown clusters and it offers better multi-tenancy and isolation than regular namespaces.