DraganSr

web-links (blinks) web-log (blog) by Dragan Sretenovic

Wednesday, April 30, 2025

Local AI: Ollama + OpenWebUI; LM Studio

I'm running my LLMs locally now! - YouTube by Maximilian Schwarzmüller

new course, $9.99 only

Local LLMs via Ollama & LM Studio - The Practical Guide | Udemy


"run free" is relative... need a powerful (enough) computer to run local, and that is not free

Learn Ollama in 15 Minutes - Run LLM Models Locally for FREE - YouTube


Run any LLM Model Locally for FREE (Ollama + OpenWebUI) - YouTube


Ollama: A Deep Dive into Running Large Language Models Locally(PART-1): | by Anoop Maurya | Medium


ollama/ollama: Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models. @GitHub, GoLang, MIT

open-webui/open-webui: User-friendly AI Interface (Supports Ollama, OpenAI API, ...) @GitHub
Python+JS/TS+svelte

Open WebUI


Google AI Gemma open models | Google for Developers  |  Google AI for Developers


LM Studio - Discover, download, and run local LLMs

Download and run Llama, DeepSeek, Mistral, Phi on your computer.

LM Studio GUI app itself is not open source, but several components are. LM Studio's CLI (lms), Core SDK, and the MLX inferencing engine are open source under an MIT license. This allows for contributions to the core development of these components. 

LM Studio @GitHub

About LM Studio | LM Studio Docs






Dragan at 8:00 PM No comments:

Kubernetes vCluster

"virtual k8s clusters" => using "classic" k8s cluster for managing "nodes" (servers for deployment)

useful for "multi-tenant" deployments.

 SE Radio 649: Lukas Gentele on Kubernetes vClusters – Software Engineering Radio

  • vCluster: Virtual Kubernetes and Multi-Tenancy
  • DevPod – Open Source Dev-Environments-As-Code
  • DevSpace – The Fastest Developer Tool for Kubernetes (open-source)
  • Lukas Gentele talk at KubeCon 2021: Beyond Namespaces Virtual Clusters are the Future of Multi Tenancy
  • Article: Virtual Kubernetes Clusters
  • A quick look at Virtual Kubernetes Clusters by Utkarsh Shigihalli
  • The Uffizzi Cluster Operator

vClusters 101 — Getting started securely | by Imran Roshan | Google Cloud - Community | Medium


vCluster Deep Dive - Powering Kubernetes Environments | by Jitendra Gupta | Cloud Experts Hub | Medium


loft-sh/vcluster: vCluster - Create fully functional virtual Kubernetes clusters - Each vcluster runs inside a namespace of the underlying k8s cluster. It's cheaper than creating separate full-blown clusters and it offers better multi-tenancy and isolation than regular namespaces.

Dragan at 6:00 AM No comments:
‹
›
Home
View web version

About Me

My photo
Dragan
View my complete profile
Powered by Blogger.