run AI models in node.js (JavaScript)

withcatai/node-llama-cpp: Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level @GitHub

• Run LLMs locally on your machine
• Metal, CUDA and Vulkan support
• Pre-built binaries are provided, with a fallback to building from source without node-gyp or Python
• Adapts to your hardware automatically, no need to configure anything
• A Complete suite of everything you need to use LLMs in your projects
• Use the CLI to chat with a model without writing any code