Merge pull request #1 from NERVsystems/claude/local-llm-feasibility-gVLhq Add OpenAI-compatible local LLM backend support
Add OpenAI-compatible backend for local LLM support (GPT-OSS) Implement OpenAIClient backend that speaks the OpenAI Chat Completions API (/v1/chat/completions), enabling llm9p to work with any local model server: Ollama, vLLM, llama-server, LocalAI, or LM Studio. Primary target is GPT-OSS (OpenAI's open-weight MoE models), but any model served via these platforms works. The backend supports: - Blocking and streaming chat completions - Tool/function calling with STOP:/TOOL: formatting - Token counting from API usage (with estimation fallback) - Conversation history, system prompts, temperature control - Stateless AskWithRequest for session isolation Usage: ./llm9p -backend openai -openai-url http://localhost:11434/v1 -model gpt-oss:20b Also fixes pre-existing stale mock backends in test files (AskWithRequest signature was out of date with the Backend interface). https://claude.ai/code/session_017qVVZUUhfCCvNkMYmXDZAa
Add local LLM backend feasibility analysis Research and document the feasibility of adding local LLM support to llm9p via an OpenAI-compatible backend. Analyzes the Backend interface, surveys the local LLM ecosystem (Ollama, llama.cpp, vLLM, LocalAI, LM Studio), proposes an implementation using sashabaranov/go-openai, and estimates ~700 lines of new code following existing patterns. https://claude.ai/code/session_017qVVZUUhfCCvNkMYmXDZAa