MaruOps · Infrastructure and AI notes
Linux, Kubernetes
and local AI.
Linux, networking, Kubernetes and local LLMs.
Configuration choices and troubleshooting, explained step by step.
Series guides
Kubernetes Lab
Prepare three VMs, build a cluster, then work through deployment, networking and recovery.
Local LLM
Run a first model, then explore APIs, document retrieval, tools and operations.
Git and GitOps
Follow repositories and commits through CI, deployment and GitOps recovery.
Latest articles
Browse the topics to find the guide you need.
-
[Local LLM 21] Build an Agent Loop with an Inventory Lookup Tool
Define an inventory lookup tool, validate its inputs and results, and follow the model-tool-response loop step by step.
-
[Local LLM 22] Install OpenClaw and Check Its Gateway
Follow the installation prerequisites, configure the Gateway, and verify the service before connecting models and tools.
-
[Local LLM 23] Check OpenClaw’s Ollama Endpoint and Tool Calls
Verify the Ollama endpoint used by OpenClaw, then distinguish connection, model selection and tool-calling problems.
-
[Local LLM 24] Use OpenRouter and Check Cost and Data Routing
Call OpenRouter through its API and inspect model names, pricing and the provider path before sending application data.
-
[Local LLM 25] Decide Which Requests Stay Local or Use the Cloud
Choose a local or cloud path based on data handling, quality, latency and cost, then record how failures and fallback are handled.
-
[Local LLM 26] Measure Loading, First Response and Generation Speed
Measure model loading, time to first response and token generation separately, using the same request and recorded runtime settings.
-
[Local LLM 27] Compare GGUF and CPU/GPU Options in llama.cpp
Run a GGUF model with llama.cpp and compare CPU and GPU settings while keeping the model and request conditions recorded.
-
[Local LLM 28] Understand LoRA, QLoRA and a Small Training Script
Separate inference from training, inspect LoRA and QLoRA requirements, and read the structure of a small adaptation script.
-
[Local LLM 29] Review API, Log and Tool Permissions
Check exposed APIs, credentials, logs, document access and agent tool permissions before sharing a local LLM service.
About these notes
Configuration
and troubleshooting.
From first configuration to operational issues.
Find what to inspect, why it matters, and how to proceed.