AI
Local inference and AI infrastructure.
-
[Local LLM 14] Write Prompts with Clear Source Text and Constraints
Separate instructions, reference text and output constraints so that a model request can be checked and repeated.
-
[Local LLM 15] Validate Structured Responses with JSON Schema
Define the expected JSON structure, validate model responses and decide how the application handles invalid output.
-
[Local LLM 16] Search Documents with Embeddings and Cosine Similarity
Turn document passages and a query into embeddings, rank them by cosine similarity, and inspect retrieval quality.
-
[Local LLM 17] Build RAG Answers from Retrieved Documents
Retrieve relevant document passages, include them in the prompt, and check whether the answer is supported by those passages.
-
[Local LLM 18] Build an Evaluation Sheet for Models and RAG
Use a fixed question set and scoring criteria to compare model answers and retrieval results before changing the application.
-
[Local LLM 19] Understand Hermes Models and Chat Templates
Match a Hermes model to the runtime and conversation template, then inspect how messages and tool calls are represented.
-
[Local LLM 20] Connect Hermes Agent and Review Tools and Memory
Connect Hermes Agent to the intended model service and inspect the permissions and persistence of tools and memory.
-
[Local LLM 21] Build an Agent Loop with an Inventory Lookup Tool
Define an inventory lookup tool, validate its inputs and results, and follow the model-tool-response loop step by step.
-
[Local LLM 22] Install OpenClaw and Check Its Gateway
Follow the installation prerequisites, configure the Gateway, and verify the service before connecting models and tools.