View original page

Omh Inference Serving

DevOps & Infrastructure

[omh] Self-hosted LLM serving on GPUs: choose the serving engine and quantization from decision tables, prepare deployment as an idempotent runbook with observed-only verification, and measure the endpoint with the standard TTFT/TPOT/goodput protocol. Use when the user says: inference-serving, inference serving, serve this model, serve the model, model serving, serving endpoint, vllm, llama.cpp.

Publisher / source

rlaope/oh-my-hermes (found on GitHub top repositories)

Upstream record

rlaope/oh-my-hermes

Version

Version 2

Published

2026-11-13

Publication review

Approved for publication ยท recorded passed scan 2026-11-13

Content fingerprint

bc1f366895a1472f54380967f52630aad7823c13ddb3d05bb2fa2918230c1f8b

Review before you use it

Publication approval is a recorded review state, not a guarantee of safe execution. Check the upstream license, required tools and permissions, and test in your intended client.

Sign in to inspect the full instructions and download the SKILL.md file. This public page contains metadata only.

Open skill in your workspace


Source: https://prompeteer.ai/skills-hub/4947db54-3a3f-43b7-8744-06352e964953