DevOps & Infrastructure
Omh Inference Serving
[omh] Self-hosted LLM serving on GPUs: choose the serving engine and quantization from decision tables, prepare deployment as an idempotent runbook with observed-only verification, and measure the endpoint with the standard TTFT/TPOT/goodput protocol. Use when the user says: inference-serving, inference serving, serve this model, serve the model, model serving, serving endpoint, vllm, llama.cpp.
- Publisher / source
- rlaope/oh-my-hermes (found on GitHub top repositories)
- Upstream record
- rlaope/oh-my-hermes
- Version
- Version 2
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-13
- Content fingerprint
bc1f366895a1472f54380967f52630aad7823c13ddb3d05bb2fa2918230c1f8b