Skip to content

Compatibility Reports

Hamr tracks local-model compatibility with explicit reports instead of broad claims. A report records one concrete smoke test against one provider, endpoint, model, and Hamr version.

Use this page as the public format until Hamr grows a generated doctor report. Mark unknown or untested fields as unknown or not tested; do not infer a pass from a similar model or gateway.

Report Fields

FieldRequiredValue
hamr_versionYesHamr package version or commit hash used for the test.
tested_atYesDate of the test in YYYY-MM-DD format.
testerNoPerson or automation that ran the smoke test.
provider_gatewayYesGateway name, such as Relay, llama.cpp server, or another OpenAI-compatible server.
provider_versionNoGateway version when known. Use unknown if unavailable.
base_urlYesEndpoint root, with host details redacted if needed.
modelYesExact model ID reported by the gateway.
quantizationNoQuantization label when known, such as IQ3_XXS, Q4_K_M, or unknown.
endpoint_compatibilityYespass, partial, fail, or not tested.
native_tool_callsYespass, partial, fail, or not tested.
text_tool_callsYespass, partial, fail, or not tested.
reasoning_leakageYesnone observed, sanitized, leaked, or not tested.
max_context_testedNoLargest configured or observed context used during the smoke test.
diagnosticsYesShort pass/fail notes from hamr doctor --full, chat, ask, run, or parser tests.
caveatsYesKnown limitations, skipped checks, or local setup constraints.

Markdown Template

md
## Provider / Model

- Hamr version:
- Tested at:
- Tester:
- Provider gateway:
- Provider version:
- Base URL:
- Model:
- Quantization:
- Max context tested:

| Check                  | Result     | Notes |
| ---------------------- | ---------- | ----- |
| Endpoint compatibility | not tested |       |
| Native tool calls      | not tested |       |
| Text-shaped tool calls | not tested |       |
| Reasoning leakage      | not tested |       |

Diagnostics:

- `bun run hamr -- doctor --full`: not run
- `hamr chat` smoke test: not run
- `hamr ask` smoke test: not run
- `hamr run` edit smoke test: not run

Caveats:

-

JSON Shape

json
{
  "hamr_version": "0.0.22-alpha",
  "tested_at": "2026-05-05",
  "tester": "manual",
  "provider_gateway": "Relay",
  "provider_version": "unknown",
  "base_url": "http://127.0.0.1:1234/v1",
  "model": "Qwen3.6-35B-A3B-UD-IQ3_XXS.gguf",
  "quantization": "IQ3_XXS",
  "endpoint_compatibility": "not tested",
  "native_tool_calls": "not tested",
  "text_tool_calls": "not tested",
  "reasoning_leakage": "not tested",
  "max_context_tested": "unknown",
  "diagnostics": [],
  "caveats": ["Example only; not a verified compatibility result."]
}

Current Matrix

Provider / GatewayModelStatusEvidence
RelayQwen/Unsloth GGUF modelsAssumed targetProduct target documented in the PRD; no checked-in smoke report yet.
OpenAI-compatible custom serverAny local modelAssumed targetConfig path exists; compatibility depends on endpoint and model behavior.

Assumed target means Hamr is designed for that path, not that the exact provider/model pair has passed a recorded smoke test. Add a dated report when a local endpoint is available and keep caveats visible.

Skaft Software · MIT License