MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
healthy
status
41
tools exposed
11831ms
connect latency
438eb7dc2035
schema fingerprint
Tools (41)
rubrkit_search_api_docs
Search the canonical docs/api Markdown guides and OpenAPI operation summaries.
rubrkit_read_api_doc
Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path.
rubrkit_read_openapi_contract
Read the canonical docs/api/openapi.yaml contract.
rubrkit_create_artifact_bundle
Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys.
rubrkit_list_artifact_bundles
List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys.
rubrkit_read_artifact_bundle
Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys.
rubrkit_delete_artifact_bundle
Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys.
rubrkit_hard_delete_artifact_bundle
Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API keys.
rubrkit_upload_artifact_files
Upload one or more text files into an artifact bundle. Requires files:write for API keys.
rubrkit_list_artifact_files
List files in an artifact bundle. Requires files:read for API keys.
rubrkit_read_artifact_file
Read the latest file metadata and content. Requires files:read for API keys.
rubrkit_update_artifact_file
Write a new editable version for a file. Requires files:write for API keys.
rubrkit_start_audit
Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys.
rubrkit_list_audits
List persisted audit history. Requires artifact_bundles:read for API keys.
rubrkit_read_audit
Read a single audit run. Requires artifact_bundles:read for API keys.
rubrkit_apply_audit_rewrite
Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys.
rubrkit_convert_to_rubr_flow
Start an async rubr_flow conversion job. Requires rubr_flow:convert for API keys.
rubrkit_list_rubr_flow_conversions
List conversion history. Requires artifact_bundles:read for API keys.
rubrkit_read_rubr_flow_conversion
Read one conversion report. Requires artifact_bundles:read for API keys.
rubrkit_poll_job
Read async job progress. Requires jobs:read for API keys.
rubrkit_list_job_events
Read append-only job progress events. Requires jobs:read for API keys.
rubrkit_list_artifact_bundle_versions
List bundle-level version events. Requires artifact_bundles:read for API keys.
rubrkit_restore_artifact_bundle_version
Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys.
rubrkit_list_file_versions
List immutable versions for a file. Requires files:read for API keys.
rubrkit_restore_file_version
Restore a prior file version by creating a new version. Requires files:write for API keys.
rubrkit_run_evals
Start an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5).
rubrkit_list_evals
List eval history. Requires artifact_bundles:read for API keys.
rubrkit_read_eval
Read one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys.
rubrkit_export_proof_report
Start an async proof report job with export storage enabled by default. Requires evals:run for API keys.
rubrkit_read_proof_report
Read one proof report. Requires artifact_bundles:read for API keys.
rubrkit_list_golden_cases
List the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_add_golden_case
Add a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for API keys.
rubrkit_retire_golden_case
Retire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys.
rubrkit_create_drift_monitor
Create a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys.
rubrkit_list_drift_monitors
List the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_read_drift_observations
List the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_run_drift_check
Queue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs one audit per repeat. Requires artifact_bundles:write for API keys.
rubrkit_set_drift_monitor_status
Pause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys.
rubrkit_record_outcome
Record a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API keys.
rubrkit_read_input_drift
Compare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact_bundles:read (or artifacts:pull) for API keys.
rubrkit_read_validity_drift
Correlate rubric scores against recorded outcome metrics for an artifact bundle to check whether the rubric is still predictive via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/validity. Requires artifact_bundles:read (or artifacts:pull) for API keys.
Endpoint
https://www.rubrkit.com/api/v1/mcp Category: Dev & Git · Last checked: 2026-07-30T13:08:03Z
Monitor your own MCP server
Get alerted the moment yours goes down, a tool schema drifts, or an upstream silently breaks.
What this means. This server responded to the MCP handshake and listed its tools without authentication. The schema fingerprint lets us flag if tool signatures silently change (schema drift) between checks.