Keyword: eval
- swarmkit-evalReleased5d agoVersion0.0.7
Evaluation infrastructure for the swarmkit ecosystem — (harness x model x task x arm x seed) agent evals with ground-truth scoring, cost-matched Pareto reporting, and scalable parallel execution.
- @jetty/sdkReleased5d agoVersion0.2.0
Typed TypeScript client for the Jetty AI/ML workflow platform
- @pro-fa/expreszoReleased6d agoVersion0.6.6
Mathematical expression evaluator
- lua-redis-wasmReleasedyesterdayVersion1.4.0
WebAssembly-based Redis Lua 5.1 script engine for Node.js - Execute Redis-compatible Lua scripts without a live Redis server
- @forwardimpact/libharnessReleasedyesterdayVersion1.0.0
Agent evaluation framework — prove whether agent changes improved outcomes with reproducible evidence.
- @twilio-alpha/assistants-evalReleased6d agoVersion0.1.1
promptfoo extension for writing AI evaluations for Twilio AI Assistants
- @intentsolutions/jrig-cliReleased13h agoVersion0.1.1
J-Rig seven-layer binary eval CLI for Claude Skills — the j-rig command: package integrity, trigger/functional/regression/baseline scoring, optimizer, and rollout-gate evidence. Self-contained (bundles the internal eval engine).
- @intentsolutions/refinerReleased2d agoVersion0.2.0
Skill Refiner orchestrator + I/O adapters + CLI: content-addressed store, j-rig score() shell-out adapter, tiered Anthropic propose() adapter, and the j-rig refine commands. Wraps the pure @intentsolutions/refiner-core.
- @intentsolutions/refiner-coreReleased2d agoVersion0.2.0
Skill Refiner pure core: bounded-edit apply transform, deterministic synthetic eval-set bootstrap, the Pareto-dominant acceptance gate (DR-028 P0-RATIFY-1), and the swappable RefinerStrategy interface (AC-13).
- @eidentic/evalReleased3d agoVersion0.1.5
Evaluation harness for Eidentic agents — scorers, LLM-as-judge, dataset management, CI pass-rate gate, and production trace promotion.
- @eidentic/benchReleased3d agoVersion0.1.5
Memory benchmark harness for Eidentic — run LongMemEval / LoCoMo / temporal-reasoning benchmarks with deterministic recall metrics.
- @forwardimpact/libsyntheticrenderReleased3d agoVersion0.1.33
Multi-format rendering of synthetic evaluation data — validate fixtures before they enter the eval pipeline.
- @dpopsuev/alef-evalReleased3d agoVersion0.0.1
Evaluation harness for Alef agents — OTel span collection, RunMetrics, Pi-parsable reports
- routeproofReleased2d agoVersion0.3.3
Test how an AI host routes real user intents to your MCP server's tools — catch silent mis-routing before your users do.