everclear077/dsh-progressive-tools

DSH Progressive Tools

Cache-stable progressive tool discovery for DeepSeek Harness. The default mode sends a small, fixed tool surface on the first request, keeps the complete catalog in process memory, and executes discovered tools through the ordinary Harness pipeline.

中文文档

Documentation map · Getting started · Upgrade guide · Troubleshooting

Why

Every visible tool definition consumes input tokens on every request. Changing that definition list later also changes the request prefix and reduces context cache reuse. Progressive disclosure needs both properties at once:

• a small first request;
• a byte-stable tool and system prefix across later requests.

The default stable-proxy mode provides that contract:

Search changes conversation history, not the top-level tool list. Approval, guards, argument validation, timeout wrappers, result policy, deferred context, and cancellation still run for the selected real tool.

Measured impact

The tables below compare the plugin off (the host sends every registered tool on every request: 71 definitions in this profile) with the current defaults on (stable-proxy, filesystem tools always visible, maxResults: 2: 9 definitions on the wire). Both arms used the same eight task families, 100 comparable turns, and the same local web profile. Cache-read tokens are the cached request prefix the host reports; uncached input is everything else that still has to be sent.

Headline: ordinary file and coding work keeps uncached input almost unchanged, cuts cache-read volume by about four fifths, lowers output, and finishes sooner. Catalog browsing and invented-name probes are the remaining places where the plugin still writes extra uncached tokens.

Overall tokens, cache, and latency (100 turns)

Uncached input rises because discovery results (and, in the first 100-turn run, searches that only proved a name was missing) land in conversation history. Cache-read volume falls because the stable prefix no longer carries dozens of unused schemas. Billing still usually tracks cache reads at a lower rate than fresh input; the combined column is the raw token volume, not a vendor price. These rows are not a bill. omittedDefinitionTokens (still mirrored as estimatedSavedTokens in result metadata) estimates deferred definitions left off the top-level tool list. It is not a net task saving. See cost metrics.

Restricting the same 100 turns to ordinary work (S1–S7, 87 turns, no invented-name probes):

Tokens by task family

S1 pays a larger 9-tool prefix than a 4-tool prefix would, but still far less cache than 71 native schemas. S2–S4 and S6 no longer search: read / write / glob / grep are on the stable surface. S5 is cheaper on the plugin because tool_search with action: "status" replaces long host-side exploration. S8 in this 100-turn table still searched on most plugin rounds; the follow-up below is the current behavior.

Latency by task family

Task results and prefix stability

S1–S7 task quality did not regress. The 100-turn S8 grader was too strict: it flagged a search whose query contained the fake name, even though dispatch never ran. After the current “do not search merely to prove a named tool is missing” guidance (and empty results for unmatched identifier queries), a dedicated 13-turn S8 rerun looked like this:

The three later partials were still correct refusals; the grader missed wording such as “doesn't exist” / “can't”.

Why the defaults moved filesystem tools onto the surface

An earlier 100-turn plugin run used a 4-tool prefix (tool_search, tool_dispatch, skill, ask_user_question) and maxResults: 5. File work then paid a search-then-dispatch round, which is where most of the +80% uncached-input tax came from:

These numbers are a snapshot of this host's tool composition, not a promise for every profile. A larger native catalog makes the cache saving larger; a task mix that always needs deferred tools will still pay discovery into history. Re-measure after changing alwaysVisible or the installed plugin set.

Features

• Minimal tool definitions on the actual first AgentLoop request.
• Byte-stable native tool list and Code Mode SDK across discovery calls.
• Exact tool matches with full name, description, and parameter schema. An exact registered name returns only that tool.
• One family member table per search. Siblings are marked schema, name-only, or skill, and the whole family stays dispatchable unless familyDiscovery is set to matched.
• Browsable status catalog listing, with an optional statusGrantsDiscovery grant for trusted deployments.
• Bounded conversation growth: the public search value omits the cumulative discovery list. Resume state travels in presentation metadata. A repeated search returns a short notice when that same definition is still in derived history; reload: true returns the full schema.
• Deterministic BM25-style lexical ranking over names, descriptions, nested parameter descriptions, enums, family metadata, and multilingual aliases.
• Stable tool_dispatch transport with runtime schema validation through the original tool definition. The program value is { protocol, tool, value } and does not repeat the rendered body. legacyResults: true restores the previous envelope.
• Optional resultBudget for direct dispatch text and the model-facing run_code text. The program value stays intact. tool_result_read reads the stored original. This stays off unless enabled.
• Optional profile: coding, profile: auto, and autoloadMaxTools. None of these change the default frozen surface.
• Monotonic guard that rejects direct calls to deferred tools and permits only dispatcher-owned nested execution trees.
• Support for inherited and agent-scoped tools.
• Durable discovery reconstruction for top-level and Code Mode search calls.
• Optional skill-to-family discovery bindings.
• dynamic compatibility mode for deployments that require native definitions after activation.
• Reversible Cordis effects for unload and configuration reload.

Requirements

• Node.js ^22.19.0 or >=24.0.0
• Host runtime 0.2.0-rc.1 (exact tested core peer versions)
• pnpm for source installation and development

Runtime compatibility

Version 0.7.0 targets runtime 0.2.0-rc.1. Core peer versions are pinned to that tested release; older runtimes and later prereleases are not covered. Install the pinned npm version below so a profile does not float to a later release. Host deferLoading stays on tools that are already on the stable surface. Deferred catalog tools stay off the assembled request, because routes without tool updates would otherwise send those schemas in full.

Install

Add the package to a Harness profile from the official npm registry:

dsh plugin --profile web add npm:@everclear077/dsh-progressive-tools@0.7.0

Harness resolves that npm: spec with the active npm registry. Use the official registry when a mirror does not have this package:

npm install @everclear077/dsh-progressive-tools@0.7.0 --registry https://registry.npmjs.org

The package name is @everclear077/dsh-progressive-tools. The unscoped name dsh-progressive-tools belongs to another account and is not this release.

Installation runs the package prepare script. If pnpm asks for build authorization, add the exact package key it reports to the profile's pnpm-workspace.yaml:

allowBuilds:
  "@everclear077/dsh-progressive-tools": true

Verify the composed layer before starting the profile:

dsh --profile web --dump-config

The dump should contain the progressive-tools row contributed by this bundle.

Use

The default direct surface contains:

• tool_search;
• tool_dispatch;
• skill, ask_user_question, report, submit_*, and structured_output* when registered;
• read, write, edit, glob, and grep when registered;
• reserved Harness presentation transports when the active tool mode needs them.

No special wording is required in an ordinary conversation. A stable system instruction tells the agent to search before declaring a needed capability class unavailable, and to refuse invented or uncallable names from the visible surface without searching. If an identifier query still runs and matches no catalog name, search returns no definitions instead of unrelated schemas.

Discovery returns exact definitions:

{
  "query": "browser navigation",
  "max_results": 2
}

The next call uses one returned definition:

{
  "name": "browser_open",
  "arguments": {
    "url": "https://example.com"
  }
}

The result lists each matched family once. Siblings that did not make the top-ranked slice are marked name-only: they are dispatchable, and one exact-name search loads their parameters. An exact registered name returns only that tool. A repeated search returns a short notice when that same definition is still in derived history; pass reload: true for the full schema. The program value of tool_dispatch is { protocol, tool, value } and does not repeat the rendered body. Set legacyResults: true to restore the previous envelopes. resultBudget also shortens the model-facing run_code text and leaves the program value intact. autoloadMaxTools and profile: auto stay off unless set; the default surface is unchanged.

tool_search also accepts {"action":"status"}, which lists every deferred family with its member tool names alongside catalog and savings estimates. By default the listing is browse-only: dispatching an unseen name still requires one exact-name search, and the rejection message says so. Deployments that prefer immediate access can set statusGrantsDiscovery: true. Search results are append-only conversation content; they never add native definitions to the top-level request.

Configure

The default configuration is intentionally small:

- id: progressive-tools
  config:
    mode: stable-proxy
    toolName: tool_search
    dispatchToolName: tool_dispatch
    maxResults: 2
    requireDiscovery: true
    statusGrantsDiscovery: false
    deferToolGuidance: true
    alwaysVisible:
      - skill
      - ask_user_question
      - report
      - submit_*
      - structured_output*
      - read
      - write
      - edit
      - glob
      - grep

Family rules improve search without changing the stable request surface:

- id: progressive-tools
  config:
    groups:
      - id: browser
        description: Browser navigation and page interaction
        aliases: [browser, web page, 浏览器]
        include: [browser_*]
      - id: database
        description: Database inspection and queries
        aliases: [database, sql, 数据库]
        include: [db_*, sql_*]

See configuration for every option, the plugin-ecosystem onboarding checklist (alwaysVisible for high-frequency tools, skillBindings for Skill-shipping packages, explicit groups for unconventional names), and the migration notes for dynamic mode. The progressive disclosure model maps Skills, exact tool definitions, execution, and provider capability gaps.

Execution and security semantics

Stable mode filters the authoritative prompt assembly instead of changing the registry view. A direct call to a deferred name is then denied by a monotonic tool guard. tool_dispatch creates a nested execution with the original agent, signal, root call identity, arguments, and real tool name, so normal DSH policy continues to apply to that real tool.

The guard is a routing invariant, not a replacement for approval or sandbox policy. Security-sensitive deployments should keep their existing controls enabled.

Trade-offs

• Deferred tools lose provider-native argument grammar at the outer request. Their original schema is validated at dispatch time by DSH.
• A task may need one discovery call before execution.
• Family siblings become dispatchable before their schemas were shown; the pipeline still validates every call, but complex or side-effectful siblings are best schema-loaded first with one exact-name search.
• Search is deterministic lexical ranking, not an embedding service.
• Search results add only matched definitions to conversation history, but those definitions remain there until normal compaction.
• A registry or composition change can legitimately alter the next prompt. Discovery alone does not.

Development

pnpm install
pnpm run check

The test suite includes a real AgentLoop request test that captures the first wire-ready tool array and verifies that discovery leaves both tools and system text unchanged.

The implementation follows the public references for architecture, system prompt assembly, tool execution, skills, and plugin packaging.

License

MIT