ethanweave/dsh-vision-better

dsh-vision-better

English | 中文

Give a text-only model in DeepSeek Harness the ability to work with images - without switching the model, starting a new session, or changing a single visible message.

Paste an image into the chat as usual. If the active model cannot accept images, this plugin sends the image to your own GLM-compatible vision endpoint, and hands the analysis to the original model as hidden context. The original model keeps answering, in the same session, with its history intact.

• No new chat buttons, modes, model entries, assistant bubbles, or extra messages.
• No vision request at all when there is no image, or when the active model already accepts images.
• The API key is stored by DSH's credential service on the host and is never sent back to the browser.
• The image, your text, the session id, and the selected provider/model are never touched.

---

Requirements

The plugin itself has zero dependencies and no build step. Its settings page is hand-written and uses only the platform's own React.

Core extension (required)

Stock DSH rejects a prompt that carries an image before the message is stored, whenever the active model does not declare image support (@deepseek-ai/dsh-api-session-controller/lib/index.js:870-874). No public plugin hook can influence that check, and pretending the model supports images is deliberately out of bounds.

This repository therefore ships one small, separate core patch that adds a single public waterfall - session/image-admission - around that check:

patches/0001-session-image-admission.patch

• Default behaviour is unchanged when no plugin answers (verified: see Testing).
• The plugin answers { admit: true } only when the relay is enabled and an API key is configured.
• From a source checkout: git apply -p1 patches/0001-session-image-admission.patch
• On an installed desktop app (no source tree): run patches/apply-core-patch.cmd, then close DeepSeek Harness so it can swap the archive, then start it again. patches/restore-core-patch.cmd puts the original back. Both stage and verify before touching anything.
• Verify without applying anything: node patches/verify-patch.mjs <dsh-src-root>

Until this extension ships upstream, the hidden-vision-context half still works on a stock install (nothing breaks) but images never reach a text-only session. **Minimum DSH version for the full experience: 0.2.0-rc.2

• this patch**, or the first release that provides session/image-admission.

---

Install

Install from GitHub (recommended), or from a local clone:

# from GitHub
dsh plugin --profile web add github:ethanweave/dsh-vision-better

# or from a released tarball
dsh plugin --profile web add https://github.com/ethanweave/dsh-vision-better/releases/latest/download/dsh-vision-better-1.0.0.tgz

# or from a local clone (an absolute path is accepted by the plugin manager)
dsh plugin --profile web add /absolute/path/to/dsh-vision-better

The same operations are available in the Web UI on the Plugins page, which accepts a path or a spec. Restart DSH afterwards the first time, so the new bundle and its settings page are registered.

Then open Settings -> 图像识别 / Vision Better.

Important — image admission needs a small core patch. Stock DSH rejects an image before it reaches a text-only model (see Core extension). Without it the settings page and the API key work, but image turns are refused. Apply it with patches/apply-core-patch.cmd (double-click, then close DeepSeek Harness so it can swap the archive) and restart again.

Screenshots

Settings → 图像识别 (Vision Better) — API key status, endpoint presets, model id, enable toggle and a connection test that never touches your conversation images:

The same session, the same model — an attached image is analyzed in the background and the original model answers from that analysis; your message and the image stay untouched:

---

Configure

Defaults were verified against the official Zhipu documentation on 2026-10-10: mainland base URL, international base URL, glm-4.6v-flash (listed as 完全免费 / completely free).

Free quota and rate limits are set by the provider and can change. This plugin does not promise that free access is permanent or unlimited, and it does not ship invented size or pixel limits: the provider's own error is the authority.

You can also export GLM_API_KEY in the environment DSH launches with; the credential store gives the environment precedence, and the settings page will report the key as configured (read-only).

---

How it works

you paste an image -> DSH session/prompt
                |- model declares image support -> native image request (sidecar silent, 0 calls)
                `- model is text-only -> core patch asks session/image-admission
                        `- plugin: enabled and key configured -> admit
                               `- agent/pre-step: read this turn's authorized attachments
                                     `- one batched vision request (GLM)
                                           `- hidden context message (source.kind = "vision-better")
                                                  `- the original model answers: same session, same model, same history

The hidden context is a normal durable user/message whose source kind is not "user". DSH's own client classifies exactly that shape as a context node, which is excluded from the visible transcript (dsh-client-ui-chat -> isVisibleChatNode). The same mechanism DSH already uses for its runtime-context snapshot. The user's own message - including the image - is never rewritten, and it survives restore.

Routing

Capability is read from the session's live selection (the projection DSH publishes to its model picker) on every step, so a model switch takes effect on the very next turn; nothing is cached across turns.

Failure behaviour

The plugin never throws inside the turn - a throw at that point would drop the user's message before DSH logs it. Instead it injects an explicit, hidden notice with a stable code, and the original model tells you what went wrong while your text and image stay in the conversation:

Invalid keys, wrong model ids and invalid images are never retried. Every request uses redirect: "error", so a credential can never be replayed to another origin.

---

Privacy and security

• Images are sent only to the vision endpoint you configured, and only when the active model cannot accept images and the turn really carries one. Nothing is sent to DeepSeek's chat service or to any other provider.
• The API key lives in DSH's credential store. Only the host half reads it, per request, without caching. The browser can write and clear it and can read whether it is configured - never its value.
• Logs contain a code, a duration, and a redacted endpoint label. Never a key, an image, base64, or a full prompt.
• Images are read through DSH's attachment service using the references carried by your own message. The plugin accepts no path, URL, or id from the browser, so it cannot be used to read arbitrary files or another session's attachments.
• Image content and any text inside an image are treated as untrusted data: the analysis is fenced with a per-message random nonce that the vision endpoint cannot know when it answers, so it cannot forge the terminator and continue as if it were plugin instructions. Control characters are stripped.
• The analysis cache is in-memory only, bounded (64 entries, 30 minutes), keyed by image hash + endpoint + model + analysis version + question, and stores text only. No image is written anywhere new, and the plugin never re-uploads your image a second time.
• The settings-page routes are same-origin checked (a null origin and cross-origin requests are refused), JSON-only, size-capped, and validate the key's character set. They never return a secret.

See SECURITY.md for reporting a vulnerability.

---

Troubleshooting

Disable or uninstall

• Disable: Settings -> Plugins, turn the bundle off (or set disabled: true for the vision-better row in the profile's cordis.patch.yml). DSH's original text and multimodal behaviour returns immediately.
• Uninstall: dsh plugin --profile web remove dsh-vision-better, or remove it on the Plugins page.
• Remove your key: Settings -> 图像识别 -> Clear credential (this unsets the GLM_API_KEY reference).
• Remove local state: <DSH_HOME>/vision-better.json holds only endpoint/model/enabled.

---

Testing

node scripts/check.mjs --dsh-src <path-to-dsh-source>   # everything that can run here
node scripts/verify-host-path.mjs                        # end-to-end on a simulated DSH host (43 checks)
node scripts/verify-client-bundle.mjs                    # browser-half contract + render smoke test (24 checks)
node patches/verify-patch.mjs <path-to-dsh-source>        # core patch applies + behaves (8 checks)
node test/run.mjs                                        # unit/integration suite (129 tests, mocked vision API)

All automated tests use a stubbed or loopback vision API. A real API key is never required, read, or printed; real-endpoint tests are opt-in only.

Repository layout

lib/            host half: routing, config, image access, GLM client, cache, relay, settings routes
client/         browser half: the hand-written Settings page bundle
patches/        the separate core extension (patch + generator + verifier)
scripts/        local verification (syntax gate, end-to-end host path, browser-half smoke test)
test/           unit/integration suite
awesome/        ready-to-submit entry for the awesome-dsh-plugin list
docs/           implementation plan and publishing checklist

License

MIT