DeepWiki

ServerDeepWiki · public · Docs & code lookup · 3 tools · mcp.deepwiki.com/mcp

StateFail

ScoreRight tool first: 32 of 48. Issues: 5. Checked: 27 Sept, Haiku 4.5.

IssueRead Specific Documentation · 0 of 12 · wrong turns start at read_wiki_structure · tool to fix: read_wiki_contents

NotesQuestions written by a model and spot-checked, not independently reviewed. Read-only tools only. This check is 42 days old; the server may have changed since.

ActionsTest a fix

Groups · 4 · worst first

Group	Tool	Right first	Median s	State
Read Specific Documentation	read_wiki_contents or ask_wiki_question	0 / 12	23.8	Fail	Questions
Understand How Code Works	ask_wiki_question or read_wiki_contents	9 / 12	21.8	Watch	Questions
Get Answers to Specific Questions	ask_wiki_question	11 / 12	20.4	Watch	Questions
Explore Documentation Structure	read_wiki_structure or read_wiki_contents	12 / 12	4.1	OK	Questions

right tool firstwrong turn, then rightnever rightfailed· one cell per run, left to right

Tested fix · 1

GroupRead Specific Documentation

ResultWe rewrote two tool descriptions (read_wiki_structure, read_wiki_contents) and re-ran two groups against the live server. Right tool first try went from 0 of 12 to 12 of 12 on “Read Specific Documentation”, and from 9 of 12 to 12 of 12 on “Understand How Code Works”.

LimitsOne re-run, same model, 6 runs per question; a model drafted the rewrite with the answer key in view; the other two groups were not re-checked.

Tools as the agent read them · 3 · version cfe350a4e1ca

Tool	Description
ask_wiki_question	Ask any question about a GitHub repository's codebase and get an AI-powered answer grounded in its DeepWiki.
read_wiki_contents	View documentation about a GitHub repository.
read_wiki_structure	Get a list of documentation topics for a GitHub repository.

Checked on Haiku 4.5, 6 runs per question.How to read this