Observed arrival · 2026-11-18
MCP Gateway Bench’s November pilot
A public benchmark compares four MCP gateways against direct calls to the same reference server, measuring tool-call correctness and added latency.
○Open
⊠Login
$Paid
†Ads
✦Pretty
●Pro
◎Niche
◉Human
⚑Risk
ƒJS
- For
- MCP gateway developers and evaluators
- Worth noticing
- All four gateways matched valid reference calls in the pilot; the page warns that hosted and local timings are not on equal footing.
Field notes
The pilot compares gateway calls with direct calls to a reference server from The Letter Company, using official MCP reference tools. For each gateway, it reports valid and invalid argument checks alongside 300 timed pairs, collected in three rounds after 20 warmups. The page says the gateways ran sequentially rather than in the planned rotating order, and cautions that hosted and local routes include different network conditions.
Observed signals
Read the marks
Editorial observations of this landing page, not a rating.
○OpenPublic substance visible
✦PrettyNotable craft visible
●ProPolished or operationally mature
◎NicheUnusually specific use
ƒJavaScriptBrowser-side code central
One card from the complete issue