E2E testing and evals

[matteo8p]

Hi Tableau team,

My name is Matt, I'm building MCPJam, it's an open source MCP testing and evals tool, like Postman for MCP. I saw that you had built some E2E tests in this commit.

I'd love to hear more about how you're thinking about MCP testing, and if there's any way that we can help. My email is matthew@mcpjam.com

Sincerely,
Matthew Wang

[anyoung-tableau]

Hey Matt, big fans of MCPJam on the team here and I've been meaning to get back to you.

The unit and E2E testing effort is currently pretty traditional and treats the MCP server mostly like any other API endpoint. We are also investing in eval testing using internal OpenAI-compatible LLM gateways and LangChain.