NodeLLM 1.17 adds MCP sampling, parallel tool calls, and ORM tool controls
NodeLLM version 1.17 has been released, introducing MCP Sampling support that allows servers to request LLM completions from the client rather than only receiving tools and resources. This enables MCP servers to offer AI-powered capabilities like summarization and classification without requiring their own API keys. The update also adds a toolConcurrency option, letting independent tool calls execute in parallel within the same turn, reducing latency for tasks like simultaneous multi-city weather lookups. A bug fix ensures multiple registered lifecycle hooks—such as onEndMessage or beforeRequest—now all run in order instead of the later one silently overwriting the earlier. Finally, the ORM persistence layer now exposes the same tool-execution controls available in core, giving Prisma-backed chats access to features like confirmation prompts and concurrent execution.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in