Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
microsoft/thinkingbox — GitHub trending stats & insights | Trendshift
Busbar
Kane CLI
Bifrost
microsoft/thinkingbox
#
AI agent
#
AI workflow
#
MCP
thinkingbox is a framework for defining tool as MCP servers, running LLM agents against them, and evaluating agent behavior — for offline training-data generation, reinforcement-learning training loops, and model evaluation.
Visit GitHub
Like microsoft/thinkingbox, 0 likes
0
Bookmark microsoft/thinkingbox, 0 bookmarks
0
Python
84
11
2 contributors
MIT License
Social mentions
Recent discussions about this repository across the web
An agent benchmark that grades the database, not the conversation: ThinkingBox, from Microsoft and Hugging Face, is live via OpenEnv — 507 workflows, 20 runs each. Opus 5.5 leads their pass@1 table…
@jimmy_longbow_ · x.com
ThinkingBox 是微软开源的智能体评测与训练框架,通过 MCP Session Proxy 调度多个隔离的工具服务进程,驱动 Agent LLM、模拟用户 LLM 和裁判 LLM 完成多轮工具调用与断言评测
@QingQ77 · x.com
We built ThinkingBox to measure whether agents actually finish the job. ThinkingBox runs agents in isolated, stateful tool environments, lets simulated users answer follow-up questions, and inspects…
@msdev · x.com
What I do with this: → grade on end state, never on the reply → run the eval 20 times, report the worst run → treat "it also did X" as a failure → write the error-recovery path before the happy path…
@_rjach · x.com
We open-sourced our repo for agentic training and evals: thinkingbox is a framework for defining tools as MCP servers, running LLM agents against them, and evaluating agent behavior. ThinkingBox:…
@vsmolyakov · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues