AutoGPT 是面向自主智能体的开源平台,支持用自然语言或可视化流程创建、运行和管理能够持续执行任务的智能体。
关于 Berkeley Function-Calling Leaderboard
Berkeley Function Calling Leaderboard (BFCL) V4 Home Blog Try it Out! Leaderboard Berkeley Function-Calling Leaderboard Gorilla LLM Team --> BFCL: From Tool Use to Agentic Evaluation of Large Language Models The Berkeley Function Calling Leaderboard (BFCL) V4 evaluates the LLM's ability to call functions (aka tools) accurately. This leaderboard consists of real-world data and will be updated periodically. For more information on the evaluation dataset and methodology, please refer to our blogs: BFCL-v1 introducing AST as an evaluation metric, BFCL-v2 introducing enterprise and OSS-contributed functions, BFCL-v3 introducing multi-turn interactions, and BFCL-v4 introducing holistic agentic evaluation. Checkout code and data . Last Updated: 2026-04-12 [Change Log] Search FC = native support for function/tool calling. Prompt = walk-around for function calling, using model's normal text generation capability. Cost is calculated as an estimate of the cost for the entire benchmark, in USD. Latency is measured in seconds. Overall Accuracy is the unweighted average of all the sub-categories. For details on score composition, please refer to our blog . Format sensitivity test cases are only supported for prompt (non-FC) models. Click on column header to sort. If you would like to add your model or contribute test-cases, please contact us via discord . Models are evaluated using commit f7cf735 . All the model response we obtained is available here . To reproduce the results, please either checkout our codebase at this checkpoint , or install the PyPI package pip install bfcl-eval==2025.12.17 . Wagon Wheel The following chart shows the comparison of the models based on a few metrics. You can select and deselect which models to compare. More information on each metric can be found in the blog . Select Models to Compare Clear All Search models... Error Type Analysis This interactive treemap shows the distribution of error types across different models. The size of each block represents the number of errors encountered by that model. Errors are categorized hierarchically, encompassing both top-level errors (e.g., Value Errors) and more specific subsidiary errors (e.g., Invalid String Format). You can hover over and click on each block to see the detailed breakdown of error types for different models. For more information on how these errors are identified and addressed, refer to our evaluation metrics and insight blog (coming soon). --> Function Calling Demo In this demo
访问提示
本站仅提供官网信息与访问导航,不代表对该网站的产品、服务或交易作出担保。访问外部网站时,请核对网址,注意账号和财产安全。
同类型网站
查看分类百川智能发布的金融大模型,金融场景能力领先GPT-4o近20%
Build a Large Language Model (From Scratch) 是一款AI 大模型方向的 AI 工具,适合主流大语言模型与开源模型。
支持多 AI Agent 框架的可视化管理面板,支持 OpenClaw 和 Hermes Agent 双引擎,内置智能助手一键安装诊断