好网站,从官网开始
企业认领/联系与合作
官网导航 提交官网
P

PubMedQA官网

生物医学研究问答数据集和模型得分排行榜

官网资料

网站名称
PubMedQA
身份核实
尚未完成企业认领核实
最近更新
链接检测
尚未检测

关于 PubMedQA

PubMedQA Homepage PubMedQA Menu PubMedQA A Dataset for Biomedical Research Question Answering About The task of PubMedQA is to answer research questions with yes/no/maybe (e.g.: Do preoperative statins reduce atrial fibrillation after coronary artery bypass grafting? ) using the corresponding abstracts. For more details about PubMedQA, please refer to this paper: PubMedQA Paper (EMNLP'19) Dataset PubMedQA has 1k expert labeled, 61.2k unlabeled and 211.3k artificially generated QA instances. Please visit our GitHub repository to download the dataset: PubMedQA Data & Code Repository Submission To submit your model, please follow the instructions in the GitHub repository. Citation If you use PubMedQA in your research, please cite our paper by: @inproceedings{jin2019pubmedqa, title={PubMedQA: A Dataset for Biomedical Research Question Answering}, author={Jin, Qiao and Dhingra, Bhuwan and Liu, Zhengping and Cohen, William and Lu, Xinghua}, booktitle={Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)}, pages={2567--2577}, year={2019} } Leaderboard (reasoning-required setting) Model Code Size Accuracy (%) Macro-F 1 (%) 1 Nov 28, 2023 GPT-4 (Medprompt) Microsoft (Nori et al. 2023) NA 82.0 NA 2 May 16, 2023 Med-PaLM 2 Google Research & DeepMind (Singhal et al. 2023) NA 81.8 NA 3 Nov 27, 2023 MEDITRON EPFL (Chen et al. 2023) 70B 81.6 NA 4 Jul 6, 2023 Palmyra-Med Writer Inc. (Kamble et al. 2023) 40B 81.1 NA 5 Dec 1, 2023 AntGLM-Med Ant Group (Li et al. 2023) 10B 80.6 NA 6 Apr 12, 2023 GPT-4-base Microsoft & OpenAI (Nori et al. 2023) NA 80.4 NA 7 Mar 4, 2024 Claude 3 Anthropic (Anthropic, 2024) NA 79.7 NA 8 Jan 11, 2023 GPT-3.5 + Z-Code++ Microsoft Azure AI (He et al. 2022) 175B 79.6 55.8 9 Dec 26, 2022 Flan-PaLM (3-shot) Google Research & DeepMind (Singhal et al. 2022) 540B 79.0 NA 10 Mar 14, 2024 HEAL DeepScribe Inc (Yuan et al. 2024) 13B 78.4 NA 11 Dec 20, 2022 Codex (5-shot) Technical University of Denmark & Copenhagen University Hospital (Liévin et al. 2022) 175B 78.2 NA 12 Sep 13, 2019 Human Performance University of Pittsburgh & Carnegie Mellon University (Jin et al. 2019) NA 78.0 72.2 13 Nov 16, 2022 Galactica Meta AI (Taylor et al. 2022) 120B 77.6 NA 14 May 22, 2023 GatorTronGPT University of Florida & NVIDIA (Peng et al. 2023) 20B 77.6 NA 15 Mar 4, 2024 MediSwift-XL Cerebras Systems (Thangarasa et al. 2024) 1.2B 76.8 NA 16 Mar 20, 202

访问提示

本站仅提供官网信息与访问导航,不代表对该网站的产品、服务或交易作出担保。访问外部网站时,请核对网址,注意账号和财产安全。

同类型网站 366

查看分类

AutoGPT 是面向自主智能体的开源平台,支持用自然语言或可视化流程创建、运行和管理能够持续执行任务的智能体。

支持多 AI Agent 框架的可视化管理面板,支持 OpenClaw 和 Hermes Agent 双引擎,内置智能助手一键安装诊断

让更多人找到你的官网

提交网站信息,建立清晰、完整的官网资料。

免费提交官网

咨询提交、推广、认领

客服微信二维码,长按识别或保存后使用微信扫一扫

扫一扫添加微信,沟通官网导航提交、认领、推广需求。

可长按识别,或保存图片后在微信扫一扫中识别。

添加时可备注“官网导航”,便于沟通您的企业需求。

保存二维码 打开原图