(Allen Institute For Artificial Intelligence & University Of Washington).pdf

1907.10641.pdf
Preview of (Allen Institute for Artificial Intelligence & University of Washington)
🔗 Source: arxiv.org
📊 Size: 1.05 MB
👤 Author: Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi
⬇️ Downloads: 110

Summary

Researchers introduce WINOGRANDE, a large-scale dataset of 44k problems inspired by the Winograd Schema Challenge, to investigate whether neural language models have truly acquired robust commonsense capabilities or rely on spurious biases in datasets. The best state-of-the-art methods on WINOGRANDE achieve 59.4-79.1% accuracy, which is 15-35% below human performance of 94.0%. The results also demonstrate the effectiveness of WINOGRANDE for transfer learning, achieving new state-of-the-art results on five related benchmarks, but raise concerns about overestimating the true capabilities of machine commonsense due to potential biases in existing datasets.

Description

Researchers introduce WINOGRANDE, a large-scale dataset of 44k problems inspired by the Winograd Schema Challenge, to investigate whether neural language...

Technical Information

  • File Format: PDF
  • File Size: 1.05 MB
  • Pages: 9
  • Language: EN
  • Author: Keisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi
  • Total Downloads: 110
  • Last Updated: 18 hours ago

Document Overview

This PDF document about (Allen Institute for Artificial Intelligence & University of Washington) provides comprehensive information and guidance. Whether you're a beginner or advanced user, this resource offers valuable insights into (Allen Institute for Artificial Intelligence & University of Washington).

Related Topics

If you're interested in (Allen Institute for Artificial Intelligence & University of Washington), you might also want to explore:

Download (Allen Institute for Artificial Intelligence & University of Washington) eBooks for free and learn more about (Allen Institute for Artificial Intelligence & University of Washington). These books contain exercises and tutorials to improve your practical skills, at all levels!

Not satisfied with this document? We have related documents to (Allen Institute for Artificial Intelligence & University of Washington), try searching with similar keywords: (Allen Institute for Artificial Intelligence & University of Washington), Washington Office 2100 M Street Nw Washington Washington Dc 20037, "Hinder och möjliggörare för 1.5°-livsstilar: Ytliga och djupgående strukturella faktorer som påverkar potentialen för hållbar k, Ändring av genomföranderam för en europeisk plattform för utbyte av balansenergi från frekvensåterställn ingsreserver med manuell, Rekommendationer för vaccination mot covid-19 för särskilda grupper av barn -, förstudie för att utvärdera förutsättningarna att genom en innovationsupphandli ng utveckla en drifttjänst för geoenergilager, Självkänsla och KBT ‐ Påverkas självkänslan vid KBT för depression och ångesttillstånd?Se lf‐esteem and CBT ‐ How does CBT for de, Matglädje för alla: en guide till rätt konsistens för olika behov

You can download PDF versions of the user's guide, manuals and ebooks about (Allen Institute for Artificial Intelligence & University of Washington), you can also find and download for free A free online manual (notices) with beginner and intermediate, Downloads Documentation, You can download PDF files (or DOC and PPT) about (Allen Institute for Artificial Intelligence & University of Washington) for free, but please respect copyrighted ebooks.