Home › Categories › Technology› Benchmarking Hierarchical Script Knowledge

Benchmarking Hierarchical Script Knowledge.pdf

N19-1412.pdf
Preview of Benchmarking Hierarchical Script Knowledge
🔗 Source: aclweb.org
📊 Size: 952 KB
👤 Author: Yonatan Bisk ; Jan Buys ; Karl Pichotta ; Yejin Choi
⬇️ Downloads: 102

Summary

Researchers introduced KIDSCOOK, a parallel script corpus, and a cloze task to evaluate models' ability to reason about hierarchical and temporal relations between events, requiring the induction of functional commonsense knowledge not explicitly stated in text. The dataset consists of higher-level single-sentence imperative descriptions paired with lower-level descriptions, built on top of the YouCookII video caption dataset. Experimental results show that state-of-the-art models struggle with this task, which requires understanding procedural language and commonsense knowledge. The KIDSCOOK dataset allows learning mappings between abstract and concrete descriptions via sequence-to-sequence prediction, and a cloze-style evaluation task assesses models' ability to predict held-out tokens targeting knowledge of tool usage, temporal ordering, and kitchen commonsense.

Download File

Description

Researchers introduced KIDSCOOK, a parallel script corpus, and a cloze task to evaluate models' ability to reason about hierarchical and temporal relations...

Technical Information

  • File Format: PDF
  • File Size: 952 KB
  • Pages: 9
  • Language: EN
  • Author: Yonatan Bisk ; Jan Buys ; Karl Pichotta ; Yejin Choi
  • Total Downloads: 102
  • Last Updated: 3 hours ago

Document Overview

This PDF document about Benchmarking Hierarchical Script Knowledge provides comprehensive information and guidance. Whether you're a beginner or advanced user, this resource offers valuable insights into Benchmarking Hierarchical Script Knowledge.

Related Topics

If you're interested in Benchmarking Hierarchical Script Knowledge, you might also want to explore:

Benchmarking guideBenchmarking tutorialHierarchical guideHierarchical tutorialScript guideScript tutorialKnowledge guideKnowledge tutorial

Related Categories

Business & Finance
41204 documents
Education & Learning
22711 documents
Health & Wellness
8956 documents

Related Documents

Preview of benchmarking
PDF file

benchmarking

2.92 MBEN29 pages
Axon Server Benchmarks by Marco Amann, motivated by a talk by Allard, measures metrics such as throughput, stability, storage space, and latency,...
Download
Preview of Hierarchical Crowdsourcing
PDF file

Hierarchical Crowdsourcing

731 KBPC-A372EN1 page
Researchers propose a hierarchical scheme for multiclass classification in crowdsourcing, where different workers are assigned to different subtasks...
Download
Preview of Hierarchical MPC
PDF file

Hierarchical MPC

442 KBEN8 pages
A hierarchical multiobjective model predictive control approach is presented for solving a dynamic pickup and delivery problem, decomposing the...
Download
Preview of Script Debugger 4.5.3 Help Book
PDF file

Script Debugger 4.5.3 Help Book

3.93 MBEN225 pages
Script Debugger is a powerful environment for developing AppleScript solutions, allowing users to explore scriptable applications, develop...
Download
Preview of Download the Script
PDF file

Download the Script

75 KBEN5 pages
Dr.
Download

Download Benchmarking Hierarchical Script Knowledge eBooks for free and learn more about Benchmarking Hierarchical Script Knowledge. These books contain exercises and tutorials to improve your practical skills, at all levels!

Not satisfied with this document? We have related documents to Benchmarking Hierarchical Script Knowledge, try searching with similar keywords: Benchmarking Hierarchical Script Knowledge, vocal knowledge lists of files pdf vocal knowledge vocal knowledge, Ebook Hierarchical Nanostructures For Energy Devi, Share Ebook Compact Hierarchical Bipolar Transist, apa reporting moderation hierarchical regression, Applied Bayesian Hierarchical Methods, Architectures For Distributed And Hierarchical Mod, Bayesian Hierarchical Models In Statistical Qualit

You can download PDF versions of the user's guide, manuals and ebooks about Benchmarking Hierarchical Script Knowledge, you can also find and download for free A free online manual (notices) with beginner and intermediate, Downloads Documentation, You can download PDF files (or DOC and PPT) about Benchmarking Hierarchical Script Knowledge for free, but please respect copyrighted ebooks.