CRAFT: A Benchmark for Causal Reasoning About Forces and InTeractions December 29, 2020
Recent advances in Artificial Intelligence and deep learning have revived the interest in studying the gap between the reasoning capabilities of humans and machines. In this ongoing work, we introduce CRAFT, a new visual question answering dataset that requires causal reasoning about physical forces and object interactions. It contains 38K video and question pairs that are generated from 3K videos from 10 different virtual environments, containing different number of objects in motion that interact with each other. Two question categories from CRAFT include previously studied descriptive and counterfactual questions. Besides, inspired by the theory of force dynamics from the field of human cognitive psychology, we introduce new question categories that involve understanding the intentions of objects through the notions of cause, enable, and prevent. Our preliminary results demonstrate that even though these tasks are very intuitive for humans, the implemented baselines could not cope with the underlying challenges.
When you visit a website, information is stored in your browser, mostly in the form of cookies. This information may be about you, your preferences or your device, and is often used to make the site work as you expect it to. The information does not usually identify you directly, it is meant to provide you with a more personalized web experience.
You can choose not to allow some cookies. Click on the different category headings to learn more and change our default settings.
These cookies are necessary for the website to function and cannot be turned off in our systems.
These cookies are used to provide insight into how we can improve our service to all our users and to understand how you interact with our website as an anonymous user.
These cookies are used to create your profile and provide ads relevant to your interests. It is also used to limit the number of times you see an ad, as well as help measure the effectiveness of the ad campaign.
Cookies are used to personalize content and ads, to provide social media features and to analyze our traffic. You can accept all cookies with the "Allow All" option or you can edit the settings with the "Customize Settings" option.