19/12/2022: FEVER6 Announced
We are pleased to announce that FEVER6 will be co-located with EACL2023. You can find the call for papers in our workshop page.
04/10/2022: New scoring site
Due to the shutdown of Codalab, it is not possible to use the old leaderboard system to score new submissions for the original FEVER shared task. Please use this website to score submissions. We are working on a way to transfer the old submissions. The FEVEROUS shared task remains unaffected.
28/04/2022: Dataset download URLs have changed
Download URLs for shared task data for FEVER, FEVER2.0 and FEVEROUS have been updated. New URLS begin with https://fever.ai/download/[task name]/[filename]
.
All resource pages have been updated with the new URLs.
Previous dataset URLs may not work and should be updated if you require these in your scripts.
With billions of individual pages on the web providing information on almost every conceivable topic, we should have the ability to collect facts that answer almost every conceivable question. However, only a small fraction of this information is contained in structured sources (Wikidata, Freebase, etc.) – we are therefore limited by our ability to transform free-form text to structured knowledge. There is, however, another problem that has become the focus of a lot of recent research and media coverage: false information coming from unreliable sources. [1] [2]
The FEVER workshops are a venue for work in verifiable knowledge extraction and to stimulate progress in this direction.
In order to bring together researchers working on the various tasks related to fact extraction and verification, we will host a workshop welcoming submissions on related topics such as recognizing textual entailment, question answering and argumentation mining.
All deadlines are calculated at 11:59pm Anywhere on Earth (UTC-12).