Participate in a labeling campaign about verifiability of unsourced statements!

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Participate in a labeling campaign about verifiability of unsourced statements!

Jonathan Morgan
Good morning/afternoon/evening everyone,


If you are an editor of the French, Italian or English Wikipedia, and you
are curious about how to contribute to technologies for improving
verifiability of Wikipedia articles, please read on—we need your help!

In the context of the Knowledge integrity
<https://meta.wikimedia.org/wiki/Knowledge_Integrity> program, we (the
WMF Research
team <http://research.wikimedia.org>) are studying ways to flag unsourced
statements needing a citation
<https://meta.wikimedia.org/wiki/Research:Identification_of_Unsourced_Statements>
using machine learning, with the aim of identifying areas where adding high
quality citations is particularly urgent or important. Following the
success of the first labeling campaign
<https://meta.wikimedia.org/wiki/Research:Identification_of_Unsourced_Statements/Citation_Reason_Pilot>,
we now need to collect additional, high-quality labeled data regarding
why sentences
need citations.

You are invited to participate in a second annotation task
<https://meta.wikimedia.org/wiki/Research:Identification_of_Unsourced_Statements/Labeling_Pilot>.
We used your input from the last experiment to generate a taxonomy of
reasons
<https://meta.wikimedia.org/wiki/Research:Identification_of_Unsourced_Statements/Labeling_Pilot#Reason_Taxonomy>
why editors add citations. With this taxonomy now embedded in the
interface, the annotation experience will be much faster and fun.

If you are interested in participating, please go to
http://labels.wmflabs.org/ui/enwiki/ (replace enwiki with itwki or frwiki
if you speak Italian or French), login, and  from *'**Labeling Unsourced
Statements II’**,*  request one (or more) workset.  For each task in a
workset, the tool will show you an unsourced sentence in an article and ask
you to annotate it. You can then label the sentence as needing an inline
citation or not, and specify a reason for your choice from a drop-down
menu.  If you can't respond please select 'skip'. You can also sign up by
(optionally) adding your name on this page
<https://meta.wikimedia.org/wiki/Research:Identification_of_Unsourced_Statements/Labeling_Pilot/Sign_Up>
to receive updates about future campaigns and results from this research

If you have any question/comment on this project, please let us know by
contacting [hidden email] or leaving a message on the talk page of
the project
<https://meta.wikimedia.org/wiki/Research_talk:Identification_of_Unsourced_Statements/Labeling_Pilot>.


Thank you for your time!

Miriam, Jonathan, and Dario

--
Jonathan T. Morgan
Senior Design Researcher
Wikimedia Foundation
User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>
_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l