[RfC] [ORES] Do you use reverted model for wikis that have damaging ones?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[RfC] [ORES] Do you use reverted model for wikis that have damaging ones?

Amir Tafreshi
Hey,

For patrolling work, ORES usually has two levels of support:

   - For basic support we usually provide a model that is called 'reverted'
   and has less accuracy.  It also risks perpetuating editor biases due to the
   lack of differentiation between reasons that a change may have been
   reverted.
   - For advanced support, we require manual labeling of a large sample of
   edits, but then we can provide two more models: 'damaging' and 'goodfaith'.


ORES review tool can only be enabled on wikis where advanced support is
available and most other tools prefer the 'damaging' over the basic
'reverted' model as well.

So, for performance and capacity reasons we think it makes sense to remove
'reverted' models from the ORES service when 'damaging' model is made
available.  However, we also want to be careful about making sure this
change doesn't disrupt the work of tool developers that make use of the
ORES service.

If you do, please voice your concerns now. If there is no objection within
the next two weeks, we'll begin the process of removing the 'reverted'
model for wikis that have the 'damaging' model available.

Related phabricator card: https://phabricator.wikimedia.org/T171059

Best
--
Amir Sarabadani Tafreshi
Software Engineer (contractor)
-------------------------------------
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
http://wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
_______________________________________________
Wikitech-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: [RfC] [ORES] Do you use reverted model for wikis that have damaging ones?

Amir Tafreshi
As there was no objection has been raised in the past two weeks, We will
remove all of them.


Best

On 19 July 2017 at 23:17, Amir Tafreshi <[hidden email]>
wrote:

> Hey,
>
> For patrolling work, ORES usually has two levels of support:
>
>    - For basic support we usually provide a model that is called
>    'reverted' and has less accuracy.  It also risks perpetuating editor biases
>    due to the lack of differentiation between reasons that a change may have
>    been reverted.
>    - For advanced support, we require manual labeling of a large sample
>    of edits, but then we can provide two more models: 'damaging' and
>    'goodfaith'.
>
>
> ORES review tool can only be enabled on wikis where advanced support is
> available and most other tools prefer the 'damaging' over the basic
> 'reverted' model as well.
>
> So, for performance and capacity reasons we think it makes sense to remove
> 'reverted' models from the ORES service when 'damaging' model is made
> available.  However, we also want to be careful about making sure this
> change doesn't disrupt the work of tool developers that make use of the
> ORES service.
>
> If you do, please voice your concerns now. If there is no objection within
> the next two weeks, we'll begin the process of removing the 'reverted'
> model for wikis that have the 'damaging' model available.
>
> Related phabricator card: https://phabricator.wikimedia.org/T171059
>
> Best
> --
> Amir Sarabadani Tafreshi
> Software Engineer (contractor)
> -------------------------------------
> Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
> http://wikimedia.de
> Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
> Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
> der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
> Körperschaften I Berlin, Steuernummer 27/681/51985.
>



--
Amir Sarabadani Tafreshi
Software Engineer (contractor)
-------------------------------------
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
http://wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
_______________________________________________
Wikitech-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Loading...