[Wikimedia-l] New Evaluation Report: Wikipedia Education Program

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[Wikimedia-l] New Evaluation Report: Wikipedia Education Program

Jaime Anstee
Greetings,

(Please pardon any cross-posting)

The final in our series of the Evaluation Reports (beta), the report on the
Wikipedia Education Program, is now available on meta:

https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WEP<https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM>

Highlights of the report include:

==Inputs==

The average Wikipedia Education Program reported cost a total of almost
$8,000 USD in total, and $275 each week to implement. The average Wikipedia
Education Program invests a total of $67 US and 3 hours into recruiting
each new editor participant.


==Participation==

Program leaders reported participation rates ranging from 25 to 2,372, and
programs lasted from two weeks to 21 months with an average of 37.5 weeks.


==Outputs==

For the seven reported Wikipedia Education Program implementations, almost
3,000 different Wikimedia pages were created or improved. The average
Wikipedia Education Program produces about 120 pages of content each week.
The average program participant adds just under half a page of content to
Wikipedia and creates or improves six wiki pages each week.


==Outcomes==

Out of the 3,334 new editor participants in Wikipedia Education Program, 36
(1.2%) participants were "active" three months after the program ended; 33
(1.1%) were "active" six months after the programs ended.

Questions are welcome and encouraged on the talk page.

On behalf of the Program Evaluation team,

Jaime


--

Jaime Anstee, Ph.D
Program Evaluation Specialist
Wikimedia Foundation
+1.415.839.6885 ext 6869
www.wikimediafoundation.org

Imagine a world in which every single human being can freely share in the
sum of all knowledge. Help us make it a reality!
*https://donate.wikimedia.org <https://donate.wikimedia.org/>*
_______________________________________________
Wikimedia-l mailing list
[hidden email]
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:[hidden email]?subject=unsubscribe>
Reply | Threaded
Open this post in threaded view
|

Re: [Wikimedia-l] New Evaluation Report: Wikipedia Education Program

Risker
Thanks for the links to the reports, Jaime.

For the overall WEP report (as opposed to the also-linked WLM report) -
could you please spell out on the Wiki page exactly what programs you are
talking about, and link each to their specific report?  I'm having a hard
time figuring out exactly what is being reported as part of the WEP, what
projects are affected, and which programs have more participants.

Thanks!

Risker/Anne


On 6 April 2014 21:30, Jaime Anstee <[hidden email]> wrote:

> Greetings,
>
> (Please pardon any cross-posting)
>
> The final in our series of the Evaluation Reports (beta), the report on the
> Wikipedia Education Program, is now available on meta:
>
> https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WEP<
> https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM>
>
> Highlights of the report include:
>
> ==Inputs==
>
> The average Wikipedia Education Program reported cost a total of almost
> $8,000 USD in total, and $275 each week to implement. The average Wikipedia
> Education Program invests a total of $67 US and 3 hours into recruiting
> each new editor participant.
>
>
> ==Participation==
>
> Program leaders reported participation rates ranging from 25 to 2,372, and
> programs lasted from two weeks to 21 months with an average of 37.5 weeks.
>
>
> ==Outputs==
>
> For the seven reported Wikipedia Education Program implementations, almost
> 3,000 different Wikimedia pages were created or improved. The average
> Wikipedia Education Program produces about 120 pages of content each week.
> The average program participant adds just under half a page of content to
> Wikipedia and creates or improves six wiki pages each week.
>
>
> ==Outcomes==
>
> Out of the 3,334 new editor participants in Wikipedia Education Program, 36
> (1.2%) participants were "active" three months after the program ended; 33
> (1.1%) were "active" six months after the programs ended.
>
> Questions are welcome and encouraged on the talk page.
>
> On behalf of the Program Evaluation team,
>
> Jaime
>
>
> --
>
> Jaime Anstee, Ph.D
> Program Evaluation Specialist
> Wikimedia Foundation
> +1.415.839.6885 ext 6869
> www.wikimediafoundation.org
>
> Imagine a world in which every single human being can freely share in the
> sum of all knowledge. Help us make it a reality!
> *https://donate.wikimedia.org <https://donate.wikimedia.org/>*
> _______________________________________________
> Wikimedia-l mailing list
> [hidden email]
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
> <mailto:[hidden email]?subject=unsubscribe>
_______________________________________________
Wikimedia-l mailing list
[hidden email]
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:[hidden email]?subject=unsubscribe>
Reply | Threaded
Open this post in threaded view
|

Re: [Wikimedia-l] New Evaluation Report: Wikipedia Education Program

Anna Torres
Dear Jamie,

Thanks for the report. As we are -WMAR- working on improving our
Educational Program we find it very useful. However, as Anne said it would
be great to know what it's exactly being reported in terms of programs in
order to find out which indicator is associated to each program.

Thank you!! Hope to hear from you asap.





2014-04-06 23:34 GMT-03:00 Risker <[hidden email]>:

> Thanks for the links to the reports, Jaime.
>
> For the overall WEP report (as opposed to the also-linked WLM report) -
> could you please spell out on the Wiki page exactly what programs you are
> talking about, and link each to their specific report?  I'm having a hard
> time figuring out exactly what is being reported as part of the WEP, what
> projects are affected, and which programs have more participants.
>
> Thanks!
>
> Risker/Anne
>
>
> On 6 April 2014 21:30, Jaime Anstee <[hidden email]> wrote:
>
> > Greetings,
> >
> > (Please pardon any cross-posting)
> >
> > The final in our series of the Evaluation Reports (beta), the report on
> the
> > Wikipedia Education Program, is now available on meta:
> >
> > https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WEP<
> > https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM>
> >
> > Highlights of the report include:
> >
> > ==Inputs==
> >
> > The average Wikipedia Education Program reported cost a total of almost
> > $8,000 USD in total, and $275 each week to implement. The average
> Wikipedia
> > Education Program invests a total of $67 US and 3 hours into recruiting
> > each new editor participant.
> >
> >
> > ==Participation==
> >
> > Program leaders reported participation rates ranging from 25 to 2,372,
> and
> > programs lasted from two weeks to 21 months with an average of 37.5
> weeks.
> >
> >
> > ==Outputs==
> >
> > For the seven reported Wikipedia Education Program implementations,
> almost
> > 3,000 different Wikimedia pages were created or improved. The average
> > Wikipedia Education Program produces about 120 pages of content each
> week.
> > The average program participant adds just under half a page of content to
> > Wikipedia and creates or improves six wiki pages each week.
> >
> >
> > ==Outcomes==
> >
> > Out of the 3,334 new editor participants in Wikipedia Education Program,
> 36
> > (1.2%) participants were "active" three months after the program ended;
> 33
> > (1.1%) were "active" six months after the programs ended.
> >
> > Questions are welcome and encouraged on the talk page.
> >
> > On behalf of the Program Evaluation team,
> >
> > Jaime
> >
> >
> > --
> >
> > Jaime Anstee, Ph.D
> > Program Evaluation Specialist
> > Wikimedia Foundation
> > +1.415.839.6885 ext 6869
> > www.wikimediafoundation.org
> >
> > Imagine a world in which every single human being can freely share in the
> > sum of all knowledge. Help us make it a reality!
> > *https://donate.wikimedia.org <https://donate.wikimedia.org/>*
> > _______________________________________________
> > Wikimedia-l mailing list
> > [hidden email]
> > Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
> > <mailto:[hidden email]?subject=unsubscribe>
> _______________________________________________
> Wikimedia-l mailing list
> [hidden email]
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
> <mailto:[hidden email]?subject=unsubscribe>
>



--
Anna Torres Adell
Directora Ejecutiva
*A.C Wikimedia Argentina*

*Imprime este correo solo si es realmente necesario*
_______________________________________________
Wikimedia-l mailing list
[hidden email]
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:[hidden email]?subject=unsubscribe>
Reply | Threaded
Open this post in threaded view
|

Re: [Wikimedia-l] New Evaluation Report: Wikipedia Education Program

Jaime Anstee
In reply to this post by Risker
Hello Anne,

Thank you for your interest. I have posted your question and the following
response on the report's talk page
https://meta.wikimedia.org/wiki/Programs_talk:Evaluation_portal/Library/WEP

Please continue with any further comments and dialogue there.

Best regards,

Jaime


== For the overall WEP report could you please spell out on the Wiki page
exactly what programs you are talking about, and link each to their
specific report?  I'm having a hard time figuring out exactly what is being
reported as part of the WEP, what projects are affected, and which programs
have more participants. ==

:Program leaders who self-reported were assured their data would be
reported without their program name identifiers. With this low a report
count, even without program names listed in line with the data, this is
very difficult to do. The implementations reported here represent program
activity in the Arab world program, Czech Republic, Mexico, Nepal, Quebec,
and the US/Canada. The data reported at the bottom actually have unique
"Report ID" numbers that can be matched across the last three tables so
that you can actually regenerate the dataset missing only event names (See
Appendix heading "More Data" for the complete input, output, and outcome
data used in the report). Those data include the instructor classroom
count, number of program weeks, and participant counts for each
implementation reported. In the future we plan to ask program leaders what
level of identifiability in this reporting they are comfortable with and
include identifiers in cases in which reporters volunteer to share that
information publicly.
:However, as there is some expressed interest in possibly comparing
programs, I must restate the need for caution, at this early stage in the
reporting, with such small numbers of implementers reporting (less than 10%
potentially), we are aware that the data do not represent all programming,
and that the data are too variable to draw comparisons between programs
statistically.  Further, in the case where the count of classroom varies
highly across implementations, aggregate reporting of more than one-hundred
classrooms is not directly comparable to the reporting of a single
classroom since summative statistics from an increased number of
observations generates a ''regression to the mean'' and do not make for a
one-to-one comparison.
:These issues as well as any other comments and/or suggestions are welcome
on this talk page.

 __________________________________
_______________________________________________
Wikimedia-l mailing list
[hidden email]
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:[hidden email]?subject=unsubscribe>
Reply | Threaded
Open this post in threaded view
|

Re: [Wikimedia-l] New Evaluation Report: Wikipedia Education Program

Andre Engels
In reply to this post by Jaime Anstee
Ccml,bv ..
Op 7 apr. 2014 03:35 schreef "Jaime Anstee" <[hidden email]> het
volgende:

> Greetings,
>
> (Please pardon any cross-posting)
>
> The final in our series of the Evaluation Reports (beta), the report on the
> Wikipedia Education Program, is now available on meta:
>
> https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WEP<
> https://meta.wikimedia.org/wiki/Programs:Evaluation_portal/Library/WLM>
>
> Highlights of the report include:
>
> ==Inputs==
>
> The average Wikipedia Education Program reported cost a total of almost
> $8,000 USD in total, and $275 each week to implement. The average Wikipedia
> Education Program invests a total of $67 US and 3 hours into recruiting
> each new editor participant.
>
>
> ==Participation==
>
> Program leaders reported participation rates ranging from 25 to 2,372, and
> programs lasted from two weeks to 21 months with an average of 37.5 weeks.
>
>
> ==Outputs==
>
> For the seven reported Wikipedia Education Program implementations, almost
> 3,000 different Wikimedia pages were created or improved. The average
> Wikipedia Education Program produces about 120 pages of content each week.
> The average program participant adds just under half a page of content to
> Wikipedia and creates or improves six wiki pages each week.
>
>
> ==Outcomes==
>
> Out of the 3,334 new editor participants in Wikipedia Education Program, 36
> (1.2%) participants were "active" three months after the program ended; 33
> (1.1%) were "active" six months after the programs ended.
>
> Questions are welcome and encouraged on the talk page.
>
> On behalf of the Program Evaluation team,
>
> Jaime
>
>
> --
>
> Jaime Anstee, Ph.D
> Program Evaluation Specialist
> Wikimedia Foundation
> +1.415.839.6885 ext 6869
> www.wikimediafoundation.org
>
> Imagine a world in which every single human being can freely share in the
> sum of all knowledge. Help us make it a reality!
> *https://donate.wikimedia.org <https://donate.wikimedia.org/>*
> _______________________________________________
> Wikimedia-l mailing list
> [hidden email]
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
> <mailto:[hidden email]?subject=unsubscribe>
_______________________________________________
Wikimedia-l mailing list
[hidden email]
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:[hidden email]?subject=unsubscribe>