Research around the use of MassMessages extension

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Research around the use of MassMessages extension

Florence Devouard-6
Hello everyone,


I was interested to know whether there has been any research done around
the use of the Mass Message mediawiki extension and in particular about
impact of using it.

By extension, I am interested in any research that might be related to
the impact of posting a "template" message (as opposed to an individual
targetted) on a user talk page.
I know the SignPost did a poll in 2017 to evaluate the interest of
switching to the Newsletter extension system. And I remember reading
about impact of notifications. But are there studies related to the
measure of impact in terms of engagement to mass posting on user talk page ?

Thanks for any insight you could provide


Florence




_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: Research around the use of MassMessages extension

Morten Wang
Hi Florence,

A paper by Zhu et al spring to mind, as well as the study of phrasing in
template messages by Geiger et al. Although these focus on one-to-one
communication on Wiki rather than mass communication, I think they'll be
relevant. I think there's also a paper about invitations to join
WikiProjects that looks at personalized vs templated messages, but I cannot
find it at the moment.

Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on
Contribution: A Field Experiment in Wikipedia. CHI, 2013.

Defense Mechanism or Socialization Tactic? Improving Wikipedia's
Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and
Walling. ICWSM 2012.


Cheers,
Morten


On Thu, 22 Nov 2018 at 07:11, Florence Devouard <[hidden email]> wrote:

> Hello everyone,
>
>
> I was interested to know whether there has been any research done around
> the use of the Mass Message mediawiki extension and in particular about
> impact of using it.
>
> By extension, I am interested in any research that might be related to
> the impact of posting a "template" message (as opposed to an individual
> targetted) on a user talk page.
> I know the SignPost did a poll in 2017 to evaluate the interest of
> switching to the Newsletter extension system. And I remember reading
> about impact of notifications. But are there studies related to the
> measure of impact in terms of engagement to mass posting on user talk page
> ?
>
> Thanks for any insight you could provide
>
>
> Florence
>
>
>
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>
_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: Research around the use of MassMessages extension

Florence Devouard-6
Hello Morten


Thanks for the infos. Will start from there !

Cheers

Flo

Le 24/11/2018 à 16:47, Morten Wang a écrit :

> Hi Florence,
>
> A paper by Zhu et al spring to mind, as well as the study of phrasing in
> template messages by Geiger et al. Although these focus on one-to-one
> communication on Wiki rather than mass communication, I think they'll be
> relevant. I think there's also a paper about invitations to join
> WikiProjects that looks at personalized vs templated messages, but I cannot
> find it at the moment.
>
> Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on
> Contribution: A Field Experiment in Wikipedia. CHI, 2013.
>
> Defense Mechanism or Socialization Tactic? Improving Wikipedia's
> Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and
> Walling. ICWSM 2012.
>
>
> Cheers,
> Morten
>
>
> On Thu, 22 Nov 2018 at 07:11, Florence Devouard <[hidden email]> wrote:
>
>> Hello everyone,
>>
>>
>> I was interested to know whether there has been any research done around
>> the use of the Mass Message mediawiki extension and in particular about
>> impact of using it.
>>
>> By extension, I am interested in any research that might be related to
>> the impact of posting a "template" message (as opposed to an individual
>> targetted) on a user talk page.
>> I know the SignPost did a poll in 2017 to evaluate the interest of
>> switching to the Newsletter extension system. And I remember reading
>> about impact of notifications. But are there studies related to the
>> measure of impact in terms of engagement to mass posting on user talk page
>> ?
>>
>> Thanks for any insight you could provide
>>
>>
>> Florence
>>
>>
>>
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: Research around the use of MassMessages extension

Leila Zia
Hi Flo,

It would be really helpful if you let us know in this thread (whenever
you're ready for it and if the answer to your questions is not already
in the literature) what kind of research or analysis would be helpful
for you. Something we would like to start exploring in the Research
team is to convert this kind of question to a well-documented open
question type and offer it to volunteer researchers who come to us and
ask for what questions to work on.

I have a few questions on this front which may help you expand from
there (or negate and tell me to discard them as not-interesting):
* What is the impact of MassMessage on activation (where activation
needs to be defined but broadly speaking, it's bringing back the user
after a period of inactivity to do at least n edits)?
* Is the impact on activation dependent on the topic of the
MassMessage? For example, does a MassMessage on a call for elections
activate the users the same way as the MassMessage to congratulate
Wiki Loves Monuments winners?
* Is the impact on activation wiki dependent? For example, are
Wikimedia Commons editors more likely to get activated after receiving
a MassMessage than Wikidata editors?
* Is the impact on activation related to the tenure of the user, where
tenure needs to be defined but roughly speaking: it's the number of
years since account registration?

And finally, we have some learnings from emailing users which may be
helpful for you to know as some of them may apply to MassMessage, too,
though we can only hypothesize at this point:
* On Wikipedia: the users are more likely to respond to a call to
action (in this case: create an article) if they have recently edited
Wikipedia. Check Figure 10 in https://arxiv.org/pdf/1604.03235.pdf .
The more there is time in between the last edit time and the time the
users received the email, the less likely they are to respond to the
call to action.
* On Wikipedia: Personalization matters. The editors who received
personalized messages (in this case, it really means personalized
recommendations) started to contribute to articles twice more than
those who received important articles as part of their recommendations
that where not personalized. I want to emphasize that the set-up of
the experiment was very specific, but there may be some learnings here
for what you have in mind.

Best,
Leila
On Mon, Nov 26, 2018 at 10:02 AM Florence Devouard <[hidden email]> wrote:

>
> Hello Morten
>
>
> Thanks for the infos. Will start from there !
>
> Cheers
>
> Flo
>
> Le 24/11/2018 à 16:47, Morten Wang a écrit :
> > Hi Florence,
> >
> > A paper by Zhu et al spring to mind, as well as the study of phrasing in
> > template messages by Geiger et al. Although these focus on one-to-one
> > communication on Wiki rather than mass communication, I think they'll be
> > relevant. I think there's also a paper about invitations to join
> > WikiProjects that looks at personalized vs templated messages, but I cannot
> > find it at the moment.
> >
> > Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on
> > Contribution: A Field Experiment in Wikipedia. CHI, 2013.
> >
> > Defense Mechanism or Socialization Tactic? Improving Wikipedia's
> > Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and
> > Walling. ICWSM 2012.
> >
> >
> > Cheers,
> > Morten
> >
> >
> > On Thu, 22 Nov 2018 at 07:11, Florence Devouard <[hidden email]> wrote:
> >
> >> Hello everyone,
> >>
> >>
> >> I was interested to know whether there has been any research done around
> >> the use of the Mass Message mediawiki extension and in particular about
> >> impact of using it.
> >>
> >> By extension, I am interested in any research that might be related to
> >> the impact of posting a "template" message (as opposed to an individual
> >> targetted) on a user talk page.
> >> I know the SignPost did a poll in 2017 to evaluate the interest of
> >> switching to the Newsletter extension system. And I remember reading
> >> about impact of notifications. But are there studies related to the
> >> measure of impact in terms of engagement to mass posting on user talk page
> >> ?
> >>
> >> Thanks for any insight you could provide
> >>
> >>
> >> Florence
> >>
> >>
> >>
> >>
> >> _______________________________________________
> >> Wiki-research-l mailing list
> >> [hidden email]
> >> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
> >>
> > _______________________________________________
> > Wiki-research-l mailing list
> > [hidden email]
> > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: Research around the use of MassMessages extension

Morten Wang
In reply to this post by Florence Devouard-6
Found the paper on welcoming newcomers to WikiProjects that I'm certain is
also relevant here, it's this one:
Choi, Boreum, et al. "Socialization Tactics in Wikipedia and Their
Effects." CSCW, 2010.
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.424.7966&rep=rep1&type=pdf


Cheers,
Morten

On Mon, 26 Nov 2018 at 10:02, Florence Devouard <[hidden email]> wrote:

> Hello Morten
>
>
> Thanks for the infos. Will start from there !
>
> Cheers
>
> Flo
>
> Le 24/11/2018 à 16:47, Morten Wang a écrit :
> > Hi Florence,
> >
> > A paper by Zhu et al spring to mind, as well as the study of phrasing in
> > template messages by Geiger et al. Although these focus on one-to-one
> > communication on Wiki rather than mass communication, I think they'll be
> > relevant. I think there's also a paper about invitations to join
> > WikiProjects that looks at personalized vs templated messages, but I
> cannot
> > find it at the moment.
> >
> > Zhu, H., Kraut, R.E., & Kittur, A., (2013) Effects of Peer Feedback on
> > Contribution: A Field Experiment in Wikipedia. CHI, 2013.
> >
> > Defense Mechanism or Socialization Tactic? Improving Wikipedia's
> > Notifications to Rejected Contributors by Geiger, Halfaker, Pinchuk, and
> > Walling. ICWSM 2012.
> >
> >
> > Cheers,
> > Morten
> >
> >
> > On Thu, 22 Nov 2018 at 07:11, Florence Devouard <[hidden email]>
> wrote:
> >
> >> Hello everyone,
> >>
> >>
> >> I was interested to know whether there has been any research done around
> >> the use of the Mass Message mediawiki extension and in particular about
> >> impact of using it.
> >>
> >> By extension, I am interested in any research that might be related to
> >> the impact of posting a "template" message (as opposed to an individual
> >> targetted) on a user talk page.
> >> I know the SignPost did a poll in 2017 to evaluate the interest of
> >> switching to the Newsletter extension system. And I remember reading
> >> about impact of notifications. But are there studies related to the
> >> measure of impact in terms of engagement to mass posting on user talk
> page
> >> ?
> >>
> >> Thanks for any insight you could provide
> >>
> >>
> >> Florence
> >>
> >>
> >>
> >>
> >> _______________________________________________
> >> Wiki-research-l mailing list
> >> [hidden email]
> >> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
> >>
> > _______________________________________________
> > Wiki-research-l mailing list
> > [hidden email]
> > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>
_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l