wikistream: displays wikipedia updates in realtime

classic Classic list List threaded Threaded
41 messages Options
123
Reply | Threaded
Open this post in threaded view
|

wikistream: displays wikipedia updates in realtime

Ed Summers
I've been looking to experiment with node.js lately and created a
little toy webapp that displays updates from the major language
wikipedias in real time:

    http://wikistream.inkdroid.org

Perhaps like you, I've often tried to convey to folks in the GLAM
sector (Galleries, Libraries, Archives and Museums) just how much
Wikipedia is actively edited. GLAM institutions are increasingly
interested in "digital curation" and I've sometimes displayed the IRC
activity at workshops to demonstrate the sheer number of people (and
bots) that are actively engaged in improving the content there...with
the hopes of making the Wikipedia platform part of their curation
strategy.

Anyhow, I'd be interested in any feedback you might have about wikistream.

//Ed

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

lior gimel
This is a great feature for public presentations, thanks for creating it.
I think a version that displays edit only updates from the English language wikipedia could be a nice feature.
Lior


On Thu, Jun 16, 2011 at 7:40 AM, Ed Summers <[hidden email]> wrote:
I've been looking to experiment with node.js lately and created a
little toy webapp that displays updates from the major language
wikipedias in real time:

   http://wikistream.inkdroid.org

Perhaps like you, I've often tried to convey to folks in the GLAM
sector (Galleries, Libraries, Archives and Museums) just how much
Wikipedia is actively edited. GLAM institutions are increasingly
interested in "digital curation" and I've sometimes displayed the IRC
activity at workshops to demonstrate the sheer number of people (and
bots) that are actively engaged in improving the content there...with
the hopes of making the Wikipedia platform part of their curation
strategy.

Anyhow, I'd be interested in any feedback you might have about wikistream.

//Ed

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l


_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

metasj
In reply to this post by Ed Summers
Without changing the concept or algorithm much, I'd like to see a
three column version, with the left-most column being for all edits --
with speed smoothed out over time (time delay 30 seconds, average it
out); the middle one being edits changing over 100 chars that aren't
immediately reverted (time-delayed 1 min?), and the left column being
edits changing over 1,000 chars that aren't quickly reverted
(time-delayed 2 minutes?), and aren't by bots or huggle.

SJ


On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:

> I've been looking to experiment with node.js lately and created a
> little toy webapp that displays updates from the major language
> wikipedias in real time:
>
>    http://wikistream.inkdroid.org
>
> Perhaps like you, I've often tried to convey to folks in the GLAM
> sector (Galleries, Libraries, Archives and Museums) just how much
> Wikipedia is actively edited. GLAM institutions are increasingly
> interested in "digital curation" and I've sometimes displayed the IRC
> activity at workshops to demonstrate the sheer number of people (and
> bots) that are actively engaged in improving the content there...with
> the hopes of making the Wikipedia platform part of their curation
> strategy.
>
> Anyhow, I'd be interested in any feedback you might have about wikistream.
>
> //Ed
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>



--
Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

metasj
I'd also like to see another layer of color-coding - background
shading based on some measure of wikitrust.

On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:

> Without changing the concept or algorithm much, I'd like to see a
> three column version, with the left-most column being for all edits --
> with speed smoothed out over time (time delay 30 seconds, average it
> out); the middle one being edits changing over 100 chars that aren't
> immediately reverted (time-delayed 1 min?), and the left column being
> edits changing over 1,000 chars that aren't quickly reverted
> (time-delayed 2 minutes?), and aren't by bots or huggle.
>
> SJ
>
>
> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>> I've been looking to experiment with node.js lately and created a
>> little toy webapp that displays updates from the major language
>> wikipedias in real time:
>>
>>    http://wikistream.inkdroid.org
>>
>> Perhaps like you, I've often tried to convey to folks in the GLAM
>> sector (Galleries, Libraries, Archives and Museums) just how much
>> Wikipedia is actively edited. GLAM institutions are increasingly
>> interested in "digital curation" and I've sometimes displayed the IRC
>> activity at workshops to demonstrate the sheer number of people (and
>> bots) that are actively engaged in improving the content there...with
>> the hopes of making the Wikipedia platform part of their curation
>> strategy.
>>
>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>
>> //Ed
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
>
>
>
> --
> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>



--
Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Ed Summers
Good ideas. Although I'm not sure how much of that I can glean from
the IRC messages without starting to hammer on the Wikipedia APIs.

//Ed

On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:

> I'd also like to see another layer of color-coding - background
> shading based on some measure of wikitrust.
>
> On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:
>> Without changing the concept or algorithm much, I'd like to see a
>> three column version, with the left-most column being for all edits --
>> with speed smoothed out over time (time delay 30 seconds, average it
>> out); the middle one being edits changing over 100 chars that aren't
>> immediately reverted (time-delayed 1 min?), and the left column being
>> edits changing over 1,000 chars that aren't quickly reverted
>> (time-delayed 2 minutes?), and aren't by bots or huggle.
>>
>> SJ
>>
>>
>> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>>> I've been looking to experiment with node.js lately and created a
>>> little toy webapp that displays updates from the major language
>>> wikipedias in real time:
>>>
>>>    http://wikistream.inkdroid.org
>>>
>>> Perhaps like you, I've often tried to convey to folks in the GLAM
>>> sector (Galleries, Libraries, Archives and Museums) just how much
>>> Wikipedia is actively edited. GLAM institutions are increasingly
>>> interested in "digital curation" and I've sometimes displayed the IRC
>>> activity at workshops to demonstrate the sheer number of people (and
>>> bots) that are actively engaged in improving the content there...with
>>> the hopes of making the Wikipedia platform part of their curation
>>> strategy.
>>>
>>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>>
>>> //Ed
>>>
>>> _______________________________________________
>>> Wiki-research-l mailing list
>>> [hidden email]
>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>
>>
>>
>>
>> --
>> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>>
>
>
>
> --
> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

lior gimel
A separate column for bot edits could be nice too.

On Thu, Jun 16, 2011 at 9:01 AM, Ed Summers <[hidden email]> wrote:
Good ideas. Although I'm not sure how much of that I can glean from
the IRC messages without starting to hammer on the Wikipedia APIs.

//Ed

On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj@gmail.com> wrote:
> I'd also like to see another layer of color-coding - background
> shading based on some measure of wikitrust.
>
> On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj@gmail.com> wrote:
>> Without changing the concept or algorithm much, I'd like to see a
>> three column version, with the left-most column being for all edits --
>> with speed smoothed out over time (time delay 30 seconds, average it
>> out); the middle one being edits changing over 100 chars that aren't
>> immediately reverted (time-delayed 1 min?), and the left column being
>> edits changing over 1,000 chars that aren't quickly reverted
>> (time-delayed 2 minutes?), and aren't by bots or huggle.
>>
>> SJ
>>
>>
>> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>>> I've been looking to experiment with node.js lately and created a
>>> little toy webapp that displays updates from the major language
>>> wikipedias in real time:
>>>
>>>    http://wikistream.inkdroid.org
>>>
>>> Perhaps like you, I've often tried to convey to folks in the GLAM
>>> sector (Galleries, Libraries, Archives and Museums) just how much
>>> Wikipedia is actively edited. GLAM institutions are increasingly
>>> interested in "digital curation" and I've sometimes displayed the IRC
>>> activity at workshops to demonstrate the sheer number of people (and
>>> bots) that are actively engaged in improving the content there...with
>>> the hopes of making the Wikipedia platform part of their curation
>>> strategy.
>>>
>>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>>
>>> //Ed
>>>
>>> _______________________________________________
>>> Wiki-research-l mailing list
>>> [hidden email]
>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>
>>
>>
>>
>> --
>> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>>
>
>
>
> --
> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l


_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Ed Summers
In reply to this post by metasj
Actually re-reading this again, I definitely can grab the number of
characters in the change from the IRC update ... something like this 3
column display could work.

On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:

> Without changing the concept or algorithm much, I'd like to see a
> three column version, with the left-most column being for all edits --
> with speed smoothed out over time (time delay 30 seconds, average it
> out); the middle one being edits changing over 100 chars that aren't
> immediately reverted (time-delayed 1 min?), and the left column being
> edits changing over 1,000 chars that aren't quickly reverted
> (time-delayed 2 minutes?), and aren't by bots or huggle.
>
> SJ
>
>
> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>> I've been looking to experiment with node.js lately and created a
>> little toy webapp that displays updates from the major language
>> wikipedias in real time:
>>
>>    http://wikistream.inkdroid.org
>>
>> Perhaps like you, I've often tried to convey to folks in the GLAM
>> sector (Galleries, Libraries, Archives and Museums) just how much
>> Wikipedia is actively edited. GLAM institutions are increasingly
>> interested in "digital curation" and I've sometimes displayed the IRC
>> activity at workshops to demonstrate the sheer number of people (and
>> bots) that are actively engaged in improving the content there...with
>> the hopes of making the Wikipedia platform part of their curation
>> strategy.
>>
>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>
>> //Ed
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
>
>
>
> --
> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Ward Cunningham
I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward


On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:

> Actually re-reading this again, I definitely can grab the number of
> characters in the change from the IRC update ... something like this 3
> column display could work.
>
> On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:
>> Without changing the concept or algorithm much, I'd like to see a
>> three column version, with the left-most column being for all edits --
>> with speed smoothed out over time (time delay 30 seconds, average it
>> out); the middle one being edits changing over 100 chars that aren't
>> immediately reverted (time-delayed 1 min?), and the left column being
>> edits changing over 1,000 chars that aren't quickly reverted
>> (time-delayed 2 minutes?), and aren't by bots or huggle.
>>
>> SJ
>>
>>
>> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>>> I've been looking to experiment with node.js lately and created a
>>> little toy webapp that displays updates from the major language
>>> wikipedias in real time:
>>>
>>>    http://wikistream.inkdroid.org
>>>
>>> Perhaps like you, I've often tried to convey to folks in the GLAM
>>> sector (Galleries, Libraries, Archives and Museums) just how much
>>> Wikipedia is actively edited. GLAM institutions are increasingly
>>> interested in "digital curation" and I've sometimes displayed the IRC
>>> activity at workshops to demonstrate the sheer number of people (and
>>> bots) that are actively engaged in improving the content there...with
>>> the hopes of making the Wikipedia platform part of their curation
>>> strategy.
>>>
>>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>>
>>> //Ed
>>>
>>> _______________________________________________
>>> Wiki-research-l mailing list
>>> [hidden email]
>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>
>>
>>
>>
>> --
>> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l


_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Ed Summers
Wow, thanks Ward. You made my professional career :-)

Major props to node.js, redis and socket.io.  I really just put the
lego pieces together. It feels like the tools are getting better and
better some days. (he says as he tunes the TCP stack on his little
linode VPN to keep up with the traffic ...)

//Ed

On Thu, Jun 16, 2011 at 10:43 AM, Ward Cunningham <[hidden email]> wrote:

> I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward
>
>
> On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:
>
>> Actually re-reading this again, I definitely can grab the number of
>> characters in the change from the IRC update ... something like this 3
>> column display could work.
>>
>> On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:
>>> Without changing the concept or algorithm much, I'd like to see a
>>> three column version, with the left-most column being for all edits --
>>> with speed smoothed out over time (time delay 30 seconds, average it
>>> out); the middle one being edits changing over 100 chars that aren't
>>> immediately reverted (time-delayed 1 min?), and the left column being
>>> edits changing over 1,000 chars that aren't quickly reverted
>>> (time-delayed 2 minutes?), and aren't by bots or huggle.
>>>
>>> SJ
>>>
>>>
>>> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>>>> I've been looking to experiment with node.js lately and created a
>>>> little toy webapp that displays updates from the major language
>>>> wikipedias in real time:
>>>>
>>>>    http://wikistream.inkdroid.org
>>>>
>>>> Perhaps like you, I've often tried to convey to folks in the GLAM
>>>> sector (Galleries, Libraries, Archives and Museums) just how much
>>>> Wikipedia is actively edited. GLAM institutions are increasingly
>>>> interested in "digital curation" and I've sometimes displayed the IRC
>>>> activity at workshops to demonstrate the sheer number of people (and
>>>> bots) that are actively engaged in improving the content there...with
>>>> the hopes of making the Wikipedia platform part of their curation
>>>> strategy.
>>>>
>>>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>>>
>>>> //Ed
>>>>
>>>> _______________________________________________
>>>> Wiki-research-l mailing list
>>>> [hidden email]
>>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>>
>>>
>>>
>>>
>>> --
>>> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>>>
>>> _______________________________________________
>>> Wiki-research-l mailing list
>>> [hidden email]
>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Sage Ross
Really solid!  This looks like the new go-to visualization for demonstrating
the pace of changes on Wikipedia.

One feature you might consider adding to it would be the option to
just see the stream from one language.

Another thing that would be good, in my opinion, would be to replace
the flags with something like color-coded language abbreviations: en,
de, and so on.

Thanks much for this. I've already added it to the Wikimedia Education
Portal as a resource that teachers can use for getting students
excited about Wikipedia when they are running Wikipedia assignments in
class.

-Sage Ross

On Thu, Jun 16, 2011 at 11:53 AM, Ed Summers <[hidden email]> wrote:

> Wow, thanks Ward. You made my professional career :-)
>
> Major props to node.js, redis and socket.io.  I really just put the
> lego pieces together. It feels like the tools are getting better and
> better some days. (he says as he tunes the TCP stack on his little
> linode VPN to keep up with the traffic ...)
>
> //Ed
>
> On Thu, Jun 16, 2011 at 10:43 AM, Ward Cunningham <[hidden email]> wrote:
>> I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward
>>
>>
>> On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:
>>
>>> Actually re-reading this again, I definitely can grab the number of
>>> characters in the change from the IRC update ... something like this 3
>>> column display could work.
>>>
>>> On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:
>>>> Without changing the concept or algorithm much, I'd like to see a
>>>> three column version, with the left-most column being for all edits --
>>>> with speed smoothed out over time (time delay 30 seconds, average it
>>>> out); the middle one being edits changing over 100 chars that aren't
>>>> immediately reverted (time-delayed 1 min?), and the left column being
>>>> edits changing over 1,000 chars that aren't quickly reverted
>>>> (time-delayed 2 minutes?), and aren't by bots or huggle.
>>>>
>>>> SJ
>>>>
>>>>
>>>> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>>>>> I've been looking to experiment with node.js lately and created a
>>>>> little toy webapp that displays updates from the major language
>>>>> wikipedias in real time:
>>>>>
>>>>>    http://wikistream.inkdroid.org
>>>>>
>>>>> Perhaps like you, I've often tried to convey to folks in the GLAM
>>>>> sector (Galleries, Libraries, Archives and Museums) just how much
>>>>> Wikipedia is actively edited. GLAM institutions are increasingly
>>>>> interested in "digital curation" and I've sometimes displayed the IRC
>>>>> activity at workshops to demonstrate the sheer number of people (and
>>>>> bots) that are actively engaged in improving the content there...with
>>>>> the hopes of making the Wikipedia platform part of their curation
>>>>> strategy.
>>>>>
>>>>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>>>>
>>>>> //Ed
>>>>>
>>>>> _______________________________________________
>>>>> Wiki-research-l mailing list
>>>>> [hidden email]
>>>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>>>>
>>>> _______________________________________________
>>>> Wiki-research-l mailing list
>>>> [hidden email]
>>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>>
>>>
>>> _______________________________________________
>>> Wiki-research-l mailing list
>>> [hidden email]
>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

R.Stuart Geiger
Yes, this is amazing, thanks for making it!  It's great that it shows
bot edits in a different color, as most people just tend to filter
them out.  This definitely will be my go-to visualization for
presentations, both about Wikipedia generally and about bots.

Stuart Geiger

On Thu, Jun 16, 2011 at 9:56 AM, Sage Ross <[hidden email]> wrote:

> Really solid!  This looks like the new go-to visualization for demonstrating
> the pace of changes on Wikipedia.
>
> One feature you might consider adding to it would be the option to
> just see the stream from one language.
>
> Another thing that would be good, in my opinion, would be to replace
> the flags with something like color-coded language abbreviations: en,
> de, and so on.
>
> Thanks much for this. I've already added it to the Wikimedia Education
> Portal as a resource that teachers can use for getting students
> excited about Wikipedia when they are running Wikipedia assignments in
> class.
>
> -Sage Ross
>
> On Thu, Jun 16, 2011 at 11:53 AM, Ed Summers <[hidden email]> wrote:
>> Wow, thanks Ward. You made my professional career :-)
>>
>> Major props to node.js, redis and socket.io.  I really just put the
>> lego pieces together. It feels like the tools are getting better and
>> better some days. (he says as he tunes the TCP stack on his little
>> linode VPN to keep up with the traffic ...)
>>
>> //Ed
>>
>> On Thu, Jun 16, 2011 at 10:43 AM, Ward Cunningham <[hidden email]> wrote:
>>> I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward
>>>
>>>
>>> On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:
>>>
>>>> Actually re-reading this again, I definitely can grab the number of
>>>> characters in the change from the IRC update ... something like this 3
>>>> column display could work.
>>>>
>>>> On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:
>>>>> Without changing the concept or algorithm much, I'd like to see a
>>>>> three column version, with the left-most column being for all edits --
>>>>> with speed smoothed out over time (time delay 30 seconds, average it
>>>>> out); the middle one being edits changing over 100 chars that aren't
>>>>> immediately reverted (time-delayed 1 min?), and the left column being
>>>>> edits changing over 1,000 chars that aren't quickly reverted
>>>>> (time-delayed 2 minutes?), and aren't by bots or huggle.
>>>>>
>>>>> SJ
>>>>>
>>>>>
>>>>> On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <[hidden email]> wrote:
>>>>>> I've been looking to experiment with node.js lately and created a
>>>>>> little toy webapp that displays updates from the major language
>>>>>> wikipedias in real time:
>>>>>>
>>>>>>    http://wikistream.inkdroid.org
>>>>>>
>>>>>> Perhaps like you, I've often tried to convey to folks in the GLAM
>>>>>> sector (Galleries, Libraries, Archives and Museums) just how much
>>>>>> Wikipedia is actively edited. GLAM institutions are increasingly
>>>>>> interested in "digital curation" and I've sometimes displayed the IRC
>>>>>> activity at workshops to demonstrate the sheer number of people (and
>>>>>> bots) that are actively engaged in improving the content there...with
>>>>>> the hopes of making the Wikipedia platform part of their curation
>>>>>> strategy.
>>>>>>
>>>>>> Anyhow, I'd be interested in any feedback you might have about wikistream.
>>>>>>
>>>>>> //Ed
>>>>>>
>>>>>> _______________________________________________
>>>>>> Wiki-research-l mailing list
>>>>>> [hidden email]
>>>>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266
>>>>>
>>>>> _______________________________________________
>>>>> Wiki-research-l mailing list
>>>>> [hidden email]
>>>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>>>
>>>>
>>>> _______________________________________________
>>>> Wiki-research-l mailing list
>>>> [hidden email]
>>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>
>>>
>>> _______________________________________________
>>> Wiki-research-l mailing list
>>> [hidden email]
>>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>>
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

fox-20
In reply to this post by Ed Summers
Il 16/06/2011 06:40, Ed Summers ha scritto:
> I've been looking to experiment with node.js lately and created a
> little toy webapp that displays updates from the major language
> wikipedias in real time


It's really nice, i think that would be great having an API to use that
data for other web apps (for example to get the last page that has been
edited from the english wikipedia in JSON or XML format).

Good job ;)

--
f.

  "I didn't try, I succeeded"
  (Dr. Sheldon Cooper, PhD)

()  ascii ribbon campaign - against html e-mail
/\  www.asciiribbon.org   - against proprietary attachments


_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

signature.asc (918 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Ziko van Dijk
Hello,

Congratulations; the next step would be to let choose which language
versions (or other Wikimedia projects) you want to have included?

Kind regards
Ziko

2011/6/16 fox <[hidden email]>:

> Il 16/06/2011 06:40, Ed Summers ha scritto:
>> I've been looking to experiment with node.js lately and created a
>> little toy webapp that displays updates from the major language
>> wikipedias in real time
>
>
> It's really nice, i think that would be great having an API to use that
> data for other web apps (for example to get the last page that has been
> edited from the english wikipedia in JSON or XML format).
>
> Good job ;)
>
> --
> f.
>
>  "I didn't try, I succeeded"
>  (Dr. Sheldon Cooper, PhD)
>
> ()  ascii ribbon campaign - against html e-mail
> /\  www.asciiribbon.org   - against proprietary attachments
>
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>
>



--
Ziko van Dijk
The Netherlands
http://zikoblog.wordpress.com/

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Goran Milovanovic
This is  a b s o l u t e l y  amazing.

Cheers,
Goran

On Thu, Jun 16, 2011 at 7:21 PM, Ziko van Dijk <[hidden email]> wrote:
Hello,

Congratulations; the next step would be to let choose which language
versions (or other Wikimedia projects) you want to have included?

Kind regards
Ziko

2011/6/16 fox <[hidden email]>:
> Il 16/06/2011 06:40, Ed Summers ha scritto:
>> I've been looking to experiment with node.js lately and created a
>> little toy webapp that displays updates from the major language
>> wikipedias in real time
>
>
> It's really nice, i think that would be great having an API to use that
> data for other web apps (for example to get the last page that has been
> edited from the english wikipedia in JSON or XML format).
>
> Good job ;)
>
> --
> f.
>
>  "I didn't try, I succeeded"
>  (Dr. Sheldon Cooper, PhD)
>
> ()  ascii ribbon campaign - against html e-mail
> /\  www.asciiribbon.org   - against proprietary attachments
>
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>
>



--
Ziko van Dijk
The Netherlands
http://zikoblog.wordpress.com/

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l



--
--------------------------------------------------------------
"Truth is much too complicated to allow
anything but approximations."
                             :: John von Neumann
--------------------------------------------------------------
http://www.milovanovicresearch.com


_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

metasj
In reply to this post by Ziko van Dijk
Fancy options:

- Choose individual Projects [just look at wiktionary, for instance]
- Choose a color scheme or audio scheme to go with it [ rcbirds comes
to mind :) ]
- Add small languages
- Include or ignore bots, period

On Thu, Jun 16, 2011 at 1:21 PM, Ziko van Dijk <[hidden email]> wrote:

> Hello,
>
> Congratulations; the next step would be to let choose which language
> versions (or other Wikimedia projects) you want to have included?
>
> Kind regards
> Ziko
>
> 2011/6/16 fox <[hidden email]>:
>> Il 16/06/2011 06:40, Ed Summers ha scritto:
>>> I've been looking to experiment with node.js lately and created a
>>> little toy webapp that displays updates from the major language
>>> wikipedias in real time
>>
>>
>> It's really nice, i think that would be great having an API to use that
>> data for other web apps (for example to get the last page that has been
>> edited from the english wikipedia in JSON or XML format).
>>
>> Good job ;)
>>
>> --
>> f.
>>
>>  "I didn't try, I succeeded"
>>  (Dr. Sheldon Cooper, PhD)
>>
>> ()  ascii ribbon campaign - against html e-mail
>> /\  www.asciiribbon.org   - against proprietary attachments
>>
>>
>> _______________________________________________
>> Wiki-research-l mailing list
>> [hidden email]
>> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>>
>>
>
>
>
> --
> Ziko van Dijk
> The Netherlands
> http://zikoblog.wordpress.com/
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>



--
Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Piotr Konieczny-4
In reply to this post by Ed Summers
Ed Summers wrote:

> I've been looking to experiment with node.js lately and created a
> little toy webapp that displays updates from the major language
> wikipedias in real time:
>
>      http://wikistream.inkdroid.org
>
> Perhaps like you, I've often tried to convey to folks in the GLAM
> sector (Galleries, Libraries, Archives and Museums) just how much
> Wikipedia is actively edited. GLAM institutions are increasingly
> interested in "digital curation" and I've sometimes displayed the IRC
> activity at workshops to demonstrate the sheer number of people (and
> bots) that are actively engaged in improving the content there...with
> the hopes of making the Wikipedia platform part of their curation
> strategy.
>
> Anyhow, I'd be interested in any feedback you might have about wikistream.

Nice, I certainly agree it is a good "screensaver" for public
presentations and such.

Feature request: ability to select feed from only some wikis (for
example, En Wikipedia only, or Pl Wikipedia only).


--
Piotr Konieczny
PhD Candidate
Dept of Sociology
Uni of Pittsburgh

http://pittsburgh.academia.edu/PiotrKonieczny/
http://en.wikipedia.org/wiki/User:Piotrus

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Ed Summers
In reply to this post by metasj
Hi SJ,

On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:
> Without changing the concept or algorithm much, I'd like to see a
> three column version, with the left-most column being for all edits --
> with speed smoothed out over time (time delay 30 seconds, average it
> out); the middle one being edits changing over 100 chars that aren't
> immediately reverted (time-delayed 1 min?), and the left column being
> edits changing over 1,000 chars that aren't quickly reverted
> (time-delayed 2 minutes?), and aren't by bots or huggle.

I am trying out a slider that allows you to set an "edit size" limit,
which should achieve roughly the same thing without the need for
additional columns. I haven't done any checking for pages that are
immediately reverted though (yet).

When I have time next I want to highlight the bots differently, maybe
with a small robot icon (let me know if you know of one), and allow
them to be filtered. Also I want to add language filtering since
several people have asked for that. I'm not quite sure how to do the
right-to-left for (ar,fa, ur, and he) since this basically right
justifies things, and it's mixed in with other direction text. Ideas
welcome on that front.

//Ed

PS. I'm having some issues keeping the service running. At the moment
I'm not sure if its a bug in my code or something lower level in
socket.io, express or node just yet...

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

metasj
Ed -- Nice.  To be clear, I would still appreciate a multi-column
look, because for me that is a much clearer visualization of the
site's activity than looking at any single edit-size-range.  It's like
a sparkline: you can get both a sense of flow and a feel for the
texture in the dimension of significance.

In fact, for the larger edits it might make sense to include 40 chars
of text from the update on a second line.

Reverts could show up as a thin red line between two edits, extending
to the side with the word "rv", with the article title available on
mouseover.

SJ

On Sat, Jun 18, 2011 at 8:33 AM, Ed Summers <[hidden email]> wrote:

> Hi SJ,
>
> On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <[hidden email]> wrote:
>> Without changing the concept or algorithm much, I'd like to see a
>> three column version, with the left-most column being for all edits --
>> with speed smoothed out over time (time delay 30 seconds, average it
>> out); the middle one being edits changing over 100 chars that aren't
>> immediately reverted (time-delayed 1 min?), and the left column being
>> edits changing over 1,000 chars that aren't quickly reverted
>> (time-delayed 2 minutes?), and aren't by bots or huggle.
>
> I am trying out a slider that allows you to set an "edit size" limit,
> which should achieve roughly the same thing without the need for
> additional columns. I haven't done any checking for pages that are
> immediately reverted though (yet).
>
> When I have time next I want to highlight the bots differently, maybe
> with a small robot icon (let me know if you know of one), and allow
> them to be filtered. Also I want to add language filtering since
> several people have asked for that. I'm not quite sure how to do the
> right-to-left for (ar,fa, ur, and he) since this basically right
> justifies things, and it's mixed in with other direction text. Ideas
> welcome on that front.
>
> //Ed
>
> PS. I'm having some issues keeping the service running. At the moment
> I'm not sure if its a bug in my code or something lower level in
> socket.io, express or node just yet...
>
> _______________________________________________
> Wiki-research-l mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>



--
Samuel Klein          identi.ca:sj           w:user:sj          +1 617 529 4266

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

Ed Summers
On Sat, Jun 18, 2011 at 7:05 PM, Samuel Klein <[hidden email]> wrote:
> Ed -- Nice.  To be clear, I would still appreciate a multi-column
> look, because for me that is a much clearer visualization of the
> site's activity than looking at any single edit-size-range.  It's like
> a sparkline: you can get both a sense of flow and a feel for the
> texture in the dimension of significance.

Understood. I'm just not sure I want to make the display that
complicated at this point. The code is there for you to use as you
wish though.


> Reverts could show up as a thin red line between two edits, extending
> to the side with the word "rv", with the article title available on
> mouseover.

Do you have a sense of the mechanics of identifying reverts? Do they
show up in an identifiable way in the IRC logs?

//Ed

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: wikistream: displays wikipedia updates in realtime

metasj
On Sun, Jun 19, 2011 at 5:48 PM, Ed Summers <[hidden email]> wrote:

>> Reverts could show up as a thin red line between two edits, extending
>> to the side with the word "rv", with the article title available on
>> mouseover.
>
> Do you have a sense of the mechanics of identifying reverts? Do they
> show up in an identifiable way in the IRC logs?

There are a few types of reverts.
Some have "rv" or "rvv" or "revert" [or equivalent in the appropriate
language] in the edit summary, undoing 1 edit
Some are (-N) changes immediately after a (+N) change, with some other
edit summary
A combination of the above rolling back multiple edits.  Here (-N) is
larger than the previous (+M)

The first group can be identified with few false positives - and the
-N/+N character-change used for confirmation.

S.

_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
123