Using Redis for Job Queue?

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Using Redis for Job Queue?

thingles
I’m planning on switching the job queue for my wikifarm to use redis [1] instead of MySQL. I know WMF uses this configuration, and it’s been in since about 1.20 so I’m hoping it’s reasonably well baked. However, I’m wondering if anyone using Semantic MediaWiki is using this configuration? I’d like to think that the job queue implementation details are not relevant to Semantic MediaWiki, but thought I would ask to see if others have tried this or not.

Jamie

[1] https://www.mediawiki.org/wiki/Redis#Job_queue
------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech
_______________________________________________
Semediawiki-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/semediawiki-user
Reply | Threaded
Open this post in threaded view
|

Re: Using Redis for Job Queue?

Toni Hermoso Pulido-2
Hello Jamie,

I'm using in a SMW-powered wiki deployment and so far I'm very happy
with performance and speed.

2014-06-04 14:02 GMT+02:00 Jamie Thingelstad <[hidden email]>:

> I'm planning on switching the job queue for my wikifarm to use redis [1] instead of MySQL. I know WMF uses this configuration, and it's been in since about 1.20 so I'm hoping it's reasonably well baked. However, I'm wondering if anyone using Semantic MediaWiki is using this configuration? I'd like to think that the job queue implementation details are not relevant to Semantic MediaWiki, but thought I would ask to see if others have tried this or not.
>
> Jamie
>
> [1] https://www.mediawiki.org/wiki/Redis#Job_queue
> ------------------------------------------------------------------------------
> Learn Graph Databases - Download FREE O'Reilly Book
> "Graph Databases" is the definitive new guide to graph databases and their
> applications. Written by three acclaimed leaders in the field,
> this first edition is now available. Download your free book today!
> http://p.sf.net/sfu/NeoTech
> _______________________________________________
> Semediawiki-user mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/semediawiki-user



--
Toni Hermoso Pulido
http://www.cau.cat

------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech
_______________________________________________
Semediawiki-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/semediawiki-user
Reply | Threaded
Open this post in threaded view
|

Re: Using Redis for Job Queue?

thingles
Just to hare my experience… I tried using Redis for the job queue and have just disabled it. My runJobs.php processes started hanging randomly. I was seeing a lot of exceptions and failures. I finally just reverted to MySQL for the job queue.

Some info at:

https://github.com/thingles/WikiApiary/issues/136

https://bugzilla.wikimedia.org/show_bug.cgi?id=66953


On Jun 4, 2014, at 7:12 AM, Toni Hermoso Pulido <[hidden email]> wrote:

> Hello Jamie,
>
> I'm using in a SMW-powered wiki deployment and so far I'm very happy
> with performance and speed.
>
> 2014-06-04 14:02 GMT+02:00 Jamie Thingelstad <[hidden email]>:
>> I'm planning on switching the job queue for my wikifarm to use redis [1] instead of MySQL. I know WMF uses this configuration, and it's been in since about 1.20 so I'm hoping it's reasonably well baked. However, I'm wondering if anyone using Semantic MediaWiki is using this configuration? I'd like to think that the job queue implementation details are not relevant to Semantic MediaWiki, but thought I would ask to see if others have tried this or not.
>>
>> Jamie
>>
>> [1] https://www.mediawiki.org/wiki/Redis#Job_queue
>> ------------------------------------------------------------------------------
>> Learn Graph Databases - Download FREE O'Reilly Book
>> "Graph Databases" is the definitive new guide to graph databases and their
>> applications. Written by three acclaimed leaders in the field,
>> this first edition is now available. Download your free book today!
>> http://p.sf.net/sfu/NeoTech
>> _______________________________________________
>> Semediawiki-user mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/semediawiki-user
>
>
>
> --
> Toni Hermoso Pulido
> http://www.cau.cat
>
> ------------------------------------------------------------------------------
> Learn Graph Databases - Download FREE O'Reilly Book
> "Graph Databases" is the definitive new guide to graph databases and their
> applications. Written by three acclaimed leaders in the field,
> this first edition is now available. Download your free book today!
> http://p.sf.net/sfu/NeoTech
> _______________________________________________
> Semediawiki-user mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/semediawiki-user

------------------------------------------------------------------------------
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
_______________________________________________
Semediawiki-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/semediawiki-user