JobQueueRedis and SMW

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

JobQueueRedis and SMW

egel
Hi,

When Redis is used for the job queues we get this error when an article
is saved. But only on the wikis that use SMW, nl.scoutwiki.org and
fr.scoutwiki.org.
-----
[3d4eebe7] /index.php?title=Zuiderkruisgroep&action=submit Exception
from line 840 of
/srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php: Redis
server error: Could not insert 1 htmlCacheUpdate job(s).

Backtrace:

#0 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php(236):
JobQueueRedis->throwRedisException(RedisConnRef, RedisException)
#1 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueue.php(340):
JobQueueRedis->doBatchPush(array, integer)
#2 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueue.php(311):
JobQueue->batchPush(array, integer)
#3 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueGroup.php(127):
JobQueue->push(array)
#4
/srv/www/scoutwiki/htdocs/includes/jobqueue/jobs/HTMLCacheUpdateJob.php(69):
JobQueueGroup->push(array)
#5 /srv/www/scoutwiki/htdocs/includes/deferred/HTMLCacheUpdate.php(64):
HTMLCacheUpdateJob->run()
#6 [internal function]: HTMLCacheUpdate->{closure}()
#7 /srv/www/scoutwiki/htdocs/includes/db/Database.php(3354):
call_user_func(Closure)
#8 /srv/www/scoutwiki/htdocs/includes/db/Database.php(3585):
DatabaseBase->runOnTransactionIdleCallbacks()
#9 /srv/www/scoutwiki/htdocs/includes/db/LoadBalancer.php(952):
DatabaseBase->commit(string, string)
#10 [internal function]: LoadBalancer->commitMasterChanges()
#11 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(185):
call_user_func_array(array, array)
#12 [internal function]: LBFactory->callMethod(LoadBalancer, string,
array)
#13 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(329):
call_user_func_array(array, array)
#14 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(175):
LBFactorySimple->forEachLB(array, array)
#15 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(192):
LBFactory->forEachLBCallMethod(string)
#16 /srv/www/scoutwiki/htdocs/includes/MediaWiki.php(591):
LBFactory->commitMasterChanges()
#17 /srv/www/scoutwiki/htdocs/includes/MediaWiki.php(435):
MediaWiki->main()
#18 /srv/www/scoutwiki/htdocs/index.php(46): MediaWiki->run()
#19 {main}
-----

The config:

$wgObjectCaches['redis'] = array(
     'class'                => 'RedisBagOStuff',
     'servers'              => array( '127.0.0.1:6379' ),
     // 'connectTimeout'    => 1,
     // 'persistent'        => false,
     // 'password'          => 'secret',
     // 'automaticFailOver' => true,
);

$wgMainCacheType = 'redis';
$wgSessionCacheType = 'redis';  // same as WMF prod
$wgMessageCacheType = 'redis';
$wgParserCacheType = 'redis';
$wgLanguageConverterCacheType = 'redis';

$wgJobTypeConf['default'] = array(
   'class'          => 'JobQueueRedis',
   'redisServer'    => '127.0.0.1:6379',
   'redisConfig'    => array(),
   'claimTTL'       => 3600
);

Does anyone have an idea?

--
Met Vriendelijke Zwerversgroeten

Wouter Rademaker

     \ / \ /
     >O< >O<
   *{_}   {_}*

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Semediawiki-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/semediawiki-user
Reply | Threaded
Open this post in threaded view
|

Re: JobQueueRedis and SMW

James HK
Hi,

> /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php: Redis
> server error: Could not insert 1 htmlCacheUpdate job(s).

We use HTMLCacheUpdateJob here [0] to ensure that the html is updated
as well when storing a subject which for the normal JobQueue works as
expected.

I suggest you report the issue about `htmlCacheUpdate ` /
`JobQueueRedis` to MW and disable the `smwgAutoRefreshSubject` setting
(of course with the impact that the parser cache isn't refreshed) for
as long as the issue isn't fixed.

This isn't a SMW issue (as the stack trace clearly indicates an issue
between htmlCacheUpdate + JobQueueRedis) therefore your best hope is
that someone on the MW side can fix this.

https://github.com/SemanticMediaWiki/SemanticMediaWiki/blob/master/includes/storage/SMW_Store.php#L221

Cheers

On 4/26/15, egel <[hidden email]> wrote:

> Hi,
>
> When Redis is used for the job queues we get this error when an article
> is saved. But only on the wikis that use SMW, nl.scoutwiki.org and
> fr.scoutwiki.org.
> -----
> [3d4eebe7] /index.php?title=Zuiderkruisgroep&action=submit Exception
> from line 840 of
> /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php: Redis
> server error: Could not insert 1 htmlCacheUpdate job(s).
>
> Backtrace:
>
> #0 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php(236):
> JobQueueRedis->throwRedisException(RedisConnRef, RedisException)
> #1 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueue.php(340):
> JobQueueRedis->doBatchPush(array, integer)
> #2 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueue.php(311):
> JobQueue->batchPush(array, integer)
> #3 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueGroup.php(127):
> JobQueue->push(array)
> #4
> /srv/www/scoutwiki/htdocs/includes/jobqueue/jobs/HTMLCacheUpdateJob.php(69):
>
> JobQueueGroup->push(array)
> #5 /srv/www/scoutwiki/htdocs/includes/deferred/HTMLCacheUpdate.php(64):
> HTMLCacheUpdateJob->run()
> #6 [internal function]: HTMLCacheUpdate->{closure}()
> #7 /srv/www/scoutwiki/htdocs/includes/db/Database.php(3354):
> call_user_func(Closure)
> #8 /srv/www/scoutwiki/htdocs/includes/db/Database.php(3585):
> DatabaseBase->runOnTransactionIdleCallbacks()
> #9 /srv/www/scoutwiki/htdocs/includes/db/LoadBalancer.php(952):
> DatabaseBase->commit(string, string)
> #10 [internal function]: LoadBalancer->commitMasterChanges()
> #11 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(185):
> call_user_func_array(array, array)
> #12 [internal function]: LBFactory->callMethod(LoadBalancer, string,
> array)
> #13 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(329):
> call_user_func_array(array, array)
> #14 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(175):
> LBFactorySimple->forEachLB(array, array)
> #15 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(192):
> LBFactory->forEachLBCallMethod(string)
> #16 /srv/www/scoutwiki/htdocs/includes/MediaWiki.php(591):
> LBFactory->commitMasterChanges()
> #17 /srv/www/scoutwiki/htdocs/includes/MediaWiki.php(435):
> MediaWiki->main()
> #18 /srv/www/scoutwiki/htdocs/index.php(46): MediaWiki->run()
> #19 {main}
> -----
>
> The config:
>
> $wgObjectCaches['redis'] = array(
>      'class'                => 'RedisBagOStuff',
>      'servers'              => array( '127.0.0.1:6379' ),
>      // 'connectTimeout'    => 1,
>      // 'persistent'        => false,
>      // 'password'          => 'secret',
>      // 'automaticFailOver' => true,
> );
>
> $wgMainCacheType = 'redis';
> $wgSessionCacheType = 'redis';  // same as WMF prod
> $wgMessageCacheType = 'redis';
> $wgParserCacheType = 'redis';
> $wgLanguageConverterCacheType = 'redis';
>
> $wgJobTypeConf['default'] = array(
>    'class'          => 'JobQueueRedis',
>    'redisServer'    => '127.0.0.1:6379',
>    'redisConfig'    => array(),
>    'claimTTL'       => 3600
> );
>
> Does anyone have an idea?
>
> --
> Met Vriendelijke Zwerversgroeten
>
> Wouter Rademaker
>
>      \ / \ /
>      >O< >O<
>    *{_}   {_}*
>
> ------------------------------------------------------------------------------
> One dashboard for servers and applications across Physical-Virtual-Cloud
> Widest out-of-the-box monitoring support with 50+ applications
> Performance metrics, stats and reports that give you Actionable Insights
> Deep dive visibility with transaction tracing using APM Insight.
> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
> _______________________________________________
> Semediawiki-user mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/semediawiki-user
>

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Semediawiki-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/semediawiki-user
Reply | Threaded
Open this post in threaded view
|

Re: JobQueueRedis and SMW

James HK
Hi,

I just added a note about this to [0]. In case the issue gets resolved
it would marvellous if you could update the page accordingly.

[0] https://www.semantic-mediawiki.org/wiki/Help:JobQueue

Cheers

On 4/26/15, James HK <[hidden email]> wrote:

> Hi,
>
>> /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php: Redis
>> server error: Could not insert 1 htmlCacheUpdate job(s).
>
> We use HTMLCacheUpdateJob here [0] to ensure that the html is updated
> as well when storing a subject which for the normal JobQueue works as
> expected.
>
> I suggest you report the issue about `htmlCacheUpdate ` /
> `JobQueueRedis` to MW and disable the `smwgAutoRefreshSubject` setting
> (of course with the impact that the parser cache isn't refreshed) for
> as long as the issue isn't fixed.
>
> This isn't a SMW issue (as the stack trace clearly indicates an issue
> between htmlCacheUpdate + JobQueueRedis) therefore your best hope is
> that someone on the MW side can fix this.
>
> https://github.com/SemanticMediaWiki/SemanticMediaWiki/blob/master/includes/storage/SMW_Store.php#L221
>
> Cheers
>
> On 4/26/15, egel <[hidden email]> wrote:
>> Hi,
>>
>> When Redis is used for the job queues we get this error when an article
>> is saved. But only on the wikis that use SMW, nl.scoutwiki.org and
>> fr.scoutwiki.org.
>> -----
>> [3d4eebe7] /index.php?title=Zuiderkruisgroep&action=submit Exception
>> from line 840 of
>> /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php: Redis
>> server error: Could not insert 1 htmlCacheUpdate job(s).
>>
>> Backtrace:
>>
>> #0 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueRedis.php(236):
>> JobQueueRedis->throwRedisException(RedisConnRef, RedisException)
>> #1 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueue.php(340):
>> JobQueueRedis->doBatchPush(array, integer)
>> #2 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueue.php(311):
>> JobQueue->batchPush(array, integer)
>> #3 /srv/www/scoutwiki/htdocs/includes/jobqueue/JobQueueGroup.php(127):
>> JobQueue->push(array)
>> #4
>> /srv/www/scoutwiki/htdocs/includes/jobqueue/jobs/HTMLCacheUpdateJob.php(69):
>>
>> JobQueueGroup->push(array)
>> #5 /srv/www/scoutwiki/htdocs/includes/deferred/HTMLCacheUpdate.php(64):
>> HTMLCacheUpdateJob->run()
>> #6 [internal function]: HTMLCacheUpdate->{closure}()
>> #7 /srv/www/scoutwiki/htdocs/includes/db/Database.php(3354):
>> call_user_func(Closure)
>> #8 /srv/www/scoutwiki/htdocs/includes/db/Database.php(3585):
>> DatabaseBase->runOnTransactionIdleCallbacks()
>> #9 /srv/www/scoutwiki/htdocs/includes/db/LoadBalancer.php(952):
>> DatabaseBase->commit(string, string)
>> #10 [internal function]: LoadBalancer->commitMasterChanges()
>> #11 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(185):
>> call_user_func_array(array, array)
>> #12 [internal function]: LBFactory->callMethod(LoadBalancer, string,
>> array)
>> #13 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(329):
>> call_user_func_array(array, array)
>> #14 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(175):
>> LBFactorySimple->forEachLB(array, array)
>> #15 /srv/www/scoutwiki/htdocs/includes/db/LBFactory.php(192):
>> LBFactory->forEachLBCallMethod(string)
>> #16 /srv/www/scoutwiki/htdocs/includes/MediaWiki.php(591):
>> LBFactory->commitMasterChanges()
>> #17 /srv/www/scoutwiki/htdocs/includes/MediaWiki.php(435):
>> MediaWiki->main()
>> #18 /srv/www/scoutwiki/htdocs/index.php(46): MediaWiki->run()
>> #19 {main}
>> -----
>>
>> The config:
>>
>> $wgObjectCaches['redis'] = array(
>>      'class'                => 'RedisBagOStuff',
>>      'servers'              => array( '127.0.0.1:6379' ),
>>      // 'connectTimeout'    => 1,
>>      // 'persistent'        => false,
>>      // 'password'          => 'secret',
>>      // 'automaticFailOver' => true,
>> );
>>
>> $wgMainCacheType = 'redis';
>> $wgSessionCacheType = 'redis';  // same as WMF prod
>> $wgMessageCacheType = 'redis';
>> $wgParserCacheType = 'redis';
>> $wgLanguageConverterCacheType = 'redis';
>>
>> $wgJobTypeConf['default'] = array(
>>    'class'          => 'JobQueueRedis',
>>    'redisServer'    => '127.0.0.1:6379',
>>    'redisConfig'    => array(),
>>    'claimTTL'       => 3600
>> );
>>
>> Does anyone have an idea?
>>
>> --
>> Met Vriendelijke Zwerversgroeten
>>
>> Wouter Rademaker
>>
>>      \ / \ /
>>      >O< >O<
>>    *{_}   {_}*
>>
>> ------------------------------------------------------------------------------
>> One dashboard for servers and applications across Physical-Virtual-Cloud
>> Widest out-of-the-box monitoring support with 50+ applications
>> Performance metrics, stats and reports that give you Actionable Insights
>> Deep dive visibility with transaction tracing using APM Insight.
>> http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
>> _______________________________________________
>> Semediawiki-user mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/semediawiki-user
>>
>

------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Semediawiki-user mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/semediawiki-user