Discovery Weekly Update for the week starting 2019-04-08

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Discovery Weekly Update for the week starting 2019-04-08

Chris Koerner-2
Greetings,

This is the weekly update from the Search Platform team for the week
starting 2019-04-08.

As always, feedback and questions are welcome.

== Discussions ==

=== Search ===
* New WikibaseCirrusSearch code is deployed and enabled on all wikis,
including Wikidata & Commons. [0]
*We re-indexed all Greek, Turkish, and Irish-language wikis with
better handling of Greek accents [1], Turkish İ/ı [2], and Irish
initial mutation [3] when lowercasing searches in quotes. [4]
* We noticed that indices can move to readonly state when disk space
is low and needs to be reset manually once disk space is available
again, so we made it a cookbook [5]
* David wrote a patch to help with an exception from
CirrusSearch/Sanity/Checker (cannot fetch ids from index) [6]
* We fixed/finalized more things with the ES6 upgrade:
** Create checks that alerts on cirrussearch update lags [7]
** Elasticsearch 6: the classic similarity is deprecated [8]
** Setup elasticsearch on cloudelastic100[1-4] [9]
** Rack/setup/install cloudelastic100[1-4].eqiad.wmnet systems [10]
* Erik converted mjolnir from KafkaRDD to direct kafka-python usage,
because KafkaRDD in pyspark only supports the 0.8 api [11]


=== Wikidata Query Service ===
* Deployed patch to fix an issue in Blazegraph workbench [12]
* Working on improving cache behavior of Updater [13]

[0] https://phabricator.wikimedia.org/T218954
[1] https://en.wikipedia.org/wiki/Greek_diacritics#Accents
[2] https://en.wikipedia.org/wiki/Dotted_and_dotless_I
[3] https://en.wikipedia.org/wiki/Irish_initial_mutations
[4] https://phabricator.wikimedia.org/T217806
[5] https://phabricator.wikimedia.org/T219799
[6] https://phabricator.wikimedia.org/T218945
[7] https://phabricator.wikimedia.org/T219601
[8] https://phabricator.wikimedia.org/T219268
[9] https://phabricator.wikimedia.org/T214921
[10] https://phabricator.wikimedia.org/T194186
[11] https://phabricator.wikimedia.org/T219932
[12] https://phabricator.wikimedia.org/T219406
[13] https://phabricator.wikimedia.org/T217897

----

Subscribe to receive on-wiki (or opt-in email) notifications of the
Discovery weekly update.

https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly

The archive of all past updates can be found on MediaWiki.org:

https://www.mediawiki.org/wiki/Discovery/Status_updates

Interested in getting involved? See tasks marked as "Easy" or
"Volunteer needed" in Phabricator.

[1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R
[2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R

Yours,
Chris Koerner (he/him)
Community Relations Specialist
Wikimedia Foundation

_______________________________________________
Wikitech-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wikitech-l