[Engineering] Analytics Hadoop cluster maintenance postponed - Tue 13th February

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[Engineering] Analytics Hadoop cluster maintenance postponed - Tue 13th February

Joseph Allemandou
Hi Analytics folks,

*TL;DR: Hadoop cluster maintenance postponed to Tue 13th February*

We've experienced an issue in getting some data onto the cluster this
month, making some of our monthly datasets (the ones that depend on that
late data) not yet computed.
We have decided to postpone the maintenance of the cluster to next week,
allowing for those jobs to be finished.
We are very sorry about the short notice and will send another email the
day before maintenance.
Best

Joseph Allemandou on behalf of the Analytics-Team
Data Engineer @ Wikimedia Foundation
IRC: joal
_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Reply | Threaded
Open this post in threaded view
|

Re: [Engineering] Analytics Hadoop cluster maintenance postponed - Tue 13th February

Luca Toscano
Hi everybody,

the Analytics Hadoop upgrade to Java 8 has been postponed due to unexpected
hw failures (https://phabricator.wikimedia.org/T187164 and
https://phabricator.wikimedia.org/T187162) happened this morning and
causing some HDFS blocks to be under replicated/corrupted. To be on the
safe side, we'll wait for the cluster's metrics to fully recover before
doing anything. I will update this email thread as soon as we'll be ready,
but it this might happen in EU late evening / SF morning.

Sorry for the delay! The Analytics Hadoop cluster staged a rebellion for
Java 8, but we'll eventually succeed :)

Luca

2018-02-05 19:48 GMT+01:00 Joseph Allemandou <[hidden email]>:

> Hi Analytics folks,
>
> *TL;DR: Hadoop cluster maintenance postponed to Tue 13th February*
>
> We've experienced an issue in getting some data onto the cluster this
> month, making some of our monthly datasets (the ones that depend on that
> late data) not yet computed.
> We have decided to postpone the maintenance of the cluster to next week,
> allowing for those jobs to be finished.
> We are very sorry about the short notice and will send another email the
> day before maintenance.
> Best
>
> Joseph Allemandou on behalf of the Analytics-Team
> Data Engineer @ Wikimedia Foundation
> IRC: joal
>
> _______________________________________________
> Engineering mailing list
> [hidden email]
> https://lists.wikimedia.org/mailman/listinfo/engineering
>
>
_______________________________________________
Wiki-research-l mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l