
- #UNINSTALL SOFTRAID 5.6.4 SOFTWARE#
- #UNINSTALL SOFTRAID 5.6.4 PLUS#
There is, as of September 2015, only one property that is not upserted as normal on every edit. The revision id of the edit is used as the elasticsearch version number to ensure out-of-order writes by the job queue have no effect on the index correctness. This is further discussed in #Trouble.ĬirrusSearch updates the elasticsearch index by building and upserting almost the entire document on every edit. Zhwiki, ukwiki, svwiki, nlwiki, frwiki, wikidatawiki, frwikisource, eswiki, enwikisource, ruwiki, itwiki, plwiki, jawiki, ptwikiĪrwiki, cawiki, commonswiki, enwiktionary, fawiki, ptwiki, ruwiki, zhwiki zhwikisourceĭue to this load across the cluster needs to be occasionally monitored and shards moved around. Other popular wikis are included in the table below(wikis can be listed twice, there is a 'content' index and a separate 'everything' index for each wiki): This means that each individual enwiki query is answered by 7 machines and at any given moment 28 (7*4) of the 31 machines in the cluster are serving enwiki queries.
#UNINSTALL SOFTRAID 5.6.4 PLUS#
The data for enwiki is split into 7 shards with 1 master plus 3 replica.
Our largest user of elasticsearch resources is, by far, queries to enwiki. This does lead to some issues where the older machines have a higher load than the newer machines, but fixing it is not yet supported by elasticsearch. The hardware within the machines is not taken into account by the shard allocation algorithms.
#UNINSTALL SOFTRAID 5.6.4 SOFTWARE#
Software RAID by partition is raid1 for the OS but elastic data will not survive a disk lossĪs far as elasticsearch is concerned all of these servers are exactly the same. Up to date rack placement can be found in ops/puppet here servers WMF runs the default configuration except for elasticsearch server locations but overrides would live in the. A pool counter configuration example lives in the README in the extension source. The canonical location of the configuration documentation is in the CirrusSearch.php file in the extension source. Doing so would break searches and search updates. $wmgUseCirrus will set the wiki to use CirrusSearch by default for all searches. It has no configuration.ĬirrusSearch is a MediaWiki extension that provides search support backed by Elasticsearch. If you want to extend the data that is available to CirrusSearch, have a look here.Įlastica is a MediaWiki extension that provides the library to interface with Elasticsearch. This system has three components: Elastica, CirrusSearch, and Elasticsearch. You can get contact information from officewiki. Here is the (sorted) emergency contact list for Search issues on the WMF production cluster: 4.1 Constraints on elasticsearch clients. 3.29 Pool Counter rejections (search is currently too busy). 3.23 Keep an eye on the number of indices on a few nodes. 3.22 Rebalancing shards to even out disk space use. 3.19.3 Using jstack or jmap or other similar tools to view logs. 3.12 Recovering from an Elasticsearch outage/interruption in updates. 3.7 Waiting for Elasticsearch to "go green". 3.5 Expected eligible masters check and alert. 3.3.1 Estimating the number of shards required. 2.3.3 Scheduled batch updates from analytics network. 2.2.6.4 Shard balance across the cluster.