I still have to deal with #WebsiteOutages , and currently I have another massive one which won't go away by purging the Varnish cache.
-
I still have to deal with #WebsiteOutages , and currently I have another massive one which won't go away by purging the Varnish cache. As usual, the outage started between 23:00 and 24:00 UTC, which is _weird_.
I have asked Gandi.net customer service a few weeks ago, but beyond suggesting blocking a random crawler, they said the following:
"Personally, I would check the plugins on my various websites and the scheduled tasks (especially backup plugins)."
I don't remember installing such plugins manually. Does anyone know of such processes that are installed on either #WordPress or #MediaWiki sites by default? (Or perhaps this is done by #SemanticMediaWiki ?)
In three days I will be leaving for a vacation, so this is the last opportunity I have to improve this situation this year.
-
I still have to deal with #WebsiteOutages , and currently I have another massive one which won't go away by purging the Varnish cache. As usual, the outage started between 23:00 and 24:00 UTC, which is _weird_.
I have asked Gandi.net customer service a few weeks ago, but beyond suggesting blocking a random crawler, they said the following:
"Personally, I would check the plugins on my various websites and the scheduled tasks (especially backup plugins)."
I don't remember installing such plugins manually. Does anyone know of such processes that are installed on either #WordPress or #MediaWiki sites by default? (Or perhaps this is done by #SemanticMediaWiki ?)
In three days I will be leaving for a vacation, so this is the last opportunity I have to improve this situation this year.
@juergen_hubert Crawlers and scrapers and fetchers! Oh my! - Dorothy (allegedly)
got dark visitors ? #RobotsTXT #DarkVisitors https://darkvisitors.com/
-
@juergen_hubert Crawlers and scrapers and fetchers! Oh my! - Dorothy (allegedly)
got dark visitors ? #RobotsTXT #DarkVisitors https://darkvisitors.com/
Numerously so, and they certainly massively contribute to website traffic.
However, the real mystery is what process starts between 23:00 and 24:00 UTC that actually triggers the outages. I mean, the crawlers are active around the clock!
