I've read here multiple reports of people suffering disruption in their forge instances because broken web crawlers.
I have not noticed anything, but: 1. I don't use a forge but cgit (and I cache aggressively), 2. I am blocking a long list of bad user agents at nginx level, 3. I don't have monitoring 😅
So it may be all down to the last point, isn't it?
(although I have never seen any load over 0.16 or so, doesn't mean it is not happening)
Had 216k requests on my cgit host just yesterday. So... yes, I'm experiencing the same issue, is just that I'm not really paying attention 😅
First offending IP in the lot... owned by Alibaba Cloud. Of course.
Not an identifiable user agent. Bastards!
Filtering a whole /16 -- I don't give a shit 😂
@reidrac Yup ... done the same. I got tired of attacks from China so looked up IANA assigns and blocked them. Then IPFire came along and made it dirt simple with a location block addon. Want to block Belarus? Select the country's checkbox and hit save. Gotta love it! (specifically in response to blocking a /16)
