CGIT

> why are they running such lightweight setups to begin with? It's easier and still gives access to almost everything. I don't think CPU limitations are the main issue there. As…

by Dylan16807 · Aug 31, 2026

> This is a much more substantial critique Thanks! FWIW, I engaged because I think there's the basis for a good approach here and I want to see if we can expose what works throu…

by zbentley · Aug 31, 2026

The problem is that the scrapers are not sophisticated enough to use things like cgit and Git Forges efficiently (e.g. by git clone), while still being sophisticated enough to b…

by A1kmm · Aug 31, 2026

Does cgit not support a .patch or .diff URL suffix? How hard could it be for AI companies to add a preference for such URLs into their models or system prompts? Wouldn't that be…

by dTP90pN · Aug 31, 2026

I highly doubt the adversaries actually care about kernel.org in particular. It's more likely that they're trying to scrape the entire internet, and cgit is just unfortunate eno…

by miki123211 · Aug 31, 2026

But the tokens are IP-bound, and as the article mentions a crawler using a single IP is not so difficult to block. A legitimate user solves it once , shows legitimate-use behavi…

by crote · Aug 31, 2026