From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <arunisaac@systemreboot.net>
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=systemreboot.net;
	s=default; t=1785860354;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:mime-version:mime-version:content-type:content-type;
	bh=5GF2l6gtmpMLqQyDEP1t5oN5MvwtMcmXNB1sePKOEBw=;
	b=aUUfqctTlCciufem23iMsGsx11J03ODEDoRxdbPDzi7xxcsghsFtGKlWKpq+PmteyAtpsU
	NhM65xY8yfOfj3NBZ3ImSyeMCvGLdgVfhD0cRXAS5VBIR3LQb2GH+bUfGnrYXQx0/EVCLh
	fn34RX50mVunzskalA0BimlxYPEfHFPcDH/fwn25u6EVbQYmrNNfk2wOnXDGK3yolhoT/r
	bNwLMrl861KyDxZp3sTa3NIc9CS2PJafPsktVx2ZXun4m2VD3JTK4zkbLaTjVF7dEj8TrP
	ObWHOmT6tEBs4Vf0JVfeewTMSt0pJBkSqhti8SkcSvDAeZLM4Akh7m65D7Dkyw==
Received: from localhost (<unknown> [192.168.2.1])
	by mugam.systemreboot.net (OpenSMTPD) with ESMTPSA id 4f3e3fc7 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO)
	for <guix-forge@systemreboot.net>;
	Tue, 4 Aug 2026 16:19:14 +0000 (UTC)
From: Arun Isaac <arunisaac@systemreboot.net>
To: guix-forge@systemreboot.net
Subject: cgit performance improvements and Anubis protection
Date: Tue, 04 Aug 2026 17:19:12 +0100
Message-ID: <877bm5270f.fsf@systemreboot.net>
MIME-Version: 1.0
Content-Type: text/plain
List-Id: <guix-forge.systemreboot.net>


Hi all,

Our cgit service now has Anubis[1] protection for its expensive /diff
and /tree endpoints. Also, the default source syntax highlighter is now
Chroma[2] instead of Python Pygments. cgit spawns a new process for
every syntax highlighting operation, and the Python interpreter
setup/teardown cost ended up being too expensive. These two improvements
together will hopefully keep the hordes of AI crawlers at bay, at least
for the time being.

Regards,
Arun

[1]: https://anubis.techaro.lol/
[2]: https://github.com/alecthomas/chroma