From f355bc6a8065401b54c8df43f90fdb471d888b86 Mon Sep 17 00:00:00 2001 From: Deimos Date: Sat, 17 Feb 2024 22:46:50 -0700 Subject: [PATCH] robots.txt: Block OpenAI GPTBot --- tildes/static/robots.txt | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/tildes/static/robots.txt b/tildes/static/robots.txt index f099c1c..b317ebb 100644 --- a/tildes/static/robots.txt +++ b/tildes/static/robots.txt @@ -30,6 +30,10 @@ Disallow: / User-agent: dotbot Disallow: / +# https://platform.openai.com/docs/gptbot +User-agent: GPTBot +Disallow: / + # Unknown/suspicious scraper - UA only contains a gmail address User-agent: MauiBot Disallow: /