Skip to content

fix: add custom robots.txt with explicit AI-crawler Allow rules - #119

Open
mpot37 wants to merge 2 commits into
RequestNetwork:mainfrom
mpot37:add-custom-robots-txt
Open

fix: add custom robots.txt with explicit AI-crawler Allow rules#119
mpot37 wants to merge 2 commits into
RequestNetwork:mainfrom
mpot37:add-custom-robots-txt

fix: repeat wildcard exclusions in named crawler groups

e16b37f
Select commit
Loading
Failed to load commit list.
Greptile Apps / Greptile Review succeeded Aug 17, 2026 in 1m 55s

Greptile Review

Greptile has reviewed the Pull Request.

1 files reviewed, 0 comments added.