Tagged "bots"

Block AI Crawlers in ASP.NET Core

How To Block AI Crawlers Like GPTBot and ClaudeBot in ASP.NET Core and IIS

October 28th, 2026

Stop GPTBot, ClaudeBot, PerplexityBot, CCBot and other AI crawlers with robots.txt, ASP.NET Core middleware, or an IIS rule, without blocking Google or Bing.

Tagged: AI, ASP.NET Core, bots, C Sharp, IIS

Ignoring Bots by User Agent in C#

How To Ignore Bot Traffic by User Agent in ASP.NET with C#

October 28th, 2026

Exclude crawlers and bots from logs and analytics in ASP.NET Core by matching user agents against the crawler-user-agents list with one compiled regex.

Tagged: ASP.NET, bots, C Sharp, spam