Not every visit to your site is real — some of them are bot visitors. Some are legitimate (Googlebot, uptime monitors), some are harmful (scrapers, hit bots, spam). Detecting and filtering bot traffic is a critical skill for correct analytics, safe ad revenue and a healthy server load. This guide explains how to detect bot traffic.

Related reading: What is a hit bot · Request hit bot · Google hit bot · Invalid traffic and AdSense

What Is Bot Traffic?

Bot traffic is when software, instead of a real human user, visits a website. A large portion of the web is actually bot traffic; reports estimate 40-50% of internet traffic is bot-sourced. But not all of these bots are malicious.

Good Bots vs Bad Bots

TypeExamplesIntent
Good botsGooglebot, Bingbot, uptime monitor, RSS readerIdentified, helpful
Grey areaSEO tools (Ahrefs, Semrush), archive botsHelpful but cause load
Bad botsHit bots, scrapers, spam bots, brute-forceHarmful, consume resources

Signs of Bot Traffic

Signs that a site has bot traffic are visible in analytics and server logs:

  • Very high bounce rate (95%+): The bot opens the page and leaves immediately.
  • 0-second average session duration: No interaction.
  • Suddenly rising traffic source: A sudden jump from unknown referrers.
  • Heavy requests from a single IP: Tens of requests per minute from one IP.
  • Visits not running JavaScript: Present in server logs, absent in GA4.
  • User-agent anomalies: Missing, outdated or "bot" in the UA.
  • Nonsensical page sequence: Random page chains a user would not follow.

Detection Methods

Server log analysis

The web server's access logs are the most direct way to detect bot traffic. With grep or awk you can count known bad-bot user-agents and list abnormal IPs. Many requests per second from the same IP is the strongest signal of botness.

JavaScript challenge

If a JavaScript snippet must run to access the page, request hit bots that do not execute JS are filtered out naturally. Modern WAFs and services like Cloudflare use this mechanism.

Behavior analysis

Real users produce natural signals like mouse movement, scrolling, keyboard interaction. Bots cannot mimic all these behaviors at once, or their patterns stay machine-like.

TLS and device fingerprinting

The TLS handshake signature (JA3/JA4) of an HTTP client differs from real browsers. These fingerprints are recognized on the server side and suspicious clients are flagged.

IP reputation lists

Known data-center, VPN, proxy and botnet IP pools are listed in reputation databases. Heavy traffic from these pools is usually bot-driven.

Filtering Bot Traffic in GA4

Google Analytics 4 filters known bots by default but cannot strip out all traffic that tries to disguise itself. What you can do: (1) exclude admin/internal traffic with an IP filter, (2) manually exclude sources containing referrer spam, (3) investigate anomalies with exploration reports. If you spot suspicious activity, take protection at the server level for deeper defense.

Server-Side Protection

  • Rate limiting: Limits like "max N requests per minute from one IP".
  • WAF (Web Application Firewall): Cloudflare, AWS WAF, ModSecurity block known bot patterns.
  • Captcha: For high-risk endpoints (forms, login).
  • IP blocking: Known bad IPs or CIDR blocks.
  • robots.txt: Good bots respect this rule — bad ones do not, but your intent is clear.
Tip
CDN/proxy services like Cloudflare offer a "Bot Management" feature — they score each incoming request's probability of being a bot and automatically filter requests above the threshold. For most sites this is the most pragmatic protection layer.

Frequently Asked Questions

What percentage of my site's traffic could be bots?

20-50% bot traffic is normal for a typical site; this number varies by site, popularity and industry. On high-authority or competitive sites the ratio is higher.

Is GA4's built-in bot filter enough?

It is enough for known bots, but does not always catch new bot types or those trying to hide. For important decisions, cross-check with server logs.

Does bot detection affect my ad revenue?

Correct bot detection and filtering actually protects your ad revenue — if invalid traffic is detected, AdSense enforces. Blocking bot traffic upfront keeps your account safe.

Clean Server Infrastructure

Filter bot traffic at the front door on a WAF-, rate-limit- and DDoS-protected infrastructure with KEYDAL hosting solutions. Explore KEYDAL hosting

WhatsApp