Ad tech stocks
CRTO19.30▲ +7.07%SST0.92▼ -6.12%TTD14.79▼ -5.68%RDDT92.93▼ -5.61%DSP11.26▼ -5.54%CPNG14.37▼ -5.43%TBLA2.11▼ -5.38%BIDU74.05▼ -5.23%APPS7.24▼ -4.93%CDLX1.28▼ -4.64%SNAP5.04▼ -4.18%PINS18.36▼ -4.15%INUV0.27▼ -3.89%GOOGL284.52▼ -3.80%MNTN4.85▼ -3.77%BABA91.04▼ -3.53%SNOW281.48▼ -3.27%SFOR37.20▼ -2.87%VER8.88▼ -2.52%META625.91▼ -2.46%PERI11.11▼ -2.33%NFLX60.74▼ -2.28%AZRN0.61▼ -2.24%24331459.00▲ +2.03%4755649.80▲ +2.01%ILLM0.53▲ +1.92%MGNI28.73▼ -1.91%SCOR3.05▲ +1.67%ZETA36.08▼ -1.56%DEC27.74▼ -1.42%U52.06▼ -1.42%AAPL351.62▼ -1.31%CART58.12▼ -1.28%IHRT0.59▼ -1.19%STGW11.40▲ +1.15%PUB104.50▼ -1.14%LFTO24.17▼ -1.10%47511387.00▲ +1.02%0700390.40▲ +0.98%RAMP38.50▲ +0.71%APP411.56▲ +0.60%PUBM20.49▼ -0.58%43243986.00▲ +0.55%WPP417.70▼ -0.55%TEAD0.16▼ -0.48%SIRI32.00▲ +0.47%NEXN10.28▼ -0.44%IBTA57.78▲ +0.33%SPOT610.89▼ -0.28%OUT33.45▼ -0.27%HAVAS18.65▲ +0.27%035420172900.00▲ +0.23%SAX38.82▼ -0.10%ROKU160.52▲ +0.09%TRU81.14▲ +0.09%OMC87.91▼ -0.07%DV13.56▲ +0.04%CCO2.43▲ 0.00%18609.93▲ 0.00%PSKY9.78▲ 0.00%WBD30.95▲ 0.00%

How invalid traffic gets caught

The layers of defence between a bot and an advertiser’s budget: lists, signals, behaviour and after-the-fact audits.

How invalid traffic gets caught

1/7
visit▭Incoming visithuman or bot?✓Known listsbots, spiders, data centers✓Device & network signalsIP, user agent, headless traits✓Behaviourmouse, timing, patterns▦Quality scoree.g. a TQI Score™!GIVT filteredroutine, list-based!SIVT flaggedneeds analytics★Clean bidsafe to buy
1
A visit arrives

Every impression starts as a visit from a device. Some are people; some are crawlers, scripts or hijacked phones pretending to be people.

  1. A visit arrives: Every impression starts as a visit from a device. Some are people; some are crawlers, scripts or hijacked phones pretending to be people.
  2. Layer 1: known lists: The easy catches: declared crawlers on the IAB/ABC Spiders & Bots List, known data-center IP ranges, non-browser user agents. The MRC calls this GIVT.
  3. Layer 2: device and network signals: Next, deeper checks: does the device claim to be an iPhone but behave like a Linux server? Is it a headless browser or a residential proxy? Inconsistencies are red flags.
  4. Layer 3: behaviour: Bots can fake a fingerprint, but it is hard to fake human behaviour at scale: timing, scrolling, click-to-install gaps, impossible volumes. Behavioural analysis catches SIVT.
  5. One score to act on: Signals are combined into a score buyers can act on in real time. ClearTrust’s TQI Score™, for example, rolls 150+ filters into a single number.
  6. Pre-bid: don’t buy it: With pre-bid filtering, bad traffic is never bought. Clean requests go through to the auction.
  7. Post-bid: prove it and claw it back: Post-bid measurement audits what was bought. Invalid impressions are reported, excluded from billing and, where contracts allow, refunded.

Step by step

  1. A visit arrivesEvery impression starts as a visit from a device. Some are people; some are crawlers, scripts or hijacked phones pretending to be people.
  2. Layer 1: known listsThe easy catches: declared crawlers on the IAB/ABC Spiders & Bots List, known data-center IP ranges, non-browser user agents. The MRC calls this GIVT.
  3. Layer 2: device and network signalsNext, deeper checks: does the device claim to be an iPhone but behave like a Linux server? Is it a headless browser or a residential proxy? Inconsistencies are red flags.
  4. Layer 3: behaviourBots can fake a fingerprint, but it is hard to fake human behaviour at scale: timing, scrolling, click-to-install gaps, impossible volumes. Behavioural analysis catches SIVT.
  5. One score to act onSignals are combined into a score buyers can act on in real time. ClearTrust’s TQI Score™, for example, rolls 150+ filters into a single number.
  6. Pre-bid: don’t buy itWith pre-bid filtering, bad traffic is never bought. Clean requests go through to the auction.
  7. Post-bid: prove it and claw it backPost-bid measurement audits what was bought. Invalid impressions are reported, excluded from billing and, where contracts allow, refunded.

Read the full lesson