Puppeteer is a bot in the headless browsers category, operated by Google.
Puppeteer is a Node.js library from the Chrome team that controls Chrome or Firefox from code. It is used for testing, screenshots, PDF generation and scraping.
Headless browsers run a full browser engine without a screen. They are used for testing, rendering and scraping sites that need JavaScript. Most scrapers that evade simple checks run in a headless browser, so client side detection matters more than the user agent here.
Anyone can copy a user agent string. Transfon Security also checks where each request comes from, so a request that claims to be a known crawler but comes from the wrong network is treated as a fake, not as the real crawler.
Puppeteer does not read robots.txt. The rules below record your policy, but they will not stop it. To actually block Puppeteer, use a WAF rule as shown in the next section.
User-agent: Puppeteer Disallow: /
User-agent: Puppeteer Disallow: /private/ Disallow: /search
User-agent: Puppeteer Allow: /blog/ Disallow: /
User-agent: Puppeteer Allow: / User-agent: * Disallow: /
User-agent: Puppeteer group, Puppeteer ignores your User-agent: * rules, so repeat any that should still apply.Puppeteer from Puppeteer's user agent; check Google's own documentation if it publishes a different robots.txt name.Treat robots.txt as a statement of your policy, and enforce it where requests arrive.
Puppeteer is a common tool for scrapers. Real readers never use it, so block it on article pages and keep it out of ad requests.
Transfon Security for publishersTraffic from Puppeteer on landing pages is automated. It inflates clicks and visits, so filter it from campaign data and raise it with the ad network.
Transfon Security for advertisersPrice scrapers, stock checkers and card testing scripts often run on Puppeteer. Block it on product, cart and checkout pages.
Transfon Security for e-commercePuppeteer is normal for API clients but not for your web app. Allow it only on API routes that need a key, and rate limit it there.
Transfon Security for SaaS and APIsPuppeteer ignores robots.txt, so it has to be stopped when the request arrives. Transfon Security shows Puppeteer by name in the Top Bots report, so you can see how often it visits and which pages it reads. Block or allow it with a User Agent rule, or slow it down with a rate limit decision rule.
Transfon Security
Puppeteer is a bot in the headless browsers category, operated by Google. Puppeteer is a Node.js library from the Chrome team that controls Chrome or Firefox from code. It is used for testing, screenshots, PDF generation and scraping.
No. Puppeteer does not follow robots.txt, so a Disallow rule will not stop it. Block it by user agent at your server, CDN or WAF instead.
Block requests whose user agent contains "Puppeteer" at your server, CDN or WAF, because Puppeteer does not read robots.txt. In Transfon Security that is one User Agent block rule.
No. robots.txt is voluntary, so Puppeteer may not follow it, and anyone can send Puppeteer's user agent, so a fake Puppeteer ignores your rule. Enforce the rule where requests arrive, at your WAF, and check the source network.
Headless browsers run a full browser engine without a screen. They are used for testing, rendering and scraping sites that need JavaScript. Most scrapers that evade simple checks run in a headless browser, so client side detection matters more than the user agent here.
Transfon Security identifies every bot in this directory in your traffic reports, flags fake search crawlers, and lets you allow, block or rate limit each bot.
Privacy, security, monetization, and performance insights. A few emails a month, no spam.