GeoPromptTracker

AI crawler profile

What is PanguBot? How to allow or block Huawei's crawler

User-agent string to match in robots.txt and server logs: PanguBot

Operator

Huawei

Purpose

AI model training

robots.txt

Compliance unknown

Official docs

None published

PanguBot is the user agent linked to data collection for Huawei's PanGu family of large language models. Unlike PetalBot (Huawei's documented search crawler), PanguBot has no official documentation, putting it in the same category as Bytespider: a training crawler you can only reliably control at the firewall level.

Does PanguBot respect robots.txt?

No official documentation exists and independent compliance reports are limited — pair any robots.txt block with a firewall or CDN rule if opting out matters to you.

Verify it's really PanguBot

Huawei publishes no IP-range file for PanguBot, so it can only be identified by its user-agent string — which anything can send. Treat traffic claiming this agent as unverified, and prefer a reverse-DNS check where the operator documents one before acting on it.

Block PanguBot with robots.txt

robots.txt — block
User-agent: PanguBot
Disallow: /

⚠ Because PanguBot's robots.txt compliance is unreliable, pair this with a firewall or CDN rule matching the user-agent string if blocking actually matters to you.

Explicitly allow PanguBot

robots.txt — allow
User-agent: PanguBot
Allow: /

Block PanguBot at the server or CDN

PanguBot's robots.txt compliance is unreliable, so a robots.txt rule alone may not stop it. These enforce the block. Matching on the user-agent string still trusts a self-declared header — and no IP-range file exists for this agent, so treat it as best-effort.

nginx
if ($http_user_agent ~* "PanguBot") {
    return 403;
}
apache — .htaccess
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} PanguBot [NC]
RewriteRule .* - [F,L]
cloudflare — WAF expression
(http.user_agent contains "PanguBot")

Find PanguBot in your server logs

shell
grep -i "PanguBot" /var/log/nginx/access.log | wc -l

Should you block PanguBot?

Blocking PanguBot opts your content out of Huawei's model training — a legitimate choice for original content you don't want reproduced by AI. The trade-off: models trained without your content are less likely to know your brand or recommend it unprompted. There is no direct traffic loss today, since training crawlers don't send visitors. See our guide on whether to block AI bots for the full decision framework.

Check and monitor PanguBot on your site

Related reading

Frequently asked questions

What is PanguBot?

PanguBot is Huawei's web crawler for collecting AI training data. Associated with training Huawei's PanGu large language models.

Does PanguBot respect robots.txt?

No official documentation exists and independent compliance reports are limited — pair any robots.txt block with a firewall or CDN rule if opting out matters to you.

How do I block PanguBot?

Add "User-agent: PanguBot" followed by "Disallow: /" to your robots.txt file. Because this bot's robots.txt compliance is not reliable, enforce the block with firewall or CDN rules (for example a Cloudflare WAF rule matching the user agent) if it matters to you.

Does blocking PanguBot hurt my Google rankings?

No. PanguBot is separate from Googlebot, which handles Google Search indexing. Blocking PanguBot has no effect on your traditional search rankings.

How can I tell if PanguBot is crawling my site?

Search your server access logs for the string "PanguBot" — for example: grep -i "PanguBot" /var/log/nginx/access.log | wc -l. Our free AI Bot Log Analyzer does this in your browser: paste a log file and it counts hits per AI crawler, including PanguBot, with per-path breakdowns.

How do I use PanguBot?

You don't — PanguBot isn't a tool you run. It's Huawei's own crawler, operated by Huawei, that visits your site from their infrastructure. The only control you have over it is whether you allow or block it, via robots.txt or a server rule. If you're looking to crawl other sites yourself, you'd write your own crawler or use a crawling library; sending "PanguBot" as your user agent would be impersonating Huawei.

Where is the official Huawei documentation for PanguBot?

Huawei publishes no official documentation for PanguBot. That absence is itself worth noting: an undocumented crawler gives you no stated policy to hold it to, and no published IP ranges to verify it against.

More Huawei agents

Part of our directory of every known AI crawler, refreshed monthly. Last verified: 2026-08-14.