The apild.com bot fetches web pages on behalf of paying customers who have registered those pages for JSON-LD monitoring. It reads the HTML to extract and validate structured data (application/ld+json blocks), then reports any issues back to the customer. It does not index pages for search, store full HTML, or follow links beyond the registered URLs.
The bot identifies itself as:
apild-bot/1.0 (+https://apild.com/bot)
The bot is polite by design. It waits at least 500 ms between requests to the same host and respects a Crawl-delay directive in robots.txt when present.
Add a robots.txt rule to block the bot from specific paths or your entire site:
User-agent: apild-bot Disallow: /
The bot checks robots.txt before every fetch and will not visit any disallowed URL.
If you have questions or concerns about the bot, email hello@apild.com.