Project Settings > Crawl Settings controls how Jakka-bot discovers and tests your site. Changes take effect on the next scheduled run or manual test.
Default Device
Sets the device profile Jakka-bot uses by default. Desktop is the standard choice. Mobile is useful when your site behaves significantly differently on phones.
Crawl Speed & Performance
Crawl Speed: Balanced (2-5 pages/second) is the default. Slow down on shared hosting; speed up on dedicated infrastructure.
Concurrent Requests: 5 connections by default. Lower this if your origin gets overwhelmed.
Respect robots.txt and crawl-delay directives: ON by default. Uncheck only for verified domains you own.
Pages Per Scan
Sets a hard cap per scan. Crawling stops when the limit is reached. The bar shows your monthly quota usage.
Execute JavaScript (for SPAs)
Toggle this on for React, Vue, Angular, or any single-page app. Wait Time (default 2000ms) is how long Jakka waits for JavaScript to render before analyzing content.
User Agent
The default crawler identifies itself as Jakka-bot/1.0 ( https://jakka.ai/bot ). You can override this for testing purposes on verified domains.
Password Protection
Enable to crawl staging sites behind HTTP Basic Auth. Pick HTTPS Basic Auth as Authentication Type, then enter Username and Password. Credentials are encrypted with AES-256 and never logged or exposed in reports.
Append Query Parameters
Add query parameters to every URL Jakka-bot visits. Useful for preview environments. Enter without the leading question mark, for example preview=true&draft=1.
Path Filters
Include Paths limits the crawl to matching paths. Exclude Paths skips matching paths. Use * as a wildcard, one pattern per line. Examples: /blog/*, /products/*, /about.
Custom HTTP Headers
Add custom headers to all crawler requests. Format: Header-Name; value (semicolon separator, not colon).