JobronaBot
JobronaBot is the crawler behind Jobrona. It reads job listings that are public, so people can find open roles and Jobrona keeps an index of live jobs.
What it fetches
Public job pages that any visitor can open without an account: company sites, the public openings APIs of ATS providers (Greenhouse, Ashby, Lever, Workable, SmartRecruiters and others) and job feeds in RSS or sitemaps. It copies only what the page itself says about a role: company, title, location, salary when given. It does not sign in, does not create accounts, does not fill application forms and never sends anything to a site.
How it names itself
Every request carries an honest User-Agent: JobronaBot/<version> (+https://jobrona.com/bot; bot@jobrona.com). Only the version number changes with our releases; this page and the contact never change.
How much it asks
Token buckets per host, kept by our rate-limit service: at most one HTML request a second (short bursts of one), two feed requests a second, three requests a second to a public ATS API. Past the limit the request waits for its turn. When a site answers 429 Too Many Requests, the bot stays silent for as long as the Retry-After header asks.
robots.txt
Before any HTML page the bot reads /robots.txt of that site and follows it: a disallowed path is never fetched. Public data endpoints are read within the limits above. Our own site is open to every crawler (see /robots.txt).
Opt out
Write to bot@jobrona.com or use the contact page: name your site and what changes for it (a slower pace, a lower limit or no fetching at all). A request to stop is honored first, and your site is not fetched again.
Open the contact page