Backend Infrastructure Engineer, Anti-Bot
True Talent Solutions Partners · On site, San Francisco, US
235,000 - 260,000 USD / Year · Posted Oct 30, 2026
About the job
ABOUT THE ROLE
Join a team building web data-extraction infrastructure for AI applications. You will own production systems that keep high-volume extraction reliable when websites actively resist automated access.
WHAT YOU'LL DO
- Architect and manage proxy rotation, IP and session management, and isolated egress nodes at scale.
- Improve extraction success rates against websites with active anti-bot and anti-scraping defenses.
- Build and maintain browser and TLS fingerprinting, CAPTCHA handling, and challenge-solving infrastructure.
- Monitor the health and cost efficiency of the proxy layer.
- Diagnose intermittent failures across the stack and deliver lasting fixes.
- Own production systems end to end, including reliability and on-call responsibilities.
WHAT WE'RE LOOKING FOR
- More than 3 years of experience in adversarial web infrastructure or proxy-layer engineering, with recent hands-on work in production web extraction.
- Experience building proxy rotation, IP and session management, egress isolation, and proxy economics for third-party web extraction.
- Production experience evading aggressive anti-bot defenses, including platforms such as Akamai, DataDome, Cloudflare, or Kasada, and ownership of success-rate metrics.
- Experience with browser and TLS fingerprinting and CAPTCHA or challenge handling at production scale.
- Proficiency in Go and/or Python, with strong networking fundamentals including TCP/IP, HTTP/2, connection pooling, and proxy orchestration.
- Experience operating end-to-end production systems and implementing observability and on-call tooling such as Prometheus and Grafana.
COMPENSATION & BENEFITS
Base salary: $235,000 to $260,000 annually. Visa sponsorship is available.
LOCATION
Hybrid, San Francisco, California, United States.