Senior Python Engineer (Web Scraping Platform) EU only

Role Overview We are looking for a Senior Python Engineer to develop and maintain web scraping solutions for a large-scale financial data platform. You’ll work on Python-based automation, browser interactions, and data extraction from investment portals, ensuring the reliability and stability of scraping processes. More information about us — [meet INSART] Role Responsibilities - Develop and maintain Python-based automation workers responsible for extracting financial data from investment portals. - Build scraping workers for new portals and maintain existing integrations. - Troubleshoot and fix failing workers when websites change their markup, authentication mechanisms, or login flows. - Implement and maintain browser automation using Playwright or Selenium. - Handle anti-bot protection mechanisms, including Cloudflare, WAFs, and CAPTCHAs. - Improve shared scraping libraries and ensure the stability and reliability of automation workers running on AWS. - Contribute to infrastructure-related tasks, including Docker, Terraform, and CI/CD. - Participate in code reviews, bug fixing, and technical documentation. - Collaborate with the integrations management team to resolve urgent issues. - Communicate directly with the client to discuss requirements, suggest solutions, and identify improvements. Role Requirements - 5+ years of commercial experience in Python development. - At least one commercial project involving web scraping or browser automation. - Strong proficiency in Python 3.10+, including OOP, asynchronous programming (asyncio), concurrency, and Pydantic. - Practical experience with web scraping, including HTML parsing, session handling, authentication flows, and adapting to website changes. - Hands-on experience with Playwright or Selenium (at least one is required). - Practical knowledge of anti-bot protection mechanisms, such as Cloudflare, WAFs, and CAPTCHAs. - Experience with AWS services, particularly Lambda, ECS, S3, and CloudWatch. - Working knowledge of Docker, CI/CD, Terraform, and MongoDB. - Experience working with authenticated portals, complex UIs, and session management. - Strong debugging and problem-solving skills. - Ownership, accountability, and the ability to work independently without close supervision. - Learning agility and willingness to explore new tools and domains. - Ability to work effectively under pressure and adapt to changing priorities. - Experience with anti-bot tools such as Camoufox, Pydoll, or CapSolver would be a plus. - Knowledge of reliability patterns for long-running jobs, including watchdogs, retries, and idempotency, would be a plus. - Experience with data matching or handling PII would be a plus. - Previous experience in fintech or financial services would be an advantage. - Strong communication skills: English B2+ Daily schedule Our company supports work-life balance and allows you to tailor your schedule, which consists of 8 working hours and time for lunch. Shared business hours for most of our teams are 12 pm — 7 pm Kyiv time. Interview Process - Intro Call with Recruiter (45 min) - Technical Interview with INSART (1 hour) - Technical Interview with the Client (1 hour) Join us! Our Youtube channel: Our Linkedin: www.linkedin.com/company/insart Looking forward to having a mutually interesting conversation with you! 😉 Відгукнутись на вакансію