Python Web Scraping Engineer

International client exposure

Flexible timing

Monthly celebration

5 days working flexible hours

About Innvonix

At Innvonix Tech Solutions, We are looking for people who have the desire to grow to the highest level in their professional careers. If you have an indestructible drive within you to showcase your skillset and to level up in your career, you stand a good chance to join us. We value skills over experience and attitude over knowledge. If you think, you have what it takes to survive in the ever-changing world of technology, feel free to get in touch with our HR team. We the best software company to work in Ahmedabad. We are actively looking for passionate candidates in the following job profiles.

Roles and Responsibility

1. Experience

li]:relative [_ul>li]:pl-5 [_ul>li::before]:absolute [_ul>li::before]:left-0 [_ul>li::before]:top-0 [_ul>li::before]:font-bold [_ul>li::before]:text-[1em] [_ul>li::before]:leading-[1.4] [_ul>li::before]:content-[-] [_ol]:m-0 [_ol]:list-decimal [_ol]:space-y-2 [_ol]:py-0 [_ol]:pl-5 [_ul>li>ol]:mt-small-12 [_ol>li]:relative [_ol>li]:pl-1 [_ol>li::before]:hidden [_ol>li::before]:content-none text-text-secondary pl-medium-24 lg:pl-large-32 [_p+ul]:mt-small-12 [_strong]:text-text-primary [_p]:m-0 [_strong]:font-bold">

• 4+ years of professional experience in Python web scraping and automation.
• Strong hands-on experience building and maintaining production-grade web scraping systems

2. Key Responsibilities

li]:relative [_ul>li]:pl-5 [_ul>li::before]:absolute [_ul>li::before]:left-0 [_ul>li::before]:top-0 [_ul>li::before]:font-bold [_ul>li::before]:text-[1em] [_ul>li::before]:leading-[1.4] [_ul>li::before]:content-[-] [_ol]:m-0 [_ol]:list-decimal [_ol]:space-y-2 [_ol]:py-0 [_ol]:pl-5 [_ul>li>ol]:mt-small-12 [_ol>li]:relative [_ol>li]:pl-1 [_ol>li::before]:hidden [_ol>li::before]:content-none text-text-secondary pl-medium-24 lg:pl-large-32 [_p+ul]:mt-small-12 [_strong]:text-text-primary [_p]:m-0 [_strong]:font-bold">

• Design, develop, and maintain scalable web scraping and data extraction pipelines.
• Build robust scrapers capable of handling dynamic websites, anti-bot protections, CAPTCHAs, and rate limiting.
• Develop high-performance, distributed scraping infrastructure using Docker and Kubernetes.
• Optimize scraper performance, reliability, scalability, and fault tolerance for large-scale deployments.
• Build and maintain APIs using Python web frameworks such as FastAPI or Django.
• Develop asynchronous and distributed task-processing pipelines using Celery.
• Monitor and troubleshoot production systems using observability tools such as Grafana and Prometheus.
• Collaborate with engineering teams to build resilient, maintainable, and scalable data collection platforms.
• Research and implement new web scraping techniques, browser automation methods, and AI-powered extraction technologies.
• Explore and contribute to AI/ML and Agentic AI initiatives for intelligent web automation and data extraction.

3. Required Skills

li]:relative [_ul>li]:pl-5 [_ul>li::before]:absolute [_ul>li::before]:left-0 [_ul>li::before]:top-0 [_ul>li::before]:font-bold [_ul>li::before]:text-[1em] [_ul>li::before]:leading-[1.4] [_ul>li::before]:content-[-] [_ol]:m-0 [_ol]:list-decimal [_ol]:space-y-2 [_ol]:py-0 [_ol]:pl-5 [_ul>li>ol]:mt-small-12 [_ol>li]:relative [_ol>li]:pl-1 [_ol>li::before]:hidden [_ol>li::before]:content-none text-text-secondary pl-medium-24 lg:pl-large-32 [_p+ul]:mt-small-12 [_strong]:text-text-primary [_p]:m-0 [_strong]:font-bold">

• Strong proficiency in Python with a solid understanding of:
  • Object-Oriented Programming (OOP)
  • Python best practices
  • Clean code principles
  • Exception handling and debugging
• Extensive hands-on experience with:
  • Selenium
  • Undetected ChromeDriver (UC)
  • Requests
  • Browser automation
  • CAPTCHA-solving techniques
• Strong understanding of modern anti-bot mechanisms, rate limiting, and anti-detection techniques.
• Experience working with Docker and containerized applications.
• Hands-on experience deploying and managing applications on Kubernetes.
• Strong experience with Celery and distributed task processing.
• Experience with at least one Python web framework:
  • FastAPI, Django
• Familiarity with monitoring and observability tools such as:
  • Grafana
  • Prometheus
• Experience working with Git and Linux environments.
• Strong problem-solving and debugging skills.

4. Preferred Qualifications

li]:relative [_ul>li]:pl-5 [_ul>li::before]:absolute [_ul>li::before]:left-0 [_ul>li::before]:top-0 [_ul>li::before]:font-bold [_ul>li::before]:text-[1em] [_ul>li::before]:leading-[1.4] [_ul>li::before]:content-[-] [_ol]:m-0 [_ol]:list-decimal [_ol]:space-y-2 [_ol]:py-0 [_ol]:pl-5 [_ul>li>ol]:mt-small-12 [_ol>li]:relative [_ol>li]:pl-1 [_ol>li::before]:hidden [_ol>li::before]:content-none text-text-secondary pl-medium-24 lg:pl-large-32 [_p+ul]:mt-small-12 [_strong]:text-text-primary [_p]:m-0 [_strong]:font-bold">

• Experience building large-scale distributed web scraping infrastructure.
• Strong knowledge of Kubernetes administration and orchestration.
• Experience with social media scraping, automation, or bot development.
• Experience with AI-assisted or Agentic AI web scraping systems.
• Knowledge of proxy management, browser fingerprinting, and anti-detection techniques.
• Experience with message queues, distributed workers, and scalable backend architectures.
• Experience working with cloud platforms and large-scale data processing systems.

5. What We Offer

li]:relative [_ul>li]:pl-5 [_ul>li::before]:absolute [_ul>li::before]:left-0 [_ul>li::before]:top-0 [_ul>li::before]:font-bold [_ul>li::before]:text-[1em] [_ul>li::before]:leading-[1.4] [_ul>li::before]:content-[-] [_ol]:m-0 [_ol]:list-decimal [_ol]:space-y-2 [_ol]:py-0 [_ol]:pl-5 [_ul>li>ol]:mt-small-12 [_ol>li]:relative [_ol>li]:pl-1 [_ol>li::before]:hidden [_ol>li::before]:content-none text-text-secondary pl-medium-24 lg:pl-large-32 [_p+ul]:mt-small-12 [_strong]:text-text-primary [_p]:m-0 [_strong]:font-bold">

• Opportunity to work on large-scale cyber intelligence products.
• Exposure to cutting-edge AI and Agentic AI technologies.
• Challenging engineering problems involving distributed systems, web automation, and large-scale data extraction.
• Collaborative engineering culture with opportunities for continuous learning, experimentation, and innovation.
• Opportunity to work on technically challenging projects and contribute to next-generation intelligent web automation solutions.

What will happen next

01

You will receive an email from our recruitment team.

02

Then, well ask you to prepare for a technical entry exam.

03

Then, well ask you to prepare a recruitment task.

04

If everything goes well, we will meet you at interviews!

Join Our Team

Disclaimer: This job posting and location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.