Python Developer

Are you interested in working with the World’s leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at QualityAI!

We are looking for an experienced Python Developer specializing in Web Scraping and Data Extraction to join our growing Data Engineering team.

You will develop and maintain reliable Python-based solutions to collect, process, and organize data from websites, APIs, and other online sources. This data will support business analytics, research, and data-driven decision-making. Experience in finance, fintech, or investment research is a plus.

Key Responsibilities

• Develop and maintain web scraping and data extraction solutions using Python.
• Extract data from websites, dynamic web pages, and REST/GraphQL APIs.
• Build reliable data pipelines and handle website changes, rate limits, and access restrictions.
• Clean, validate, and transform data to ensure accuracy and quality.
• Monitor scraping processes and troubleshoot technical issues.
• Optimize solutions for performance, scalability, and reliability.
• Store and manage data using SQL/NoSQL databases and cloud storage.
• Write clean, reusable, well-tested, and documented code.
• Collaborate with data engineers, analysts, and business teams to meet data requirements.
• Follow data privacy, compliance, and responsible data collection practices.
• Mentor junior developers and contribute to team best practices.

Required Qualifications

• 5–8 years of professional Python development experience, including at least 3 years in web scraping or data extraction.
• Hands-on experience with Scrapy, BeautifulSoup, Requests/HTTPX, and Selenium or Playwright.
• Good understanding of HTML, CSS, DOM, XPath, HTTP, cookies, sessions, and authentication.
• Experience with asynchronous programming and concurrency.
• Knowledge of Pandas, NumPy, and regular expressions.
• Experience with SQL and NoSQL databases such as PostgreSQL and MongoDB.
• Familiarity with data pipeline orchestration tools such as Airflow or Prefect.
• Experience with Git, Docker, CI/CD, and automated testing using pytest.
• Knowledge of cloud platforms such as AWS, Azure, or GCP.
• Strong analytical, debugging, and problem-solving skills.
• Good communication and collaboration skills.
• Bachelor's degree in Computer Science, Engineering, Mathematics, Finance, or a related field, or equivalent practical experience.

Preferred Qualifications

• Experience in financial services, fintech, asset management, or investment research.
• Knowledge of financial data, market prices, company filings, earnings reports, financial news, or ESG data.
• Familiarity with financial data providers and APIs such as Bloomberg, Refinitiv, Alpha Vantage, Yahoo Finance, or Polygon.
• Understanding of financial data quality, licensing, governance, and compliance.
• Experience with NLP, PDF parsing, or extracting data from unstructured documents.
• Familiarity with big data tools such as Spark and Kafka, or data warehouses such as Snowflake, BigQuery, and Redshift.
• Exposure to Kubernetes or distributed data processing systems.

Key Competencies

• Reliability: Builds stable and scalable data extraction solutions.
• Data Quality: Ensures data accuracy, completeness, and consistency.
• Ownership: Takes responsibility for tasks from development through deployment and monitoring.
• Problem-Solving: Identifies issues and develops effective solutions.
• Collaboration: Works effectively with technical and business teams.
• Integrity: Follows responsible data collection, privacy, and compliance practices.

Benefits

Why QualityAI?

• Be a part of a company who strives to support for diversity and inclusion in the workplace – we are one, we are many at QualityAI. Celebrate culture, share knowledge with engineers from around the globe, and inspire each other through our differences. We have more than 40% women and around 120 different nationalities.
• Local and global opportunities – we offer you internal rotation and international mobility opportunities to grow your career.
• Clear view of your career and progression with the company – QualityAI is growing massively (since 2021 – tripled our employees base – we now have more than 8,000 engineers) and giving you the opportunity to grow with us.
• Work hard and play harder with our flexible and casual culture.
• Take care of health with enrollment into one of our competitive healthcare benefits from Day 1.
• Never stop experimenting and learning with QCraft – our Learning & Development platform: 50,000+ courses, 300+ virtual labs, mentorship and leadership programs, professional tribes, sponsored certifications, and much more.
• Earn bonuses via our Client Referral and Employee Referral Program’s. Refer and earn – tap your network for net-worth.
• We recognize our employees work via our Qudos platform - You can earn bonuses and spot awards by celebrating your and your peers’ achievements.
• Intrigued to find more about us?
• Visit our website at https://www.qualitestgroup.com/
• If you like what you have read, send us your resume and let’s start talking!