Senior Software Engineer

Company Overview

GobbleCube is an agentic growth operating system designed to help brands scale profitably across digital marketplaces. Founded in November 2022 by the ex- core team of Blinkit, the platform went live commercially from private beta in September 2024.

Since then, GobbleCube has scaled rapidly, supporting 600+ brands across enterprise and D2C, growing revenue 10X, and onboarding 45 of India’s largest CPG enterprises in just the last 9 months, including HUL, Nivea, Tata Consumer Products, ITC, Godrej, Beiersdorf, MTR, L’Oréal, Hershey’s, and many more.

As commerce becomes more distributed and hyperlocal, GobbleCube is building agentic solutions to help brands navigate complexity in real time, across visibility, performance marketing, supply chain, and growth strategy. Headquartered in Gurugram, the company supports brands across India, MENA, and LATAM.

Key Responsibilities

• Scale & Architecture: Architect, build, and optimize high-throughput crawler networks using Python and the Scrapy framework.
• Anti-Bot & WAF Defense: Develop robust, automated mechanisms to bypass advanced anti-bot protections, rate limits, enterprise WAFs (e.g., Akamai Bot Manager, Cloudflare, Datadome), and complex CAPTCHA challenges.
• Infrastructure Optimization: Implement proxy rotation, custom Scrapy middleware, request fingerprinting, header emulation, and TLS/JA3 fingerprint spoofing.
• Distributed Orchestration: Build distributed queuing and scraping architectures using Scrapy, Redis, Kafka, and Celery for seamless execution at scale.
• Mobile Reverse Engineering: Analyze mobile network traffic (iOS/Android), inspect API endpoints, perform certificate unpinning, and extract data directly from native mobile backend APIs.

Required Qualifications

• Scrapy Mastery: Deep internal knowledge of Scrapy (Twisted engine, asynchronous networking, custom pipelines, spider middleware, and extensions).
• Anti-Bot Infra Expertise: Proven track record bypassing enterprise anti-scraping systems (Akamai Bot Detection, Cloudflare, Imperva, Datadome, PerimeterX).
• Network & Protocol Mastery: Deep understanding of HTTP/HTTPS, HTTP/2, WebSocket protocols, TLS signatures/fingerprinting (JA3/JA4), request headers, and cookie management.
• Scale Experience: Direct experience running distributed crawling infrastructure handling millions of requests daily.

Preferred Qualifications (Nice-to-Have)

• Mobile Application Reverse Engineering: Experience with tools like Frida, Charles Proxy, Mitmproxy, or Burp Suite to intercept, analyze, and bypass mobile SSL pinners.
• Device Farm Management: Hands-on experience working with mobile device farms (Real device or Emulated Android/iOS farms) for app automation.
• Browser Automation & Bypassing: Experience integrating Scrapy with undetected headless engines (Playwright, Selenium-Stealth, Puppeteer-Extra).
• Data Pipelines & Cloud Infrastructure: Familiarity with AWS/GCP, Docker, Kubernetes, and streaming message queues (Kafka, Redis, RabbitMQ).