Backend Engineer, High-Volume Data Processing

Location: Dumbo, Brooklyn, NY (onsite, 5 days/week)
Type: Full-time
Compensation: $220K-$300K base salary
Relocation: Up to $10K
Visa: Open to visa transfers (including OPT and H-1B). Additional sponsorship may be considered for the right candidate.
Openings: 2

About Client

Client is the primary source of real, proprietary enterprise data for the world's leading frontier AI labs. They acquire enterprise data generated through collaboration, communication, and building. They transform it into de-identified datasets that remain useful, and license those datasets directly to frontier AI labs.

They've scaled from $0 to a multi-eight-figure run rate in a matter of months. They have about 14 people, with a lean engineering team of around five, backed by Floodgate, Afore Capital, Ludlow Ventures, and Hustle Fund. The client was built by the team behind Sunset, which scaled to an eight-figure run rate and helped hundreds of venture-backed startups wind down.

The Role

You'll own the backend systems that turn raw enterprise data into clean, de-identified, high-value datasets. This is not a role about moving data between systems. The work is code applied to the data itself: multi-stage pipelines that process large volumes of messy, real-world data where correctness matters as much as throughput.

You'll join a small team where each engineer has real ownership, the problems are ambiguous, and your work directly affects revenue.

What You'll Do

• Design, build, and own production multi-stage data-processing pipelines end to end
• Build systems that stay correct under failure, with sound handling of retries, partial failures, and recovery
• Apply NLP and Named Entity Recognition (NER) techniques to de-identify and transform enterprise data
• Build internal tooling and dashboards that show how the pipeline is performing and where it's breaking
• Work across the stack, in AWS and mostly Python, to ship quickly and improve reliability and quality
• Make pragmatic technical decisions with minimal process and a lot of autonomy

Required

• A relevant undergraduate STEM degree from a top-30 U.S. institution
• 5 -10 years of software engineering experience, with personal ownership of production backend systems
• Hands-on experience building and running multi-stage, high-volume data-processing pipelines
• Strong fundamentals in distributed and asynchronous systems: queues, workers, concurrency, idempotency, retries, partial failure, and recovery. We care about correctness and recovery under failure, not just scale.
• Meaningful full-time experience at an early-stage or high-growth startup, with real ambiguity and ownership (internships and brief stints don't count)
• Strong skills in a general-purpose backend language. Our stack is Python on AWS, but strong Go, Rust, or Java engineers are welcome.
• Experience with AWS
• Familiarity with NLP and NER
• Willingness to work onsite in Dumbo, Brooklyn, 5 days a week. We support relocation for candidates outside NYC.

Nice to have

• Brand-name company experience paired with a meaningful startup stint
• A clear record of career progression
• Batch or workflow orchestration experience
• A backend-leaning full-stack background, especially internal tools and dashboards

Compensation & Logistics

• Base salary: $220K-$300K
• Relocation support: up to $10K
• Visa transfers supported, including OPT and H-1B
• Onsite 5 days/week in Dumbo, Brooklyn

#hc267456