Senior Data Engineer- Financial Servies experience required

Job Details:

Senior Data Engineer - Build Next-Gen Data Platforms in Financial Services

Philadelphia, PA

Own the data engine behind critical financial operations

You’ll be the data engineer who turns massive, messy operational data into clean, trusted, business‑ready datasets that middle- and back-office teams can actually use.

This isn’t just “move data from A to B”. You’ll architect and build modern data platforms and pipelines that power trading operations, risk, reconciliations, and compliance across capital markets.

Batch. Streaming. High-volume. Low-latency.

If you’ve built serious data systems in financial services and want to own the next generation of platforms, we want to talk to you.

What You'll Work On

You’ll sit on a Data Technologies team that partners directly with middle- and back-office application teams to:

• Next-generation data platforms for capital markets operations
• Scalable batch and streaming data pipelines
• Business-ready data products for Operations and Compliance
• Large-scale analytical datasets for middle- and back-office systems
• High-performance data processing and query environments
• Modern file and table formats for analytics at scale
• On-premises data platform components and integrations

You’ll work with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and Kafka, using Python as your primary development language.

Your core challenge: design and optimize data platforms that stay reliable and fast even as the data and the business keep scaling. What You'll Be Doing

• Designing, developing, and supporting scalable data pipelines for middle- and back-office systems
• Architecting and implementing modern data platform solutions
• Building and optimizing large-scale batch data processing workflows
• Building and optimizing large-scale streaming data processing workflows
• Collaborating with application teams to model and transform data to meet business requirements
• Delivering business-ready data products to operations and compliance stakeholders
• Implementing and tuning high-volume data processing frameworks
• Optimizing queries and performance in large-scale analytical environments
• Monitoring data processing environments for reliability, scalability, and performance
• Troubleshooting and resolving issues across data pipelines and platforms
• Improving robustness and efficiency of existing data workflows
• Providing occasional off-hours or weekend support when needed

What We're Looking For

• 5+ years of experience in data engineering, data platforms, or large-scale distributed data processing
• Strong experience with modern data technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and/or Kafka
• Strong Python development skills
• Hands-on experience designing and optimizing high-volume data pipelines
• Experience with large-scale batch and streaming data processing frameworks
• Proven background in query optimization and performance tuning in analytical environments
• Experience with on-premises data platforms (preferred)
• Industry experience within capital markets or financial services (required)
• Domain knowledge in Operations and/or Compliance within financial services (highly preferred)
• Ability and flexibility to provide occasional off-hours/weekend support

The Experience That Will Really Get Our Attention

You’ve been the go-to engineer when data problems get hard: distributed joins blowing up, streaming jobs lagging, analytical queries timing out, and stakeholders who still need answers on time. You know how to design data models and pipelines that work in the real world of capital markets and post-trade operations.

If you’ve paired strong Python engineering with hands-on work in Spark- or Databricks-based platforms, dealt with on-prem constraints, and delivered high-performance datasets for operations or compliance teams, you’ll stand out here.

Spark

• Databricks
• Trino
• Iceberg
• Snowflake
• Parquet
• Apache Arrow
• Polars
• Kafka
• Python
• Capital Markets
• Financial Services
• Operations
• Compliance

Why This Opportunity?

You’ll work close to the money, on the data that actually runs the business—operations, settlements, reconciliations, compliance—not vanity dashboards.

You’ll own substantial pieces of the data platform, from architecture through production support, with direct partnerships across middle- and back-office teams.

You’ll get to sharpen your skills on modern data technologies at serious scale, in a capital markets environment where performance, correctness, and reliability all matter.

Important Requirements

Industry experience within capital markets or financial services is required. Ability and flexibility to provide occasional off-hours/weekend support is required. Interested?

If you’re a senior data engineer who thrives on large-scale, high-impact financial data challenges, let’s talk.

Please send your resume to [email protected]

Kevin McCarthy

484-238-1949

Keywords

Senior Data Engineer, Data Engineer, Lead Data Engineer, Data Platform Engineer, Distributed Data Engineer, Spark Engineer, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, Kafka, Python, data pipelines, batch processing, streaming data, real-time data, data products, data platforms, query optimization, performance tuning, large-scale data processing, on-premises data platform, capital markets, financial services, middle-office, back-office, operations data, compliance data, post-trade, data engineering jobs Philadelphia