Data Engineer

W2 Only -- Onsite In Plano, TX

Data Engineer

Location: Plano, TX (Local and Nearby Candidates Preferred)

Employment Type: Contract

Pay Rate: $75/hour on W2

Work Authorization: W2 Candidates Only

Interview Process: Round 1 – Zoom | Round 2 – In-Person at the Client Location

Job Overview

We are seeking an experienced Data Engineer with strong hands-on expertise in PySpark, Apache Spark, Java/Python development, and ETL/streaming pipelines. The ideal candidate will contribute to designing, developing, testing, deploying, maintaining, and improving scalable data processing solutions within a cloud-based enterprise environment.

The candidate should have strong software engineering fundamentals, practical AWS experience, and an understanding of Agile methodologies, CI/CD, application resiliency, and security.

Key Responsibilities

• Design, develop, test, deploy, and maintain data engineering applications using Python or Java.
• Build and support scalable ETL and streaming data pipelines using PySpark and Apache Spark.
• Develop and maintain cloud-based data processing solutions using AWS services, including S3, Lambda, SQS, and RDS.
• Apply software design techniques and engineering best practices to deliver reliable and maintainable applications.
• Participate in the complete software development lifecycle, including analysis, development, testing, deployment, maintenance, and continuous improvement.
• Implement and support CI/CD processes and test-driven development practices.
• Follow Agile methodologies and collaborate with cross-functional engineering teams.
• Ensure application resiliency, security, reliability, and performance in cloud environments.
• Troubleshoot technical issues and contribute to continuous improvements in data processing and application performance.

Required Skills

• Extensive hands-on experience with PySpark, Apache Spark, and ETL/streaming pipelines .
• Strong programming proficiency in Python or Java .
• Hands-on experience with AWS services such as:
• Amazon S3
• AWS Lambda
• Amazon SQS
• Amazon RDS
• Strong understanding of software development principles, application design, testing, and deployment.
• Understanding of Agile methodologies and common Agile frameworks.
• Experience with Continuous Integration, Continuous Delivery, and Test-Driven Development.
• Understanding of cloud development, application resiliency, and security.
• 4–5+ years of applied software engineering experience.

Preferred Qualifications

• Experience with Shell scripting and Unix/Linux systems.
• Knowledge of Terraform and Infrastructure as Code.
• Familiarity with modern Large Language Model (LLM) techniques.
• Practical LLM use-case development experience using Azure OpenAI.

Education

• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or a related technical field.
• Formal training or certification in software engineering concepts is preferred.

Location and Interview Requirements

• Candidates currently located in Plano, TX, or nearby areas are strongly preferred.
• Candidates must be available for a first-round Zoom interview.
• Candidates must be able to attend the second-round interview in person at the client location.
• W2 engagement only.