Big Data Developer- Pyspark, SQL, Scala

About LTIMindtree

LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree — a Larsen & Toubro Group company — combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit www.ltimindtree.com

Job Title: Big Data PySpark

Work Location : Irving, Texas

Job Description

• Seeking a Senior Big Data Engineer with 5 to 10 years of experience proficient in Apache Spark and Python to design and implement scalable data processing solutions within the Python Data domain
• Scala, PL/SQL
• Develop and maintain robust and scalable data pipelines using Apache Spark and Python Collaborate with data scientists and analysts to optimize data workflows and enhance data quality Ensure data integrity and consistency across large and complex datasets Implement efficient data transformations and aggregations to support analytics and reporting needs Work closely with cross functional teams to integrate data solutions seamlessly into existing systems Monitor and troubleshoot data processing jobs to maintain high reliability and performance Stay updated with emerging trends technologies and best practices in big data and Python development

Roles and Responsibilities

• Design develop and optimize high performance data processing applications leveraging Apache Spark Write clean reusable and efficient Python code to support various data engineering initiatives Analyze complex datasets to extract actionable insights and identify data trends Collaborate with stakeholders to gather requirements and deliver tailored data solutions that meet business objectives Mentor junior team members and promote knowledge sharing within the team Participate actively in code reviews to ensure adherence to coding standards and best practices Manage deployment of data pipelines and continuously monitor their health and performance in production environments

Benefits and Perks:

Comprehensive Medical Plan Covering Medical, Dental, Vision

Short Term and Long-Term Disability Coverage

401(k) Plan with Company match

Life Insurance

Vacation Time, Sick Leave, Paid Holidays

Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all Canada locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, colour, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.