Varun Mahajan

Senior Data Engineer | Talend Data Fabric | AI-ETL Pipelines & RAG | Vector Databases (Pinecone) | Azure | Mulesoft | PL/SQL | Salesforce

11 recommandations

Salaire / Taux journalier

11 personnes recommandent

Noida, Uttar Pradesh, Inde

Freelance

Expertises

ETLDatabricksCoaching agileScrumGitGitHubSalesforceMySQLAzureSalesforce MuleSoftRESTful APIsJira

Recommandé par

Manoja Lanka

Optum

SAS Programmer

A recommandé le 18 septembre 2024

Ayush Maurya

Tredence Inc.

Associate Manager

A recommandé le 04 avril 2022

Seth Partridge

HipTen

Principal Solution Architect

A recommandé le 23 juillet 2021

Et 8 autres personnes

À propos

Introduction

-Experienced 8+ years of experience working as Senior Talend Developer with a demonstrated history of working in the information technology and services industry (Health,Insurance,Bank,Retail). -Integrate and loading data with different systems and data cleanup, and manage operations, dealing with health plan data including member, provider, eligibility, claims and Healthcare EDI File Creation using Talend -Skilled in ,Talend Data Integration/Big Data Platform/Talend Open Studio for ESB , Informatica, ETL Testing,Talend Job Support, Java, Spring boot, Mulesoft -Recently designed cost-effective RAG (Retrieval-Augmented Generation) pipelines that integrate localLLMs (Ollama) and Vector Databases (Pinecone) with enterprise ETL workflows -Extensively used ETL methodology for performing Data Migration, Extraction, Transformation and Loading using Talend and designed data conversions from wide variety of source systems including Oracle, SQL server non-relational sources like flat files and XML Files. -Exceptional knowledge in Design/Development/Testing/Debugging/Tuning/Supporting Talend ETL solutions -Expertise in handling error, exception and performance issue in Talend. -Expertise in handling production issues and implementing Change Request. -Excellent team player with the strong interpersonal communication, analytical skills, ability to work on multiple tasks, Quick learner, meets the strict deadlines in the fast-paced and demanding environment. -Experienced in Handling Talend ESB jobs with Jason, XML and Web services using Talend Open Studio for ESB -Experience in designing REST Web services using ESB. -Migrated data from different sources(text based files,Excel spread sheets and access) to SQL Server databases using Talend Platform. -Analyzing the data generated by the business process and Source-to-Target mapping of the data elements. -Gained hands-on experience with Azure Data Factory and Azure Databricks, and am eager to further explore and contribute in this domain if given the opportunity. -Developed three full-stack applications using Node.js for the frontend and JavaScript for backend logic in Visual Studio Code, integrating AI models like ChatGPT-4.x and Claude 3.7 to enhance functionality and user experience. -Well-versed in the end-to-end development lifecycle of Spring Boot applications, including designing Model, DAO, and Controller classes, and deploying projects using GitHub Actions.

Liens

Expérience de travail

Senior Software Engineer

Optum

avr. 2021 - Présent

5 ans 7 mois

Noida, Uttar Pradesh, Inde

- Working as a Sr ETL developer in this organization - Working on Talend Open Studio 8.X -Responsible for taking the requirements . converting functional requirements to technical requirements and setting up all the tables database scripts and converting technical stuff via code with the help of talend tool -Responsible for deploying the same code in GIT HUB in child branch and then merging in the master branch by creating a pull request and check the same if that has been done properly or not -Got the working knowledge of FACETS while working in the project , Knows about claim process. Billing, Providers -End to end taking care of development as well deployment of talend jobs , Also documentation part was also taken care of -Co-ordinating with support people for incidents and helping them to achieve the solution as well -Responsible for showing demo over the call to business folks and taking those feedback and incorporate the same -Gained, Architected, implemented a scalable, multi-hop Bronze, Silver, Gold data architecture in Databricks, ensuring data quality, lineage, and auditability from raw ingestion to curated insights -Governed data progression through the Medallion framework to deliver high-reliability datasets (Gold layer) -Creating a healthy environment within the team so that what work we are doing, we are enjoying our work and if anybody is stuck I work beyond expectations and help that team member to resolve the error/complete the work

Data Engineer

Publicis Sapient

sept. 2019 - mai 2021

1 an 9 mois

Gurgaon, Haryana, Inde

-Worked on Talend Data Management with Integration with Salesforce -Extensive knowledge of salesforce components of TALEND and how they are being integrated and used. -Worked in DEPTH integrating data in the SALESFORCE OBJECTS LIKE ACCOUNTS/ OPPORTUNITY, PRODUCTS/INVOICE/INVOICEPRODUCTS/ORDERS/PRICEBOOKS/Gift Transactions/Gift Designation/ Quotes/Quote Line Items and several other custom objects -Responsible to moving to code to GIT (PUSH/PULL). Resolving merge conflicts as well -Creating and using mutiple frameworks related to file extraction or loading in data base -Proficient in using mySQL database for storing intermediate data -Experience of working in scrum framework , Knowledge about Jira and agile methodology -Present working on Talend Data Management Enterprise Version 7.2.1 -Responsible for running of jobs in TAC- Talend Administration Center -Working extensively with onsite team to get the JIRA stories /defects completed on time -Also worked on the enterprise version v7.2.X Expertise in creating and deploying jobs. - worked against data cleansing , migrating , extracting , loading and many other things to different target systems -Refactor/Optimize/Improve Project best practices; - Fix issues related to infrastructure failures/problems; - Review other team members work(Code Review/Github PRs); - Created triggers for a Talend job to run automatically on server. -Setup ETL Framework, best practices around Talend for data integration implementation. -Responsible for installing Talend on multiple environments, creating projects, setting up user roles, setting up job servers, configure TAC options, adding Talend jobs, job failures, on-call support and scheduling etc. - Used Talend components tMap, tDie, tConvertType, tFlowMeter, tLogCatcher, tRowGenerator. - Performed requirement gathering, Data Analysis using Data Profiling scripts, Data Quality (DQ) scripts and unit testing of ETL jobs. - Creating test data in Salesforce. - Knowledge of AWS S3

Senior Talend Developer

Pimcore

juil. 2019 - oct. 2019

4 mois

Noida, Uttar Pradesh, Inde

1. Working as a Senior Talend Developer for product based company. 2. Working on Xml, JSON,WEBServices using Talend open studio for ESB. 3. Responsible for creating Talend jobs using talend ESB Components(REST) which involves data transfer from one application to another application 4.Experience in working in extracting the file from gcp,mysql,oracle etc and loading the same using Talend components only 5. Doing data cleansing , transformation, validation when data moves from one source to another 6 Checkin and doing the push/pull the code using GIT

Talend ETL Developer

Tata Consultancy Services

mars 2016 - juil. 2019

3 ans 5 mois

Noida, Uttar Pradesh, Inde

• Have spent 3.5 Years of Experience in DWH, ETL, Data Modeling and Implementing Enterprise BI applications across various domains by using Talend Open studio for Data Integration and Bigdata (7.0.1), Experience of working in agile environment using Scrum methodology. • Extensive experience in extraction, transformation and loading of data directly from heterogeneous source systems like flat files, xlsx,xls,.csv,.zip etc. • Experience in creating jobs and tuning performance using open source tool Talend (ETL &ELT). • Working Experience in Oracle SQL, • Experience in establishing the connection between Talend and other sources and extracting data for transformation as per the business logic. • Experience in scheduling the talend Master jobs • Excellent Communication, interpersonal, analytical skills and strong ability to perform in a team. • Basic knowledge in UNIX Shell Scripting, USQL. • Experienced in requirement analysis, coding, debugging and unit testing various modules in a software development life cycle (SDLC). • Basic Knowledge in Agile processing life cycle • Designing, developing and deploying end-to-end Data Integration solution. • Implemented custom error handling in Talend jobs and worked on different methods of logging. • Develop the ETL mappings for XML, .CSV, .TXT sources and loading the data from these sources into relational tables with Talend ETL Developed Joblets for reusability and to improve performance.


Formation

Punjab Technical University

BTech - Bachelor of Technology, Computer Software Engineering


Licences et certifications

Microsoft Certified: Azure Fundamentals

Délivré le : juil. 2024

Certifié par Microsoft

Artificial Intelligence Tools

Délivré le : mai 2024

Certifié par Be10x

Le meilleur endroit pour trouver votre prochaine opportunité

© 2026. Tous droits réservés.