Data Engineer – DataStage / PySpark / Control-M

Data Engineer – DataStage / PySpark / Control-M

third party payroll and contract basis job artech

*JP ID:* CGEMJP00354761

*Experience:* 7–10 Years

*Location:* Pune

*Notice Period:* Only Immediate

*Budget:* 20–21 LPA

Role Summary

Looking for a Data Engineer with 7+ years’ experience to design, build, and support robust data integration and processing solutions. The role involves end-to-end delivery of batch/ETL pipelines using IBM DataStage, PySpark, Linux, and Control-M, with a strong preference for Banking/Finance domain experience.

Key Responsibilities

* Design, develop, and maintain ETL/data pipelines using *IBM DataStage*.

* Build and optimize big data processing jobs using *PySpark*, including transformations, performance tuning, and partitioning strategies.

* Develop and support batch scheduling and workload automation using *Control-M*.

* Work confidently in *Linux/Unix* environments including scripting, troubleshooting, file handling, permissions, and process monitoring.

* Perform root-cause analysis for production issues and implement fixes focused on stability, resiliency, and repeatability.

* Partner with upstream/downstream teams including data producers, consumers, QA, platform, and operations.

* Ensure solutions meet *banking/finance* expectations for data quality, auditability, lineage, and operational controls.

* Prepare technical documentation including mappings, job design, runbooks, and operational procedures.

Required Skills & Experience

* *7+ years* hands-on experience as a Data Engineer / ETL Engineer / Data Integration Engineer.

* *IBM DataStage* – job design, performance tuning, parallelism, error handling.

* *PySpark* – DataFrames, transformations/actions, optimization.

* *Control-M* – scheduling, monitoring, incident handling, job orchestration.

* *Linux/Unix* – shell scripting and environment troubleshooting.

* *Banking or Finance domain experience* – risk, finance reporting, payments, AML, regulatory reporting, treasury, customer data.

* Experience supporting production environments with on-call/incident processes and SLAs.

* Strong analytical and problem-solving skills with clear communication to technical and non-technical stakeholders.

Preferred / Nice-to-Have

* Relational databases such as *Oracle/DB2/PostgreSQL* and strong *SQL* skills.

* Data quality controls, reconciliation, and metadata/lineage concepts.

* CI/CD, version control (*Git*), and automated deployment practices.

* Data governance and regulatory expectations in financial services.

Education

* Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.

Pay: From ₹2,000,000.00 per year

Work Location: In person