Big Stream (IBM StreamSets) Developer

Required Skills:

• IBM StreamSets / StreamSets Data Collector
• Streaming & Batch Data Pipeline Development
• Snowflake
• Apache Kafka
• Cloud Data Warehouses
• Pipeline Monitoring & Troubleshooting
• Data SLA Monitoring
• Performance Tuning & Data Quality
• Data Governance
• Automation & Job Orchestration

Key Responsibilities:

• Design, develop, test, and maintain robust streaming and batch data pipelines using IBM StreamSets.
• Integrate data across platforms such as Snowflake, Apache Kafka, and cloud data warehouses.
• Monitor active jobs, analyze SLAs, troubleshoot pipeline failures, and resolve data issues.
• Optimize pipeline performance while maintaining data quality and governance.
• Automate workflows and implement resilient job scheduling and failover mechanisms.