RunOps Support Data Pipelines

Job highlights

• You will be responsible for real-time and batch data operations,job monitoring,pipeline health checks,and handling failures
• Key Responsibilities: Monitor,schedule,and troubleshoot batch and streaming data pipelines
• Required Skills & Qualifications: Experience with Databricks for managing notebooks and pipelines
• Hands-on experience with Snowflake data warehouse operations

Job Title: RunOps Support Data Pipelines
Job Type: Full-Time
Location: Remote
About Us
At micro1 were building the worlds first AI recruitment engine to match the worlds most talented people with their dream jobs
As a core team member, youll be at the forefront of AI innovation, contributing to our companys expansion while collaborating with Silicon Valleys fastest-growing companies
Youll thrive in a supportive, fast-paced, and innovative environment, tackling exciting challenges while unlocking unparalleled career growth and development
Job Summary:
We are hiring RunOps Support Engineers for our Data Pipelines team to support and maintain critical ETL/ELT workflows
You will be responsible for real-time and batch data operations, job monitoring, pipeline health checks, and handling failures
This role requires deep understanding of Databricks, SQL, Snowflake, and AWS-based data ecosystems
Key Responsibilities:
Monitor, schedule, and troubleshoot batch and streaming data pipelines
Provide L1/L2 operational support for jobs in Databricks, Snowflake, and AWS-based data frameworks
Analyze job failures, logs, and resolve incidents or escalate as needed
Optimize SQL queries and ensure data integrity and freshness
Document and update SOPs, runbooks, and dashboards for pipeline health
Collaborate with data engineers to improve system reliability and performance
Lead efforts on root cause analysis and long-term fixes (senior/lead level)
Required Skills & Qualifications:
Experience with Databricks for managing notebooks and pipelines
Strong in SQL and data analysis for debugging data failures
Hands-on experience with Snowflake data warehouse operations
Familiarity with AWS services used in data engineering workflows (S3, Glue, Lambda, etc )
Ability to handle production incidents, alerts, and automate resolutions
Strong problem-solving, documentation, and communication skills
Show more Show less