Observability Engineer

Position Summary:

BCS is NETS’ wholly owned subsidiary and is an entity within the NETS Group. It manages and operates clearing and payment infrastructure for the Singapore Automated Clearing House, including Fast And Secure Transfers (FAST), Inter-bank GIRO (IBG), Cheque Truncation System (CTS), and provides services for PayNow and SGQR Central Repository.

Team and Position Summary:

The Technology Division at BCS is responsible for the operations, maintenance, and support of BCS applications such as FAST, Giro, CTS, PayNow, SGQR, TFR, eGIRO and its critical infrastructure, ensuring its operational stability, regulatory compliance, and service reliability.

The Observability Engineer is responsible for designing, implementing, and operating enterprise observability solutions using ELK Stack (Elasticsearch, Logstash, Kibana) and AWS monitoring services. The role focuses on telemetry ingestion, monitoring, alerting, automation, and delivering actionable insights to improve system performance, reliability, and operational efficiency.

The ideal candidate will also lead observability initiatives from conception to implementation, driving continuous improvements in monitoring capabilities, incident detection, root cause analysis, automation, and operational resilience with minimal supervision.

Key Responsibilities:

Observability Engineering

• Manage and enhance enterprise observability platforms, with a primary focus on ELK Stack and AWS service monitoring.
• Design, implement, and maintain end-to-end telemetry pipelines, including log ingestion, parsing, enrichment, and integration of logs, metrics, traces, and events.
• Develop observability dashboards, visualizations, alerts, and monitoring solutions to support infrastructure, application, and operational teams.
• Partner with stakeholders to define observability requirements, establish best practices, and drive observability adoption and maturity across the organization.

General

• Provide technical support for Observability tools including incident/problem coordinator, troubleshooting, resolution and performance optimization.
• Liaising with application, infrastructure, security, and operations teams to discuss on observability requirements, implementation and operation.
• Liaising with vendor to discuss on the requirements, solutioning and validating the implementation.
• Some experiences in handling audit and risk activities from MAS, Group audit, Risk & Compliance, and 3rd party auditor.
• Prepare and update Observability documentations, knowledgebase, SOP, best practices as required.

Requirements:

Education and Experience

• Bachelor’s degree in information technology, Computer Science, or a related field.
• Minimum 3 years of hands-on experience with Elasticsearch, Logstash, and Kibana, including managing ELK cluster, log ingestion, parsing (Regex/Grok), filtering, and enrichment.

Skills and Knowledge

• Strong understanding of observability principles, including telemetry, Golden Signals, monitoring frameworks, and the ability to derive actionable insights across infrastructure and application environments.
• Hands-on experience with AWS monitoring and observability services, including implementing and managing monitoring, alerting, and performance analysis solutions.
• Exposure to additional observability and monitoring platforms such as Grafana, Dynatrace, SolarWinds.
• Proficieny in Python scripting for automation and integration, with experience working with REST APIs and OpenTelemetry (OTEL). Familiarity with AI/ML concepts and technologies, including anomaly detection, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG), is highly desirable.
• Good communication skills with the ability to understand user requirements and explain observability data and insights for business and technical stakeholders.
• Strong communication and stakeholder management skills, with the ability to gather requirements and articulate observability insights effectively to both technical and non-technical audiences.
• Demonstrated ownership, accountability, and commitment to delivering quality outcomes, with the ability to drive observability initiatives from inception through implementation while supporting BAU operations.
• Strong analytical, troubleshooting, and problem-solving skills.
• Proven ability to manage competing priorities, work under tight deadlines, and consistently deliver against committed timelines.
• Excellent interpersonal skills and a collaborative mindset, with a strong focus on teamwork and knowledge sharing.

Preferred Certifications

• Elastic Certified Observability Engineer or Elastic Certified Analyst
• AWS Certified SysOps Administrator – Associate, AWS Certified DevOps Engineer – Professional