Software Engineer (Synthetic Monitoring)

• The Synthetic Monitoring squad builds and operates Grafana Cloud Synthetic Monitoring, used by teams globally to proactively verify that their critical user journeys, APIs, and services work as expected - before their customers notice they don’t
• Synthetic Monitoring is a multi-tenant distributed system implemented in Go, running on Kubernetes across all major cloud providers (AWS, GCP, Azure), executing billions of synthetic tests each month from probe locations around the world and from customer-operated private probes
• The product is in a scale phase, and our focus is on making Synthetic Monitoring a deeply integrated part of Grafana Cloud: connecting checks to real user experience and cross-product investigation workflows, making check results a trusted signal for AI-assisted workflows, and enabling large organizations to operate the product at enterprise scale on our infrastructure and on their own private probes
• The role is full-stack in the real sense: the same engineer who designs how a check execution flows through scheduling, probes, and the telemetry pipeline should also be able to build the workflow that lets a user understand and act on the result
• As a Software Engineer on the Synthetic Monitoring squad, you will work across the whole system - Go services and agents on the backend, a TypeScript/React application on the frontend and you’ll be expected to reason about it as one system, not two halves
• Own features end-to-end across the stack: from API and data model design in Go, through the execution pipeline, to the user-facing workflows in TypeScript/React
• Design and evolve systems, not just features: contribute to architectural decisions on scheduling, probe lifecycle, telemetry ingestion, and API design that shape how the product scales
• Build the cross-product and AI-assisted workflows that connect Synthetic Monitoring to the wider Grafana Cloud platform
• Make the product operable at enterprise scale: the governance and organization primitives that let teams with hundreds of checks manage Synthetic Monitoring as code and with confidence
• Break down complex, ambiguous problems into incremental deliverables and iterate quickly based on feedback
• Ensure quality through testing, observability of your own systems, and documentation: our checks are something customers alert on, so reliability is a feature
• Be a part of the team’s on-call rotation and take ownership of the services you’re running
• Technologies you’ll work with:
• Go (backend services, APIs, and the synthetic monitoring agent)
• TypeScript / React (the Synthetic Monitoring app in Grafana)
• Kubernetes across AWS, GCP, and Azure
• K6 (the execution engine behind scripted and browser checks)
• Grafana ecosystem (Mimir, Loki, Prometheus)

Benefits

• Vacation: Balance is key. Our team enjoys 30 days of paid vacation each year on top of national holidays, parental leave, and sick leave. We also take a breather on a number of Grafana Shutdown Days each year
• Healthcare: We’re proud to provide health coverage or stipends for our colleagues in the US, UK, Canada, the Netherlands, Sweden, Singapore, and India
• Retirement planning: There’s no time like the present to start saving for your future. We make employer contributions into the pension pots of our team members in the US, UK, Canada, the Netherlands, Sweden, and Germany
• Professional development: On top of a $1,500 annual learning and development stipend, Grafanistas have thousands of on-demand courses at their fingertips to help them grow professionally. Want to attend a conference or training? Go ahead. Just pass on what you learned
• Work location: Vast majority of our roles are fully remote, focused on hiring the best talent and allowing you to perform from the comfort of your home. If you fancy a change of scene, we’ll also reimburse you up to $175 a month for a personal co-working space
• Choice of tech: There’s no one-size-fits-all when it comes to the tech required to do your job. Choose the laptop and accessories you need when you join us, and we’ll refresh them every three years
• Mindfulness: When you join the team, you can sign up for a complimentary subscription to Headspace to take advantage of the benefits of mindfulness and meditation. Our wellbeing resource group also organize sessions run by fellow Grafanistas or external trainers
• Global Employee Assistance Program: We offer all team members a 100% confidential support service with 24/7 365 access to professionally qualified counsellors and specialists
• Paid parental leave: Grafana offers paid parental leave to all eligible new parents. This offers Grafanistas time to bond with and care for their children in the first year after birth or adoption- For us, working together means being collaborative, friendly, kind, and respectful. We operate by consensus. You can contribute to a discussion, disagree constructively, and commit to the team’s decision. You are able to communicate design decisions clearly in written and spoken English
• Pragmatism and short feedback loops. You break complex problems into increments: analyze, design, deliver an MVP, learn, iterate. You are able to design a solution, get feedback, and write a prototype by yourself - the ability to work on your own is crucial
• You use AI tools as a natural part of your engineering workflow - whether for accelerating exploration, code review, or reasoning through design tradeoffs - and you’re thoughtful about where they help and where they don’t
• You are comfortable working in a remote-first company; communication is key
• You have a good understanding of a software development process that takes a user-centered approach. You easily build an understanding of the users’ context and goals which will help you build the right solution with the maximum value
• You are a systems thinker: you reason about how components interact - data flow, failure modes, cost, and operational behavior - not just how a single feature works in isolation
• Operational mindset. You’ve run what you’ve built: you’ve owned production services, understand what it means to carry a pager, and treat reliability and toil reduction as part of the product
• Strong Go, or a path to it. We build Synthetic Monitoring in Go. Deep experience building and operating production backend systems in another systems language (Rust, Java, C++) translates well; backend experience limited to JavaScript/Node.js runtimes does not
• Experience designing or operating multi-tenant SaaS systems at scale
• Experience with observability tools (Grafana, Datadog, New Relic, Sentry, etc.)
• Experience with Kubernetes in a production environment
• Familiarity with k6, Playwright, or browser automation at scale
• Experience contributing to or maintaining open source projects