Staff Software Engineer, Reliability - Command|Alert
About Command|Link
Command|Link is a global SaaS Platform providing network, voice services, and IT security solutions, helping corporations consolidate their core infrastructure into a single vendor and layering on a proprietary single pane of glass platform. Command|Link has revolutionized the IT industry by tackling the problems our competitors create. In recognition for our unprecedented innovation and dedication, Command|Link was recognized as the SD-WAN Product of the Year, ITSM Visionary Spotlight, UCaaS Product of the Year, NaaS Product of the Year, Supplier of the Year, and the AT&T Strategic Growth Partner. Command|Link has built the only IT platform for scale that solves ISP vendor sprawl and IT headaches. We make it easy for our customers to get more done, maximize uptime and improve the bottom line.
Learn more about us here!
This is a 100% remote position
About your new role:
Command|Alert is CommandLink 's signal-processing core, the engine that turns raw security, monitoring, and customer-defined telemetry into alerts customers actually trust. Alert fatigue and noise are the top complaint across every competitor in this space, and this role exists to make sure our alerts are the ones people don't tune out.
As a Staff Software Engineer on Command|Alert, you'll own the reliability of the alerting pipeline end to end and drive the org's most consequential decisions on how it's architected. This role suits someone who thinks like a site reliability engineer as much as a software engineer: fluent in SLOs, error budgets, and blameless incident response, with the technical range to reason across security tooling, monitoring telemetry, syslog, OpenTelemetry, and L2-L4 network protocols.
Key Responsibilities:
- Own the reliability of the alerting pipeline end to end, from OpenSearch alert evaluation through Kafka delivery via OpenSearch callbacks to downstream notification, including idempotency guarantees and soak-tested behavior under sustained load.
- Define SLOs and SLIs for the pipeline's availability, latency, and delivery guarantees, and use error budgets to guide how much investment goes into reliability work versus new capability.
- Lead incident response for the pipeline's most critical production issues, running blameless post-mortems and driving the systemic fixes and automation that come out of them.
- Build the observability and automation needed to run the pipeline at Fortune 1000 scale with low operational toil, and own capacity planning as ingestion volume and customer count grow.
- Set the architecture for how Command|Alert evaluates rule-based thresholds, ML anomaly scores, and correlation logic, turning diverse telemetry into usable network and system topologies that power LLM-driven investigation and remediation.
- Mentor engineers across the teams you touch and represent Command|Alert's technical direction to stakeholders outside engineering.
- Takes on additional responsibilities and projects as needed to support the success of the team and organization.
What you'll need for success:
Required
- Background operating as a Site Reliability Engineer, DevOps engineer, or in a similar production-ownership role, with fluency in SLOs, SLIs, error budgets, and blameless incident response.
- Demonstrated experience designing, building, or operating high-reliability alerting or notification systems in production, including rule-based and ML-based detection at scale.
- Strong Kafka experience, and a track record building systems where webhook reliability, idempotency, and delivery guarantees under load are non-negotiable.
- Experience building the observability and automation that let a high-volume production system run with low operational toil.
- A working command of telemetry and protocol data (security tooling output, syslog, OpenTelemetry, NetFlow/sFlow, SNMP, ICMP, firewall logs) and the ability to turn it into real network and system topologies.
- Recognized mastery of Go
This role requires you to be in the Philippines. If that means relocating or flying in, it is worth checking fares before you commit to a start date.
Compare flights and hotels →Get remote developer jobs like this by email
10 hand-picked jobs, one email a day. No spam, unsubscribe anytime.
Similar for you
Get 10 hand-picked remote jobs like this one in your inbox every morning. One email a day, matched to what you browse. No spam, one-click unsubscribe.
No thanks — continue to the application ↗