IT Infrastructure Support Site Reliability Engineer II

About the Job

We are seeking an experienced Infra Automation Engineer to join our IT Infrastructure Support team, responsible for ensuring the reliability, scalability, and performance of critical physical security infrastructure, including IP camera fleets, access control systems, and a large-scale Cisco switch fleet, and the servers, network, and cloud environment that support them. In this role, you will combine software engineering expertise with operations knowledge to build and maintain automation tools, a centralized CMDB, monitoring systems, and processes that support enterprise-grade server, network, and security device management within a large-scale, cloud-hosted enterprise environment. You will work closely with cross-functional teams to define and enforce service level objectives, reduce operational toil through automation, and drive continuous improvement in system resilience. This position requires 24x5 availability with on-call rotation to ensure uninterrupted support for mission-critical infrastructure.
Key Responsibilities

Partner with leadership to establish, monitor, and enforce Service Level Indicators (SLIs) and Service Level Objectives (SLOs) for infrastructure tooling, including configuration compliance rates, patch success rates, and deployment latency metrics.

Provide Level 3 expertise for tooling-specific incidents, focusing on automating incident remediation workflows and reducing Mean Time To Repair (MTTR) through intelligent automation and runbook development.

Identify and automate repetitive manual tasks across managed infrastructure, targeting measurable reductions in operational overhead (e.g., 50% reduction in manual server build time) through scripting and workflow automation.

Conduct thorough root cause analysis and lead blameless postmortems for all major service-impacting incidents, driving systemic improvements in tooling reliability and infrastructure resilience.

Engineer and maintain automated processes and scripts to populate, update, and synchronize asset management platforms (e.g., NetBox), configuration management databases, and monitoring systems for internal and external stakeholders.

Design, develop, and deploy full-stack applications, custom plugins, and automation scripts to extend functionality of management and monitoring systems, enabling direct device interaction for configuration management.

Develop and maintain fully automated Infrastructure-as-Code configurations for Windows and Linux server roles using tools such as Ansible, Terraform, or Puppet, including drift detection and auto-remediation capabilities.

Build end-to-end automation pipelines for vulnerability patching, security baseline enforcement (CIS benchmarks), and continuous compliance auditing against internal and regulatory standards for physical security devices.

Develop API-driven tools for network configuration management, automated firmware updates, zero-touch provisioning, pre/post-change validation, and real-time network health monitoring across the device fleet.

Deploy and standardize monitoring agents, centralized log collection systems, and custom dashboards with alerts based on critical SLIs (latency, error rate, saturation, traffic) for servers and edge devices.

Build and maintain custom monitoring exporters for the physical security device fleet, including camera systems, ensuring accurate metrics and structured, multi-severity logging output.

Build diagnostic tooling to correlate timestamps across distributed log streams and detect clock drift or NTP desync, a recurring root cause of false-positive outages across the device fleet.

Build automation scripts for intelligent ticket handling, problem validation, and escalation workflows within enterprise ticketing systems, ensuring 2-hour initial response SLAs are consistently met.

Support foundational security improvements across the device fleet, including managed credential/access controls and automated configuration