Sr Engineer (Backend)

We are looking for a mid to senior level API Platform Engineer.

In this role, youll architect and scale the foundation that powers delightful developer experiences and production-grade AI systems. You'll work at the intersection of high-performance APIs, scalable infrastructure, and cutting-edge machine learningdelivering tools that enable developers and partners to build on top of Menlos intelligent platform.
Responsibilities

-
Design and build the Menlo API Platform , focusing on high reliability, performance, and a world-class developer experience

-
Develop intuitive APIs and SDKs that make it easy for developers to access and integrate multimodal AI capabilities

-
Deploy and optimize AI/ML models into scalable, production environments, working closely with research and applied ML teams

-
Manage and evolve a modern, cloud-native infrastructure stack , using Kubernetes, Docker, and infrastructure-as-code (IaC) tools

-
Ensure platform reliability , including designing and implementing telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery mechanisms

-
Contribute to developer and operations workflows , including CI/CD pipelines, release management, and on-call rotations

-
Collaborate across teams to implement secure APIs with fine-grained access control, usage metering, and billing integration

-
Continuously improve platform performance , cost-efficiency, and observability as we scale to serve millions of users worldwide

Requirements

-
3+ years of experience building and operating large-scale, production systems with real-world usage and uptime expectations

- Strong experience with containerization and orchestration : Kubernetes, Docker, Helm, and service mesh technologies (e.g., Istio or Linkerd)

- Proficiency with cloud platforms : AWS, GCP, or Azure including experience with IAM, networking, and serverless tooling

- Hands-on coding skills in Python and JavaScript/TypeScript , with familiarity in backend frameworks (e.g., FastAPI, Express)

- Deep knowledge of API architecture and design patterns: WebRTC/Websockets, REST, gRPC, OpenAPI/Swagger, authentication (OAuth2, API keys), and versioning

- Experience with databases : PostgreSQL, Redis, and modern vector databases (e.g., Pinecone, Weaviate, FAISS)

- Familiarity with CI/CD pipelines , GitOps practices, and tools like GitHub Actions, Argo CD, or Jenkins

- Comfortable with monitoring and observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry

Bonus Experience

- Experience with MLOps tools and AI workflows: model versioning, inference pipelines, model registries, etc.

- Understanding of access control systems : ACLs, RBAC, multi-tenant security and isolation

- Knowledge of billing systems , rate limiting, chargeback models, quota enforcement, and usage metering

- Prior experience working on developer platforms or API products with a strong focus on UX and documentation

Originally posted on Himalayas