Senior/Staff Software Engineer, Search & Retrieval Infrastructure

Role Overview

We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era. You'll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications.
What You Will Do

Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation. Optimize latency, throughput and cost across large-scale inference and retrieval workloads.
Why It Might Be a Fit

This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. You'll have significant ownership across architecture, performance, and system reliability.
Requirements

- 6+ years of shipping production-grade backends for large-scale systems

- Experience building high-throughput indexing pipelines

- Direct experience in semantic search, vector databases, hybrid retrieval strategies, or with traditional search engines like Elastic or OpenSearch

- Experience with Retrieval-Augmented Generation (RAG) patterns

- Expertise in at least one major language like Go, Rust, C++, Java, or Python

- Familiarity and experience with modern infrastructure tools, such as Kubernetes, cloud-native architectures, and observability frameworks

Benefits

- Comprehensive health coverage

- 401(k) Plan

- Equity award

- Flexible time off

- Paid parental leave

- Annual Company Retreat

- WFH Equipment Stipend

Originally posted on Himalayas