AI Engineer

About the Role

We're looking for an AI Engineer to design, build, and scale the systems that power our AI-driven product. You'll work at the intersection of large language models, multi-agent systems, and production software, turning cutting-edge AI capabilities into reliable, user-facing experiences.
What You'll Do

- Design and implement LLM-powered pipelines, including prompt engineering, context management, and response synthesis

- Build and optimize multi-agent orchestration systems where AI components interact, reason, and produce coherent outputs

- Develop and maintain integrations with foundation model APIs (Anthropic, OpenAI, and others), managing latency, cost, and reliability at scale

- Implement retrieval-augmented generation (RAG) and memory systems for persistent, context-aware behavior

- Partner with the Evaluation/QA Engineer to build frameworks that measure output quality, coherence, and factual grounding

- Collaborate with product and design to translate workflows into robust technical experiences

- Ship production features across the stack, from the model layer to the application

Monitor, debug, and improve system performance, token efficiency, and guardrails

- 3+ years of software engineering experience, with hands-on work building LLM-powered applications

- Strong proficiency in Python and/or TypeScript/JavaScript

- Experience with LLM APIs, prompt engineering, and agentic frameworks (e.g., LangChain, LlamaIndex, or custom orchestration)

- Familiarity with vector databases and RAG architectures (Pinecone, Weaviate, pgvector, etc.)

- Understanding of multi-agent systems, tool use, and function calling

- Experience designing evaluation and testing strategies for non-deterministic AI outputs

- Solid grasp of API design, async processing, and scalable backend architecture

- Comfort working in a fast-moving, ambiguous, early-stage environment

- Experience with real-time streaming (WebSockets, SSE) for conversational interfaces

- Background in fine-tuning, model distillation, or inference optimization

- Familiarity with cloud infrastructure (AWS/GCP/Azure) and CI/CD

- Contributions to open-source AI projects

Originally posted on Himalayas