Staff Software Engineer, AI

<h2><strong>This is Engineering at Lattice</strong></h2> <p>At Lattice, we build software that helps people and organizations thrive. Our AI Engineering team defines how intelligence works across our platform - how AI systems are measured, improved, and trusted in production.</p> <p>This Staff-level role shapes the foundations that determine AI quality, reliability, and impact at scale.</p> <h2><strong>What You Will Do</strong></h2> <p>You will architect and scale the infrastructure that powers AI quality, reliability, and reuse across Lattice.</p> <h3>AI Evaluation &amp; Quality</h3> <ul> <li>Design and scale an end-to-end AI evaluation framework spanning offline evals, production tracing, and human feedback loops.</li> <li>Define meaningful performance metrics (task completion, hallucination, response quality, engagement, business impact) and build the datasets and automated scoring systems that prevent regressions.</li> <li>Identify and quantify the drivers of agent quality improvement and set methodological standards for evaluation across the organization.</li> </ul> <h3>Agent Architecture &amp; Production Systems</h3> <ul> <li>Architect reusable agent infrastructure (multi-turn workflows, LLM DAGs, recommendation systems, standardized topologies) using LangGraph or comparable frameworks.</li> <li>Build and scale RAG pipelines, vector retrieval systems, and production-grade AI infrastructure with strong reliability, observability, and performance.</li> <li>Make principled build-vs-buy decisions across LLM providers, agent frameworks, and evaluation tooling, balancing capability, cost, latency, and risk.</li> <li>Engineer AI systems as reusable internal platforms that multiply product engineering velocity at Lattice.</li> </ul> <h3>Technical Leadership</h3> <ul> <li>Own projects end-to-end: scope, design, execution, and delivery.</li> <li>Set technical direction for agent quality and evaluation strategy across Lattice engineering teams.</li> <li>Lead rigorous discussions on AI system design and evaluation methodology.</li> <li>Raise the AI engineering bar through mentorship, code review, and clear technical communication across engineering and leadership.</li> </ul> <h2><strong>What You Will Bring to the Table</strong></h2> <h3>Experience</h3> <ul> <li>8+ years of professional experience writing and maintaining production-level code, with 5+ years in designing, delivering, and operating AI/ML systems in production.</li> <li>Deep production experience with LLM systems (prompting, RAG, agent orchestration, evaluation frameworks, fine-tuning).</li> <li>Experience building and operating agentic systems (multi-step workflows, multi-agent topologies) and managing their failure modes.</li> <li>Strong command of AI evaluation methodology and statistical experimentation.</li> <li>Strong system design judgment across scalability, latency, accuracy, reliability, and cost.</li> </ul> <h3>Technical Skills</h3> <ul> <li>Production-grade Python (clean, maintainable, testable systems).</li> <li>Experience with LangGraph (or comparable agent orchestration frameworks) and LLM observability/evaluation tooling (e.g., LangSmith).</li> <li>Vector databases and retrieval system design (Pinecone or similar).</li> <li>Experience operating AI systems in AWS or comparable cloud environments, including CI/CD, monitoring, and deployment workflows.</li> <li>Familiarity with TypeScript is a plus.</li> <li>Actively engaged in AI research and industry trends.</li> </ul> <h3>Nice to Have</h3> <ul> <li>Experience with RLHF, LoRA, or other model adaptation techniques.</li> <li>Background in traditional ML and judgment in selecting ML vs. LLM approaches.</li> <li>Experience with MLOps tooling (MLflow, DataDog).</li> <li>Published research, talks, or open-source contributions in AI/ML.</li> <li>Experience in HR tech or other trust-sensitive domains.</li> </ul> <p><strong>Location Requirement:</strong><br>This role is open to candidates located in British Columbia or Ontario, Canada. At this time, we are only able to hire employees residing in these provinces.</p> <p>&nbsp;</p> <p><em data-stringify-type="italic">The estimated annual cash salary for this role is CAD $146,250 - CAD $195,000. This position is also eligible for incentive stock options, subject to the terms of Lattice’s applicable plans.&lt