Staff Software Engineer, DevProd (Infrastructure Observability)

<div class="content-intro"><h3><strong>About Us</strong></h3> <div>Temporal is an open source programming model that can simplify code, make applications more reliable, and help developers focus on the important things like delivering features faster. We are on a mission to be the reliable foundation of every developer’s toolbox, and are building the team that will make that happen.</div> <div>&nbsp;</div> <div>Our values guide us —they are present in how we show up, make decisions, and work together to make an impact. We’re curious, driven, collaborative, genuine and humble.</div> <div>&nbsp;</div> <div>Temporal is growing and we are looking for those who share our values, challenge 'standard' thinking, and want to influence our future. If you have a passion for improving the developer experience, building world-class open-source software and communities, and want to be a part of our amazing team, we'd love to hear from you!</div></div><div> <h3><span style="font-size: 12pt;"><strong>Summary</strong></span></h3> <p><span style="font-size: 10pt;">We have an opening for a <strong>Staff Software Engineer</strong> on our <strong>Infrastructure Team, with specific focus on Observability - both internal and customer-facing</strong>. This is an opportunity to join a mission-critical engineering team that is driving the productivity and reliability of Temporal’s developers and<strong> </strong>core platforms, respectively. We are a passionate team of talented developers who truly care about our mission and enjoy working deeply across the entire Temporal ecosystem to be a force multiplier across the organization.</span></p> <p><span style="font-size: 12pt;"><strong>What You'll Do</strong></span></p> <p><strong>Build:</strong></p> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Lead the end-to-end Software Development Lifecycle: goals &amp; requirements solicitation, design &amp; review, implementation, operationalization &amp; deployment, support &amp; maintenance.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Lead feature design, review with stakeholders, iterate to incorporate feedback and drive consensus.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Clearly document design choices and operational knowledge to successfully deploy and manage the software you develop.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Provide appropriate test and production readiness coverage for unit, integration, and performance of your feature ownership area.</span></li> </ul> <p><strong>Own:</strong></p> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Set a high bar for technical excellence and take pride in the software you develop.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Design and build multi-component, distributed systems that operate at scale.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Investigate issues with a methodical approach to identify a root cause.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Understand performance and reliability implications of design options at scale. Make related tradeoffs.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Participate in the team’s on-call rotation.</span></li> </ul> <p><strong>Learn:</strong></p> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Expert-level knowledge of architecture and services of assigned domain. Strong command over all aspects of the Temporal ecosystem. This role provides a strong opportunity for diverse technical exposure!</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Investigate and understand ways to best leverage Temporal’s own software to power our mission.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Deeply understand the needs of Temporal internal developers and external customers, and leverage that knowledge for product development and feature design.</span></li> </ul> <p><strong>Collaborate:</strong></p> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Lead and mentor fellow team members.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Participate in design reviews and contribute to design of other features.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Share design principles for building reliable systems at scale.</span></li> </ul> <p><span style="font-size: 12pt;"><strong>What You'll Bring</strong></span></p> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">User-first mindset. You’re excited by the opportunity to empower others through tooling, and enjoy deeply internalizing user goals and use cases to build effective solutions.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Motivated by impact. You are driven by a desire to make positive things happen.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Strong opinions about tools and technology that are equally balanced by a pragmatic drive for impact.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Ability to work in a self-directed manner in a fast-paced environment.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Excellent collaboration and communication skills.</span></li> </ul> <p><strong>Skills &amp; Technologies</strong></p> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Demonstrated ability to develop horizontally scalable, resilient, and high performance distributed systems in a production environment.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Experience designing, implementing, deploying, and supporting large scale, geographically distributed observability and/or high throughput data streaming/processing pipelines, or similar.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Expert in one or more high-level programming languages, preferably Go.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Expert-level Kubernetes skills.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Expert-level query development skills, preferably SQL.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Hands-on experience with one or more cloud providers, preferably AWS, or GCP.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Thorough understanding of computer architecture, operating systems, and networking.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Familiarity with best practices regarding monitoring, instrumenting, and configuring infrastructure.</span></li> </ul> <p><span style="font-size: 12pt;"><strong>Team Highlights</strong></span></p> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Core observability tech stack: Clickhouse, Prometheus, Grafana, Loki, Thanos, Kubernetes, <strong>Temporal.</strong></span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">Our recent observability project had the biggest impact to Temporal margins of any engineering effort in company history while also unlocking unprecedented operator capabilities.&nbsp;</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;">“Observability is the beating heart of our ability to deliver a mission critical service” -Preeti Somal, Senior VP of Engineering.</span></li> </ul> </div> <div> <h3><strong>Compensation</strong></h3> </div> <div> <ul> <li style="font-size: 10pt;"><span style="font-size: 10pt;">The estimated pay range for this role is $212,000 - $286,200 depending on qualifications and location.</span></li> <li style="font-size: 10pt;"><span style="font-size: 10pt;&quot