Staff Software Engineer , Anywhere Cloud - AI Systems & Runtimes

For our client, we are seeking a Staff Software Engineer Anywhere Cloud - AI Systems & Runtimes to join the team of a leader in the Information Technology space. This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will work across engineering, product, operations, and business stakeholders to translate complex requirements into practical technology solutions. The position offers the opportunity to influence architecture, execution quality, and the technology capabilities that enable long-term growth within a technology-driven environment. Location: Remote - US based candidates only, no visa sponsorship available Compensation: $130,000 – $160,000 annually Responsibilities Design and implement scalable application services that wrap AI capabilities for enterprise use Lead the deployment of inference servers using Kubernetes tools for serverless-style scaling of AI workloads Build internal tooling, SDKs, and AI Gateways to enhance team agility in integrating Foundation Models into products Architect robust Retrieval-Augmented Generation pipelines and integrate them with data sources Collaborate with UI engineers, UX designers, and Product Management to ensure usability of the AI platform Ensure AI workloads are secure, multi-tenant, and optimized for GPU resource scheduling Qualifications Bachelor's degree with 6+ years of software engineering experience (or equivalent Masters/PhD tenure), with at least 2+ years focused on AI/ML systems Expert proficiency in Python and strong competence in a systems language like Go or Rust/C++ Deep understanding of LLM deployment challenges and runtimes (e.g., vLLM, ONNX, TorchServe, Triton) Experience building complex workflows using tools like LangChain or LlamaIndex, and deploying them on containerized infrastructure Ability to navigate the rapidly changing AI landscape, filtering hype from practical engineering solutions Benefits Generous PTO Policy Support work life balance with Unplugged Days Flexible WFH Policy Mental & Physical Wellness programs Phone and Internet Reimbursement program Access to Continued Career Development Comprehensive Benefits and Competitive Packages Paid Volunteer Time Employee Resource Groups Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.