AI Research Engineer, Inference

<p>Hudson River Trading (HRT) is seeking an AI Research Engineer (<strong>Inference</strong>) to join the HAIL team. HAIL (HRT AI Labs) is the team at HRT responsible for developing and maintaining our most powerful models, which are used by our trading teams to drive a significant fraction of our trading. We are building and deploying "foundation models for markets", that ingest and train on vast amounts of market and “alternative” data (such as language) to make predictions about future market state.</p> <p>As an <strong>inference</strong> research engineer on HAIL, you will have a general mandate to improve all aspects of large-scale model inference, including but not limited to GPU kernel development, novel inference devices like ASICs and FPGAs (both off-the-shelf and in-house), and data streaming. You will work closely with our researchers to co-design and improve our models, and shape the research agenda.</p> <p>We have a complex inference solution involving a variety of devices deployed around the world to meet a variety of trading needs. We are simultaneously pursuing multiple strategies and developing many model types with different purposes, and we are strongly incentivized to squeeze as much as we can out of our systems. Your work will be directly, clearly, and highly impactful on the business, and it will be challenging: this is a field with no easy or obvious solutions.</p> <p><strong>Qualifications</strong></p> <ul> <li>Strong engineering skills, especially any of: CUDA/Triton/Pallas/CuTe DSL kernel development, lower-level PyTorch/JAX/XLA development, CUDA Graphs, FPGA/ASIC experience</li> <li>Must have two or more years work experience building deep learning systems, for any domain: robotics, biology, chemistry, physics, audio, video, recommendations, etc.</li> <li>Experience translating methods between areas of application is highly valued</li> <li>LLM experience is valuable, but not necessary</li> <li>Finance experience is not required</li> </ul> <p>The estimated base salary range for this position is 250,000 to 300,000 USD per year (or local equivalent). The base pay offered may vary depending on multiple individualized factors, including location, job-related knowledge, skills, and experience. This role will also be eligible for discretionary performance-based bonuses and a competitive benefits package.</p><div class="content-conclusion"><p><strong>Culture</strong></p> <p><span data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Hudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading. \n\nAt HRT we come from a variety of disciplines: mathematics and computer science, physics, and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization - from trading, to business operations, to recruiting and beyond. Our culture celebrates great ideas whether they come from HRT veterans or new hires. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.\n\nFeel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.&quot;}" data-sheets-userformat="{&quot;2&quot;:13185,&quot;3&quot;:{&quot;1&quot;:0},&quot;10&quot;:1,&quot;11&quot;:4,&quot;12&quot;:0,&quot;15&quot;:&quot;IBM Plex Sans&quot;,&quot;16&quot;:11}" data-sheets-textstyleruns="{&quot;1&quot;:0}{&quot;1&quot;:328,&quot;2&quot;:{&quot;2&quot;:{&quot;1&quot;:2,&quot;2&quot;:16711935}}}{&quot;1&quot;:402}{&quot;1&quot;:917,&quot;2&quot;:{&quot;2&quot;:{&quot;1&quot;:2,&quot;2&quot;:16711935}}}{&quot;1&quot;:945}">Hudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading. <br><br><span style="font-weight: 400;">At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.</span><br><br>Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.</span></p> <p><em><span data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Hudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading. \n\nAt HRT we come from a variety of disciplines: mathematics and computer science, physics, and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization - from trading, to business operations, to recruiting and beyond. Our culture celebrates great ideas whether they come from HRT veterans or new hires. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.\n\nFeel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.&quot;}" data-sheets-userformat="{&quot;2&quot;:13185,&quot;3&quot;:{&quot;1&quot;:0},&quot;10&quot;:1,&quot;11&quot;:4,&quot;12&quot;:0,&quot;15&quot;:&quot;IBM Plex Sans&quot;,&quot;16&quot;:11}" data-sheets-textstyleruns="{&quot;1&quot;:0}{&quot;1&quot;:328,&quot;2&quot;:{&quot;2&quot;:{&quot;1&quot;:2,&quot;2&quot;:16711935}}}{&quot;1&quot;:402}{&