Senior Data Engineer, AI and Systems Engineering

<h2>Role Description</h2> <p data-start="0" data-end="442">As a Senior Data Engineer on the CMDB and Asset Intelligence platform, you will help build the unified data foundation that powers asset visibility, cost optimization, and security insights across the company. You will design scalable pipelines and data models that bring together sources like ServiceNow, Okta, Oracle, and Jamf into a centralized lakehouse architecture, turning messy, multi-system data into trusted, decision-ready signals.</p> <p data-start="444" data-end="748" data-is-last-node="" data-is-only-node="">This role is a chance to raise the bar on data quality and governance while building systems that teams actually rely on day to day. You will partner closely with IT, Security, and Finance to define what “good” looks like, deliver high-impact solutions, and shape the long-term direction of the platform.</p> <div> <p><span class=" author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z95lz89zy6z71zz79zz84zz68zyz69zupz72zz79zcz69zz76zkz79zp1z66ztz67zxz71zz89zz86zz71z">Our Engineering Career Framework is </span><span class="attrlink url author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z95lz89zy6z71zz79zz84zz68zyz69zupz72zz79zcz69zz76zkz79zp1z66ztz67zxz71zz89zz86zz71z"><a class="attrlink" href="https://dropbox.github.io/dbx-career-framework/" target="_blank" data-target-href="https://dropbox.github.io/dbx-career-framework/"><u>viewable by anyone outside the company</u></a></span><span class=" author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z95lz89zy6z71zz79zz84zz68zyz69zupz72zz79zcz69zz76zkz79zp1z66ztz67zxz71zz89zz86zz71z"> and describes what’s expected for our engineers at each of our career levels. Check out our blog post on this topic and more </span><span class="attrlink url author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z95lz89zy6z71zz79zz84zz68zyz69zupz72zz79zcz69zz76zkz79zp1z66ztz67zxz71zz89zz86zz71z"><a class="attrlink" href="https://dropbox.tech/culture/sharing-our-engineering-career-framework-with-the-world" target="_blank" data-target-href="https://dropbox.tech/culture/sharing-our-engineering-career-framework-with-the-world">here</a></span><span class=" author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z95lz89zy6z71zz79zz84zz68zyz69zupz72zz79zcz69zz76zkz79zp1z66ztz67zxz71zz89zz86zz71z">.</span></p> </div> <h2>Responsibilities</h2> <ul> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Design and build scalable data pipelines using Databricks and Spark to ingest, transform, and unify data from multiple enterprise systems</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Develop and maintain medallion architecture</span> <span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc h-lparen">(Bronze,</span><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc"> Silver, Gold) data models to create reliable and performant</span> <span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc h-ldquo">“Golden</span><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc"> Record” datasets</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Implement data normalization, mapping, and entity resolution techniques</span> <span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc h-lparen">(e.g.,</span><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc"> fuzzy matching, XREF tables) to unify asset data across disparate systems</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Build data workflows to detect and surface Shadow IT across financial, identity, endpoint, and network signals and integrate results into CMDB systems</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Partner with IT, Security, Finance, Procurement, and GRC teams to define and enforce data standards for critical CMDB attributes</span> <span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc h-lparen">(e.g.,</span><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc"> ownership, approval status, lifecycle)</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Develop and maintain data integrations and APIs to synchronize curated datasets into operational systems such as ServiceNow and Jira Assets</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Monitor, troubleshoot, and improve data quality, reliability, and observability across the data platform</span></li> </ul> <p><span class="thread-348589118974529206372994 attrcomment attrcommentfirst thread-348589118974529206372994-first author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z95lz89zy6z71zz79zz84zz68zyz69zupz72zz79zcz69zz76zkz79zp1z66ztz67zxz71zz89zz86zz71z"><span class=" author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90z9z84zyz72zz70zz71zz72zhwl8r6xz85zr3z69z6z86zz78zz76zcfvdsgm4t">On-call work may be necessary occasionally to help address bugs, outages, or other operational issues, with the goal of maintaining a stable and high-quality experience for our customers.</span></span></p> <h2>Requirements</h2> <ul> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">9+ years of experience building and maintaining data pipelines and large-scale data platforms</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Strong experience with Databricks, Apache Spark, and SQL for distributed data processing and transformation</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2qowz80ziz76z0z75zz74zz85z1j4z66zoz85zz122zfz81zllz80zz69zdtandz89zz82z0sz77zc">Experience designing data models and architectures such as medallion architecture, data lakes, or lakehouse systems</span></li> <li><span class=" author-d-1gg9uz65z1iz85zgdz68zmqkz84zo2