Senior Platform Data Engineer

For our client, we are seeking a Senior Platform Data Engineer to join the team of a leader in the Healthcare space. This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will partner with business, technical, and operational stakeholders to build reporting, surface trends, and translate analysis into action. The position offers the opportunity to strengthen data-driven execution and help teams focus on the metrics that matter most within a healthcare environment. Location: Remote - US based candidates only, no visa sponsorship available Compensation: $120,000 – $150,000 annually Responsibilities Stream real-time clinical data into Databricks for AI model consumption Curate shared clinical feature tables for multiple AI programs Own RAG Infrastructure for AI use in grounding large language model outputs Design document ingestion pipelines for clinical documents and guidelines Optimize chunking strategies for healthcare content Manage and tune embedding pipelines with clinical models Administer vector databases, including schema design and performance tuning Build retrieval pipelines to enhance search accuracy for AI agents Establish data quality gates for retrieval-augmented generation processes Monitor and analyze retrieval quality metrics to improve performance Qualifications 5+ years in data engineering with batch and streaming pipeline experience Expert-level skills in Databricks: Delta Live Tables, PySpark, Unity Catalog Hands-on experience in real-time data ingestion frameworks like Kafka or Spark Strong proficiency in SQL and Python for data transformation and feature engineering Experience managing Databricks workspaces including policies and access controls Familiarity with clinical data models and EHR sources preferred Knowledge of clinical data extraction from Epic systems is a plus Benefits Flexible work from home arrangement Regular employment status assures job stability Opportunity to work in a cutting-edge AI healthcare environment Contribution to significant clinical data initiatives Engagement with a diverse range of clinical data sources and architectures Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.