Senior Data Engineer

For our client, we are seeking a Senior Data Engineer to join the team of a leader in the Information Technology space. This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will partner with business, technical, and operational stakeholders to build reporting, surface trends, and translate analysis into action. The position offers the opportunity to strengthen data-driven execution and help teams focus on the metrics that matter most within a technology-driven environment. Location: Remote - US based candidates only, no visa sponsorship available Compensation: $120,000 – $150,000 annually Responsibilities Build and maintain scalable data pipelines on Databricks Design and deploy AI solutions using Databricks and Spark Develop batch and streaming pipelines with Azure Data Factory Create logical data flow diagrams and implement Lakehouse patterns Ensure data integrity and security across the data lifecycle Optimize Spark jobs for efficiency in data processing Monitor and troubleshoot pipeline execution and failures Collaborate with teams to deliver data solutions Qualifications 5+ years of experience with Databricks for data solutions Proficiency in Python (including PySpark) and SQL Hands-on experience with Spark and Delta Lake Knowledge of data quality and governance practices Familiarity with machine learning tools such as TensorFlow and Scikit-learn is advantageous Experience integrating external AI models Skills in asynchronous programming patterns for scalable workloads Strong problem-solving and collaboration abilities Benefits Commitment to fostering an equitable and respectful hiring process Encouragement of an AI-friendly culture that values curiosity and learning Opportunities for professional growth in AI and data technologies Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.