Job Description

Pay Rate: $54 - $58/Hour

Lead Databricks Data Engineer

We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.

Key Responsibilities:

• Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.
• Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.
• Collaborate with Data Platform Architects and ML Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.
• Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.
• Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.
• Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.
• Implement secure and scalable data capture and ingestion workflows.
• Support data preparation, exploration, and visualization to facilitate data-driven decision-making.
• Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.

Qualifications:

• Bachelor’s degree in Computer Science, a technical field, or a related business discipline. Equivalent experience, certifications, or training will be considered. Master degree preferred
• 5+ years of experience in designing and delivering secure cloud solutions.
• 3+ years of experience with Databricks
• 2+ years of experience with Agile Methodology
• Strong problem-solving, analytical, and communication skills.

Job Tags

Similar Jobs