Lead Data Engineer
Target Salary: $130,000 – $140,000 per year
Join a dynamic organization dedicated to innovation and growth in the plasma donation industry. As a Lead Data Engineer, you will play a vital role in designing and optimizing scalable data pipelines that drive data-driven decisions and enhance operational efficiency. This position offers the opportunity to lead technical projects, mentor team members, and influence the future of data management within the company—without revealing specific locations or brands.
What You’ll Do
- Lead the design, development, and optimization of scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake
- Enhance CI/CD pipelines through Azure DevOps, Git, and automation frameworks to improve development and deployment processes
- Ensure data quality, consistency, and security through best practices in data integration, transformation, and governance using Unity Catalog, Azure RBAC, and managed identities
- Lead and mentor a team of data engineers, promoting best practices and technical growth
- Collaborate with stakeholders to translate data needs into technical solutions and participate in resolving complex data issues
- Support on-call responsibilities and assist with after-hours troubleshooting as needed
Top 5 Required Skills
- Expertise in Azure Databricks, PySpark, and SQL
- Proven experience in designing and managing scalable data pipelines and ETL/ELT workflows
- Strong knowledge of CI/CD processes, Azure DevOps, and automation frameworks
- Excellent communication and leadership skills, with team-leading experience considered a big plus
- Data security and governance knowledge, including Unity Catalog and Azure RBAC
Top 5 Nice to Have Skills
- Experience with Python for data manipulation and automation projects
- Knowledge of Delta Lake architecture and data management best practices
- Familiarity with Terraform for infrastructure as code
- Experience with Power BI, MicroStrategy, or similar BI tools
- Certifications such as Databricks Data Engineer Professional or Associate
Preferred Education and Experience
- Bachelor’s degree in Computer Science, Information Systems, or a related field
- Minimum of 3 years of experience with Azure Databricks
- At least 5 years in data warehouse analysis, design, and ETL/ELT development
- Extensive experience with data modeling, operational data stores, and data governance
Other Requirements
- Ability to work onsite at our corporate location in Charlotte, NC
- Capable of sitting, standing, and lifting up to 20 pounds occasionally
- Excellent verbal and written communication skills
- Willing to travel up to 20% for business needs
- Ability to use assistive devices, if necessary, for mobility or communication
Seize the opportunity to elevate your career with a forward-thinking company where your expertise makes a difference. Apply now to become a key contributor to our innovative data solutions.
Associate Staffing is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment based on race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other protected status under applicable law. We are committed to creating a diverse and inclusive work environment and welcome applicants from all backgrounds to apply for open positions with our company.