Lead Consultant Data Engineer
Skills
- 6+ years in data engineering with deep SQL, Python, and PySpark expertise.
- 2+ years hands-on experience with Databricks in cloud environments.
- Experience with Parquet, Delta Lake, HDInsight and big-data/distributed systems.
- Proficiency with Azure native services: Azure Data Factory, Synapse, Storage Accounts, Streaming Analytics, Azure Fabric.
- Strong CI/CD, infrastructure-as-code (Terraform), and Azure DevOps pipeline experience.
- Advanced Git knowledge, branching strategies, and collaborative development workflows.
- Experience designing secure, performant data lake and analytical platform architectures.
- Leadership and mentoring experience; strong communication across technical and non-technical stakeholders.
Responsibilities
- Lead design, development, and optimization of scalable data solutions (data lakes, warehouses, operational stores).
- Define and enforce data architecture strategies, governance, and quality frameworks.
- Oversee creation and automation of production data pipelines and platform components.
- Collaborate with architects, product owners, data scientists, and DevOps to align technical solutions with business needs.
- Research and evaluate emerging data technologies; produce proofs-of-concept when appropriate.
- Implement CI/CD, infrastructure-as-code, and observability best practices for data platforms.
- Develop risk mitigation and data recovery strategies; ensure secure integrations into client environments.
- Mentor and coach junior and senior engineers, driving technical growth and best practices adoption.
Education
- Bachelor’s degree in Computer Science, Engineering, Data Science, or related field, or equivalent professional experience.
- Relevant cloud or data platform certifications preferred (e.g., Databricks, Microsoft Azure).
Benefits
- Top-of-industry medical, dental, and vision plans with employer-contributed HSA options.
- Infertility coverage and orthodontia options.
- 8 weeks parental leave; 15 days paid vacation, 6 federal holidays, and 4 floating holidays.
- Bonus eligibility starting day one.
- TechEleX program: choice of Mac or PC and device replacement after 3 years (keep the old device).
- Annual internet reimbursement ($25/month).
- 3 days paid professional development + allowance for registration/certifications.
- Care.com membership with 3 emergency backup child/elder care days annually.
- Discounted pet insurance and mental health resources (Headspace, Talkspace).
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Senior leader responsible for defining and delivering procurement data and analytics strategy, roadmaps, and governance to drive digital transformation and measurable business value across AbbVie's procurement function.
Aptura AI is seeking U.S.-licensed Internal Medicine physicians to remotely apply clinical judgment to label, evaluate, and refine AI systems that support healthcare delivery.
Work with a growing data team at a high-velocity gaming startup to build reliable ETL/ELT pipelines, model datasets, and improve data accessibility across the business.
Lead the architecture and operation of Mistral's next-generation data infrastructure to scale compute and storage for large-scale model training and research.
Join Welo Data's U.S. talent community to receive invitations for flexible, remote annotation, evaluation, and prompt-creation projects that support the development of safer, more inclusive AI.
Excella exists to cultivate exceptional careers for Excellians by creating meaningful solutions for our clients. We help organizations use technology to transform big problems into lasting solutions. We believe great work is driven by experts wh...
1 jobs
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
