Search Jobs
Lead Data Engineer
Job Description
- Contract Duration:Â 6 months
- Worksite Location:Â Brooklyn Park, MNÂ | Hybrid or remote
- Compensation: $60.00-$90.00 per hour
- Design, build, and maintain large-scale, cloud-based data pipelines using Python, PySpark, and Scala
- Optimize Spark performance for distributed processing in cloud environments (preferably GCP)
- Develop production-ready workflows using orchestration tools like Kubeflow Pipelines (KFP) or Airflow
- Collaborate with data scientists, machine learning engineers, and product teams to support experimentation and model deployment
- Manage containerized applications using Docker and integrate them into CI/CD pipelines
- Ensure software quality through testing, version control, and documentation
- Contribute to robust, scalable, and secure data infrastructure that powers personalization and recommendation systems
- Bachelor’s degree in Computer Science, Engineering, or related field or equivalent experience
- 5+ years of experience in data engineering, with strong expertise in Python, PySpark, and/or Scala
- Deep knowledge of distributed systems and big data technologies
- Hands-on experience with Spark performance tuning in cloud environments (GCP preferred)
- Experience with workflow orchestration tools such as Airflow or Kubeflow Pipelines
- Proficiency in containerization using Docker and deployment through CI/CD pipelines
- Proven ability to build scalable, maintainable, and secure data pipelines
- Strong communication skills and the ability to collaborate across technical and product teams
As an equal opportunity employer, Dahl Consulting welcomes candidates of all backgrounds and experiences to apply. If this position sounds like the right opportunity for you, we encourage you to take the next step and connect with us. We look forward to meeting you!
Dahl Consulting is proud to offer a comprehensive benefits package to eligible employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review the DAHL Benefits Summary: https://www.dahlconsulting.com/benefits-w2fta/
Dahl Consulting is proud to offer a comprehensive benefits package to eligible contract employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review our Benefits Summary: www.dahlconsulting.com/benefits-w2fta.
Dahl Consulting is an Equal Opportunity Employer and does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or other applicable legally protected characteristics.
Review DAHL & earn up to $100 | www.dahlconsulting.com/review-us
Refer a friend for rewards | www.dahlconsulting.com/careers/refer-a-friend
Share This Job:
Related Jobs:
About Brooklyn Park, MN
Are you sure you want to apply for this job?
Please take a moment to verify your personal information and resume are up-to-date before you apply.