About the Role
Title: Senior Data Engineer (ETL) – SkySail
Location: Brookfield United States
Job Category: Information Technology
Requisition Number: SENIO009424
Job Type: Full Time/Remote
Job Description:
Milliman SkySail is seeking a Senior Data Engineer to join our team. In this role, you will manage and maintain ETL pipelines, ensuring the smooth ingestion and transformation of data ultimately destined for Databricks. You will primarily work with Python, Bash and SQL, using AWS services like EC2 and S3. Databricks familiarity is a plus but not required.
Who We Are
Milliman SkySail is a consulting and software-as-a-service (SaaS) unit of Milliman, specializing in pharmacy claims analysis and reporting. Established in 2015 and acquired by Milliman in 2021, we have rapidly grown into a team of around fifty experts focused on pharmaceutical claims analysis, data engineering, and application development.
Job Responsibilities
What You’ll Do as a Senior Data Engineer at Milliman SkySail
- Collaborate: Work closely with key stakeholders and the rest of the data platform team to ensure data pipelines meet business requirements.
- Develop and Maintain ETL Pipelines: Design, develop, and manage robust ETL processes to efficiently ingest and transform data into Databricks.
- Automation and Optimization: Write and maintain scripts in Bash and Python to automate data workflows, optimize performance, and ensure reliability.
- Deploy and manage data pipelines in production: Deploy ETL workflows into production environments, ensuring robust operation, monitoring performance, and promptly addressing any pipeline issues to maintain reliability and stability.
- Troubleshooting and Support: Proactively monitor ETL processes, troubleshoot issues, and support timely resolution of data pipeline challenges.
- Client Engagement: Participate in client meetings and calls related to ETL requirements, providing clear communication and technical expertise.
- On-Call Availability: Participate in an on-call rotation to support ETL processes.
Minimum requirements
- 5+ years of relevant experience in data engineering or related roles.
- Proficiency in Python scripting and Bash.
- Strong SQL skills for data querying, manipulation, and validation.
- Familiarity with AWS infrastructure, specifically EC2 and S3.
Competencies and Behaviors that Support Success in this Role
- Familiarity with Databricks or similar big data platforms.
- Familiarity with DevOps best practices for ETL processes.
- Experience in healthcare data or pharmaceutical claims processing.
- Strong problem-solving abilities and attention to detail.
- Excellent written and verbal communication skills.
Individual(s) must be legally authorized to work in the United States without the need for immigration support or sponsorship from Milliman now or in the future.