About the Role
Title: Senior Engineer Data Engineering
US Remote
Location: MO-Saint Louis
United States (Remote)
TRENDING
JOB DESCRIPTION
Job Description
We are seeking an accomplished Senior Data Engineer to join our Data Engineering & Data Warehouse team. As a Senior Data Engineer, you will be a key contributor to our data ecosystem, ensuring efficient data processing, robust pipelines, and seamless integration. Your expertise in Snowflake, IDMC, Airflow, Python, and extensive knowledge of Snowflake stored procedures will be invaluable.
Responsibilities:
- Design and Develop Data Pipelines:
- Collaborate with cross-functional teams to understand data requirements and architect scalable, reliable data pipelines.
- Implement ETL processes for data warehousing and analytics.
- Optimize data ingestion, transformation, and loading workflows.
- Snowflake Expertise:
- Configure and manage Snowflake accounts, warehouses, and databases.
- Design and implement Snowflake schemas (e.g., star schema, snowflake schema) for efficient querying.
- Leverage your years of experience with Snowflake stored procedures to enhance data processing and performance.
- IDMC (Integrated Data Management Console):
- Utilize IDMC for monitoring, managing, and troubleshooting data pipelines.
- Set up alerts, track job execution, and optimize resource utilization.
- Airflow Workflow Orchestration:
- Develop and maintain Airflow DAGs for scheduling and orchestrating ETL tasks.
- Monitor task execution, handle retries, and manage dependencies.
- Python Development:
- Write clean, efficient Python code for data processing, transformation, and automation.
- Leverage Python libraries (e.g., Pandas, NumPy) to manipulate data effectively.
- Nice-to-Have: SQL Server:
- Familiarity with SQL Server for legacy systems or hybrid environments.
- Ability to optimize SQL queries and troubleshoot performance issues.
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Minimum 5 years of experience as a Data Engineer, with a focus on Snowflake, IDMC, and Airflow.
- Proven expertise in Snowflake stored procedures.
- Strong understanding of data modeling, ETL principles, and data warehousing concepts.
- Excellent problem-solving skills and attention to detail.
- Effective communication and collaboration skills.