161 Sr. Data Engineer Jobs in Milwaukee, WI
Sorry! This job is no longer available. Please explore similar jobs listed on the left.
Carex Consulting Group is Hiring a Sr. Data Engineer Near Milwaukee, WI
Carex Consulting Group is partnering with one of our financial services partners to find a Senior Data Engineer. We are seeking a skilled Data Engineer who will play a critical role in shaping our data infrastructure, ensuring the availability, reliability, and performance of our data systems.
Job Responsibilities:
- Data Pipeline Development: Build and expand existing DRR processing in Snowflake to include Commercial loans.
- Data Migration: Create and deliver three one-time data migration files and two batch recurring import files.
- Data Integration: Support the development and delivery of a standard data extract file from systems to DRR, and modify Snowflake to handle data.
- Documentation: Develop technical documentation for Phase 2 of the project.
- Pipeline Design: Design, develop, test, and deploy data ingestion methods and pipelines for both streaming and batch processing across various data domains using programming languages, application integration software, messaging technologies, REST APIs, and ETL/ELT tools.
- Data Quality: Ensure high-throughput, low-latency, and fault-tolerant data pipelines, applying best practices in data mapping, code development, error handling, and automation.
- Architecture: Develop and maintain data pipeline architecture for both structured and big data in on-premises and cloud environments.
- ETL/ELT Automation: Automate ETL/ELT code using scripting languages and ETL tools to support reporting and analytical needs.
- DataOps: Implement DataOps best practices for data orchestration, tools, environments, and code.
- Data Modeling: Design and build dimensional data models to support data warehouse initiatives.
- Process Improvement: Identify and implement internal process improvements, including automation of manual processes and optimization of data pipeline performance.
- Requirements Gathering: Participate in sessions to translate business requests into technical requirements.
- Collaboration: Work with business partners to optimize and scale enterprise analytics.
- Required: Bachelor’s Degree in Computer Science, Information Technology, Engineering, or a related field.
- Preferred: Master’s Degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience: 3-5 years of data engineering experience with ETL or ELT patterns, and related technologies.
- Technical Skills: 1-2 years of experience with cloud platforms (AWS, Azure, GCP, Snowflake) and proficiency in Python programming or SQL coding.
- Database Knowledge: Understanding of relational, columnar, and NoSQL databases and best practices for development.
- Data Modeling: Experience in dimensional data modeling for data warehouses.
- Infrastructure: Familiarity with Infrastructure as Code (IAC) tools such as Terraform.
- Big Data Technologies: Experience with big data streaming technologies such as Kafka, and data formats like XML/JSON.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to thrive in a fast-paced, dynamic environment.
- Attention to detail and commitment to data quality.
Job Summary
Full Time
Business Services
$114k-141k (estimate)
08/26/2024
09/01/2024
carexconsultinggroup.com
Madison, WV
50 - 100
Business Services
Related Companies
The job skills required for Sr. Data Engineer include SQL, Python, Data Engineering, AWS, Big Data, Data Warehouse, etc. Having related job skills and expertise will give you an advantage when applying to be a Sr. Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Sr. Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Sr. Data Engineer positions, which can be used as a reference in future career path planning. As a Sr. Data Engineer, it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Sr. Data Engineer. You can explore the career advancement for a Sr. Data Engineer below and select your interested title to get hiring information.
Similar Jobs
Popular Articles
