You haven't searched anything yet.
Lead Data Engineer
Location: Hybrid in Madison, WI
Schedule: Tues, Wed, Thurs onsite; Mon & Fri Remote
Duration: 6 month Contract with Possible Extension
What you will do:
• Guide and mentor engineering team(s) in all aspects of our SDLC
• Develop and maintain software to support a streaming data platform that powers an industry-leading healthcare CRM product
• Contribute towards software projects that use programming languages including Python, Scala, NodeJS, and SQL
• Work with a variety of data stores including traditional relational databases, NoSQL databases, and real-time messaging queue systems like Kafka
• Use SQL to analyze healthcare and marketing data sets
• Refactor and optimize our existing code base to improve efficiency and performance
• Respond to ad-hoc questions and assist our technical support team as necessary
• Ensure that our data pipelines are performant and scalable
• Ensure that our consumption layers and platform APIs meet the needs of end users
• Work collaboratively within a small team to design and implement creative solutions to our business needs
• Plan, refine, perform, and review work according to agile software development methodologies
What you will bring:
• Previous experience in a lead or management role with direct reports
• Solid understanding of software engineering concepts, including programming methodologies and the software development lifecycle
• 9 years of experience writing SQL queries to analyze and report on data
• 9 years of experience writing Native Python code
• Experience with additional scripting languages is preferred
• Experience with CI/CD pipelines including the use of git and Jenkins
• Experience with Docker, Kubernetes, and cloud-based services from providers such as Amazon Web Services
• Experience with TDD, automated testing, or writing tests to prove your code does what it’s supposed to
• Understanding of enterprise scalability needs
• Ability to set priorities and manage time effectively to complete tasks and meet deadlines
• Experience coaching and mentoring colleagues on policies, processes, and best practices
• Ability to translate ideas into technical designs and experience leading technical design sessions
Full Time
$103k-129k (estimate)
06/23/2024
07/11/2024
The following is the career advancement route for Senior Data Engineer positions, which can be used as a reference in future career path planning. As a Senior Data Engineer, it can be promoted into senior positions as a CAE Designer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer. You can explore the career advancement for a Senior Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.