Demo

Principal Data Engineer

3M
Saint Paul, MN Full Time
POSTED ON 1/14/2025
AVAILABLE BEFORE 4/7/2025

Job Description :

Principal Data Engineer

Collaborate with Innovative 3Mers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it's equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a diversity of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.

This position provides an opportunity to transition from other private, public, government or military experience to a 3M career.

The Impact You'll Make in this Role

3M is seeking a Principal Data Engineer to join the Corporate Research Systems Lab (CRSL) to develop scalable Data Systems. As part of an agile team, you will enable applications in diverse markets including energy, manufacturing, personal safety, transportation, electronics, and consumer.

As a Principal Data Engineer, you will have the opportunity to design and support an Enterprise Data Mesh to empower informatics and digital technologies for users across the globe :

  • Architect, design, and build scalable, efficient, and fault-tolerant data operations.
  • Collaborate with senior leadership, analysts, engineers, and scientists to implement new mesh domain nodes and data initiatives.
  • Drive technical architecture for accelerated solution designs, including data integration, modeling, governance, and applications.
  • Explore and recommend new tools and technologies to optimize the data platform.
  • Improve and implement data engineering and analytics engineering best practices.
  • Collaborate with data engineering and domain nodes teams to design physical data models and mappings.
  • Work with scientists and informaticians to develop advanced digital solutions and promote digital transformation and technologies.
  • Perform code reviews, manage code performance improvements, and enforce code maintainability standards.
  • Develop and maintain scalable data pipelines for ingesting, transforming, and distributing data streams.
  • Advise and mentor 3M businesses, data scientists, and data consumers on data standards, pipeline development, and data consumption.
  • Provide technical guidance and mentorship, ensure adherence to best practices, and maintain high software quality through rigorous testing and code reviews.
  • Guide project planning and execution, manage timelines and resources, and facilitate effective communication between team members and stakeholders.
  • Foster a positive team environment, assist in recruitment, and provide training opportunities to address skill gaps.

Your Skills and Expertise

To set you up for success in this role from day one, 3M requires ( at a minimum ) the following qualifications :

  • Bachelor's degree or higher in Computer Science from an accredited university.
  • Ten (10) years of professional experience in data management, data engineering, data governance, and data warehouse / lakehouse design and development with proficiency. across SQL and NoSQL data management systems and having comfort working with structured and unstructured data and analyses.
  • Five (5) years of extensive experience and proficiency with Python, Apache Spark, PySpark, and Databricks
  • Three (3) of hands-on experience in Python to extract data from APIs, build data pipelines.
  • Additional qualifications that could help you succeed even further in this role include :

  • Exposure to data and data types in the Materials science, chemistry, computational chemistry, physics space.
  • Proficiency in developing or architecting modern distributed cloud architecture and workloads (AWS, Databricks preferred). Familiarity with data mesh style architecture design principles.
  • Proficiency in building data pipelines to integrate business applications and procedures.
  • Solid understanding preferred of advanced Databricks concepts like Delta Lake, MLFlow, Advanced Notebook Features, Custom Libraries and Workflows, Unity Catalog, etc.
  • Experience with AWS cloud computing services and infrastructure developing data lakes and data pipelines leveraging multiple technologies such as AWS S3, AWS Glue, Elastic MapReduce, etc. and awareness of considerations for building scalable, distributed computational systems on Spark.
  • Experience with stream-processing systems : Amazon Kinesis, Spark, Storm, Kafka, etc.
  • Data quality and validation principles experience, security principles data encryption, access control, authentication & authorization.
  • Deep experience in definition and implementation of feature engineering.
  • Experience with Docker containers and Kubernetes, experience developing or interacting with APIs.
  • Experience in using data orchestration workflows using open-source tools like Temporal.io, Apache Airflow is a plus.
  • Knowledge of data visualization tools like Dash Apps, Tableau, Power BI, etc.
  • Good experience with agile development processes and concepts with leveraging project management tools like JIRA and Confluence.
  • Devise and implement data engineering best practices across teams, optimize and redesign existing data engineering solutions to improve efficiency or stability, as well as monitoring of and consulting with domain node teams.
  • Excellent interpersonal, collaborative, team building, and communication skills to ensure effective collaborations with matrixed teams.
  • Travel : May include up to 10% domestic / international

    Relocation Assistance : May be authorized

    Location : Maplewood, MN

    Must be legally authorized to work in country of employment without sponsorship for employment visa status (e.g., H1B status).

    Supporting Your Well-being

    3M offers many programs to help you live your best life - both physically and financially. To ensure competitive pay and benefits, 3M regularly benchmarks with other companies that are comparable in size and scope.

    Chat with Max

    For assistance with searching through our current job openings or for more information about all things 3M, visit Max, our virtual recruiting assistant on 3M.com / careers.

    Applicable to US Applicants Only : The expected compensation range for this position is $160,284 - $195,903, which includes base pay plus variable incentive pay, if eligible. This range represents a good faith estimate for this position. The specific compensation offered to a candidate may vary based on factors including, but not limited to, the candidate's relevant knowledge, training, skills, work location, and / or experience. In addition, this position may be eligible for a range of benefits (e.g., Medical, Dental & Vision, Health Savings Accounts, Health Care & Dependent Care Flexible Spending Accounts, Disability Benefits, Life Insurance, Voluntary Benefits, Paid Absences and Retirement Benefits, etc.). Additional information is available at : https : / / www.3m.com / 3M / en_US / careers-us / working-at-3m / benefits / .

    Good Faith Posting Date Range 11 / 20 / 2024 To 12 / 20 / 2024 Or until filled

    Learn more about 3M's creative solutions to the world's problems at www.3M.com or on Instagram, Facebook, and LinkedIn [redacted]

    Responsibilities of this position include that corporate policies, procedures and security standards are complied with while performing assigned duties.

    Pay & Benefits Overview : https : / / www.3m.com / 3M / en_US / careers-us / working-at-3m / benefits /

    3M is an equal opportunity employer. 3M will not discriminate against any applicant for employment on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or veteran status.

    Please note : your application may not be considered if you do not provide your education and work history, either by : 1) uploading a resume, or 2) entering the information into the application fields directly.

    3M Global Terms of Use and Privacy Statement

    Carefully read these Terms of Use before using this website. Your access to and use of this website and application for a job at 3M are conditioned on your acceptance and compliance with these terms.

    Please access the linked document by clicking here, select the country where you are applying for employment, and review. Before submitting your application, you will be asked to confirm your agreement with the terms.

    Salary : $160,284 - $195,903

    If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution. Compensation Planning
    Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right. Surveys & Data Sets

    What is the career path for a Principal Data Engineer?

    Sign up to receive alerts about other jobs on the Principal Data Engineer career path by checking the boxes next to the positions that interest you.
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    Income Estimation: 
    $168,522 - $211,152
    Income Estimation: 
    $189,259 - $248,928
    Income Estimation: 
    $71,122 - $96,652
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $92,929 - $122,443
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $122,257 - $154,284
    Income Estimation: 
    $143,391 - $179,890
    View Core, Job Family, and Industry Job Skills and Competency Data for more than 15,000 Job Titles Skills Library

    Job openings at 3M

    3M
    Hired Organization Address Alexandria, MN Full Time
    Job Description : Job Title Project Engineer Collaborate with Innovative 3Mers Around the World Choosing where to start ...
    3M
    Hired Organization Address Hutchinson, MN Full Time
    Operations Director Collaborate with Innovative 3Mers Around the World Choosing where to start and grow your career has ...
    3M
    Hired Organization Address Fairmont, MN Full Time
    Benefits and Culture We offer a range of benefits, including competitive pay, medical and dental insurance, and retireme...
    3M
    Hired Organization Address Hutchinson, MN Full Time
    Job Summary We are seeking an experienced Operations Director to join our team at 3M's Hutchinson site. As a key member ...

    Not the job you're looking for? Here are some other Principal Data Engineer jobs in the Saint Paul, MN area that may be a better fit.

    Principal Data Engineer, MongoDB

    eBay, Saint Paul, MN

    Network Engineer II - 2nd Shift

    Atomic Data, Minneapolis, MN

    AI Assistant is available now!

    Feel free to start your new journey!