Data Engineer II

If you are an internal associate, please login to Workday and apply through Jobs Hub.

Job Purpose

The Data Engineer II will be responsible for building and optimizing the data platform. The Data Engineer will provide the development and automation of computing processes to detect, predict and respond to opportunities in business operations. The Data Engineer will work with a variety of disparate datasets that encompass many disciplines and business units. They will strive to transform and implement true business integration, leveraging top-notch data integration best practices. Merging and securing data in a way that reduces the cost to maintain and increases the utilization of enterprise-wide data as an asset and developing business intelligence.

Essential Responsibilities

• Engineers and implements solutions that align to architecture patterns and security guidelines for data, compute and technology platforms, meeting business needs.
• Works in partnership with business product owners, and DevSecOps to engineer and build mature scalable and robust business capabilities.
• Follows IT architecture and IT operations guidelines and requirements while implementing optimal engineering solutions for the company.
• Participates in engineering and planning initiatives related to capabilities, future roadmaps, operations, and strategic planning.
• Engineers and implements business and technology innovation that drives the organization's top and bottom lines.
• Stays current with industry trends, making recommendations of new technologies that deliver strategic business value and reduce costs.
• Engineers and implements architecture solutions that maximize reuse and are efficient, maintainable, scalable, stable, highly available, portable, secure, and implemented correctly.
• Strong communication competency across all levels of stakeholders, providing engineering guidance and insight into best practices.
• Follows organizational policies and goals for IT security, change management, and operational risk.
• Synthesizes information into clear and concise materials with thoughtful attention to detail and quality.
• Provides engineering consulting services within domain to help achieve desired business and operational outcomes across Jackson.
• Engineers and implements the service management processes for maintaining the technology platforms in production.
• Acquires and maintains a working knowledge of Jackson processes and procedures across various departments.
• Assists in researching, planning, and executing the migration of on-prem data infrastructure to Azure, including evaluating tradeoffs between cost, performance, and maintainability.
• Develops and maintains data pipelines for complex business use cases.
• Develops, designs, and builds solutions on a platform dedicated to large-scale processing of various data sets.
• Collaborates with IT architecture and IT operations to identify and implement the most optimal data engineering solutions for the company.
• Collaborates with team to execute and iterate on application development, including interfacing with
• legacy databases, parsing raw structured and unstructured data, documenting the data warehouse, debugging, and deploying to production environments.
• Collaborates with other teams to clarify and answer complex business questions using statistical and graphical approaches.
• Employs exceptional problem-solving skills, with the ability to see and solve issues before applications are moved to production systems.
• Sets, communicates, and reinforces technical standards.
• Leads and develops best practices for larger Data Engineer Community of Practice (Data CoP).
• Stays current with industry trends, makes recommendations of new technologies that deliver strategic business value and reduce costs.
  
  

Other Duties

• May provide training to users on new/updated systems.
• Provides trending and related support for production issues as needed.
• Ability to work extended hours as needed.
• Performs other duties and/or projects as assigned.
  
  

Knowledge, Skills And Abilities

• Knowledge of industry standards, emerging technologies; and security and system best practices.
• Excellent verbal and written communication skills including presentation creation and delivery.
• Experience with the Microsoft Cloud ecosystem.
• Demonstrated scripting skills in a system automation language.
• Strong organizational skills; ability to independently prioritize tasks and projects to meet deadlines.
• Strong collaboration skills with the ability to build consensus, influencing across all levels in the organization.
• Ability to learn and maintain a comprehensive understanding of finance/insurance business and technology.
• Demonstrated record of successful, complex project completion with minimal supervision including skills in design, requirement gathering, project planning, prioritization, coordination, multi-tasking, and problem solving.
• Knowledge of Lean and Agile principles, systems, and tools.
• Ability to explain and communicate technical concepts clearly.
• Ability to conduct gap analysis and identify possible solutions for continuous improvements.
• Fluency in Python, R, Powershell and Java with experience parsing, manipulating, and converting data to and from a wide range of formats (CSV, json, XML, html, SQL tables, etc.).
• Deep understanding of modern database concepts and SQL syntax, including experience with DB2, MongoDB, SQL Server, CosmosDB, Data Lake, Hadoop, etc.
• Deep understanding of modern data migration/messaging platforms including experience with Kafka, SAP Data Service, IBM InfoSphere, etc.
• Familiarity with the Azure ecosystem, including tradeoffs between services that meet overlapping needs.
• Hands-on experience with a batch data processing framework/technology (Spark, Data Bricks, Hive,etc.).
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  
  

Qualifications

• Bachelor's Degree in Computer Science/Computer Engineering and/or equivalent education or experience required.
• 3 years related IT experience required.
• 2 years in Data Engineering required.
• 2 years software development or related position required.
• 3 years SQL, relational database experience and unstructured datasets required.
• 2 years experience of Big Data, Spark, Python, Java, SDLC, Terraform, Config Management and Monitoring required.
• 1 years experience using Agile methodologies, data pipelines, data streaming, data as a service (REST APIs), CI/CD pipelines, cloud technologies, IBM Infosphere (DataStage, Quality Stage), Parquet, JSON, AVRO required.
• 1 years experience working with Jupyter notebooks, Google Colab, R, SAS Data Visualization, microservices and data modeling preferred.
• 1 years IT infrastructure/operations role preferred.
• Certification in Azure Fundamentals & Data Engineer upon hire preferred.
  
  

We don't just accept difference - we celebrate it, we support it, and we thrive on it for the benefit of our employees, our products and our community. Jackson is proud to be an equal opportunity workplace. The Company subscribes to and endorses federal and state laws and regulations relating to equal employment opportunity for all persons without regard to race, color, religion, gender, age, national origin, legally-recognized disability, marital status, legally-protected medical condition, citizenship, ancestry, height, weight, sexual orientation, veteran status, or any other factor not related to the needs of the job. The Company is committed to a policy of equal opportunity. Company facilities and campuses are tobacco-free environments.