208 Sr / Lead Data Engineer Jobs in New York, NY
SORT BY
C
C
F
B
C
Community Blood Center of Greater Kansas City
New York, NY | Full Time
$143k-175k (estimate)
1 Month Ago
R
I
N
K
D
J
s
Z
H
C
I
H
S
S
P
N
C
V
P
P
Sr / Lead Data Engineer
$127k-155k (estimate)
Full Time
7 Days Ago
Fynbosys Inc is Hiring a Sr / Lead Data Engineer Near New York, NY
Top Skills - Must Haves
- Python
- Sql
- scala
- AWS
Top Skills' Details
Python - developing scalable and efficient data pipelines and automate data workflows enabling the processing of large volumes of data
SQL - designing, optimizing and maintaining databases and data pipelines using queries
Scala - develop robust data pipelines and application of large-scale data sets
AWS - development and optimization of all aspects of cloud infrastructure
SQL - designing, optimizing and maintaining databases and data pipelines using queries
Scala - develop robust data pipelines and application of large-scale data sets
AWS - development and optimization of all aspects of cloud infrastructure
Secondary Skills - Nice to Haves
- spark
- etl
- big data
- hadoop
Job Description
Responsibilities: Work on migrating applications from an on-premises location to the cloud service providers.
Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation.
Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.
Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology.
Perform problem analysis, data analysis, reporting, and communication.
Work with peers across the system to define and implement best practices and standards.
Assess applications and help determine the appropriate application infrastructure patterns.
Use best practices and knowledge of internal or external drivers to improve products or services.
Qualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.
Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plus
Expert-level experience in data architecture, data types/formats, optimizing code and ETL jobs, data architecture, data modeling, data contracts a key requirement for successful collaboration with data architects and visualization developers.
Expert-level professional hands-on experience in extensible data pipeline development using Databricks, Alteryx, AWS Glue and Lambda functions.
Expert-level professional hands-on experience with RDBMS, ETL scripting tools and IDEs, data pipeline development, and management using orchestration/monitoring tools.
Expert-level knowledge and experience in implementing software engineering security best practices and contributing to design/engineering for DevSecOps.
Expert-level experience with master data management strategies, rules-based engines, and tools for multi-stage data correlation on large data sets.
Must have experience managing deployment and leading the release of code to production.
Expert-level understanding of data visualization tools and requirements for business customers.
Sr / Lead Data EngineerDevelop products and services on the latest technologies through contributions in development, enhancements, testing and implementation.
Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.
Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology.
Perform problem analysis, data analysis, reporting, and communication.
Work with peers across the system to define and implement best practices and standards.
Assess applications and help determine the appropriate application infrastructure patterns.
Use best practices and knowledge of internal or external drivers to improve products or services.
Qualifications: Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.
Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plus
Expert-level experience in data architecture, data types/formats, optimizing code and ETL jobs, data architecture, data modeling, data contracts a key requirement for successful collaboration with data architects and visualization developers.
Expert-level professional hands-on experience in extensible data pipeline development using Databricks, Alteryx, AWS Glue and Lambda functions.
Expert-level professional hands-on experience with RDBMS, ETL scripting tools and IDEs, data pipeline development, and management using orchestration/monitoring tools.
Expert-level knowledge and experience in implementing software engineering security best practices and contributing to design/engineering for DevSecOps.
Expert-level experience with master data management strategies, rules-based engines, and tools for multi-stage data correlation on large data sets.
Must have experience managing deployment and leading the release of code to production.
Expert-level understanding of data visualization tools and requirements for business customers.
Job Summary
JOB TYPE
Full Time
SALARY
$127k-155k (estimate)
POST DATE
06/22/2024
EXPIRATION DATE
07/10/2024
WEBSITE
fynbosys.com
HEADQUARTERS
SACRAMENTO, CA
SIZE
25 - 50
FOUNDED
2011
TYPE
Private
CEO
GOBISURESHBABU RAMASAMY
REVENUE
<$5M
INDUSTRY
IT Outsourcing & Consulting
Related Companies
Show more
Similar Jobs
Popular Articles
Top 10 Things to Avoid Putting on a Job Application
Read Article
How to Describe Your Education in a Resume
Read Article
How to Write a Memorable Cover Letter in 5 Ways
Read Article
4 Personal Finance Tips to Make During Job Transition
Read Article
4 Best Camera Setups for Interview
Read Article
Keeping a Job Search Journal: 9 Types of Journaling You Can Do
Read Article
