1119 Senior Data Engineer (Senior Engineer II) Jobs in New York, NY
Rockerbox is Hiring a Senior Data Engineer (Senior Engineer II) Near New York, NY
The Core Data team is a pivotal part of our engineering organization, managing everything from live data collection and aggregation to data warehousing, including governance. We are looking to grow the team by bringing on a Senior Data Engineer who will take on crucial projects within our technical organization. We expect these initiatives to focus on optimizing data storage, access patterns for efficiency and safety, and contributing to scaling our pipelines, as well as product-driven projects related to our feature roadmap.
Key skills that will set this Engineer up for success include expertise in data lakes, data warehouses (Redshift, Snowflake), and real-time streaming technologies (Kafka). Familiarity with tools like Spark, Trino, and Airflow is essential, along with experience in managing and optimizing cloud-based data platforms. Beyond technical acumen, we are looking for candidates who are passionate about contributing to a team-focused, dynamic environment, eager to influence our product's evolution as we expand our reach to thousands of customers.
Responsibilities:
- Scope and own projects related to building scalable, resilient, well-monitored, and cost-efficient data pipelines utilizing a range of technologies
- Provide input on data architecture, ensuring quality and scalability through design and code reviews
- Utilize SQL expertise to improve and optimize queries; share knowledge with other engineers
- Optimize cloud-based data platforms, ensuring scalability, security, and cost-efficiency
- Maintain and improve the application of effective patterns in the data engineering codebase
- Drive the implementation of robust monitoring and quality control practices, including automated testing and alerting, to ensure the integrity of data across all data products.
- As a tech lead, work with Product Managers and cross-functional teams to design data solutions meeting business requirements, detailed in clear technical specifications
- Identify and evaluate emerging technologies, tools, and trends to improve efficiency and effectiveness in data engineering processes.
- 7 years of experience as a data engineer, working with data lakes, data warehouses, big data pipelines and cloud technologies (ideally AWS)
- Proficient in data modeling and architecture for distributed data warehouses and cloud solutions, with deep knowledge of the trade-offs between data warehouses, databases, and data lakes to guide informed decisions on when to use each
- Skilled in crafting modern big data pipelines, both real-time and batch, with tight SLOs and complex transformations, utilizing messaging, serverless, and streaming tech
- Expert-level SQL; experience with other database paradigms (key-value stores, graph databases)
- Expert-level python; comfort working with version control and CI/CD is required; significant exposure to other languages is a plus
- Experience with Spark and Trino (or similar technologies) for big data processing and optimization
- Strong data platform management skills, with experience managing cloud infrastructure and ensuring scalability, security, and cost efficiency
- Ability to simplify complex topics in both written and verbal communication
- Technical project leadership experience and the communication skills to bring stakeholders together around a project plan and architecture, demonstrated by successful large-scale projects spanning multiple teams
- Product mindset to embrace business needs and produce scalable data/engineering solutions
Compensation And Benefits
- $175,000 base; Equity options
- Remote-first - work anywhere in the US
- Health, vision, and dental insurance
- Unlimited PTO
- 10 Paid Holidays
- Rockerbox Unplugged - we shut down the last week of the year
- 12 weeks Parental Leave for all parents of a new child
- Traditional and ROTH 401k options
- $1000 annual training stipend
- Rockertreat! Annual company get-together
Please note that we are not able to accommodate C2C candidates for this role.
Job Summary
Full Time
$126k-158k (estimate)
09/02/2024
09/29/2024
rockerbox.com
New York, NY
50 - 100
Related Companies
The job skills required for Senior Data Engineer (Senior Engineer II) include SQL, Data Engineering, AWS, Big Data, Data Warehouse, Data Warehousing, etc. Having related job skills and expertise will give you an advantage when applying to be a Senior Data Engineer (Senior Engineer II). That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Senior Data Engineer (Senior Engineer II). Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Senior Data Engineer (Senior Engineer II) positions, which can be used as a reference in future career path planning. As a Senior Data Engineer (Senior Engineer II), it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Senior Data Engineer (Senior Engineer II). You can explore the career advancement for a Senior Data Engineer (Senior Engineer II) below and select your interested title to get hiring information.
If you are interested in becoming a Senior Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Senior Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Senior Data Engineer job description and responsibilities
The Senior Data Engineer builds data processing frameworks that handle the business’s growing database.
03/09/2022: Billings, MT
The Senior Data Engineer owns and extends the business’s data pipeline through the collection, storage, processing, and transformation of large data-sets.
01/05/2022: Melbourne, FL
Create architecture for real-time, big data applications with minimal maintenance effort.
03/23/2022: Benton Harbor, MI
Work with both structured and unstructured data, with focus on ETL (Extract, Transfer, Load) and stabilizing pipelines and code.
01/22/2022: Greenville, MS
Provides successful deployment and provisioning of data solutions to production or other required environments.
01/12/2022: Dothan, AL
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Senior Data Engineer jobs
Apply for an entry-level data engineer role and gain experience.
02/06/2022: Providence, RI
Earn a bachelor’s degree related to data engineering and begin working on projects.
02/16/2022: Denver, CO
Consider pursuing additional professional engineering or big data certifications.
03/06/2022: Raleigh, NC
Gain knowledge with new data architecture principles and concepts, thorough understanding of layered systems architectures.
01/24/2022: Abilene, TX
Senior data engineers should also have an understanding of other programming languages that help with statistical analysis and modeling, such as Python.
01/02/2022: New York, NY
Step 3: View the best colleges and universities for Senior Data Engineer.
Similar Jobs
Popular Articles
