290 Data Engineer Jobs in New York, NY
annalect is Hiring a Data Engineer Near New York, NY
Annalect’s 2,000 innovators leverage data and technology to help clients across Omnicom build relationships that matter — whether that means fostering consumers’ trust in brands, building new experiences, or delivering advanced analytics where it’s most needed. Annalect is the driving force behind Omni, Omnicom’s unique open operating system, which works hand-in-hand with clients’ and partners’ data and tools, to orchestrate better marketing outcomes.
Annalect’s unique approach to data and technology – one that relies on transparency, neutrality, and interoperability – allows us to deliver purpose-built and scalable solutions that make data actionable. Our advanced teams of product leaders, data scientists, consultants, and engineers enable us to meet the business goals of our internal and external clients.
Position OverviewAnnalect is currently seeking a data engineer to join our technology team. In this role you will build Annalect products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design, and development of software products as well as research and evaluation of new technical solutions.
Required Skills
- Experience designing and managing data flows.
- Experience designing systems and APIs to integrate data into applications.
- 4 years of Linux, Bash, Python, and SQL experience
- 2 years using Spark and other frameworks to process large volumes of data.
- 2 years using Parquet, ORC, or other columnar file formats.
- 2 years using AWS/GCP/Azure cloud services, esp. services that are used for data processing e.g. Glue, Dataflow, Data Factory, EMR, Dataproc, HDInsights , Athena, Redshift, BigQuery etc.
- Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges.
- BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (You've learned something to be able to claim you are an engineer)
- Significant experience with Python, C , or other popular language
- Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or something similar.
- Experience working with relational databases.
- Experience with Hadoop, Hive, Spark, or other data processing tools
- Experience building scalable data pipelines (Airflow experience a plus)
- Significant experience working with AWS and/or GCP.
- Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product.
- Culture. We have an incredibly fun, collaborative, and friendly environment, and often host social and learning activities such as game night, speaker series, and so much more!
- Generous vacation policy. Paid time off (PTO) includes vacation days, personal days, and a Summer Friday program.
- Extended time off around the holiday season. Our office is closed between Xmas and New Year to encourage our hardworking employees time to rest, recharge and celebrate the season with family and friends.
- As part of Omnicom, we have the backing and resources of a global billion-dollar company, but also have the flexibility and pace of a “startup” - we move fast, break things, and innovate.
Compensation Range
$135,000—$135,000 USD
Annalect, a division of Omnicom Media Group is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class.Review Our Recruitment Privacy Notice
Job Summary
Full Time
Business Services
$115k-141k (estimate)
07/10/2024
08/07/2024
annalect.com
AMSTELVEEN, NOORD-HOLLAND
500 - 1,000
2010
P. MOLLEMAN
<$5M
Business Services
Related Companies
The job skills required for Data Engineer include SQL, Python, AWS, Big Data, Computer Science, Azure, etc. Having related job skills and expertise will give you an advantage when applying to be a Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Data Engineer positions, which can be used as a reference in future career path planning. As a Data Engineer, it can be promoted into senior positions as a Database Engineer III that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer. You can explore the career advancement for a Data Engineer below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.
Similar Jobs
Popular Articles
