Senior Data Engineer

Company Description

Job Description

The Office of Technology and Innovation (OTI) oversees all Citywide technology, privacy, cybersecurity, infrastructure, and telecommunications to ensure the security of, and enhance, City operations and service delivery to New York City's residents, businesses, employees, and visitors. As the City's technology and innovation leader, OTI is responsible for operating, maintaining and securing IT infrastructure and systems that touch every aspect of City life from public safety to human services, from education to economic development crossing the full spectrum of governmental operations.

At OTI, we offer great benefits, and the chance to work on projects that have a meaningful impact on millions of people. You'll have the opportunity to work with cutting-edge technology, transition our existing data infrastructure to a cloud-centric platform, and collaborate with other passionate professionals who share your drive and commitment to making a difference through data technology.

Join our dynamic DataOps team at OTI as a Senior Data Engineer! Work with talented professionals to build foundational solutions that provide core services to New York City's residents, businesses, and visitors. As a key player in defining our data strategy, you'll have the opportunity to develop innovative solutions that improve the quality of life for all New Yorkers.

As a successful candidate, you'll work with a wide range of datasets and build data assets for city agencies and divisions, including 311, Public Safety (911), Sanitation, Health, Buildings, Transportation, and more.

Responsibilities will include :

• Collaborate with stakeholders to define and understand data needs;
• Design and develop efficient data architectures that can support large-scale data processing and storage requirements;
• Develop and maintain data pipelines, data models, and ETL processes that align with business requirements, data quality standards, and industry best practices;
• Work closely with other data engineering teams to build and maintain reusable data pipelines and tools, enabling faster time-to-market for data-driven solutions;
• Monitor, troubleshoot, and optimize data pipelines and processes for performance, reliability, and scalability;
• Ensure the quality and integrity of various datasets across different platforms and data sources;
• Continuously evaluate and recommend emerging technologies and methodologies to improve data engineering processes, workflows, and performance;
• Mentor and guide junior data engineers on technical best practices, code reviews, and design patterns to ensure high-quality, scalable, and maintainable data engineering solutions;
• Perform special technology-related projects, as assigned.

Qualifications

1. A baccalaureate degree from an accredited college including or supplemented by 24 credits in the field of voice and / or data telecommunications or in a pertinent scientific, technical, electronic or related area, and four years of satisfactory fulltime experience in the performance of analytical, planning, operational, technical, or administrative duties in a voice and / or data telecommunications or closely related electronics planning, management, and / or service organization, one year of which must have been in a highly specialized capacity and 18 months must have been in an executive, managerial, or administrative capacity or in the supervision of staff performing work in the voice and / or data telecommunications field; or

2. An associate degree from an accredited college including or supplemented by 12 credits in the field of voice and / or data telecommunications or in a pertinent, scientific, technical, electronic or related area and five years of experience as described in "1" above; or

3. Education and / or experience equivalent to "1" above. However, all candidates must have at least a four-year high school diploma or its educational equivalent and one year of the specialized experience as described in "1" above and must possess the 18 months of executive, managerial, administrative or supervisory experience as described in "1" above.

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.