What are the responsibilities and job description for the Data Engineer position at NYSTEC?
About Us:
NYSTEC is a nonprofit technology consulting company, advising agencies, organizations, institutions, and businesses since 1996. Were independent and vendor-neutral, so we have our clients best interests at heart. At NYSTEC, we know that we succeed when individuals and teams flourish personally and professionally, so our benefits and perks support that mindset.
About the Role:
As a data engineer in the information technology department, you will collaborate with team members to work on innovative projects and be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. The role will collaborate closely with cross-functional teams to ensure the availability, reliability, and performance of NYSTEC data systems and solutions.
Key Responsibilities
Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses.
Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions.
Ensure data integrity, quality, and governance throughout Microsoft Fabric environments.
Collaborate with stakeholders, analysts, and architects to translate business needs into actionable data solutions.
Troubleshoot and optimize existing Microsoft Fabric implementations for enhanced performance.
Test, monitor, and ensure compliance with best practices in data analytics and quality management.
About you:
Experience translating business requirements to technical requirements.
Proficiency in programming languages commonly used in data engineering (e.g., Python, Java, Scala).
Strong knowledge of database systems, data modeling techniques, and SQL proficiency.
Proficiency with ETL tools commonly used in data engineering (e.g., SSIS, Databricks, Azure Data Factory).
Strong working knowledge and experience with Microsoft Azure services and tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, Azure SQL Database, and Azure Databricks.
Experience using a work management tool such as Azure DevOps.
Preferred/Desired Qualifications
Microsoft Certified: Fabric Data Engineer Associate.
Microsoft Certified: Fabric Analytics Engineer Associate.
Education and Experience
Bachelors degree in computer science, engineering, information systems, or related field. Masters degree preferred. A minimum of five years of experience in information technology with at least two years of the following:
Experience in business analytics, data science, software development, data modeling, or data engineering work or equivalent experience.
Experience manipulating and transforming data in Spark SQL, PySpark, or Spark Scala, or a minimum of two years of experience manipulating and transforming data in T-SQL.
The pay range for this position is $91,761.00 to $126,172.20 per year.
It is NYSTEC's policy to provide equal employment opportunity (EEO) to all individuals, regardless of actual or perceived race, color, creed, religion, sex, or gender (including pregnancy, childbirth, and related medical conditions), gender identity or gender expression (including transgender status), age, national origin, ancestry, citizenship status, physical or mental disability, protected medical condition as defined by applicable state or local law, genetic information, military service and veteran status, sexual orientation, marital status, or any other characteristic protected by local, state, or federal laws and ordinances. NYSTEC is strongly committed to this policy and believes in the concept and spirit of the law.
Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please contact recruitment@nystec.com if you require a reasonable accommodation to apply for or to perform this job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.
Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future.
Learn more about NYSTEC by visiting www.nystec.com.
Salary : $91,761 - $126,172
