Data Engineer

Job Title: Data Engineer and onsite lead

Location: NYC, NY (Hybrid)

Duration: 12 Months (CTH)

Job Description:

Your Key Responsibilities

• Design, implement, and maintain databases and datastores, ensuring optimal performance, scalability, and data integrity.
• Write complex SQL queries to analyse data and create views for reporting purposes for downstream consumers.
• Interact with business customers/users, understand their requirements, and translate them into technical requirements.
• Implement and enforce data security and access controls, ensuring compliance with industry standards and regulations.
• Conduct database capacity planning, forecasting future requirements, and implementing necessary scaling strategies.
• Troubleshoot and resolve complex database-related issues, collaborating closely with development and operations teams.
• Utilize Python/Shell scripting to automate database tasks, such as data extraction, transformation, loading, monitoring, and maintenance.
• Monitor and optimize database performance, identifying and resolving bottlenecks, and implementing performance tuning techniques.
• Stay up to date with the latest advancements in RDBMS systems, Postgres DB, scripting languages (Python/Shell), as well as other data engineering tools and evaluate their potential application within our organization.

Skills / Qualifications

Required:

• Bachelor’s degree in computer science, software engineering, information technology, or related field required.
• At least 10 years of experience in data development and solutions in highly complex data environments with large data volumes
• At least 7 years of SQL experience with the ability to write ad-hoc and complex SQL queries.
• At least 5 years of Python experience with ability to write good python code.
• Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.
• Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
• Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities.
• Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.

Good to have:

• Experience with Reporting tool like Tableau, Power BI would be a plus.
• Experience on any ETL tool is added advantage.
• Knowledge of using GIT and Jenkins/CI_CD pipeline for automated code deployment.
• Knowledge and Experience of Graph DB (Star dog DB) will be an added advantage, including ontology modelling, data integration, semantic graph querying, and reasoning capabilities.
• Experience with Agile development methodologies.