Data Engineer

Setting the Standard for Exceptional Care

For ninety years, Silver Hill Hospital has been at the forefront of psychiatry and leading the way in providing the best treatment for psychiatric and addictive illnesses.

A Data Engineer designs, builds, and maintains data systems and pipelines to ensure efficient data processing and accessibility. You’ll collaborate with data scientists and analysts to optimize data architecture, manage big data tools, and work with cloud platforms. Their role includes ensuring data security, governance, and performance optimization to meet business needs.

Duties/Responsibilities:

• Design, construct, install, and maintain large-scale processing systems and data pipelines to support the organization's data needs.
• Ensure that the data architecture is scalable, reliable, and capable of meeting the evolving requirements of the business.
• Develop, construct, test, and maintain data architectures (e.g., databases, data warehouses, and large-scale processing systems).
• Collaborate with data scientists and analysts to implement effective data solutions that address their analytical needs and business objectives.
• Implement, manage, and optimize data warehousing solutions to facilitate efficient querying and reporting.
• Monitor, troubleshoot, and optimize the performance of data systems to ensure maximum efficiency and uptime.
• Develop and maintain comprehensive documentation for data systems, pipelines, and processes to ensure transparency and effective knowledge sharing.
• Utilize programming languages and tools (e.g., SQL, Python) to analyze, clean, and transform data for use by business teams.
• Ensure compliance with data governance policies and best practices to safeguard data privacy and security.

Required Skills/Abilities: 

• Must have the ability to function optimally in a stressful environment, and the ability to remain calm in emotionally charged situations.
• Proficiency in programming languages such as SQL, Python, and Java for data processing and transformation.
• Familiarity with big data tools and frameworks such as Hadoop, Spark, and Kafka for distributed data processing.
• Hands-on experience with cloud platforms such as AWS, Google Cloud, or Microsoft Azure to deploy and manage data infrastructure.
• Knowledge of data governance, security practices, and regulatory compliance requirements.
• Strong ability to optimize and fine-tune data systems for better performance and scalability.

Education and Experience:

• Bachelor’s degree in computer science, Engineering, or a related field. Master’s degree is preferred.
• Proven experience as a Data Engineer or in a similar role, with a strong portfolio of successfully implemented data systems.
• Experience with data pipeline and workflow management tools such as Apache Airflow, Luigi, or similar platforms.
• Experience working with large datasets and building data pipelines in complex environments.
• Familiarity with machine learning techniques and data modeling concepts.
• Certification in cloud platforms such as AWS Certified Data Analytics or Google Cloud Data Engineer is a plus.

Physical Requirements: 

• Ability to move light objects weighing less than 20 pounds for short distances.
• Ability to sit at a desk and walk around for different periods of time.
• Ability to occasionally work beyond regular business hours or on weekends to resolve critical issues, as needed.

Silver Hill Hospital

208 Valley Road, New Canaan, CT. 06840

www.silverhillhospital.org

Silver Hill Hospital has mandated the COVID-19 vaccination for all staff, contractors, consultants, students and volunteers. For more information, or accommodation questions, please reach out to the Human Resources Department.

All qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national or ethnic origin, age, disability, veteran status or any other characteristic protected by law.