Job Description
Job Description
Title : Lead Data Engineer (Subcontract at a Core BTS Client)
Through Core BTS Resource Management Services (RMS), we offer custom talent solutions to help our clients meet their evolving technology and business needs. We help effectively match the right technology professional to their organization, recruiting for contract, contract-to-hire, and direct roles. Our client, which is headquartered in New York, NY has an immediate need for a Lead Data Engineer.Please note that this is a (contract / contract to hire / direct hire) opportunity with our client and NOT with Core BTS.
- This position is a hybrid work environment, where qualified candidates can reside within the New York, NY, Kansas City, Missouri, St. Paul Minnesota, Providence, RI or Newark, DE.
Overview :
Our client within the Healthcare industry, is currently in need of a Lead Data Engineer to join their team as they work towards meeting and exceeding the growing needs of their diverse communities, lifesaving strategic goals in a rapidly changing environment, and expand our impact on the local, national, and global communities they serve.
Responsibilities :
As the Lead Data Engineer , the selected resource will get to innovate at the intersection of technology and human compassion crafting the backbone of our clients' infrastructure. As the lead Engineer role is pivotal,serving as a key architect developing data solutions, as every algorithm is a potential lifeline for patients. Qualified candidates will consider themselves as an expert builder of intricate systems that support all functions across the organization to ensure the highest standards for all facilities nationally.
This position isnt just about the numbers, the ideal candidate must be passionate about making a difference and execute effective strategies. As a leader in every sense of the word, this resource will be responsible for encouraging your teams in a hands-on capacity to drive business impact, so everyone feels part of this rewarding experience.
Primary Responsibilities :
Data Overseer : Lead the architectural design and optimization of robust, scalable data pipelines using SQL, Python, and cloud-based ETL tools such as Databricks. Oversee data flow and processing to support large-scale operations and ensure system-wide efficiency. Use your skills as a guru to lead teams.Data Maestro Director : Direct the development of complex data models to accurately mirror critical business processes, ensuring seamless integration with our comprehensive data architecture, including Big Data frameworks like Spark.Insights Wrangler : Shape and enhance our data architecture strategy, making high-level decisions on data storage, consumption, integration, and management across cloud platforms (Azure, AWS, or Google Cloud).Information Artisan : Orchestrate Agile / SCRUM frameworks to drive efficient project delivery. Lead sprints and stand-up meetings, implementing strategies to optimize processes across teams.Lead Wizard and Sage : Guide collaboration efforts with data scientists, BI teams, and engineering groups to translate intricate data requirements into executable engineering strategies. Mentor senior teams for continuous growth, nurturing a culture of excellence.Purveyors of Standard Procedures : Establish and enforce the highest data quality standards and governance policies, ensuring reliability and regulatory compliance across all data operations.Analytical Guardians : Continuously monitor and refine the performance of data infrastructure, resolving high-level bottlenecks in cloud and Big Data environments.Information Oracle : Stay at the forefront of emerging data engineering technologies and methodologies, leading implementation of innovative practices that enhance our capabilities.Qualifications : Education :
Bachelors Degree in Computer Science, Data Science, Information Technology or other quantitative disciplines such as Science, Statistics, Economics, or Mathematics.Essential Experience :
10 years of progressive experience in data engineering, with proven expertise in designing, implementing, and leading initiatives for optimizing databases and data pipelines.Extensive hands-on experience with SQL Server, Oracle, or other relational database management systems (RDBMS).Advanced proficiency in SQL and Python for sophisticated data manipulation and analytics.Demonstrated leadership in data modeling and architecture for both analytics and transactional systems within large-scale environments.At least 2 years of experience leading teams of data engineers : Proven ability to mentor and guide teams in the development and optimization of data systems, fostering a collaborative and innovative working environment.Cloud and Big Data Experience :
Expertise with at least one major cloud data platform (Azure, AWS, Google Cloud) with extensive application in data engineering projects.Deep knowledge of Big Data technologies such as Spark and Cloud ETL tools like Databricks, with a focus on scalability and real-time processing capabilities.Methodology and Tools :
Senior-level experience with Agile and SCRUM methodologies, leading successful project delivery in a dynamic development environment.Skilled in developing data models for integration and analysis that support complex business intelligence and data analytics initiatives.Any combination of education, training, and experience equivalent to the requirements abovethat has supplied the necessary knowledge, skills, and experience to perform the essential functions of the job.
Required Knowledge, Skills & Abilities :
Knowledge
Fluent Communication : Ability to articulate complex data concepts and project updates clearly to both technical and non-technical stakeholders.Strong Data Analysis Ability : Expertise in analyzing large datasets to derive insights and inform business decisions.Proficiency in SQL and Python : High level of skill in SQL and Python for data analysis, data manipulation and scripting.ETL / ELT Architecture : In-depth knowledge of developing and managing ETL and ELT architectures using various tools and frameworks.Cloud Experience : Experience with cloud platforms such as Azure, AWS, or Google Cloud, and their respective data services and tools.Big Data Concepts : Understanding of Big Data technologies and frameworks, including Spark and Cloud ETL tools such as Databricks.Agile and SCRUM Knowledge : Familiarity with Agile methodologies and SCRUM practices, capable of integrating these into project management and daily workflows.Quality Assurance and Data Governance : Knowledge of data quality standards and governance, ensuring data integrity and compliance across all processes.Skills
Collaboration : Ability to work effectively with cross-functional teams, including data scientists, BI analysts, and software engineers, to implement data solutions.Mentorship and Leadership : Skills in mentoring junior engineers and leading project teams to promote knowledge sharing and professional growth within the team.Innovation and Continuous Learning : Commitment to staying updated on the latest industry trends and technologies in data engineering and implementing them as relevant.Abilities
Ability to interact with customers one-on-one or in large groups.Ability to work independently with remote supervision.Ability to build in receiving feedback as part of the development process and seek consistent and constructive feedback.Ability to embrace accountability and ownership.Preferred Qualifications :
Education : Masters Degree in Computer Science, Data Science, Information Technology or other quantitative disciplines such as Science, Statistics, Economics, or Mathematics.Experience with the Microsoft Azure technology stack or similar technologies in competing platforms.Practical knowledge of data analytics and visualization tools to aid in data-driven decision making and reporting.Certifications & Licenses :
Professional certification in Agile and SCRUM methodologies (e.g., Certified ScrumMaster (CSM), SAFe Agilist).Certifications in Python and SQL programming (e.g., Microsoft Certified : Python Programming Specialist, Oracle SQL Certification).Certifications in cloud services relevant to the job (e.g., AWS Certified Solutions Architect, Google Professional Data Engineer, Microsoft Certified : Azure Data Engineer Associate).Big Data certifications (e.g., Cloudera Certified Professional (CCP) : Data Engineer, Databricks Certified Professional Data Scientist).Willing to obtain certification, if not currently certified.
