What are the responsibilities and job description for the Data Engineer position at MedScout?
A company is looking for a Data Engineer to build and optimize data infrastructure for processing healthcare claims.Key ResponsibilitiesDesign, implement, and maintain scalable data pipelines using Databricks, Python, and PySparkDevelop processes to integrate multiple data sources into a unified data model for the sales enablement platformCollaborate with cross-functional teams to inform design and implementation decisions based on customer insightsRequired Qualifications3 years of experience with data pipelines in modern data warehouses like Databricks, Snowflake, or AWS RedshiftProficiency in Python and PySparkUnderstanding of data modeling and schema design for high-volume data processingExpertise in data quality frameworks and automated testing of data pipelinesFamiliarity with software development practices including version control and CI / CD
