What are the responsibilities and job description for the Data Engineer position at VirtualVocations?
A company is looking for an Analytics and Data Engineer to design, develop, and maintain data and analytics pipelines.Key Responsibilities : Manage the data engineering lifecycle, including research, design, development, testing, and maintenanceBuild automated, scalable, and secure data and analytics pipelines with monitoring and reporting featuresMaintain documentation for data definitions and processes to ensure data governance and securityRequired Qualifications : 4 years of experience in software engineering using SPARK with Python and SQL4 years of experience in data engineering, specifically with ETL and pipeline building2 years of experience with cloud platforms (Azure / AWS / GCP) including Databricks and Snowflake1 years of experience working with healthcare dataExperience with data orchestration tools such as ADF, Airflow, or DBT
