What are the responsibilities and job description for the Data Engineer position at Marencor?
Role : Data Engineer (Contract to Hire)
Location : Greater Tampa Bay Area FL (Hybrid)
Responsibilities :
- Develop and maintain scalable data pipelines and workflows using Databricks.
- Process and integrate structured and unstructured data with Delta Live Tables and Streaming Data Processing.
- Prepare and manage datasets for machine learning workflows, optimizing for training and inference.
- Collaborate with data scientists and AI teams to support AI / BI Genie integrations.
- Implement Snowflake and Star Schema architectures to enhance data storage and query performance.
- Ensure BI reporting pipelines are compatible with advanced analytics tools.
- Document data processes and architectures thoroughly.
- Optimize Spark jobs and workflows for performance and cost-efficiency.
- Troubleshoot and resolve issues related to data quality and pipelines.
- Stay current with advancements in data engineering, machine learning, and AI technologies.
Requirements :
