What are the responsibilities and job description for the Data Engineer position at Piper Companies?
Piper Companies is seeking a Data Engineer to cluster large datasets across various container and data platforms depending on external client needs. The Data Engineer will work hands-on with challenging data engineering, data management, and analytics projects. This job opens for applications on 1 / 14 / 2024. Applications for this job will be accepted for at least 30 days from the posting date.
Responsibilities of the Data Engineer include :
- Achieve and maintain proficiency with cluster and framework sizing, installation, debugging, performance optimization, migration, security and automation
- Collaborate with data scientists, analysts, business users, and IT teams to design, implement, and deploy data services and analytics.
- Use Continuous Integration / Continuous Delivery (CI / CD) concepts to engineer a standardized data environment
- Recommend and advise on optimal data models for data ingestion, integration, and visualization
- Integrate data from a variety of data source types
Qualifications for the Data Engineer include :
Compensation for the Data Engineer include :
Keywords : #LI-JD4 #LI-REMOTE
Dynamics 365, ERP, CRM, MS, Fabric, Databrick, Data Brick, Data Factory, Datafactory, purview, data lake, One Lake, Data warehouse, data architecture, data architect, data developer
Salary : $165,000
