What are the responsibilities and job description for the Data Engineer position at Apexon?
Job Role: Data Engineer
Location : Providence, NJ – Onsite/ Hybrid
Duration: 6 months C2H
Job Title:
Data Engineer Position Overview:
We are looking for an experienced Data Engineer with a strong foundation in data engineering best practices and experience with modern data warehousing and ETL platforms. The ideal candidate will have at least 5 years of hands-on experience, preferably with Snowflake, SQL Server, AWS and Matillion ETL, to build, optimize, and maintain data pipelines and data integration solutions. This role involves working closely with cross[1]functional teams to support data-driven initiatives across the organization.
Key Responsibilities:
• Data Pipeline Development and Maintenance:
Design, develop, and maintain scalable and high-performance ETL pipelines using Matillion ETL to ingest, transform, and load data into Snowflake. o Integrate and manage data from various sources, ensuring data quality, reliability, and performance. o Optimize SQL queries, scripts, and stored procedures in Snowflake and SQL Server to improve eKiciency and reduce processing time.
• Data Warehousing and Modeling:
Develop and implement data models within Snowflake to support business intelligence and analytics requirements. o Collaborate with data architects and analysts to design and enhance data warehouse schemas and ensure alignment with reporting and analytics needs.
• Collaboration and Requirements Gathering:
Work with business stakeholders to understand data requirements and translate them into technical specifications. o Support data architects and analysts by providing guidance on data ingestion, storage, and retrieval methods.
• Platform Monitoring and Optimization:
Monitor data pipeline and ETL performance, identifying bottlenecks and making necessary adjustments to ensure optimal system performance. o Perform troubleshooting and root cause analysis to resolve data issues and prevent future occurrences.
Required Qualifications:
• Experience: At least 5 years of experience in data engineering, with proficiency in Snowflake, SQL Server, AWS and ETL tools (preferably Matillion).
• Technical Skills: Strong SQL and Python skills with experience in query optimization and performance tuning.
• Education: Bachelor’s degree in computer science, Information Technology, or a related field.
• Soft Skills: Strong analytical, problem-solving, and communication skills.
• Data Engineering Skills: Experience in building, maintaining, and optimizing data pipelines and ETL processes.
• Data Modeling: Knowledge of data warehousing concepts and hands-on experience in data modelling, particularly within Snowflake.
Preferred Qualifications:
• Additional Tools and Platforms: Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus.
• Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required.
