What are the responsibilities and job description for the Software Systems Engineer position at Pinnacle living?
Position : Senior Data Engineer
Location : Richmond, VA or Cayce, SC (Hybrid Schedule : 1 week in office, 1 week work remote)
Duration : 12 Months Contract
- Quick description of the role or project story (What this role will be doing) :
As a core member of team of Data Analytics / ETL / EDI support team, responsibilities include but not limited to supporting the Design, Development and maintenance of secure, consistent, and reliable ETL, EDI and reporting solutions supporting critical business processes across the various Business Units.
Ensure data solutions are compliant with enterprise security standards
Work in complex multi-platform environments on multiple project assignments.
Develop and perform tests and validate data flows and prepare ETL processes to meet complex business requirements, including designing and implementing of complex end-to-end solutions using BI platforms.
Coordinate with analysts and developers to ensure jobs designed and developed meet minimum support standards and best practices before migration into the production environment.
Partner with various infrastructure teams, application teams, and architects to generate process designs and complex transformations to various data elements to provide the Business with insights into their business processes.
Uses strategies such as Indexing and partitioning to fine tune the data warehouse and big data environments to improve the query response time and scalability.
Define and capture metadata and rules associated with ETL processes.
Provide resolutions to production job failures, data issues and performance tuning
1. Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts
2. Minimum 5 years working experience in ETL tools such as Talend, Informatica, Data Stage etc
3. Minimum 5 years working experience in SQL, Stored Procedures and Table Design
1. Minimum 5 years working experience in SQL Query optimization and ETL Data loading Performance
2. Experience as a Data Engineer in Cloudera Platforms on components like HIVE, KAFKA, NiFi, Spark etc is a big plus.
3. Minimum 2 years working experience in shell scripting
4. Minimum 2 years working experience in EDI
5. Minimum 2 years working experience in Power BI and other reporting and data visualization tools
6. Experience in real time streaming technologies is preferred
7. Experience deploying machine learning models and automating processes in production is a plus
8. Experience with cloud technologies(AWS, Azure, GCP, Snowflake) is big plus
1. Bachelor's degree in Computer Science, Engineering, or a related discipline. In lieu of a degree, 6 years of related IT experience.
2. 5-8 years of related experience in information technology systems analysis, ETL and EDI processes.
Pay Range : $60 - $65 Hourly
The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by appliable state or localities where you reside or work.
Salary : $60 - $65
