What are the responsibilities and job description for the Data Engineer - W2 position at Pyramid Technology Solutions, Inc.?
Job Details
Title: Senior/ Middle Data Software Engineer
Location: San Francisco, CA - Hybrid
Duration: 12 Months
Contract Type: Only W2
Mandatory Skills: Either Java or Scala, SQL and NoSQL, Apache Spark, Cloud Platforms
Data Engineer Responsibilities:
- System development and maintenance activities of the team to meet service level agreements and create solutions with innovation, cost effectiveness, high quality and faster time to market.
- Support code versioning, and code deployments for Data Pipelines.
- Ensure test coverage for unit testing and support integration and performance testing.
- Contribute ideas to help ensure that required standards and processes are in place.
- Research and evaluate current and upcoming technologies and frameworks.
- Build data expertise and own data quality for your areas.
Minimum Qualifications:
- Strong experience on Java/Scala development experience.
- Strong experience on SQL and NoSQL experience (handling structured and unstructured data).
- Extensive experience with Spark Processing engine.
- Experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)
- Experience with Data Modeling.
- Experience analyzing data to discover opportunities and address gaps.
- Experience working with cloud or on-prem Big Data platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar)
- Programming experience in Python - Nice to have but not mandatory.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
