What are the responsibilities and job description for the Data Engineer position at US Tech Solutions?
Job Title: Data Engineer (4 days onsite, 1 day remote)
Location: Ridgefield Park, NJ 07660
Duration: 12 months Contract
Top Skills:
GCP Big Query, Python, ETL pipelines
Summary:
The main function of the Data Engineer is to develop, evaluate, test, and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organizations data assets.
Qualifications:
- 5-7 years of experience in designing and implementing large scale data processing/data storage/data distribution systems
- Extensive experience working with large data sets with hands-on technology skills to design and build robust Big Data solutions using Spark framework, GCP Big data services and industry standard frameworks
- Ability to work with a multi-technology/cross-functional teams and key stakeholders to guide/manage a full life-cycle solution
- Extensive experience in Relational and MPP database platforms like (GCP Bigquery/Hive/Cloud SQL etc.)
- Open-source Hadoop stack/Spark framework
- Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data
- Excellent problem solving, hands-on engineering skills and communication skills
- Broad understanding and experience of real-time analytics
- Participate in full Software Development Life Cycle (SDLC) of the Big Data Solution
Technical Skills Required
- Any combination of below technical skills
- Hadoop : HDFS, MapReduce, Hive, Airflow
- DW : Bigquery, Hive
- Languages : Python, PySpark, Shell Scripting, SQL Scripting
- Cloud : GCP Big data native services
- Any RDBMS/DWBI technologies
- Spark(Mandatory): Spark on GCP Dataproc
Roles & Responsibilities
- Should be able to design complex and high-performance Data architecture
- Developing and maintaining strong relations with senior executives—developing new insights into the client’s business model and pain points, and delivering actionable, high-impact results
- Participating and leading key engagements, in developing plans and strategies of data management processes and IT programs for the business, providing hands on assistance in data modeling, technical implementation of big data solutions
- Facilitating, guiding, and influencing the clients and teams towards right information technology architecture and becoming interface between Business leadership, Tech leadership and the delivery teams
- Leading and mentoring other developers within the team
- Identify the performance bottlenecks and resolve the same
- Should be able to work in a team
- Ability to produce high quality work products under pressure and within deadlines
- To coordinate with developers / other architects / other stakeholders and cross functional teams from organization
Education: Bachelor’s Degree
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.
US Tech Solutions is an Equal Opportunity Employer.All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Recruiter Details:
Name: Sujith Reddy
Email: sujith.reddy@ustechsolutions.com
Internal Id: 25-31140
Salary : $60 - $68