You haven't searched anything yet.
Job title: Big Data Engineer
Locations: Plano, TX
Duration: 12 Months
Need only USC & GC as this is C2H
Job Family Description: Expert in AWS and Client Azure technology and design techniques as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs (e.g., Expert Engineers) starting to be firm-wide resources working on projects across Client
§ Is multi-skilled with expertise across the software development lifecycle and toolset
§ May be recognized as a leader in Agile and cultivating teams working in Agile frameworks
§ Sought out as coach for at least one technical skill
§ Strong understanding of techniques such as Continuous Integration, Continuous Delivery, Test
Driven Development, Cloud Development, resiliency, security
§ Stays abreast of cutting-edge technologies/trends and uses experience to influence the application of those technologies/trends to support the business; may give speeches outside the firm, writes articles
Technologies:
1. Databricks
2. Apache Spark
3. Python(and/or Scala)
4. AWS
5. SQL
6. Java
7. CI/CD Pipeline tools
Minimum Industry experience: 10 years
Job Description:
1. Bachelor’s degree or equivalent work experience
2. Must have experience implementing at least 2 end to end projects with Databricks which includes components like.
- Delta Lake.
- Unity Catalog.
- Databricks Connect.
- DataBricks API.
- Databricks workflow Orchestration.
3. Must be well-versed with Databricks Lakehouse concepts and their implementation in large-scale enterprise environments.
4. Must have a good understanding of creating complex data pipelines and use of data ingestion tools like Nifi.
5. Must be well versed in using Apache Spark framework and strong in SQL and spark-SQL
6. Must have excellent coding skills in Python(and/or Scala), preferably Python.
7. Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing.
8. Must have worked on AWS and should have working experience with AWS services like S3, Lambda, DynamoDB, SQS, and CloudWatch.
9. Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirements.
10. Must have strong written and verbal communication skills.
11. Must have experience in an Agile environment.
12. A data engineering background is a plus.
Contractor
Business Services
$129k-157k (estimate)
06/10/2024
06/29/2024
aesmolds.com
LAKE FOREST, CA
25 - 50
2000
RUI MARQUES
<$5M
Business Services
We are specialized in Engineering and Manufacturing of Injection Molds for the Plastics and Die Cast Industry. Offices in the Portugal and in the USA, Tool Manufacturing in Portugal, China and in the USA, Tool Support in Portugal and in the USA, Tooling Engineering in Portugal and in the USA. Customers in Germany, Spain, UK, Switzerland, USA, Mexico, Canada and China. For inquires, contact sales@aesmolds.com or www.aesmolds.com
The job skills required for Big Data Engineer include SQL, Python, Verbal Communication, etc. Having related job skills and expertise will give you an advantage when applying to be a Big Data Engineer. That makes you unique and can impact how much salary you can get paid. Below are job openings related to skills required by Big Data Engineer. Select any job title you are interested in and start to search job requirements.
The following is the career advancement route for Big Data Engineer positions, which can be used as a reference in future career path planning. As a Big Data Engineer, it can be promoted into senior positions as a Database Engineer V that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Big Data Engineer. You can explore the career advancement for a Big Data Engineer below and select your interested title to get hiring information.