You haven't searched anything yet.
Data Engineer (Java/Spark/AWS/ETL)
Work Location: Columbus, OH ( need local to OH) Hybrid (3 days onsite 2 days Remote)
Experience: looking for a junior profile Minimum 2 years Required
Must Have Skills :
(Java/Spark/AWS/ETL)
MUST have
- Teradata, DBMS knowledge
- Cloud knowledge - AWS preferably
- ETL knowledge
- CICD and data warehouse concept
- Java & Spark
Candidates with Database knowledge & ETL knowledge will get 100% preference
Data pipeline work, sending data to data warehouse, etc Currently set up on Java/Spark (MUST HAVE Java/Spark)
Must have Teradata and DBMS knowledge (SQL)
Must have good ETL knowledge (Abinitio or Informatica is fine)
Must have good CICD and Data Warehouse concepts
Must have good AWS experience
Postgres DB is a big plus
Snowflake is a big plus but not a must have Team will utilize some Snowflake eventually
Python is a big plus will eventually be moving from Java/Spark to Python/Spark
Job Responsibilities:
Execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
Write secure and high-quality code and maintains algorithms that run synchronously with appropriate systems.
Produce architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development.
Apply knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation.
Apply technical troubleshooting to break down solutions and solve technical problems of basic complexity.
Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
Proactively identify hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
Contribute to software engineering communities of practice and events that explore new and emerging technologies.
Add to team culture of diversity, equity, inclusion, and respect.
Required qualifications, capabilities, and skills.
Proven experience in understanding requirement related to extraction, transformation, and loading (ETL) of data using Spark on Cloud
Formal training or certification on software engineering concepts and 3 years applied experience.
Ability to independently design, build, test, and deploy code. Should be able to lead by example and guide the team with his/her technical expertise.
Ability to identify risks/issues for the project and manage them accordingly.
Hands-on development experience and in-depth knowledge of Java/Python, Microservices, Containers/Kubernetes, Spark, and SQL.
Hands-on practical experience in system design, application development, testing, and operational stability
Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages.
Proficient in coding in one or more programming languages
Experience across the whole Software Development Life Cycle
Proven understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security
Proven knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
Preferred qualifications, capabilities, and skills
Knowledge about Data warehousing Concepts.
Experience with Agile based project methodology.
Ability to identify risks/issues for the project and manage them accordingly.
Knowledge or experience on ETL technologies like Informatica or Ab-initio would be preferable
People management skills would be given preference but is not mandatory.
Full Time
$112k-138k (estimate)
06/19/2024
07/02/2024
The following is the career advancement route for Data Engineer (Java/Spark/AWS/ETL) positions, which can be used as a reference in future career path planning. As a Data Engineer (Java/Spark/AWS/ETL), it can be promoted into senior positions as a Database Engineer IV that are expected to handle more key tasks, people in this role will get a higher salary paid than an ordinary Data Engineer (Java/Spark/AWS/ETL). You can explore the career advancement for a Data Engineer (Java/Spark/AWS/ETL) below and select your interested title to get hiring information.
If you are interested in becoming a Data Engineer, you need to understand the job requirements and the detailed related responsibilities. Of course, a good educational background and an applicable major will also help in job hunting. Below are some tips on how to become a Data Engineer for your reference.
Step 1: Understand the job description and responsibilities of an Accountant.
Quotes from people on Data Engineer job description and responsibilities
The data engineer develops and maintains the enterprise data framework for continued use.
03/12/2022: Dothan, AL
A data engineer prepares data for analytical or operational uses.
03/03/2022: Boulder, CO
Data engineers simplify complex data structure and prevent the reduplication of data.
03/28/2022: New Suffolk, NY
Data Engineers are the technical professionals who prepare data that can be used by data scientists for valuable decisions and strategies.
04/13/2022: Harrisburg, PA
Step 2: Knowing the best tips for becoming an Accountant can help you explore the needs of the position and prepare for the job-related knowledge well ahead of time.
Career tips from people on Data Engineer jobs
Changing oil, running basic checks, topping off fluids and checking tire pressure are common job duties.
01/22/2022: Fort Wayne, IN
Oil changes are an essential component of preventative maintenance.
02/26/2022: Newark, NJ
A data engineer should be aligned with a data scientist’s needs while creating a data system.
04/10/2022: Fayetteville, NC
Start with an entry-level position.
02/10/2022: Winston Salem, NC
Consider pursuing additional professional engineering or big data certifications.
03/09/2022: Saginaw, MI
Step 3: View the best colleges and universities for Data Engineer.