What are the responsibilities and job description for the Job Opening for Sr Data Engineer -Reston, VA (Onsite) position at Stellar IT Solution?
Job Details
Job Description
Python, PySpark
AWS native services
Databases (Oracle, PostgreSQL, Aurora)
Data engineering (EMR, Redshift, Glue),
Serverless experience (Lambda, step functions),
Containerization (ECS with Fargate)
Focused on manipulating data in a software engineering capacity. Some of that data might live in relational systems, but its increasingly moving towards NoSQL systems and data lakes.
Normalize databases and ascertain the structure of the data meets the requirements of the applications that are accessing the information.
Construct datasets that are easy to analyze and support company requirements.
Combine raw information from different sources to create consistent and machine-readable formats.
Skills: This IT role requires a significant set of technical skills, including a deep knowledge of SQL, data modeling, and tools like Spark/Hive/Airflow.
Education/Work
Experience:
1) Bachelor degree in Computer Science, Information Systems or related field
2) Post-graduate degree desired
3) Professional certification(s) desired 5-10 years relevant experience
Additional Skills & Qualifications
This team sits within the Finance Org of Fannie Mae. Support the F3 Future Forecasting initiative. They have 80 applications in both java and python that are centered around Treasury data. All their applications are 100% on the cloud.
development/architecting in python and spark.
Speak to all the AWS native technologies and how you have worked with them
Python development - extensive
Be ready to answer in depth technical questions
They are looking for someone who is self-sufficient and a go getter
They will be asking you technical questions and potentially having you share screen/type in the chat your answers.
- Expect Python questions as well as SQL question
Data Engineer
- Experience with large volume data
- Lots of data change between multiple applications
- Done some data transformation work -- can speak to the difficulties - find catch problems on the front end
- SQL - more complex SQL - multiple table joints
- Deep data analysis tools
- Validating tools against expected results
Employee Value Proposition (EVP)