Job Description
Job Description
Job Description
Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an
exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a
crucial role in designing, developing, and maintaining our Advana data infrastructure and
systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript / JSON, SQL, and
Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.
Responsibilities
- Design, develop, and implement end-to-end data pipelines, utilizing ETL processes
and technologies such as Databricks, Python, Spark, Scala, JavaScript / JSON, SQL,
and Jupyter Notebooks.
Create and optimize data pipelines from scratch, ensuring scalability, reliability, andhigh-performance processing.
Perform data cleansing, data integration, and data quality assurance activities tomaintain the accuracy and integrity of large datasets.
Leverage big data technologies to efficiently process and analyze large datasets,particularly those encountered in a federal agency.
Troubleshoot data-related problems and provide innovative solutions to addresscomplex data challenges.
Implement and enforce data governance policies and procedures, ensuringcompliance with regulatory requirements and industry best practices.
Work closely with cross-functional teams to understand data requirements and designoptimal data models and architectures.
Collaborate with data scientists, analysts, and stakeholders to provide timely andaccurate data insights and support decision-making processes.
Maintain documentation for software applications, workflows, and processes.Stay updated with emerging trends and advancements in data engineering andrecommend suitable tools and technologies for continuous improvement.
Requirements
Secret clearance or higher required (can be sponsored).High level of proficiency in ETL processes and demonstrated, hands-on experience withtechnologies such as Databricks, Python, Spark, Scala, JavaScript / JSON, SQL, and
Jupyter Notebooks.
Strong problem-solving skills and ability to solve complex data-related issues.Demonstrated experience working with large datasets and leveraging big datatechnologies to process and analyze data efficiently.
Understanding of data modeling / visualization, database design principles, and datagovernance practices.
Excellent communication and collaboration skills, with the ability to work effectivelywith cross-functional teams.
Detail-oriented mindset with a commitment to delivering high-quality results.Benefits
Compensation - We carefully consider a wide range of compensation factors, including but not limited to prior experience, skills, expertise, location, and other considerations permitted by law.Healthcare - We offer Health, Vision, and Dental Plans for our employees and their families.Retirement Plan – We invest in your future with a competitive 401(k) plan, where we match 100% of your contributions up to your first 6% and give you access to Vanguard Admiral funds.Paid Time Off - Based on length of service, we offer a generous amount of paid leave.Bonus System – As you invest in us, we invest in you. We offer bonuses to all employees who meet and exceed goals throughout the year.Professional Development – Support for career growth through training programs and certifications.Company Retreats & Team Events – Sponsored trips, team-building activities, and annual conferences related to your skillset.