What are the responsibilities and job description for the Secret Cleared Data Engineer position at System One Holdings, LLC?
ALTA IT Services is looking for a Data Engineer with Python expertise to work for a large government contractor in Washington DC Metro area. This is an exciting opportunity to join a great team and bring your skills to the table.
Duration : Six-month temp to perm
Pay Rate : 75-85 / hr W-2
Clearance : Active DoD Secret or higher
Work Model : Hybrid - 3 days on-site in Arlington VA
The ideal candidate will have a strong background in data engineering and experience in designing, implementing, and maintaining robust pipelines. This role requires deep understanding of data architecture, data warehousing, ETL processes and big data technologies. The Data Engineer will work closely with data scientists, analyst, and other stakeholders to ensure the seamless flow and integrity of data across the organization.
Responsibilities :
- Build, maintain, and optimize data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse.
- Integrate large, complex data sets that meet functional and non-functional business requirements.
- Design and implement scalable and reliable data warehousing solutions.
- Extract data from various sources, transform it into a usable format, and load it into Azure data storage solutions such as Azure Data Lake Storage, Azure SQL Database, or Azure Synapse Analytics
- Develop and maintain data pipelines using Azure Data Factory and other relevant Azure technologies
- Manage and optimize databases, ensuring data quality, integrity, and security.
- Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver high-quality data solutions.
- Document data flows, processes, and system architecture to ensure clarity and knowledge sharing within the team.
Required :
Desired :
The project is specifically focusing on managed identities and cyber threats. You will be dealing with very large data sets of audit logs that will need to be cleaned and processed to use for data modeling.
We are looking for someone who is "jack of all trades" and can do data engineering, analysis and science.
