Data Engineer Active Top Secret/SCI required
2-3 Days onsite in SCIF, located in DC. Salary Range $145k -$155k As a Data Engineer, you will be required to interpret business needs, select appropriate technologies, and have experience in implementing data governance of shared and/or master sets of data. You will work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions. You will create, maintain, and optimize data pipelines as workloads move from development to production for specific use cases to ensure seamless data flow for the use case. You will perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics. You will analyze data and systems architecture, create designs, and implement information systems solutions. Qualifications:
• TS-SCI clearance • Bachelor's degree or equivalent practical experience. • Understand cloud architectures and enable tools and technologies, such as AWS Cloud (GovCloud/C2S). • Familiar with Amazon Web Managed Services (AWS). • Working knowledge of software platforms and services, such as Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar. • Proficient experience utilizing JavaScript, Elasticsearch, JSON, SQL, and XML. • Working knowledge of data stores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis. • Familiar with Linux/Unix server environments. • Experience with Agile development methodology. • Publishing and/or presenting design reports • Coordinating with other team members to reach project milestones and deadlines • Working knowledge of collaboration tools, such as Jira and Confluence. Preferred Qualifications:
• Master's degree or equivalent experience in a related field. • Familiarity and experience with the Intelligence Community (IC), and the intel cycle. • Familiarity and experience with the Department of Homeland Security (DHS). • Direct Experience with DHS and Intelligence Community (IC) component's data architectures and environments (IC-GovCloud experience preferred). • Experience with cloud message APIs and usage of push notifications. • Keen interest in learning and using the latest software tools, methods, and technologies to solve real-world problem sets vital to national security. • Working knowledge of public keys and digital certificates. • Experience with DevOps environments. • Expertise in various COTS, GOTS, and open-source tools that support the development of data integration and visualization applications. • Experience with cloud message APIs and usage of push notifications. • Specialization in object-oriented programming languages, scripting, and databases. Responsibilities:
• Bullets of responsibilities of the role, examples: • Define and communicate a clear product vision for our client's software products, aligning with user needs and business objectives. • Create and manage product roadmaps that reflect both innovation and growth strategies. • Partner with a government product owner and a product team of 7-8 FTEs. • Develop and design data pipelines to support an end-to-end solution. • Develop and maintain artifacts (e.g., schemas, data dictionaries, and transforms related to ETL processes). • Integrate data pipelines with AWS cloud services to extract meaningful insights. • Manage production data within multiple datasets, ensuring fault tolerance and redundancy. • Design and develop robust and functional dataflows to support raw data and expected data. • Provide Tier 3 technical support for deployed applications and dataflows. • Collaborate with the rest of the data engineering team to design and launch new features. • Coordinate and document dataflows, capabilities, etc.? • Occasionally (as needed) support off-hours deployments such as evenings or weekends. Role Requirements:
• Minimum education requirements: Bachelor's Degree
• Part-time or full-time: Full-Time
• Flexibility option: Med to High Co-Location Skills:
• Stakeholder Management • ETL • Data Pipelines • Effective Team Communication • Product Management • Data Engineering • Data Management • Master Data Management • Agile • Intelligence Community • Client Engagement