What are the responsibilities and job description for the Data Engineer, Senior position at Eleccion LLC?
OVERVIEW:
Eleccion is seeking a senior Data Engineer to develop new tools, code & services to execute data engineering activities.
RESPONSIBILITIES:
Activities include the following tasks:
Movement of structure & unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. View data in its source format. Develop code to format data that supports exploration. Analyze source data formats & work with Data Scientists & partners to determine the formats & transforms that best meet mission objectives. Develop code and tools to provide one-time & on-going data formatting & transformations into enterprise or boutique data models. Implement existing ETL code & best practices/standards. Develop an ETL Code Transition Plan. Develop & deliver documentation for each project including ETL mappings, code use guide, code location & access instructions. Facilitate Code Reviews. Provide consulting services to support data transport, ingestion, conditioning, access, & management.
QUALIFICATIONS:
Required skills and tools:
- Extract, Transform and Load (ETL) tools and processes.
- Python
- AWS
- SQL
- APIs
- Linux
- Geospatial tools/data
Desired skills and tools:
- Docker
- Jenkins
- Hadoop/Spark
- Kibana
- Kafka
- NiFi
- ElasticSearch
All candidates must have a TS/SCI clearance with a Full-Scope Polygraph.
Eleccion provides a competitive, comprehensive benefits package for all our employees.
