What are the responsibilities and job description for the Data Engineer - McLean VA position at Janus Soft Inc?
Position Title: Data Engineer
Job Description:
- Develop new tools, code & services for data engineering activities
- Execute data movement of structured & unstructured data using approved methods
- Perform data ingestion activities for local or enterprise storage
- View and analyze data in source format
- Develop code for data exploration formatting
- Collaborate with Data Scientists & partners to determine optimal data formats and transformations
- Create tools for one-time & ongoing data formatting/transformations
- Implement ETL code following best practices/standards
- Develop ETL Code Transition Plans
- Create comprehensive documentation including:
- ETL mappings
- Code usage guides
- Code location & access instructions
- Facilitate Code Reviews
- Provide consulting services for:
- Data transport
- Data ingestion
- Data conditioning
- Data access
- Data management
Mandatory Skills:
- Extract, Transform and Load (ETL) tools and processes
- Python
- AWS
- SQL
- APIs
- Linux
- Geospatial tools/data experience
Desired Skills:
- Docker
- Jenkins
- Hadoop/Spark
- Kibana
- Kafka
- NiFi
- ElasticSearch
