What are the responsibilities and job description for the Senior ETL Engineer (Pipeline) position at Technica Corporation?
About Technica
At Technica Corporation, our goal is to provide exceptional professional services and innovative technology solutions that meet or exceed our customer’s expectations. We specialize in a wide range of advanced information technology solutions from Systems Engineering to Cyber Security, and from Software Development to Product Solutions. From our locations across the DC Metro area, Hampton, Virginia, and Huntsville, Alabama, we provide technological subject matter expertise, program management and business process knowledge as a trusted advisor in support of our Department of Defense and other Federal Agency customers.
This position description does not represent a current opening but may be used to identify candidates with skills and experience for positions within Technica Corporation that frequently become available. Candidates who express an interest may be considered for future positions at Technica Corporation. If a position becomes available that aligns with your qualifications, our recruitment team will contact you.
A Senior ETL Engineer will be responsible for maintaining existing software as the transition from server-based to cloud-based occurs. The position will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. The person will be involved in the engineering planning and transition of the existing system software / data into a Cloud-based solution.
Typical requirements may include
It is Technica's policy to affirmatively support Equal Employment Opportunity (EEO) for all qualified individuals without regard to color, gender, religion, creed, national origin, age, race, disability, gender identity, genetic information, sexual orientation, marital status, veteran status or any other characteristic protected by law. This policy covers all aspects of the employment relationship including recruiting, hiring, compensation, assignment, promotion, transfer, training, working conditions, employment longevity, retirement, employee benefits and termination.
Technica's EEO philosophy promotes equal employment opportunity throughout the organization. Any form of unlawful employee harassment based on the above mentioned characteristics is prohibited. Equal Opportunity Employer Minorities/Women/Vets/Disabled/Gender Identity/Sexual Orientation.
At Technica Corporation, our goal is to provide exceptional professional services and innovative technology solutions that meet or exceed our customer’s expectations. We specialize in a wide range of advanced information technology solutions from Systems Engineering to Cyber Security, and from Software Development to Product Solutions. From our locations across the DC Metro area, Hampton, Virginia, and Huntsville, Alabama, we provide technological subject matter expertise, program management and business process knowledge as a trusted advisor in support of our Department of Defense and other Federal Agency customers.
This position description does not represent a current opening but may be used to identify candidates with skills and experience for positions within Technica Corporation that frequently become available. Candidates who express an interest may be considered for future positions at Technica Corporation. If a position becomes available that aligns with your qualifications, our recruitment team will contact you.
A Senior ETL Engineer will be responsible for maintaining existing software as the transition from server-based to cloud-based occurs. The position will work with a GOTS-based Extract, Transform and Load (ETL) system that loads information into Postgres database with billions of rows and deals with a file repository that is in a Petabyte range. The person will be involved in the engineering planning and transition of the existing system software / data into a Cloud-based solution.
Typical requirements may include
- Design, develop, and maintain the ETL (Extract, Transform, Load) processes for master data management (MDM) system
- Build and optimize data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services
- Collaborate with stakeholders to gather data requirements, understand data sources, and ensure data quality and integrity throughout the ETL process
- Implement data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data
- Monitor and troubleshoot ETL processes to identify and resolve issues in a timely manner
- Active Top Secret clearance with SCI eligibility
- Bachelor’s degree in Engineering, Computer Science, or other related technical discipline, or an equivalent combination of education and experience
- At least 5 years’ experience with ETL
- Strong proficiency in programming languages such as Scala or Java
- Experience in designing and developing ETL workflows using tools like Apache Spark or AWS Glue
- In-depth knowledge of ETL best practices, data integration techniques, and data quality management
- Familiarity with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift
- Proven experience in the engineering planning and transition of existing system software / data into a Cloud-based AWS solution
- Experience in Linux command lines and continuous integration
- Understanding of concepts of Data Lakehouse architecture as well as OpenSearch is a plus
- Experience using software repository tools such GIT or SVN
It is Technica's policy to affirmatively support Equal Employment Opportunity (EEO) for all qualified individuals without regard to color, gender, religion, creed, national origin, age, race, disability, gender identity, genetic information, sexual orientation, marital status, veteran status or any other characteristic protected by law. This policy covers all aspects of the employment relationship including recruiting, hiring, compensation, assignment, promotion, transfer, training, working conditions, employment longevity, retirement, employee benefits and termination.
Technica's EEO philosophy promotes equal employment opportunity throughout the organization. Any form of unlawful employee harassment based on the above mentioned characteristics is prohibited. Equal Opportunity Employer Minorities/Women/Vets/Disabled/Gender Identity/Sexual Orientation.
