What are the responsibilities and job description for the Platform & HPC Data Engineer position at Rgi Corp?
RGi is searching for a talented Platform and HPC Data Engineer to join our team, where you will play a key role in the design, implementation, and optimization of data management solutions within high-performance computing (HPC) environments. We are looking for a candidate with substantial experience in diverse file systems, data labeling and tagging systems, as well as the configuration of various storage appliances.
In this position you will be responsible for ensuring that data workflows, storage configurations, and metadata management are not only efficient and scalable but also adhere to organizational and government security standards. As part of a dynamic, cross-disciplinary team, you will help address the technical demands of HPC platforms, effective data management, and large-scale computational workflows. Join us in advancing our innovative solutions and shaping the future of high-performance computing!
Clearance :
Active Top Secret clearance with willingness and ability to obtain an SCI and CI polygraph
US Citizenship required
Interested in this role You can find all the relevant information in the description below.
As a Platform & HPC Data Engineer you will...
- Design and implement data management systems and architectures for HPC platforms, focusing on optimizing data flow, storage, and access in large-scale computing environments.
- Oversee the configuration, maintenance, and optimization of distributed file systems (e.g., Lustre, IBM Spectrum Scale, NFS, GPFS) and storage solutions used in HPC environments to ensure efficient performance, scalability, and reliability.
- Implement and manage metadata-driven systems for data labeling / tagging. This includes the development of strategies for classifying, indexing, and organizing datasets to enhance data discoverability, access control, and auditing.
- Configure and maintain various storage appliances (e.g., NetApp, Dell EMC, HPE) and integrated storage solutions. Ensure that storage devices are optimized for performance, capacity, and availability within the HPC ecosystem.
- Integrate data storage and management systems with HPC clusters, ensuring seamless data flow between compute nodes and storage appliances. Optimize data pipelines to support high-throughput workloads and minimize bottlenecks in I / O performance.
- Monitor and improve the performance of storage systems, focusing on I / O throughput, latency, and efficient resource allocation. Use performance metrics to guide optimizations across storage appliances and file systems.
- Implement security best practices for data access, protection, and management, ensuring compliance with government regulations and internal data governance policies. Configure encryption, access control, and secure data sharing methods.
- Develop and maintain automation scripts (e.g., using Python, Bash, or Perl) to streamline storage configurations, data labeling / tagging, and system monitoring tasks. Automate processes related to data integration and HPC platform management.
- Work closely with data scientists, HPC administrators, software developers, and other technical staff to support ongoing projects. Provide expertise in troubleshooting data storage issues and ensuring optimal system performance.
- Maintain thorough documentation for storage configurations, file system setups, data labeling / tagging procedures, and performance optimization strategies. Provide regular reports on system health, data management processes, and any improvements made.
Platform & HPC Data Engineer Qualifications :
Additional Skills We'd Like to See :
Who we are :
Reinventing Geospatial, Inc. (RGi) is a fast-paced small business that has the environment and culture of a start-up, with the stability and benefits of a well-established firm. We solve complex problems within geospatial software development and national defense to make an Immediate Impact for our nation’s soldiers and analysts.
We pride ourselves on giving employees an exceptional life experience, where creativity thrives, and challenges are simply part of the fun. We provide truly excellent benefits, including :
Grow to be our next leader :
At RGi, fostering a strong and organic corporate culture is paramount and serves as a compass on the decisions we make and how we operate the company. We believe our culture of camaraderie, innovation, and collaboration reflects the caliber of our employees and their dedication to the mission of providing quality software to our customers. As such, we want our employees to feel empowered to seek growth and leadership opportunities within the company and position us to maintain our culture as we grow. RGi provides opportunities, resources, training, and mentorship to all our employees to let them take control of their careers and become a leader or a crucial member of our company. If this is what you are looking for in a company, then you are what we are looking for in an employee.
Reinventing Geospatial, Inc. is an Equal Opportunity Employer committed to hiring and retaining a diverse workforce. We are an Equal Opportunity Employer, making decisions without regard to race,
J-18808-Ljbffr
