What are the responsibilities and job description for the Data Integration Engineer position at Onsight Technology Inc.?
Job Details
Job Description
Job Description
Benefits:
About the Job
Onsight Technology is at the forefront of the energy industry, revolutionizing the way solar sites are managed and optimized. Onsight Technology utilizes the power of AI, computer vision, and robotics to analyze and optimize solar sites. The cutting-edge technology offered by Onsight is specifically designed to provide essential data and insights for large remote sites, without the need for additional labor costs. Onsight's advanced algorithms can identify hundreds of potential problems and predict future ones, enabling proactive maintenance and optimization. With Onsight, solar sites can maximize their efficiency, reduce downtime, and increase overall profitability. To meet the growing demands of the energy industry, Onsight Technology is expanding its engineering and development team.
Job Description
Position Overview
We are seeking a highly skilled and motivated Data Engineer to design and implement data pipelines connecting embedded Linux devices on robots and smart cameras in the field to our cloud infrastructure. The role involves collecting, processing, and managing large datasets to support data cleaning, labeling, performance metric generation, and training workflows, as well as data delivery to our customers. This position offers the opportunity to work at the intersection of robotics, embedded systems, and cloud data engineering in the clean energy industry.
Key Responsibilities:
Develop data pipelines to collect and transmit data from embedded Linux devices to AWS cloud storage (S3 and PostgreSQL).
Design automated workflows using tools like Apache Airflow (or equivalent) to streamline data processing.
Ensure data integrity, security, and availability throughout the data lifecycle.
Build and maintain visual tools for data introspection at various stages of the pipeline.
Work with large data types, including images and point clouds, and optimize data transmission protocols.
Collaborate with teams to understand requirements for data labeling, cleaning, and system performance analysis.
Collaborate with product managers and customer engagement teams to ensure data is delivered correctly for each end customer.
Test, debug, and optimize software to ensure security, reliability, and performance.
Document software and system designs, interfaces, and implementation details.
Qualifications:
Bachelor's degree in Software Engineering, Computer Science, Computer Engineering, Data Engineering, or similar/equivalent.
Experience with Python, C , or Rust cloud or embedded systems development and deployment.
Hands-on experience with AWS services such as S3, Kinesis, and PostgreSQL.
Strong understanding of data processing pipelines and tools like Apache Airflow.
Familiarity with best practices for handling and securing large datasets.
Strong technical aptitude and problem-solving skills.
Ability to work independently and as part of a team.
Excellent communication skills.
Attention to detail and a commitment to develop quality and secure systems.
Preferred Qualifications:
Knowledge of moving and managing large data types (e.g., images, point clouds).
Expertise in data security practices and encryption standards.
Ability to design intuitive visual tools for data monitoring and introspection.
Knowledge of computer vision, sensor fusion, or machine learning is desirable.
Proficiency in Python, C , or Rust for embedded systems development and deployment.
Experience working with embedded Linux devices or robotics systems.
Knowledge of embedded communication protocols like CAN, Ethernet, TCP, UDP, etc.
Experience with version control systems like Git is preferred.
Familiarity with ROS2 (Robot Operating System 2) is a plus.
Knowledge of solar energy systems is a plus.
If you are passionate about technology, robotics, and sustainable energy and want to be a part of a dynamic team that is reshaping the future of solar site management, we encourage you to apply.
Onsight Technology is an equal-opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees.
- 401(k)
- Competitive salary
- Dental insurance
- Health insurance
- Stock options plan
About the Job
Onsight Technology is at the forefront of the energy industry, revolutionizing the way solar sites are managed and optimized. Onsight Technology utilizes the power of AI, computer vision, and robotics to analyze and optimize solar sites. The cutting-edge technology offered by Onsight is specifically designed to provide essential data and insights for large remote sites, without the need for additional labor costs. Onsight's advanced algorithms can identify hundreds of potential problems and predict future ones, enabling proactive maintenance and optimization. With Onsight, solar sites can maximize their efficiency, reduce downtime, and increase overall profitability. To meet the growing demands of the energy industry, Onsight Technology is expanding its engineering and development team.
Job Description
Position Overview
We are seeking a highly skilled and motivated Data Engineer to design and implement data pipelines connecting embedded Linux devices on robots and smart cameras in the field to our cloud infrastructure. The role involves collecting, processing, and managing large datasets to support data cleaning, labeling, performance metric generation, and training workflows, as well as data delivery to our customers. This position offers the opportunity to work at the intersection of robotics, embedded systems, and cloud data engineering in the clean energy industry.
Key Responsibilities:
Develop data pipelines to collect and transmit data from embedded Linux devices to AWS cloud storage (S3 and PostgreSQL).
Design automated workflows using tools like Apache Airflow (or equivalent) to streamline data processing.
Ensure data integrity, security, and availability throughout the data lifecycle.
Build and maintain visual tools for data introspection at various stages of the pipeline.
Work with large data types, including images and point clouds, and optimize data transmission protocols.
Collaborate with teams to understand requirements for data labeling, cleaning, and system performance analysis.
Collaborate with product managers and customer engagement teams to ensure data is delivered correctly for each end customer.
Test, debug, and optimize software to ensure security, reliability, and performance.
Document software and system designs, interfaces, and implementation details.
Qualifications:
Bachelor's degree in Software Engineering, Computer Science, Computer Engineering, Data Engineering, or similar/equivalent.
Experience with Python, C , or Rust cloud or embedded systems development and deployment.
Hands-on experience with AWS services such as S3, Kinesis, and PostgreSQL.
Strong understanding of data processing pipelines and tools like Apache Airflow.
Familiarity with best practices for handling and securing large datasets.
Strong technical aptitude and problem-solving skills.
Ability to work independently and as part of a team.
Excellent communication skills.
Attention to detail and a commitment to develop quality and secure systems.
Preferred Qualifications:
Knowledge of moving and managing large data types (e.g., images, point clouds).
Expertise in data security practices and encryption standards.
Ability to design intuitive visual tools for data monitoring and introspection.
Knowledge of computer vision, sensor fusion, or machine learning is desirable.
Proficiency in Python, C , or Rust for embedded systems development and deployment.
Experience working with embedded Linux devices or robotics systems.
Knowledge of embedded communication protocols like CAN, Ethernet, TCP, UDP, etc.
Experience with version control systems like Git is preferred.
Familiarity with ROS2 (Robot Operating System 2) is a plus.
Knowledge of solar energy systems is a plus.
If you are passionate about technology, robotics, and sustainable energy and want to be a part of a dynamic team that is reshaping the future of solar site management, we encourage you to apply.
Onsight Technology is an equal-opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees.
Flexible work from home options available.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Senior Security Engineer
MDS (Micro-Data Systems) -
Rancho Cordova, CA
Data Integration Project Manager PMP
Lumecg -
Sacramento, CA
3D NAND Principal Process Integration Engineer
Solidigm -
Rancho Cordova, CA