What are the responsibilities and job description for the Cloud Data Engineer position at RDO OFFUTT?
The Cloud Data Engineer designs, develops, and maintains data solutions on the Microsoft Azure platform. Responsibilities include building scalable data pipelines, optimizing data storage, and integrating data from multiple sources to support data-driven decision-making across the organization. The position emphasizes the use of Azure tools and technologies to deliver robust, secure, and efficient data solutions in a cloud or hybrid application environment. This position is non-remote and will require the individual to be based in the Fargo, ND area.
Specific Job Duties:
- Analyzes and defines business requirements to determine specifications and standards; proposes and develops solutions.
- Deploys and oversees implementation and integration of web-based applications, ensuring that appropriate information security standards are met.
- Maintains reports, logs, or other records of security audits.
- Monitors system uptime and performance, troubleshooting and resolving errors.
- Stays informed of emerging cloud technologies and evaluates their value to the organization's operations.
- Designs and implements cloud architectures: Azure SQL, Data Lake, and Blob Storage.
- Develops, tests, and maintains data ingestion processes using Azure Data Factory, Microsoft Fabric and other tools appropriate to a variety of sources: API, IoT or relational.
- Manages and optimizes Azure Storage services, Fabric Data Warehousing, Azure Databricks, Apache Spark or similar services for advanced analytics and data processing.
- Ensures data quality, security, and compliance with organizational and regulatory standards.
- Implements and maintains CI/CD pipelines using Azure DevOps for seamless deployments.
Requirements:
- Knowledge of data processing languages and tools including SQL, Python, Java, and C#, with the ability to understand parallel processing and data architecture patterns.
- Proficient in using cloud services: Azure Data Factory, Azure Data Lake Storage, Synapse Analytics, Stream Analytics, Azure Event Hubs, as required to create data processing solutions.
- Proficient in software design and software documentation, debugging, and problem-solving skills.
- Detail-oriented and capable of working within a collaborative team environment.
- Requires a bachelor's degree and 3 to 8 years of experience.
- Master’s degree beneficial.
EOE/M/F/Disabled/Veteran
