What are the responsibilities and job description for the Data Analytics & Engineering - Data Engineer Test IV position at Iron Systems, Inc?
The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization’s data assets.
Job Responsibilities
Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
Job Responsibilities
- Manage data engineering projects through the full cycle.
- Identify and underline business initiatives from a data engineering perspective
- Design, construct, install, test and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Design, implement, automate and maintain large scale enterprise data ETL processes.
- Build high-performance algorithms, prototypes, predictive models and proof of concepts.
Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- 5 years of Python development experience.
- 5 years of SQL experience.
- 5 years experience in engineering data pipelines using big data technologies (Hive, Presto, Spark, Flink etc.) on large scale datasets.
- 5 years experience with Schema Design and Data Modeling.
- 5 years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
- Experience understanding requirements, analyzing data, discovering opportunities, addressing gaps and communicating them to multiple individuals and stakeholders.
- Experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. Snowflake, AWS Redshift, Google BigQuery, Azure Data Warehouse, Netezza, Teradata, or similar).
- Ability to work as part of a team, as well as work independently or with minimal direction.
- Excellent written, presentation, and verbal communication skills.
- Collaborate with data architects, modelers and IT team members on project goals.
- Strong PC skills including knowledge of Microsoft SharePoint.
