7 Certified Cloud Engineer AWS Jobs in Madison, WI
SORT BY
X
B
N
E
V
R
Certified Cloud Engineer AWS
$111k-138k (estimate)
Full Time | IT Outsourcing & Consulting
1 Week Ago
Nava Software Solutions is Hiring a Certified Cloud Engineer AWS Near Madison, WI
NAVA Software solutions is looking for a Certified Cloud Engineer/ AWS EngineerDetailsCertified Cloud Engineer/ AWS EngineerLocation: Remote project (Need to be based in WI state)Duration: 12 months The Enterprise Analytics Platform (EAP) team supports the development and support of the data lake for the UW System Office and member universities. We are seeking an experienced AWS Redshift Data Engineer to assist our team in designing, developing, and optimizing data pipelines for our AWS Redshift-based data lake house. Priority needs are cloud formation and event-based data processing utilizing SQS to support ingestion and movement of data from Workday to AWS Redshift for consumer and analytic use.
Key Responsibilities
Key Responsibilities
- Collaborate with data engineering, business analysts, and development teams to design, develop, test, and maintain robust and scalable data pipelines from Workday to AWS Redshift.
- Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
- Provide expertise in Redshift database optimization, performance tuning, and query optimization.
- Assist with design and implementation of workflows using Airflow.
- Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
- Proactively identify opportunities to automate tasks and develop reusable frameworks.
- Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git/Bitbucket.
- Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.
- Advanced hands-on experience designing AWS data lake solutions.
- Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow.
- Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
- Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins and transforming dataframes with pyspark code.
- Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles.
- Experience with Airflow DAG creation.
- Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.
- Ability to work in a highly complex python object oriented platform.
- Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
- Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
- Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
- Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
- Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.
- Docker
- Airflow Server Administration
- Parquet file formats
- AWS Security
- Jupyter Notebooks
- API Best Practices, API Gateway, Route Structuring and standard API authentication protocols including tokens
- Git, Git flow best practices
- Release management and DevOps
- Shell scripting
- AWS certifications related to data engineering or databases are a plus.
- Experience with DevOps technologies and processes.
- Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
- Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
- Experience working with large-scale, high-volume data environments.
- Exposure to higher education, finance, and/or human resources data is a plus.
- Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.
Job Summary
JOB TYPE
Full Time
INDUSTRY
IT Outsourcing & Consulting
SALARY
$111k-138k (estimate)
POST DATE
06/17/2024
EXPIRATION DATE
07/14/2024
WEBSITE
navasoftsol.com
HEADQUARTERS
ROCKY HILL, CT
SIZE
<25
FOUNDED
2017
CEO
GOVIND PEDDAPOTHLA
REVENUE
$5M - $10M
INDUSTRY
IT Outsourcing & Consulting
Related Companies
Show more
Similar Jobs
Popular Articles
Top 10 Things to Avoid Putting on a Job Application
Read Article
How to Describe Your Education in a Resume
Read Article
How to Write a Memorable Cover Letter in 5 Ways
Read Article
4 Personal Finance Tips to Make During Job Transition
Read Article
4 Best Camera Setups for Interview
Read Article
Keeping a Job Search Journal: 9 Types of Journaling You Can Do
Read Article
