1 cloud Engineer - w2 only - local to WI Job in Madison, WI
SORT BY
C
cloud Engineer - w2 only - local to WI
$108k-134k (estimate)
Contractor | IT Outsourcing & Consulting
1 Week Ago
Chelsoft Solutions Co. is Hiring a cloud Engineer - w2 only - local to WI Near Madison, WI
Key Responsibilities
- Collaborate with data engineering, business analysts, and development teams to design, develop, test, and maintain robust and scalable data pipelines from Workday to AWS Redshift.
- Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
- Provide expertise in Redshift database optimization, performance tuning, and query optimization.
- Assist with design and implementation of workflows using Airflow.
- Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns.
- Proactively identify opportunities to automate tasks and develop reusable frameworks.
- Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git/Bitbucket.
- Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.
- Advanced hands-on experience designing AWS data lake solutions.
- Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow.
- Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
- Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins and transforming dataframes with pyspark code.
- Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles.
- Experience with Airflow DAG creation.
- Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.
- Ability to work in a highly complex python object oriented platform.
- Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
- Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
- Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
- Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
- Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.
- Docker
- Airflow Server Administration
- Parquet file formats
- AWS Security
- Jupyter Notebooks
- API Best Practices, API Gateway, Route Structuring and standard API authentication protocols including tokens
- Git, Git flow best practices
- Release management and DevOps
- Shell scripting
- AWS certifications related to data engineering or databases are a plus.
- Experience with DevOps technologies and processes.
- Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
- Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
- Experience working with large-scale, high-volume data environments.
- Exposure to higher education, finance, and/or human resources data is a plus.
- Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.
Job Summary
JOB TYPE
Contractor
INDUSTRY
IT Outsourcing & Consulting
SALARY
$108k-134k (estimate)
POST DATE
06/17/2024
EXPIRATION DATE
12/11/2024
WEBSITE
chelsoftusa.com
HEADQUARTERS
OLATHE, KS
SIZE
50 - 100
FOUNDED
2010
TYPE
Private
CEO
KIRAN CHELLUR
REVENUE
$5M - $10M
INDUSTRY
IT Outsourcing & Consulting
Related Companies
About Chelsoft Solutions Co.
Chelsoft Solutions is a provider of consulting and staff augmentation services for banking, healthcare and hospitality industries.
Show more
Similar Jobs
Popular Articles
Top 10 Things to Avoid Putting on a Job Application
Read Article
How to Describe Your Education in a Resume
Read Article
How to Write a Memorable Cover Letter in 5 Ways
Read Article
4 Personal Finance Tips to Make During Job Transition
Read Article
4 Best Camera Setups for Interview
Read Article
Keeping a Job Search Journal: 9 Types of Journaling You Can Do
Read Article
