What are the responsibilities and job description for the AWS Data Engineer, position at VeriiPro?
Job Title - AWS Data EngineerLocation - Atlanta, GA/ Charlotte, NC/ Dallas, TX
We are seeking an experienced AWS Data Engineer to design, build, and maintain data systems using Amazon Web Services (AWS), ensuring efficient data ingestion, transformation, and storage solutions.
- Design and develop data models, data pipelines, and storage solutions using AWS services.
- Build ETL (Extract, Transform, Load) pipelines and workflows to ingest and transform data.
- Create documentation for data pipelines, processes, and best practices.
- Manage data lifecycle, ensure data quality, and apply programming concepts to optimize data processes.
- Work with AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR, Amazon Athena, Amazon DynamoDB, Amazon CloudWatch, Amazon SNS, and AWS Step Functions.
- Proficient in SQL, Python, PySpark, and data warehousing.
Required Skills & Experience
- Expertise in AWS Data Services, including Redshift, RDS, and AWS S3.
- Strong programming skills in Python, Spark, and Scala.
- In-depth knowledge of Big Data technologies, including Hadoop, AWS Glue, and data lakes.
- Experience in building and maintaining data pipelines and ensuring efficient processing of structured and unstructured data.
