What are the responsibilities and job description for the Senior Data Engineer (AWS & Machine Learning) position at VDart?
Senior Data Engineer (ETL, AWS & Machine Learning)
Juno Beach FL
10 months Contract
Key skills : AWS, ML, ETL & Big Data, CloudWatch monitoring, Python development, Spark / PySpark, SQL performance tuning, AWS Lambda
Required Skills -
Experience building and maintaining ETL pipelines with large data sets using services such as AWS Glue, EMR, Kinesis or Kafka, CloudWatch -
Strong Python development experience with proficiency in Spark or PySpark and in using APIs. -
Strong in writing SQL queries and performance tuning in AWS Redshift and other industry leading RDMS such MS SQL Server, Postgres -
Proficient working with AWS Services such as AWS Lambda, Event Bridge, Step functions, SNS, SQS, S3 and MI models -
Knowledge of machine learning, deep learning AMIs and natural language processing (NLP) techniques. -
Design and build machine learning models and algorithms to solve complex problems -
Familiar with how IAM Roles and Policies work
Preferred Skills
Familiar with infrastructure coding such as Cloud Formation Worked in CI / CD pipeline and agile methodologies.
