AWS Developer

We are seeking a technically strong AWS Developer with proven experience in building data integration pipelines using AWS Glue, implementing real-time data processing with Kafka, and automating cloud infrastructure with Terraform. Secondary expertise in .NET technologies is a plus to help support and enhance legacy systems.

This role is ideal for a developer passionate about scalable data platforms, cloud-native architectures, and modern DevOps practices.

Key Responsibilities: AWS Glue & Data Engineering

• Design, develop, and maintain ETL/ELT jobs using AWS Glue (PySpark/Scala).
• Manage Glue Crawlers, Glue Catalog, and job orchestration using Lambda or Step Functions.
• Optimize job performance with techniques like partitioning, dynamic frames, and pushdown predicates.
• Ingest data from various sources: S3, RDS, DynamoDB, and Redshift.

Kafka (Streaming Data)

• Build Kafka-based real-time pipelines using Apache Kafka or Amazon MSK.
• Develop producers and consumers to handle large-scale, event-driven workloads.
• Implement schema evolution (e.g., Schema Registry), robust error handling, retries, and reprocessing.
• Monitor Kafka streams using Confluent Control Center, Kafka Manager, or Grafana/Prometheus.

Terraform & Infrastructure as Code

• Write and maintain Terraform modules to provision and manage AWS infrastructure (e.g., Glue, Lambda, MSK, CloudWatch, VPC, IAM, API Gateway).
• Use Terraform Cloud or Terraform Enterprise for state management and deployment pipelines.
• Apply best practices in environment isolation, resource versioning, and rollback strategies.

.NET Development (Secondary Skill)

• Support and maintain legacy services built with .NET Core or .NET Framework.
• Develop and expose REST APIs or background services integrated with AWS components.
• Deploy .NET apps on Windows EC2 or containerized environments like ECS/EKS.

Collaboration & Quality Assurance

• Ensure scalable, maintainable code through design patterns, unit testing, and code reviews.
• Implement logging, monitoring, and alerting using CloudWatch, X-Ray, or third-party tools.
• Collaborate with DevOps, QA, and data architecture teams in an Agile/Scrum environment.
• Document architecture, processes, and configurations in Confluence, GitHub, or internal wikis.

Required Skills & Qualifications:

• Programming Languages: Python (Glue), Scala (optional), C# (.NET)
• Cloud & Infrastructure: AWS Glue, Lambda, S3, RDS, MSK, IAM, Redshift, Step Functions, Secrets Manager
• DevOps & Automation: Terraform, Git, CI/CD (GitHub Actions / Jenkins), Docker
• Streaming: Kafka (Apache or Confluent), Schema Registry, Avro, JSON
• Databases: PostgreSQL, SQL Server, DynamoDB, Redshift
• Others: REST APIs, YAML/JSON, PySpark, CI/CD pipelines
• AWS Certifications (Developer, DevOps Engineer, or Data Analytics – Specialty)
• Experience with Docker and container orchestration (ECS or EKS)
• Familiarity with data lake or lakehouse architecture
• Knowledge of data privacy, security, and governance (e.g., encryption, GDPR)

Job Type: Contract

Pay: $60,000.00 - $100,000.00 per year

Application Question(s):

• Are you a permanent citizen or hold Green Card or GC EAD? If Not Please help with your Visa status for the location Applied For.
• Are you comfortable with the location of the position?
• What is your Current Location?
• What is your Current CTC?
• What is your Expected CTC?
• Your LinkedIn Profile Link

Experience:

• AWS Developer: 5 years (Required)

Work Location: In person

Salary : $60,000 - $100,000