What are the responsibilities and job description for the Data Engineer (AWS & Java) position at Celer Soft LLC?
Job Details
Job Title: Data Engineer (AWS & Java)
Location: Richmond, VA (Day One On-Site)
Duration: Contract
Job Description:
We are seeking a Data Engineer with strong AWS and prior Java experience to join our team in Richmond, VA. The ideal candidate will have expertise in designing, developing, and optimizing data pipelines while leveraging cloud technologies.
Key Responsibilities:
Develop, maintain, and optimize data pipelines using AWS services.
Work with large-scale structured and unstructured datasets.
Implement data processing solutions using Spark, Python, or Java.
Utilize AWS services like Glue, Lambda, S3, Redshift, EMR, and Kinesis.
Collaborate with data scientists, analysts, and software engineers.
Ensure data security, governance, and compliance best practices.
Required Skills:
8 years of experience in Data Engineering.
Strong AWS expertise (Glue, Lambda, S3, Redshift, etc.).
Prior Java experience in data processing or backend services.
Experience with SQL, Python, or Scala for data transformation.
Knowledge of ETL processes and data warehousing.
Familiarity with CI/CD pipelines and version control (Git).
Nice-to-Have:
Experience with Kafka, Snowflake, or Databricks.
Hands-on experience in Terraform or CloudFormation.