You haven't searched anything yet.
Job Title: Python Spark AWS
Location: Columbus, OH nonlocal candidates accepted
Duration: FULLTIME or 12 Months COntract
Job Responsibilities:
Develop and maintain data platforms using Python, Spark, and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladoc-style documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
Skills:
Proficiency in Python, Scala (with a focus on functional programming), and Spark.
Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloud-native applications.
Familiarity with serverless approaches using AWS Lambda is a plus
Thanks and Regards,
Chanakya [IT Recruiter]
Direct :
Full Time
$82k-103k (estimate)
06/22/2024
07/08/2024
conchtech.com
MEMPHIS, TN
25 - 50
2004
MADHU MAREDU
<$5M
Business Services
Conch Technologies, Inc connects technology professionals with small and large scale organizations to accelerate their business goals. For over a decade Conch Technologies, Inc has led the industry in providing innovative workforce solutions.