What are the responsibilities and job description for the Bigdata engineer position at Carbonsoft?
**** Hiring Alert ****
Role: Sr. Big data developer / Pyspark developer
Location: Plano, TX - ONSITE
OPT, H1B, GC and citizens
8 years minimum
Type: Contract - W2 (All visa types are eligible to apply)
Job description:
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in data intensive development tools and technologies
Work with a team of developers with deep experience in distributed microservices and full stack systems
Utilize programming languages like Python and powerful computing technologies such as spark to do real time transformations and consumption of data.
Conduct reviews with other team members to make sure code is rigorously designed, elegantly
coded and effectively tuned for performance
Drive automated CI/CD release pipelines
Bachelor's Degree
At least 6 years of experience in big data technologies
At least 5 years of experience in practical coding in python
At least 4 years of experience in PySpark, Spark, Hadoop, EMR, and other cluster computing environments for data
At least 3 years experience with cloud computing (AWS)
Familiarity with jenkins, unit testing, and proper CI/CD practices is a must have
Preferred Qualifications:
7 years of experience in application development using Python
6 years of experience with AWS S3, EC2, ECS, Lambdas and EMR
6 years experience with Distributed data/ computing tools (EMR, Hadoop, Spark, MapReduce, and/or Kafka)
6 year experience working on real-time data and streaming applications - spark structured streaming in particular. Familiarity with data formats
Role: Sr. Big data developer / Pyspark developer
Location: Plano, TX - ONSITE
OPT, H1B, GC and citizens
8 years minimum
Type: Contract - W2 (All visa types are eligible to apply)
Job description:
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in data intensive development tools and technologies
Work with a team of developers with deep experience in distributed microservices and full stack systems
Utilize programming languages like Python and powerful computing technologies such as spark to do real time transformations and consumption of data.
Conduct reviews with other team members to make sure code is rigorously designed, elegantly
coded and effectively tuned for performance
Drive automated CI/CD release pipelines
Bachelor's Degree
At least 6 years of experience in big data technologies
At least 5 years of experience in practical coding in python
At least 4 years of experience in PySpark, Spark, Hadoop, EMR, and other cluster computing environments for data
At least 3 years experience with cloud computing (AWS)
Familiarity with jenkins, unit testing, and proper CI/CD practices is a must have
Preferred Qualifications:
7 years of experience in application development using Python
6 years of experience with AWS S3, EC2, ECS, Lambdas and EMR
6 years experience with Distributed data/ computing tools (EMR, Hadoop, Spark, MapReduce, and/or Kafka)
6 year experience working on real-time data and streaming applications - spark structured streaming in particular. Familiarity with data formats
Bigdata Engineer
Trident Consulting Inc. -
Irving, TX
Bigdata Engineer
Applied Thought Auditors & Consultants Inc. -
Irving, TX
Bigdata Engineer
DTEL Engineering & Consultants Inc -
Irving, TX