What are the responsibilities and job description for the Big Data Developer position at TekDoors Inc.?
Job Title: BigData Engineer
Location: USA
Duration: Contract and Full Time
Contract W2
Must Have:
• 8 years of work experience and relevant experience.
• Looking for strong software engineer first that happen to have data experience second.
• Strong solid understanding of the Big Data Platform/Architecture.
• Extensive experience on Spark, Scala/PySpark
• Expertise in SQL ; Hands-on experience working with Hive/Impala/Spark-SQL for data curation/conformance (ETL) related work
• Experience on Kafka/Spark Streaming
• Strong Communication skills Team player
• Experience building and maintaining data processing and machine learning pipelines.
• More depth in Software Engineering/ coding experience
• Familiarity with basic concept like CI/CD
• Proficient in the SDLC in an agile environment
• Experience with source code and exposure to repositories such as git, jira, or equivalent system
