TITLE: Big Data Engineer
TYPE: Contract
LOCATION: Columbia South Carolina 29223 (Hybrid)

Partial Onsite - 1 day per week
Required Technologies:

• Big Data technologies
• Experience in cloud-based technologies.
• AWS computational - EMR, State Machines, Step Functions, CDK, Glue, TypeScript, CloudWatch
• AWS storage S3, Glacier Archival Storage
• Spark
• Scala
• Python

Nice To Have:

• AWS DataSync
• AWS Lake Formation
• AWS Redshift
• Cloud9
• Hive
• Kafka
• HBase
• Oozie
• Sqoop
• Git
• IntelliJ

Day to Day:
Review and analyze systems, streamlining processes to ensure efficient, consistent use of all resources and adjusting designs to maximize reusability and reduce costs across subsystems. Provide technology solutions and prototypes to be used as the basis or template for more complicated business/technical requirements. Research, diagnose, and develop fixes for defects in existing code. Address maintenance issues related to current development, testing, and production.
Act as an internal consultant, advocate, mentor, and change agent providing expertise and technical guidance on complex projects. Work closely with customers, business analysts, and team members to determine business requirements that drive the analysis and design of quality technical solutions. Ensure solutions are aligned with business and IT strategies and comply with the organization s architectural standards.
Provide design recommendations based on long-term IT organization strategy. Make recommendations towards the development of new code or reuse of existing code. Responsibilities may also include participation in component and data architecture design, performance monitoring, product evaluation and buy versus build recommendations.
Perform analysis, design, programming, and implementation on systems and procedures to solve complex business or scientific problems. Develop enterprise-level applications and custom integration solutions. Evaluate complex interrelationships in immediate programming area to determine how changes in one program will affect another related area.
Develop programming and development standards. Devise new sources of data and develop new approaches and techniques. Involved in the full systems life cycle and is responsible for designing, coding, testing, implementing, maintaining, and supporting application software that is delivered on time and within budget.