Big Data (Spark,Scala & Abinito)

Job Title : Big Data (Spark,Scala & Abinito)

Work Location : NYC, NY (Contract)

SparkScala is the primary job requirement Abinito knowledge would help as the work is to migrate Abinito graph to Spark Cloud knowhow is a big plus

Knowledge Skills

• Experienced in Cloud Data Architecture and designing same based on business need and developing a migration strategy for data
• Hands on Experience with SparkPython and Abinitio
• Architected Developed All Ingestion Patterns Real Time Batch Structured Unstructured ImagesPDF for each data analytics platform
• Strong analytical skills with a proven ability to understand and document business data requirements in complete accurate extensible and flexible logical data models data modeling tools
• Able to facilitate discussions between Technology and business people recognize issues of conflict and inconsistency between data requirements and pursue a resolution of these issues
• Evaluates and undertakes impact analysis on major design options for Spark jobs and assesses and leads associated risks
• Design and Developed ETL Engineering Frameworks Low Code No Code and Intake frameworks
• Leads modification and maintenance of data structures and associated components according to logical and physical design structures for large or complex systems
• Crafts and or uses System of Records SORs and identify data reuse
• Deep Technical knowledge of DBMS products and ecosystem eg storage formats access algorithms data management processes administration data maintenance replication high availability encryption etc
• Ability to monitor and tune databases and DBMSs to reach high performance eg use data monitoring and analysis tools tune configuration parameters alter physical designs benchmark etc
• Takes part in reviews of own work and leads reviews of colleagues work
• Has working knowledge of the range of tools used in the planning analyzing crafting building testing configuring and maintaining of assigned applications
• Able to participate in assigned teams Agile delivery methodology
• Understands and has practical experience with infrastructure technologies and components like servers jvms and networking concepts
• Application of industry best practices processes and standards
• Identifies a number of ways to do things differently that will continuously improve the product
• Understands the complete vertical platform environment technical stack
• Everyone needs to be well equipped with Spark job design should be proactive enough to perform RDs assess best architecture options etc and should be hands on Developers who can write Speak and deliver against a given backlog is not good enough need people who has experience in Spark migration familiar with challenges can proactively recommend implement best practices

Please send your resumes to :

azhar@eagleiitech.com