Position: Data Architect

Location: Wilmington, DE/ New Jersey – Only Local Resumes

Years of experience: 13 Years

Job Description:12 years of experience on client projects to deliver AWS, Py Spark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing pipelines Scala (with a focus on the functional programming paradigm), Scalatest, JUnit, Mockito Embedded Cassandra Apache Spark 2.x Spark query tuning and performance optimization SQL database integration Microsoft, Oracle, Postgres, and/or MySQL Experience working with DFS, S3, Cassandra, and/or DynamoDB. Spark developer who knows how to fully exploit the potential of our Spark cluster and special emphasis to database development skills across Migration projects.