**Hybrid - candidate must be local to Atlanta, GA to go onsite 2-3 times a month.**
Our transportation client is looking for a Big Data Engineer - Spark/Databricks to join their team.
Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Pay Rate: $65.00 - $70.00/hr on W2
Skills, experience, and other compensable factors will be taken into account when determining pay rate. The pay range provided in this posting is a reflection of a W2 hourly rate; other employment options may be available that may result in pay outside of the provided pay range.
W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.
Requirements of the Big Data Engineer - Spark/Databricks:

• At least 5 years of relevant experience
• Must have hands-on experience with Databricks
• Must have hands-on experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming
• Must have hands-on experience with Python and/or Scala i.e. PySpark/Scala-Spark
• Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka
• Experience with Traditional ETL tools and Data Modeling
• Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog
• Experience with data ingestion of different file formats across like JSON, XML, CSV
• Experience with Cloud platforms e.g. AWS, Google Cloud Platform, etc.
• Experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake or BigQuery
• Deep knowledge of troubleshooting and tuning Spark applications
• Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series
• Knowledge of Unix/Linux platform and shell scripting

Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact
Job ID: 385438
About Eliassen Group:
Eliassen Group is a leading strategic consulting company that provides business and IT services for our clients as they seek to transform and execute strategies that will drive exceptional outcomes. Leveraging over 30 years of success, we focus on professional services, talent solutions, and life sciences. Eliassen Group offers local community presence and deep networks. We are committed to positively impacting the lives of our employees, clients, consultants, and the communities in which we operate.
Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a $1,000 referral check!