Skip to main content
Question

Spark 3.0 Scala 2.12 Support?

  • March 4, 2021
  • 2 replies
  • 6 views

GarrisonHale

Hi All,
To support many functionalities of our data analytic application, we upgraded to Spark 3.0, which is supported through scala 2.12. As of today (15 Jan 2021), Vertica 9 and 10 supports only up to Spark 2.4/Scala 2.11.
I would like to know when are we expecting latest version of Spark 3.0 support in Vertica? Any idea or any link through which it can be setup with Vertica?

Regards, https://9apps.ooo/

2 replies

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • March 4, 2021

Vertica 10.1 includes a new version of the Spark Connector which supports Scala 2.12 with Spark versions 2.4.1 and 3.0.

https://www.vertica.com/docs/10.1.x/HTML/Content/Authoring/NewFeatures/10.1/10.1.0/IntegrationSpark.htm


sujatavid
  • New Participant
  • September 28, 2022

For the Scala API, Spark 3.0. 0 uses Scala 2.12. You will need to use a compatible Scala version . .