nxcals.api.extraction.data.builders.SparkSession.newSession
- SparkSession.newSession() SparkSession
Returns a new
SparkSession
as new session, that has separate SQLConf, registered temporary views and UDFs, but sharedSparkContext
and table cache.New in version 2.0.0.
- Returns:
Spark session if an active session exists for the current thread
- Return type:
Examples
>>> spark.newSession() <...SparkSession object ...>