nxcals.api.extraction.data.builders.DataFrame.sparkSession

property DataFrame.sparkSession: SparkSession

Returns Spark session that created this DataFrame.

Added in version 3.3.0.

Changed in version 3.4.0: Supports Spark Connect.

Return type:

SparkSession

Examples

>>> df = spark.range(1)
>>> type(df.sparkSession)
<class '...session.SparkSession'>