nxcals.api.extraction.data.builders.DataFrame.unpersist
- DataFrame.unpersist(blocking: bool = False) DataFrame
Marks the
DataFrame
as non-persistent, and remove all blocks for it from memory and disk.New in version 1.3.0.
Changed in version 3.4.0: Supports Spark Connect.
Notes
blocking default has changed to
False
to match Scala in 2.0.- Parameters:
blocking (bool) – Whether to block until all blocks are deleted.
- Returns:
Unpersisted DataFrame.
- Return type:
Examples
>>> df = spark.range(1) >>> df.persist() DataFrame[id: bigint] >>> df.unpersist() DataFrame[id: bigint] >>> df = spark.range(1) >>> df.unpersist(True) DataFrame[id: bigint]