nxcals.api.extraction.data.builders.DataFrame.sortWithinPartitions

DataFrame.sortWithinPartitions(*cols: Union[str, Column, List[Union[str, Column]]], **kwargs: Any) DataFrame

Returns a new DataFrame with each partition sorted by the specified column(s).

New in version 1.6.0.

Parameters:
  • cols (str, list or Column, optional) – list of Column or column names to sort by.

  • ascending (bool or list, optional) – boolean or list of boolean (default True). Sort ascending vs. descending. Specify list for multiple sort orders. If a list is specified, length of the list must equal length of the cols.

Examples

>>> df.sortWithinPartitions("age", ascending=False).show()
+---+-----+
|age| name|
+---+-----+
|  2|Alice|
|  5|  Bob|
+---+-----+