nxcals.api.extraction.data.builders.DataQuery.getAsPivot

static DataQuery.getAsPivot(spark: SparkSession, start_time: str | datetime | datetime64 | timedelta | int | int64, end_time: str | datetime | datetime64 | timedelta | int | int64, system: str, variables: Iterable[str] = (), variables_like: Iterable[str] = ()) → DataFrame

Create a dataset with variable names as columns. Values are joined on timestamps. Experimental, may be changed in the future. Doesn’t support variables pointing to whole entities. :param spark: spark session :param start_time: begin of extraction time window :param end_time: end of extraction time window :param system: system name, where variables will be searched from variable_names :param variables: iterable containing variable names, which must be registered in system. All must exist, throws

exception otherwise

Parameters:

variables_like – iterable containing variable name patterns, which must be registered in system

Returns:

PySpark DataFrame, with one column “nxcals_timestamp” and other columns named after variables, e.g.

“nxcals_timestamp”, “BLM1:arr”, “BLM2:voltage”.