Supported software versions
Please take note of the following requirements:
JDK (Java) versions
JDK 11 (Java 11)
The current version supported by NXCALS. Please update your configurations to use /var/nxcals/jdk1.11 for Spark executors running on Yarn.
JDK 8 (Java 1.8)
The obsolete version used by NXCALS.
Python versions
Python 3.7.9
The current version supported by NXCALS.
This version is the one provided by acc-py.
Spark version
Spark 3.1.1
The current version supported by NXCALS. Please update your configurations to use jars from this version (property spark.yarn.jars) for Spark executors running on Yarn.
Spark 2.4.0
The obsolete version used by NXCALS.