nxcals.api.common.utils.hdfs_utils.HdfsUtils

class nxcals.api.common.utils.hdfs_utils.HdfsUtils(spark: SparkSession)

Utility class for interacting with HDFS.

Methods

HdfsUtils.__init__(spark)	Initializes the HdfsUtils instance.
HdfsUtils.copy_to_local(source, destination)	Copies files from an HDFS source directory to a local destination.
HdfsUtils.list_files(src_dir)	Retrieves a list of file paths from the specified HDFS directory.