RDDStorageInfo
== [[RDDStorageInfo]] RDDStorageInfo
[[creating-instance]] RDDStorageInfo
contains information about RDD persistence:
- [[id]] RDD id
- [[name]] RDD name
- [[numPartitions]] Number of RDD partitions
- [[numCachedPartitions]] Number of cached RDD partitions
- [[storageLevel]] storage:StorageLevel.md[Storage level] ID
- [[memoryUsed]] Memory used
- [[diskUsed]] Disk used
- [[dataDistribution]] Data distribution (as
Seq[RDDDataDistribution]
) - [[partitions]] Partitions (as
Seq[RDDPartitionInfo]]
)
RDDStorageInfo
is <LiveRDD
is requested to webui:spark-core-LiveRDD.md#doUpdate[doUpdate] (when requested to spark-core-LiveEntity.md#write[write]).
RDDStorageInfo
is used when:
. web UI's StoragePage
is requested to render an HTML spark-webui-StoragePage.md#rddRow[table row] and an entire spark-webui-StoragePage.md#rddTable[table] for RDD details
. REST API's AbstractApplicationResource
is requested for spark-api-AbstractApplicationResource.md#rddList[rddList] (at storage/rdd
path)
. AppStatusStore
is requested for core:AppStatusStore.md#rddList[rddList]
Last update: 2020-10-06