pyspark.RDD.collectWithJobGroup

RDD.collectWithJobGroup(groupId, description, interruptOnCancel=False)[source]

When collect rdd, use this method to specify job group.

New in version 3.0.0.

Deprecated since version 3.1.0: Use pyspark.InheritableThread with the pinned thread mode enabled.

previous

pyspark.RDD.collectAsMap

next

pyspark.RDD.combineByKey