pyspark.sql.DataFrame.crosstab

DataFrame.crosstab(col1: str, col2: str) → pyspark.sql.dataframe.DataFrame

Computes a pair-wise frequency table of the given columns. Also known as a contingency table. The number of distinct values for each column should be less than 1e4. At most 1e6 non-zero pair frequencies will be returned. The first column of each row will be the distinct values of col1 and the column names will be the distinct values of col2. The name of the first column will be $col1_$col2. Pairs that have no occurrences will have zero as their counts. DataFrame.crosstab() and DataFrameStatFunctions.crosstab() are aliases.

New in version 1.4.0.

Parameters

col1str

The name of the first column. Distinct items will make the first item of each row.

col2str

The name of the second column. Distinct items will make the column names of the DataFrame.

pyspark.sql.DataFrame.crossJoin pyspark.sql.DataFrame.cube