pyspark.sql.streaming.StreamingQuery.lastProgress

property StreamingQuery.lastProgress

Returns the most recent StreamingQueryProgress update of this streaming query or None if there were no progress updates

New in version 2.1.0.

Returns

dict, optional

The most recent StreamingQueryProgress update of this streaming query or None if there were no progress updates.

Examples

>>> sdf = spark.readStream.format("rate").load()
>>> sq = sdf.writeStream.format('memory').queryName('this_query').start()

Get the most recent query progress updates for this query

>>> sq.lastProgress
>>> sq.stop()

pyspark.sql.streaming.StreamingQuery.isActive pyspark.sql.streaming.StreamingQuery.name