Amazon Redshift will no longer support the creation of new Python UDFs starting November 1, 2025.
If you would like to use Python UDFs, create the UDFs prior to that date.
Existing Python UDFs will continue to function as normal. For more information, see the
blog post
SYS_STREAM_SCAN_STATES
Records scan states for records loaded via streaming ingestion.
SYS_STREAM_SCAN_STATES is visible to all users. Superusers can see all rows; regular users can see only their own data. For more information, see Visibility of data in system tables and views.
Table columns
| Column name | Data type | Description |
|---|---|---|
| external_schema_name | character(128) | The external schema name. It is case sensitive. |
| stream_name | character(255) | The stream name. It is case sensitive. |
| mv_name | character(128) | The name of the associated materialized view. Empty if none. It is case sensitive. |
| transaction_id | bigint | The transaction ID. |
| query_id | bigint | The query ID. |
| record_time | timestamp without time zone | The time when the data was logged. |
| partition_id | character(128) | The partition or shard id. It is case sensitive. |
| latest_position | character(128) | The position of the last record read in the batch. This corresponds with the sequence number in Kinesis or the offset in Amazon MSK. It is case sensitive. |
| scanned_rows | bigint | The number of records that were scanned in the batch. |
| skipped_rows | bigint | The number of records that were skipped in the batch. |
| scanned_bytes | bigint | The number of bytes that were scanned in the batch. |
| stream_record_time_min | timestamp without time zone | Kinesis or Amazon MSK arrival time for the earliest record in the batch. |
| stream_record_time_max | timestamp without time zone | Kinesis or Amazon MSK arrival time for the latest record in the batch. |
The following query shows stream and topic data for specific queries.
select query_id,mv_name::varchar,external_schema_name::varchar,stream_name::varchar,sum(scanned_rows) total_records, sum(scanned_bytes) total_bytes from sys_stream_scan_states where query in (5401180,8601939) group by 1,2,3,4; query_id | mv_name | external_schema_name | stream_name | total_records | total_bytes ------------+----------------+----------------------+-----------------+---------------+---------------- 5401180 | kinesistest | kinesis | kinesisstream | 1493255696 | 3209006490704 8601939 | msktest | msk | mskstream | 14677023 | 31056580668 (2 rows)