Amazon Redshift will no longer support the creation of new Python UDFs starting November 1, 2025.
If you would like to use Python UDFs, create the UDFs prior to that date.
Existing Python UDFs will continue to function as normal. For more information, see the
blog post
Secure logging
When Amazon Redshift logs a query that references one or more Amazon Glue Data Catalog views, Amazon Redshift automatically masks fields in certain system table and view columns when logging metadata about that query.
Secure log masking applies to all system table and view entries that Amazon Redshift
generates while running a query that fits the masking conditions. The following
table lists system views and columns that have secure logging applied, masking
text with ****** and numbers with -1.
The number of asterisks used to mask text matches the number of characters in the
original text, up to 6 characters. Strings longer than 6 characters still
appear as 6 asterisks.
| System table | Sensitive columns |
|---|---|
| SYS_EXTERNAL_QUERY_DETAIL | Columns: source_type, total_partitions, qualified_partitions, scanned_files, returned_rows, returned_bytes, file_format, file_location, external_query_text, warning_message. |
| SYS_EXTERNAL_QUERY_ERROR | Columns: file_location, rowid, column_name, original_value, modified_value, trigger, action, action_value, error_code. |
| SYS_QUERY_DETAIL | Columns: step_id, step_name, table_id, table_name, input_bytes, input_rows, output_bytes, output_rows, blocks_read, blocks_write, local_read_IO, remote_read_IO, spilled_block_local_disk, spilled_block_remote_disk, step_attribute. |
| SYS_QUERY_HISTORY | Columns: returned_rows, returned_bytes. |
| STL_AGGR | Columns: rows, bytes, tbl, type. |
| STL_BCAST | Columns: rows, bytes, packets. |
| STL_DDLTEXT | Columns: label, text. |
| STL_DELETE | Columns: rows, tbl. |
| STL_DIST | Columns: rows, bytes, packets. |
| STL_ERROR | Columns: file, linenum, context, error. |
| STL_EXPLAIN | Columns: plannode, info. |
| STL_FILE_SCAN | Columns: name, line, bytes. |
| STL_HASH | Columns: rows, bytes, tbl, est_rows. |
| STL_HASHJOIN | Columns: rows, tbl, num_parts, join_type. |
| STL_INSERT | Columns: rows, tbl. |
| STL_LIMIT | Columns: rows. |
| STL_MERGE | Columns: rows. |
| STL_MERGEJOIN | Columns: rows, tbl. |
| STL_NESTLOOP | Columns: rows, tbl. |
| STL_PARSE | Columns: rows. |
| STL_PLAN_INFO | Columns: startupcost, totalcost, rows, bytes. |
| STL_PROJECT | Columns: rows, tbl. |
| STL_QUERY | Columns: querytxt. |
| STL_QUERY_METRICS | Columns: max_rows, rows, max_blocks_read, blocks_read, max_blocks_to_disk, blocks_to_disk, max_query_scan_size, query_scan_size. |
| STL_QUERYTEXT | Columns: text. |
| STL_RETURN | Columns: rows, bytes. |
| STL_S3CLIENT | Columns: bucket, key, transfer_size, data_size. |
| STL_S3CLIENT_ERROR | Columns: bucket, key, error, transfer_size. |
| STL_SAVE | Columns: rows, bytes, tbl. |
| STL_SCAN | Columns: rows, bytes, fetches, type, tbl, rows_pre_filter, rows_pre_user_filter, perm_table_name, scanned_mega_value. |
| STL_SORT | Columns: rows, bytes, tbl. |
| STL_SSHCLIENT_ERROR | Columns: ssh_username, endpoint, command, error. |
| STL_TR_CONFLICT | Columns: table_id. |
| STL_UNDONE | Columns: table_id. |
| STL_UNIQUE | Columns: rows, type, bytes. |
| STL_UTILITYTEXT | Columns: label, text. |
| STL_WINDOW | Columns: rows. |
| STV_BLOCKLIST | Columns: col, tbl, num_values, minvalue, maxvalue. |
| STV_EXEC_STATE | Columns: rows, bytes, label. |
| STV_INFLIGHT | Columns: label, text. |
| STV_LOCKS | Columns: table_id. |
| STV_QUERY_METRICS | Columns: rows, max_rows, blocks_read, max_blocks_read, max_blocks_to_disk, blocks_to_disk, max_query_scan_size, query_scan_size. |
| STV_STARTUP_RECOVERY_STATE | Columns: table_id, table_name. |
| STV_TBL_PERM | Columns: id, name, rows, sorted_rows, temp, block_count, query_scan_size. |
| STV_TBL_TRANS | Columns: id, rows, size. |
| SVCS_EXPLAIN | Columns: plannode, info. |
| SVCS_PLAN_INFO | Columns: rows, bytes. |
| SVCS_QUERY_SUMMARY | Columns: step, rows, bytes, rate_row, rate_byte, label, rows_pre_filter. |
| SVCS_S3LIST | Columns: bucket, prefix, retrieved_files, max_file_size, avg_file_size. |
| SVCS_S3LOG | Columns: message. |
| SVCS_S3PARTITION_SUMMARY | Columns: total_partitions, qualified_partitions, min_assigned_partitions, max_assigned_partitions, avg_assigned_partitions. |
| SVCS_S3QUERY_SUMMARY | Columns: external_table_name, file_format, s3_scanned_rows, s3_scanned_bytes, s3query_returned_rows, s3query_returned_bytes. |
| SVL_QUERY_METRICS | Columns: step_label, scan_row_count, join_row_count, nested_loop_join_row_count, return_row_count, spectrum_scan_row_count, spectrum_scan_size_mb. |
| SVL_QUERY_METRICS_SUMMARY | Columns: step_label, scan_row_count, join_row_count, nested_loop_join_row_count, return_row_count, spectrum_scan_row_count, spectrum_scan_size_mb. |
| SVL_QUERY_REPORT | Columns: rows, bytes, label, rows_pre_filter. |
| SVL_QUERY_SUMMARY | Columns: rows, bytes, rows_pre_filter. |
| SVL_S3LIST | Columns: bucket, prefix, retrieved_files, max_file_size, avg_file_size. |
| SVL_S3LOG | Columns: message. |
| SVL_S3PARTITION | Columns: rows, bytes, label, rows_pre_filter. |
| SVL_S3PARTITION_SUMMARY | Columns: total_partitions, qualified_partitions, min_assigned_partitions, max_assigned_partitions, avg_assigned_partitions. |
| SVL_S3QUERY | Columns: external_table_name, file_format, s3_scanned_rows, s3_scanned_bytes, s3query_returned_rows, s3query_returned_bytes, files. |
| SVL_S3QUERY_SUMMARY | Columns: external_table_name, file_format, s3_scanned_rows, s3_scanned_bytes, s3query_returned_rows, s3query_returned_bytes. |
| SVL_S3RETRIES | Columns: file_size, location, message. |
| SVL_SPECTRUM_SCAN_ERROR | Columns: location, rowid, colname, original_value, modified_value, trigger, action, action_value, error_code. |
| SVL_STATEMENTTEXT | Columns: type, text. |
| SVL_STORED_PROC_CALL | Columns: querytxt. |
| SVL_STORED_PROC_MESSAGES | Columns: message, linenum, querytext. |
| SVL_UDF_LOG | Columns: message, funcname. |
| SVV_DISKUSAGE | Columns: name, col, tbl, blocknum, num_values, minvalue, maxvalue. |
| SVV_QUERY_STATE | Columns: rows, bytes, label. |
| SVV_TABLE_INFO | Columns: table_id, table. |
| SVV_TRANSACTIONS | Columns: relation. |
For more information on system tables and views, see System tables and views reference in the Amazon Redshift Database Developer Guide. For information on Amazon Redshift’s ability to dynamically mask query results, see Dynamic data masking in the Amazon Redshift Database Developer Guide. For information on creating views in the Amazon Glue Data Catalog using Amazon Redshift, see Amazon Glue Data Catalog views in the Amazon Redshift Database Developer Guide.