Advanced data types
Advanced data types are data types that DataBrew detects within a string column in a project by means of pattern matching. When you click on a string column, the column is flagged as the corresponding advanced data type if 50% or more of the values in the column meet the criteria for that data type.
The data types DataBrew can detect are:
Date/timestamp
SSN
Phone number
Email
Credit card
Gender
IP address
URL
Zipcode
Country
Currency
State
City
You can use the following transforms to work with advanced data types:
GET_ADVANCED_DATATYPE: Given a string column, identifies the advanced data type of the column, if any.
EXTRACT_ADVANCED_DATATYPE_DETAILS: Extracts details for an advanced data type.
ADVANCED_DATATYPE_FILTER: Filters a current source column based on advanced data type detection.
ADVANCED_DATATYPE_FLAG: Creates a new flag column based on the values for the current source column.