filterIndex compared to filter
To illustrate the difference between filterIndex
and filter
, consider the following example
queries. Assume that you have created a field index for IPaddress
, for four of your log groups, but not for a fifth log
group. The following query using filterIndex
will skip scanning the log group that doesn't have the field indexed.
For each indexed log group, it attempts to scan only log events that have the indexed field, and it
also returns only results from after the field index was created.
fields @timestamp, @message | filterIndex IPaddress = "198.51.100.0" | limit 20
In contrast, if you use filter
instead of filterIndex
for a query of the same five log groups,
the query will attempt to scan not only the log events that contain the value in the indexed log groups, but will also scan the fifth log group that isn't indexed, and
it will scan every log event in that fifth log group.
fields @timestamp, @message | filter IPaddress = "198.51.100.0" | limit 20