Performance benefits - Amazon ElastiCache
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Performance benefits

The following table summarizes the performance improvements observed in testing with a memory-enabled agent versus a stateless agent:

Metric Without memory With memory Improvement
Tool calls per request 3 0 (memory retrieval) Eliminated redundant tool calls
Token usage ~70,000 ~6,300 12x reduction
Response time 9.25 seconds 2 seconds 3x+ faster
Memory lookup latency N/A Sub-millisecond Valkey in-memory performance