AthenaCacheSettings

class awswrangler.typing.AthenaCacheSettings

Bases: TypedDict

Typed dictionary defining the settings for using cached Athena results.

Attributes

max_cache_seconds	awswrangler can look up in Athena's history if this table has been read before.
max_cache_query_inspections	Max number of queries that will be inspected from the history to try to find some result to reuse.
max_remote_cache_entries	Max number of queries that will be retrieved from AWS for cache inspection.
max_local_cache_entries	Max number of queries for which metadata will be cached locally.

Attributes Documentation

max_cache_seconds: NotRequired[int]

awswrangler can look up in Athena’s history if this table has been read before. If so, and its completion time is less than max_cache_seconds before now, awswrangler skips query execution and just returns the same results as last time.

max_cache_query_inspections: NotRequired[int]

Max number of queries that will be inspected from the history to try to find some result to reuse. The bigger the number of inspection, the bigger will be the latency for not cached queries. Only takes effect if max_cache_seconds > 0.

max_remote_cache_entries: NotRequired[int]

Max number of queries that will be retrieved from AWS for cache inspection. The bigger the number of inspection, the bigger will be the latency for not cached queries. Only takes effect if max_cache_seconds > 0 and default value is 50.

max_local_cache_entries: NotRequired[int]

Max number of queries for which metadata will be cached locally. This will reduce the latency and also enables keeping more than max_remote_cache_entries available for the cache. This value should not be smaller than max_remote_cache_entries. Only takes effect if max_cache_seconds > 0 and default value is 100.