The settings in this section affect the way that Solr will process and respond to queries.
These settings are all configured in child elements of the <query> element in solrconfig.xml.
<query>
...
</query>Caches
Solr caches are associated with a specific instance of an Index Searcher, a specific view of an index that doesn’t change during the lifetime of that searcher. As long as that Index Searcher is being used, any items in its cache will be valid and available for reuse. Caching in Solr differs from caching in many other applications in that cached Solr objects do not expire after a time interval; instead, they remain valid for the lifetime of the Index Searcher.
When a new searcher is opened, the current searcher continues servicing requests while the new one auto-warms its cache. The new searcher uses the current searcher’s cache to pre-populate its own. When the new searcher is ready, it is registered as the current searcher and begins handling all new search requests. The old searcher will be closed once it has finished servicing all its requests.
In Solr, there are three cache implementations: solr.search.LRUCache, solr.search.FastLRUCache, and solr.search.LFUCache .
The acronym LRU stands for Least Recently Used. When an LRU cache fills up, the entry with the oldest last-accessed timestamp is evicted to make room for the new entry. The net effect is that entries that are accessed frequently tend to stay in the cache, while those that are not accessed frequently tend to drop out and will be re-fetched from the index if needed again.
The FastLRUCache, which was introduced in Solr 1.4, is designed to be lock-free, so it is well suited for caches which are hit several times in a request.
Both LRUCache and FastLRUCache use an auto-warm count that supports both integers and percentages which get evaluated relative to the current size of the cache when warming happens.
The LFUCache refers to the Least Frequently Used cache. This works in a way similar to the LRU cache, except that when the cache fills up, the entry that has been used the least is evicted.
The Statistics page in the Solr Admin UI will display information about the performance of all the active caches. This information can help you fine-tune the sizes of the various caches appropriately for your particular application. When a Searcher terminates, a summary of its cache usage is also written to the log.
Each cache has settings to define its initial size (initialSize), maximum size (size) and number of items to use for during warming (autowarmCount). The LRU and FastLRU cache implementations can take a percentage instead of an absolute value for autowarmCount.
FastLRUCache and LFUCache support showItems attribute. This is the number of cache items to display in the stats page for the cache. It is for debugging.
Details of each cache are described below.
filterCache
This cache is used by SolrIndexSearcher for filters (DocSets) for unordered sets of all documents that match a query. The numeric attributes control the number of entries in the cache.
The most typical way Solr uses the filterCache is to cache results of each fq search parameter, though there are some other cases as well. Subsequent queries using the same parameter filter query result in cache hits and rapid returns of results. See Searching for a detailed discussion of the fq parameter. Another Solr feature using this cache is the filter(…) syntax in the default Lucene query parser.
Solr also uses this cache for faceting when the configuration parameter facet.method is set to fc. For a discussion of faceting, see Searching.
<filterCache class="solr.LRUCache"
size="512"
initialSize="512"
autowarmCount="128"/>queryResultCache
This cache holds the results of previous searches: ordered lists of document IDs (DocList) based on a query, a sort, and the range of documents requested.
The queryResultCache has an additional (optional) setting to limit the maximum amount of RAM used (maxRamMB). This lets you specify the maximum heap size, in megabytes, used by the contents of this cache. When the cache grows beyond this size, oldest accessed queries will be evicted until the heap usage of the cache decreases below the specified limit.
<queryResultCache class="solr.LRUCache"
size="512"
initialSize="512"
autowarmCount="128"
maxRamMB="1000"/>documentCache
This cache holds Lucene Document objects (the stored fields for each document). Since Lucene internal document IDs are transient, this cache is not auto-warmed. The size for the documentCache should always be greater than max_results times the max_concurrent_queries, to ensure that Solr does not need to refetch a document during a request. The more fields you store in your documents, the higher the memory usage of this cache will be.
<documentCache class="solr.LRUCache"
size="512"
initialSize="512"
autowarmCount="0"/>User Defined Caches
You can also define named caches for your own application code to use. You can locate and use your cache object by name by calling the SolrIndexSearcher methods getCache(), cacheLookup() and cacheInsert().
<cache name="myUserCache" class="solr.LRUCache"
size="4096"
initialSize="1024"
autowarmCount="1024"
regenerator="org.mycompany.mypackage.MyRegenerator" />If you want auto-warming of your cache, include a regenerator attribute with the fully qualified name of a class that implements solr.search.CacheRegenerator. You can also use the NoOpRegenerator, which simply repopulates the cache with old items. Define it with the regenerator parameter as`: regenerator=”solr.NoOpRegenerator”`.
Query Sizing and Warming
maxBooleanClauses
This sets the maximum number of clauses allowed in a boolean query. This can affect range or prefix queries that expand to a query with a large number of boolean terms. If this limit is exceeded, an exception is thrown.
<maxBooleanClauses>1024</maxBooleanClauses>This option modifies a global property that effects all Solr cores. If multiple solrconfig.xml files disagree on this property, the value at any point in time will be based on the last Solr core that was initialized. |
enableLazyFieldLoading
If this parameter is set to true, then fields that are not directly requested will be loaded lazily as needed. This can boost performance if the most common queries only need a small subset of fields, especially if infrequently accessed fields are large in size.
<enableLazyFieldLoading>true</enableLazyFieldLoading>useFilterForSortedQuery
This parameter configures Solr to use a filter to satisfy a search. If the requested sort does not include “score”, the filterCache will be checked for a filter matching the query. For most situations, this is only useful if the same search is requested often with different sort options and none of them ever use “score”.
<useFilterForSortedQuery>true</useFilterForSortedQuery>queryResultWindowSize
Used with the queryResultCache, this will cache a superset of the requested number of document IDs. For example, if the a search in response to a particular query requests documents 10 through 19, and queryWindowSize is 50, documents 0 through 49 will be cached.
<queryResultWindowSize>20</queryResultWindowSize>queryResultMaxDocsCached
This parameter sets the maximum number of documents to cache for any entry in the queryResultCache.
<queryResultMaxDocsCached>200</queryResultMaxDocsCached>useColdSearcher
This setting controls whether search requests for which there is not a currently registered searcher should wait for a new searcher to warm up (false) or proceed immediately (true). When set to “false”, requests will block until the searcher has warmed its caches.
<useColdSearcher>false</useColdSearcher>maxWarmingSearchers
This parameter sets the maximum number of searchers that may be warming up in the background at any given time. Exceeding this limit will raise an error. For read-only slaves, a value of two is reasonable. Masters should probably be set a little higher.
<maxWarmingSearchers>2</maxWarmingSearchers>
