{"id":156,"date":"2010-11-29T23:38:55","date_gmt":"2010-11-29T22:38:55","guid":{"rendered":"http:\/\/sematext.solr.pl\/?p=156"},"modified":"2020-11-10T23:39:44","modified_gmt":"2020-11-10T22:39:44","slug":"solr-and-autocomplete-part-3","status":"publish","type":"post","link":"https:\/\/solr.pl\/en\/2010\/11\/29\/solr-and-autocomplete-part-3\/","title":{"rendered":"Solr and autocomplete (part 3)"},"content":{"rendered":"

In the previous parts (part 1<\/a>, part. 2<\/a>) of the cycle, we learned how to configure and query Solr to get the autocomplete functionality. In today’s entry I will show you how to add the dictionary to the Suggester, and thus have an impact on the generated suggestions.<\/p>\n\n\n\n\n\n

\"\"<\/p>\n

Component configuration<\/h3>\n

To configure the component presented in the previous part of the cycle add the following parameter:\n<\/p>\n

<str name=\"sourceLocation\">dict.txt<\/str><\/pre>\n
Thus our configuration should look like this:\n<\/p>\n
<searchComponent name=\"suggest\" class=\"solr.SpellCheckComponent\">\n <lst name=\"spellchecker\">\n  <str name=\"name\">suggest<\/str>\n  <str name=\"classname\">org.apache.solr.spelling.suggest.Suggester<\/str>\n  <str name=\"lookupImpl\">org.apache.solr.spelling.suggest.tst.TSTLookup<\/str>\n  <str name=\"field\">name_autocomplete<\/str>\n  <str name=\"sourceLocation\">dict.txt<\/str>\n <\/lst>\n<\/searchComponent><\/pre>\n
With the parameter we informed the component to use the dictionary named dict.txt<\/em> which should be placed in the Solr configuration directory.<\/p>\n
Handler configuration<\/h3>\n
The handler configuration also gets one additional parameter which is:\n<\/p>\n
<str name=\"spellcheck.onlyMorePopular\">true<\/str><\/pre>\n
So our configuration should be as follows:\n<\/p>\n
<requestHandler name=\"\/suggest\" class=\"org.apache.solr.handler.component.SearchComponent\">\n <lst name=\"defaults\">\n  <str name=\"spellcheck\">true<\/str>\n  <str name=\"spellcheck.dictionary\">suggest<\/str>\n  <str name=\"spellcheck.count\">10<\/str>\n  <str name=\"spellcheck.onlyMorePopular\">true<\/str>\n <\/lst>\n <arr name=\"components\">\n  <str>suggest<\/str>\n <\/arr>\n<\/requestHandler><\/pre>\n
This parameter tell Solr, to return only those suggestions for which the number of results is greater than the number of results for the current query.<\/p>\n
Dictionary<\/h3>\n
We told Solr to use the dictionary, but how should this dictionary look like ? For the purpose of this post I defined the following dictionary:\n<\/p>\n
# sample dict\nHard disk hitachi\nHard disk wd    2.0\nHard disk jjdd    3.0<\/pre>\n
What is the construction of a dictionary? Each of the phrases (or single words) is located in a separate line. Each  line ends with the weight of the phrase (between the weight and the  phrase is a TAB character) which is used together with the parameter  spellcheck.onlyMorePopular=true<\/em> (the higher the weight, the higher the  suggestion will be). The default weight value is 1.0. A dictionary should be saved in UTF-8 encoding. Lines beginning with # character are skipped.<\/p>\n
Data<\/h3>\n
In this case we don’t need data – we will only use the defined dictionary.<\/p>\n
Let’s check how it works<\/h3>\n
To check how our mechanism behaves I sent the following query to Solr, of course after rebuilding of the Suggester index:<\/p>\n
\/suggest?q=Har<\/code><\/p>\n
As a result we get the following:\n<\/p>\n
<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<response>\n<lst name=\"responseHeader\">\n  <int name=\"status\">0<\/int>\n  <int name=\"QTime\">0<\/int>\n<\/lst>\n<lst name=\"spellcheck\">\n  <lst name=\"suggestions\">\n    <lst name=\"Dys\">\n      <int name=\"numFound\">3<\/int>\n      <int name=\"startOffset\">0<\/int>\n      <int name=\"endOffset\">3<\/int>\n      <arr name=\"suggestion\">\n        <str>Hard disk jjdd<\/str>\n        <str>Hard disk hitachi<\/str>\n        <str>Hard disk wd<\/str>\n     <\/arr>\n    <\/lst>\n  <\/lst>\n<\/lst>\n<\/response>\n<\/pre>\n
A few words at the end<\/h3>\n
As you can see the suggestions are sorted by on the basis of weight, as expected. It  is worth noting that the query was passed with a capital letter, which  is also important – the lowercased query will return empty suggestion  list.<\/p>\n
What  can you say about the method – if we have a very good dictionaries  generated on the basis of weights such as customer behavior this is the  method for you and your customers will love it. I  would not recommend it if you don’t have good dictionaries – there is a  very high chance that your suggestions will be of poor quality.<\/p>\n
What will be next ?<\/h3>\n
The number of tasks this week didn’t let me finish the performance tests and that’s why, in the next part of the cycle, I’ll try to show you how each method behaves with various index structure and size.<\/p>","protected":false},"excerpt":{"rendered":"
In the previous parts (part 1, part. 2) of the cycle, we learned how to configure and query Solr to get the autocomplete functionality. In today’s entry I will show you how to add the dictionary to the Suggester, and<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[27],"tags":[229,249,164,250,248,252],"class_list":["post-156","post","type-post","status-publish","format-standard","hentry","category-solr-en","tag-autocomplete","tag-component-2","tag-solr-2","tag-suggest-2","tag-suggest-component-2","tag-suggester-2"],"_links":{"self":[{"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/posts\/156","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/comments?post=156"}],"version-history":[{"count":1,"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/posts\/156\/revisions"}],"predecessor-version":[{"id":157,"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/posts\/156\/revisions\/157"}],"wp:attachment":[{"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/media?parent=156"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/categories?post=156"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solr.pl\/en\/wp-json\/wp\/v2\/tags?post=156"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}