Lucene in Action

...'t be determined during indexing. An interesting idea for a custom sorting mechanism is to order search ... and their fictitious grid coordinates on a sample 10x10 grid.2 The test data is indexed as shown in listing ... of businesses and could allow us to filter search results to specific types of places. Listing 6.1 Indexing ... .addDocument(doc); } } The coordinates are indexed into a single location field as a string ... implementa- tion makes space to store a float for every document in the index and computes the distance from...

...There are two different styles of TokenStreams: Tokenizer and TokenFilter. A good generalization to explain the distinction is that Tokenizers deal with indi- vidual characters, and TokenFilters deal with words. Figure 4.2 shows this archi- tecture graphically. A Tokenizer is a TokenStream that tokenizes the input from a Reader. When you're indexing a String through Field.Text(String, String) or Field. UnStored(String, String) (that is, the indexed field constructors which accept a String...

... for this case, repre- sents how many stop words could be present in the original text between indexed ... .length()); } Both laziness and the phrase "fox jumped" matched our indexed document, allowing users...

... on the index path provided as a system property: String indexDir = System.getProperty("index.dir...

...In our book data, several fields were indexed. Users may want to query for terms regardless of which field they are in. One way to handle this is with MultiField- QueryParser, which builds on QueryParser. Under the covers, it parses a query expression using QueryParser's static parse method for each field as the default field and combines them into a BooleanQuery. The default operator OR is used ... practice for user-entered queries. More commonly, all words you want searched are indexed into a contents...

... framework, combined with a file-indexing application that uses it Listing 7.13 FileHandler interface ... to a Document * @return a ready-to-index instance of Document */ Document getDocument(File file...

... into a Lucene index. This allows for rapid synonym lookup--for example, for synonym injection during indexing or querying (see section 8.6.2 for such an implementation)....

... was indexed, the slop factor can be set to something other than zero automatically if it isn't specified using... [Full sample chapter]

... the terms that would be indexed. Listing 4.2 AnalyzerDemo: seeing analysis in action /** * Adapted from ... to the text and the tokens are extracted. AnalyzerUtils passes text to an analyzer without indexing it and pulls the results in a manner similar to what happens during the indexing process under ... in section 8.7 uses a Token- Stream and the resulting Tokens outside of indexing to determine where...

...Internally, Lucene stores all characters in the standard UTF-8 encoding. Java frees us from many struggles by automatically handling Unicode within Strings and providing facilities for reading in external data in the many encodings. You, however, are responsible for getting external text into Java and Lucene. If you're indexing files on a file system, you need to know what encoding the files were saved as in order to read them properly. If you're reading HTML or XML from an HTTP server...

... of IndexSearcher to benefit from the caching. When index changes need to be reflected in searches...

...Listing 7.6 contains the HTML document that we'll be parsing using the HTML parsers featured in this section. A large percentage of HTML documents avail- able on the Web aren't well formed, and not all parsers deal with that situation equally well. In this section, we use the JTidy and NekoHTML parsers, both of which are solid HTML parsers capable of dealing with broken HTML. Listing 7.6 The HTML document that we'll parse, index, and ultimately search