RegNet Solutions - Advanced Search Explanation

Overview


Advanced Search

Terms

A query is broken up into terms and operators. There are two types of terms: Single Terms and Phrases. A Single Term is a single word such as car or automobile. A Phrase is a group of words surrounded by double quotes such as "safety regulation". Multiple terms can be combined together with Boolean operators to form a more complex query (see below).

Fields

Search supports fielded data. When performing a search you can either specify a field, or use the default text field. Commonly used fields include:

The default text field (fields searched when you don't specify a field) includes everything in the title, text and url fields. You can search a specific field by typing the field name followed by a colon : and then the term you are looking for. As an example, let's assume you are looking for, title and text. Remember text is the default field. If you want to find the document entitled "Global Technical Regulations" which contains the text "registry ", you can enter:

title:"Global Technical Regulations" AND text:registry

or

title:"Global Technical Regulations" AND registry

Since text is the default field, the field indicator is not required. Note: The field is only valid for the term that it directly precedes, so the query title:Global Technical Regulations Will only find "Global" in the title field. It will find "Technical" and "Regulations" in the default field (in this case the text field).

Term Modifiers

Search supports modifying query terms to provide a wide range of searching options.

Wildcard Searches

Search supports single and multiple character wildcard searches within single terms (not within phrase queries). To perform a single character wildcard search use the ? symbol. To perform a multiple character wildcard search use the * symbol. The single character wildcard search looks for terms that match that with the single character replaced. For example, to search for text or test you can use the search:
te?t
Multiple character wildcard searches looks for 0 or more characters. For example, to search for test, tests or tester, you can use the search:
test*
You can also use the wildcard searches in the middle of a term.
te*t
Note: You cannot use a * or ? symbol as the first character of a search.

Regular Expression Searches

(Advanced) Search supports regular expression searches matching a pattern between forward slashes "/". The syntax may change across releases, but the current supported syntax is documented in the RegExp class. For example to find documents containing "moat" or "boat":
/[mb]oat/

Fuzzy Searches

(Powerful) Search supports fuzzy searches based on Damerau-Levenshtein Distance. To do a fuzzy search use the tilde, "~", symbol at the end of a Single word Term. For example to search for a term similar in spelling to "roam" use the fuzzy search:
roam~
This search will find terms like foam and roams. An additional (optional) parameter can specify the maximum number of edits allowed. The value is between 0 and 2, For example: roam~1 The default that is used if the parameter is not given is 2 edit distances.

Proximity Searches

Search supports finding words are a within a specific distance away. To do a proximity search use the tilde, "~", symbol at the end of a Phrase. For example to search for a "brake" and "regulation" within 10 words of each other in a document use the search:

"brake regulation"~10

Range Searches

Range Queries allow one to match documents whose field(s) values are between the lower and upper bound specified by the Range Query. Range Queries can be inclusive or exclusive of the upper and lower bounds. Sorting is done lexicographically.
date:[20020101 TO 20030101]
This will find documents whose mod_date fields have values between 20020101 and 20030101, inclusive. Note that Range Queries are not reserved for date fields. You could also use range queries with non-date fields:
title:{tractor TO trailer}
This will find all documents whose titles are between tractor and trailer, but not including tractor and trailer. Inclusive range queries are denoted by square brackets. Exclusive range queries are denoted by curly brackets.

Boosting a Term

Search provides the relevance level of matching documents based on the terms found. To boost a term use the caret, "^", symbol with a boost factor (a number) at the end of the term you are searching. The higher the boost factor, the more relevant the term will be. Boosting allows you to control the relevance of a document by boosting its term. For example, if you are searching for agreement concerning and you want the term "agreement" to be more relevant boost it using the ^ symbol along with the boost factor next to the term. You would type:
agreement^4 concerning
This will make documents with the term agreement appear more relevant. You can also boost Phrase Terms as in the example: "agreement concerning"^4 "concerning regulation" By default, the boost factor is 1. Although the boost factor must be positive, it can be less than 1 (e.g. 0.2)

Boolean Operators

Boolean operators allow terms to be combined through logic operators. Search supports AND, "+", OR, NOT and "-" as Boolean operators(Note: Boolean operators must be ALL CAPS).

OR

The OR operator is the default conjunction operator. This means that if there is no Boolean operator between two terms, the OR operator is used. The OR operator links two terms and finds a matching document if either of the terms exist in a document. This is equivalent to a union using sets. The symbol || can be used in place of the word OR. To search for documents that contain either "agreement concerning" or just "agreement" use the query:
"agreement concerning" agreement
or
"agreement concerning" OR agreement

AND

The AND operator matches documents where both terms exist anywhere in the text of a single document. This is equivalent to an intersection using sets. The symbol && can be used in place of the word AND. To search for documents that contain "agreement concerning" and "concerning regulation" use the query:
"agreement concerning" AND "concerning regulation"

+

The "+" or required operator requires that the term after the "+" symbol exist somewhere in the field of a single document. To search for documents that must contain "agreement" and may contain "regulation" use the query:
+agreement regulation

NOT

The NOT operator excludes documents that contain the term after NOT. This is equivalent to a difference using sets. The symbol ! can be used in place of the word NOT. To search for documents that contain "agreement concerning" but not "concerning regulation" use the query:
"agreement concerning" NOT "concerning regulation"
Note: The NOT operator cannot be used with just one term. For example, the following search will return no results: NOT "agreement concerning"

-

The "-" or prohibit operator excludes documents that contain the term after the "-" symbol. To search for documents that contain "agreement concerning" but not "concerning regulation" use the query:
"agreement concerning" -"concerning regulation"

Grouping

Search supports using parentheses to group clauses to form sub queries. This can be very useful if you want to control the boolean logic for a query. To search for either "agreement" or "concerning" and "website" use the query:
(agreement OR concerning) AND website
This eliminates any confusion and makes sure you that website must exist and either term agreement or concerning may exist.

Field Grouping

Search supports using parentheses to group multiple clauses to a single field. To search for a title that contains both the word "theft" or the phrase "Motor Vehicle" use the query:
title:(+theft + "Motor Vehicle")

Escaping Special Characters

Search supports escaping special characters that are part of the query syntax. The current list special characters are

+ - && || ! ( ) { } [ ] ^ " ~ * ? : \ /

To escape these character use the \ before the character. For example to search for (1+1):2 use the query:

\(1\+1\)\:2