1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
|
---
hide-toc: true
---
# Lunr.py 🌖
A Python implementation of [Lunr.js](https://lunrjs.com) by [Oliver Nightingale](https://github.com/olivernn).
> A bit like Solr, but much smaller and not as bright.
This Python version of Lunr.js aims to bring the simple and powerful full text search
capabilities into Python guaranteeing results as close as the original
implementation as possible.
## What does this even do?
Lunr is a simple full text search solution for situations where deploying a full
scale solution like Elasticsearch isn't possible, viable or you're simply prototyping.
Lunr parses a set of documents and creates an inverted index for quick full text
searches in the same way other more complicated solution.
The trade-off is that Lunr keeps the inverted index in memory and requires you
to recreate or read the index at the start of your application.
## Interoperability with Lunr.js
A core objective of Lunr.py is to [provide interoperability with the JavaScript
version](lunrjs-interop.md).
An example can be found in the [MkDocs documentation library](http://www.mkdocs.org/).
MkDocs produces a set of documents from the pages of the documentation and uses
[Lunr.js](https://lunrjs.com) in the frontend to power its built-in searching
engine. This set of documents is in the form of a JSON file which needs to be
fetched and parsed by Lunr.js to create the inverted index at startup of your application.
While this is not a problem for most sites, depending on the size of your document
set, this can take some time.
Lunr.py provides a backend solution, allowing you to parse the documents in Python
of time and create a serialized Lunr.js index you can pass have the browser
version read, minimizing start up time of your application.
Each version of lunr.py
[targets a specific version of lunr.js](https://github.com/yeraydiazdiaz/lunr.py/blob/master/lunr/__init__.py#L12)
and produces the same results as it both in Python 2.7 and 3 for
[non-trivial corpus of documents](https://github.com/yeraydiazdiaz/lunr.py/blob/master/tests/acceptance_tests/fixtures/mkdocs_index.json).
Lunr.py also serializes `Index` instances respecting the
[`lunr-schema`](https://github.com/olivernn/lunr-schema) which are consumable by
Lunr.js and viceversa.
## Installation
`pip install lunr`
An optional and experimental support for other languages thanks to the
[Natural Language Toolkit](http://www.nltk.org/) stemmers is also available via
`pip install lunr[languages]`. The usage of the language feature is subject to
[NTLK corpus licensing clauses](https://github.com/nltk/nltk#redistributing).
Please refer to the
[documentation page on languages](https://lunr.readthedocs.io/en/latest/languages/)
for more information.
## Usage
First, you'll need a list of dicts representing the documents you want to search on.
These documents must have a unique field which will serve as a reference and a
series of fields you'd like to search on.
Lunr provides a convenience `lunr` function to quickly index this set of documents:
```python
>>> from lunr import lunr
>>>
>>> documents = [{
... 'id': 'a',
... 'title': 'Mr. Green kills Colonel Mustard',
... 'body': 'Mr. Green killed Colonel Mustard in the study with the candlestick.',
... }, {
... 'id': 'b',
... 'title': 'Plumb waters plant',
... 'body': 'Professor Plumb has a green plant in his study',
... }]
>>> idx = lunr(
... ref='id', fields=('title', 'body'), documents=documents
... )
>>> idx.search('kill')
[{'ref': 'a', 'score': 0.6931722372559913, 'match_data': <MatchData "kill">}]
>>> idx.search('study')
[{'ref': 'b', 'score': 0.23576799568081389, 'match_data': <MatchData "studi">}, {'ref': 'a', 'score': 0.2236629211724517, 'match_data': <MatchData "studi">}]
```
```{toctree}
:hidden:
usage
indices
languages
lunrjs-interop
changelog
customisation
GitHub Repository <https://github.com/yeraydiazdiaz/lunr.py>
```
|
