Semantic search demo

A simple CLI and web tool to help you search your PDF files.

Dependencies

Ollama

You need to run Ollama server using either local instance or docker image.

Local instance

install ollama
run ollama serve
pull selected embedding model:
```
> ollama pull nomic-embed-text
```

Ollama: Podman / Docker image

Pull docker/podman image:

> podman run -d -v models:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

Then you need to pull the selected model (in our case nomic-embed-text):
```
> podman exec -ti ollama ollama pull nomic-embed-text
```

UV

Install UV from your package manager. You can also run the script as-is without UV, but you will need to install required dependencies manually (pymupdf and ollama packages).

Running

Test

Check that the script can reach Ollama server and create / delete databases:

> py -m uv run main.py test

Create database

> uv run main.py create

Add files

> uv run main.py add-file db.pkl ~/docs/*pdf

Query (CLI)

> uv run main.py query db.pkl "balanced tree"
Querying: 'balanced tree' in database: db.pkl

Found 10 results:
============================================================

1. Distance: 15.2735
   Document: [Niklaus_Wirth]_Algorithms_+_Data_Structures_=_Programs.pdf
   Page: 236, Chunk: 1
   Text preview: constructed balanced tree? 2. What is the probability that an insertion requires rebalancing? Mathematical analysis of this complicated algorithm is still an open problem. Empirical tests support t...
----------------------------------------

2. Distance: 15.7531
   Document: [Niklaus_Wirth]_Algorithms_+_Data_Structures_=_Programs.pdf
   Page: 230, Chunk: 1
   Text preview: s balanced if and only if for every node the heights of its two subtrees differ by at most 1. Trees satisfying this condition are often called AVL-trees (after their inventors). We shall simply cal...
----------------------------------------
...

Query (web interface)

Start the server first:

> uv run main.py host db.pkl
   Starting web server...
   Database: db.pkl
   URL: http://127.0.0.1:5000
   Press Ctrl+C to stop
 * Serving Flask app 'main'
 * Debug mode: off
 WARNING: This is a development server. Do not use it in a production deployment. Use a production WSGI server instead.
 * Running on http://127.0.0.1:5000
Press CTRL+C to quit

Then visit http://localhost:5000/ and search there.

Important

If you intend to expose this publicly, use production WSGI server instead of the one built in Flask. Also as I intend to use this internally, not much effort went into securing the server.