Yiorgis Gozadinos
|
7d57fd6c97
|
Add filter param to search(). When filtering, we search in two steps: First filter documents, then search on the chunks with document_id IN the filtered documents
|
2025-10-30 13:03:23 +02:00 |
|
Yiorgis Gozadinos
|
9c8ffcc212
|
Drop ConfigProxy in favour of passing AppConfig as an keyword param to HaikuRag clients.
|
2025-10-27 10:33:33 +02:00 |
|
Yiorgis Gozadinos
|
618b3ffd5f
|
Refactor config from flat to nested Pydantic models
|
2025-10-23 13:30:21 +03:00 |
|
Yiorgis Gozadinos
|
08c07edfb8
|
Lazy-load forgotten docling-related functionality
|
2025-10-23 11:39:58 +03:00 |
|
Yiorgis Gozadinos
|
5e4928ccad
|
Make sure vacuum task has been complete before exiting the client
|
2025-10-07 12:27:55 +03:00 |
|
Yiorgis Gozadinos
|
094f0e0d44
|
Centralize vacuuming
|
2025-10-07 12:05:25 +03:00 |
|
Yiorgis Gozadinos
|
ce11efd17c
|
Auto-vacuum when inserting/updating
|
2025-10-07 10:54:56 +03:00 |
|
Yiorgis Gozadinos
|
c6eaf9d5cd
|
Add vacuum retention setting
|
2025-10-07 10:47:28 +03:00 |
|
Yiorgis Gozadinos
|
9318ffc302
|
Make exception for incompatible settings more user-friendly
|
2025-09-30 12:19:08 +03:00 |
|
Yiorgis Gozadinos
|
184fd12e42
|
Do not run db upgrades when creating a new db
|
2025-09-25 10:52:11 +03:00 |
|
Yiorgis Gozadinos
|
45d0b47a02
|
Meta in CLI add-src, add
|
2025-09-23 16:39:27 +03:00 |
|
Yiorgis Gozadinos
|
b46765e197
|
vb
|
2025-09-22 13:59:03 +03:00 |
|
Yiorgis Gozadinos
|
2c1e81dc6e
|
Display title where appropriate in cli
|
2025-09-22 12:45:32 +03:00 |
|
Yiorgis Gozadinos
|
312d29333c
|
DB migration and schema updates to introduce title in documents
|
2025-09-22 12:45:32 +03:00 |
|
Yiorgis Gozadinos
|
6b7f574180
|
Config DISABLE_DB_AUTOCREATE option to not auto-create dbs
|
2025-09-22 10:09:07 +03:00 |
|
Yiorgis Gozadinos
|
c221a35547
|
Upgrade fts index for phrase queries
|
2025-09-19 12:06:12 +03:00 |
|
Yiorgis Gozadinos
|
cf8b87246b
|
Infer vector dimension
|
2025-09-18 14:01:38 +03:00 |
|
Yiorgis Gozadinos
|
d1e2470d94
|
Upgrades are back. Make chunk order a table column rather than a metadata property
|
2025-09-18 13:42:07 +03:00 |
|
Yiorgis Gozadinos
|
b4b6c3f1ad
|
When MARKDOWN_PREPROCESSOR fails to load raise the exception.
|
2025-09-16 12:32:09 +03:00 |
|
Yiorgis Gozadinos
|
4a07444030
|
Rollback version if a failure occurs when creating/updating documents
|
2025-09-15 11:54:50 +03:00 |
|
Yiorgis Gozadinos
|
765a6e647d
|
Allow for custom pre-processing after markdown is generated and before it is chunked.
|
2025-09-15 11:02:34 +03:00 |
|
Yiorgis Gozadinos
|
2207b7d1ed
|
vacuum() in store, client, cli. Removes old versions and reduces disk usage
|
2025-09-10 11:24:51 +03:00 |
|
Yiorgis Gozadinos
|
b99f88f104
|
Support batch embedding
|
2025-09-05 10:48:31 +03:00 |
|
Yiorgis Gozadinos
|
ed604f6a1d
|
Batch operations & small optimization
|
2025-09-03 10:50:08 +03:00 |
|
Yiorgis Gozadinos
|
75e878308e
|
Simplify deleting all chunks
|
2025-09-02 15:13:31 +03:00 |
|
Yiorgis Gozadinos
|
ecf8894755
|
Fix checking settings
|
2025-09-02 13:01:36 +03:00 |
|
Yiorgis Gozadinos
|
9e5f11060d
|
Allow connecting to lancedb cloud, s3, gc, az etc
|
2025-09-02 12:49:17 +03:00 |
|
Yiorgis Gozadinos
|
767d36b494
|
Use a lock for optimize(), when bulk creating chunks optimize once.
|
2025-09-02 12:10:54 +03:00 |
|
Yiorgis Gozadinos
|
e08fce84f8
|
Debounce optimize() to avoid exceeding too-many-files-open
|
2025-09-02 10:55:58 +03:00 |
|
Yiorgis Gozadinos
|
b05e5f5408
|
Set/get haiku version to db
|
2025-09-01 17:41:41 +03:00 |
|
Yiorgis Gozadinos
|
d233788400
|
Optimize table after insertion, update instead of recreating the index
|
2025-09-01 14:56:15 +03:00 |
|
Yiorgis Gozadinos
|
a5e087aa53
|
Fix scores depending on search type
|
2025-09-01 14:56:15 +03:00 |
|
Yiorgis Gozadinos
|
628bdc8151
|
Cleanup
|
2025-09-01 14:56:15 +03:00 |
|
Yiorgis Gozadinos
|
0592a7d122
|
Adapt search to lancedb
|
2025-09-01 14:56:14 +03:00 |
|
Yiorgis Gozadinos
|
b83596ff07
|
Basic moving to lancedb.
|
2025-09-01 14:56:14 +03:00 |
|
Yiorgis Gozadinos
|
2f42b1a3ac
|
Get adjacent chunks method
|
2025-08-12 13:24:04 +02:00 |
|
Yiorgis Gozadinos
|
ad4b655a31
|
Operate on DoclingDocument instead of Document
|
2025-08-08 17:24:34 +02:00 |
|
Yiorgis Gozadinos
|
91f6122ef7
|
Basic chunking using docling
|
2025-08-01 16:27:44 +02:00 |
|
Yiorgis Gozadinos
|
0f2809cb8d
|
Use Write-Ahead Logging jorunaling mode for SQLite concurrency
|
2025-08-01 09:07:31 +02:00 |
|
Yiorgis Gozadinos
|
74eea9284a
|
create_document now optionally accepts pre-computed chunks
|
2025-07-26 10:42:27 +03:00 |
|
Yiorgis Gozadinos
|
4d8088efa8
|
Log db upgrades
|
2025-07-16 18:32:58 +03:00 |
|
Yiorgis Gozadinos
|
0bf5606117
|
Store haiku.rag version, enabling upgrades
|
2025-07-16 18:21:41 +03:00 |
|
Yiorgis Gozadinos
|
62a519b094
|
Prevent rebuild from throwing and recreate the embeddings table
|
2025-07-12 21:21:14 +03:00 |
|
Yiorgis Gozadinos
|
4444ec50da
|
Check if settings are compatible when loading a db
|
2025-07-12 20:56:49 +03:00 |
|
Yiorgis Gozadinos
|
a59b38158d
|
Settings table & repo, tests
|
2025-07-12 20:21:34 +03:00 |
|
Yiorgis Gozadinos
|
11d9f2701e
|
Rebuild database in client & cli
|
2025-07-02 10:55:06 +03:00 |
|
Yiorgis Gozadinos
|
f3ed88b970
|
Include document uri and meta in search results
|
2025-06-28 09:10:23 +03:00 |
|
Yiorgis Gozadinos
|
095d532a7a
|
QA LLM, Ollama implementation
|
2025-06-25 18:18:28 +03:00 |
|
Yiorgis Gozadinos
|
9f5ba912d7
|
Simplify repos
|
2025-06-19 08:55:34 +02:00 |
|
Yiorgis Gozadinos
|
8a5c505b86
|
Replace positional params by keyword params for clarity
|
2025-06-19 08:21:58 +02:00 |
|