6914aab88a
Merge remote-tracking branch 'upstream/develop' into bnakkoma
2024-06-14 13:34:42 +09:00
Oneric
a3840e7d1f
Raise minimum PostgreSQL version to 12
...
This lets us:
- avoid issues with broken hash indices for PostgreSQL <10
- drop runtime checks and legacy codepaths for <11 in db search
- always enable custom query plans for performance optimisation
PostgreSQL 11 is already EOL since 2023-11-09, so
in theory everyone should already have moved on to 12 anyway.
2024-06-07 16:21:09 +02:00
Oneric
fc7e07f424
meilisearch: enable using search_key
...
Using only the admin key works as well currently
and Akkoma needs to know the admin key to be able
to add new entries etc. However the Meilisearch
key descriptions suggest the admin key is not
supposed to be used for searches, so let’s not.
For compatibility with existings configs, search_key remains optional.
2024-05-29 23:17:27 +00:00
Oneric
65aeaefa41
meilisearch: respect meili’s result ranking
...
Meilisearch is already configured to return results sorted by a
particular ranking configured in the meilisearch CLI task.
Resorting the returned top results by date partially negates this and
runs counter to what someone with tweaked settings expects.
Issue and fix identified by AdamK2003 in
https://akkoma.dev/AkkomaGang/akkoma/pulls/579
But instead of using a O(n^2) resorting, this commit directly
retrieves results in the correct order from the database.
Closes: https://akkoma.dev/AkkomaGang/akkoma/pulls/579
2024-05-29 23:17:27 +00:00
Oneric
5d6cb6a459
meilisearch: remove duplicate preload
2024-05-29 23:17:27 +00:00
1b6a18b473
Improve search results by implementing filtering on the Meilisearch side
...
You will need to rerun the `search.meilisearch index` task in order to
support this. If you do not, Akkoma will only be able to filter for
newer posts than this commit and will return an error for advanced
searches if you did not update the `filterable-attributes` attribute on
the `objects` index manually.
2024-05-03 06:46:48 +09:00
0bbcd4065f
Support for searching local posts/users only
2023-11-15 08:45:53 +09:00
66e26882e8
Support the 'following' option on post searches
2023-09-27 05:23:06 +09:00
49eda427fd
Make the availability of media search configurable
2023-09-27 04:28:18 +09:00
0ceee820a6
Add support for searching media status
...
w/ some refactors and updates
2023-09-16 07:18:09 +09:00
af349b073a
Deduplicate query_with
2023-08-07 03:53:53 +09:00
557fce16e5
Add support for PGroonga
2023-08-04 06:27:23 +09:00
floatingghost
07a48b9293
giant massive dep upgrade and dialyxir-found error emporium ( #371 )
...
Co-authored-by: FloatingGhost <hannah@coffee-and-dreams.uk>
Reviewed-on: https://akkoma.dev/AkkomaGang/akkoma/pulls/371
2022-12-14 12:38:48 +00:00
sn0w
4c0911592b
Skip posts in indexer where publish date is nil
2022-12-09 20:56:39 +01:00
floatingghost
b2aa82cee5
Fix false error in meilisearch index ( #221 )
...
the schema changed
https://docs.meilisearch.com/reference/api/documents.html#add-or-update-documents
this wasn't breaking anything, it would just report errors that were actually successes
Co-authored-by: FloatingGhost <hannah@coffee-and-dreams.uk>
Reviewed-on: https://akkoma.dev/AkkomaGang/akkoma/pulls/221
2022-09-20 10:36:21 +00:00
floatingghost
89ffc01c23
only return create objects for ES search ( #165 )
...
Reviewed-on: https://akkoma.dev/AkkomaGang/akkoma/pulls/165
2022-08-16 23:24:19 +00:00
floatingghost
405406601f
Fix emoji qualification ( #124 )
...
Reviewed-on: https://akkoma.dev/AkkomaGang/akkoma/pulls/124
2022-07-28 12:02:36 +00:00
FloatingGhost
635a3c223a
Add elasticsearch tests
2022-06-30 16:53:21 +01:00
FloatingGhost
1ecdb19de5
Refactor ES on top of search behaviour
2022-06-30 16:28:31 +01:00
Ekaterina Vaartis
563b964690
Change updateId to uid because apparently that's the new name
2022-06-29 20:49:45 +01:00
Ekaterina Vaartis
b7462040cc
Change the meilisearch key auth to conform to 0.25.0
2022-06-29 20:49:45 +01:00
Ekaterina Vaartis
54b2a86f47
Add a search backend behaviour
2022-06-29 20:49:45 +01:00
Ekaterina Vaartis
bac70a2bc1
Implement suggestions from the Meilisearch MR
...
- Index unlisted posts
- Move version check outside of the streaming and only do it once
- Use a PUT request instead of checking manually if there is need to insert
- Add error handling, sort of
2022-06-29 20:49:45 +01:00
Ekaterina Vaartis
c128798418
Rename Activity.Search to Search.DatabaseSearch
2022-06-29 20:49:44 +01:00
Ekaterina Vaartis
ea582fbf93
Rename search.ex to database_search.ex and add search/2
2022-06-29 20:49:00 +01:00
Ekaterina Vaartis
0769f06bd1
Style fixes
2022-06-29 20:49:00 +01:00
Ekaterina Vaartis
5dd908552c
Move the search.ex file so credo doesn't complain
2022-06-29 20:48:59 +01:00
Ekaterina Vaartis
51faa28568
Set content-type to application/json
2022-06-29 20:48:44 +01:00
Ekaterina Vaartis
afcdd2f437
Modify some meilisearch variables
2022-06-29 20:48:44 +01:00
Ekaterina Vaartis
41f3572152
Fix activity being passed to objec_to_search_data
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
d1079f1aa3
Add the meilisearch.stats command
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
dbf556cdcf
Implement meilisearch auth
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
0cf3654907
Rework task indexing to share code with the main module
...
The code in the main module now scrubs new posts too
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
b3401ba7bd
Also index incoming federated posts
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
a586ce0ddd
Use content instead of source and scrub it
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
c3a04166a0
Tweak search ordering to hopefully return newer results
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
e5ac2ffa07
Ensure only indexing public posts and implement clearing and delete
2022-06-29 20:48:29 +01:00
Ekaterina Vaartis
e961cf2689
Initial meilisearch implementation, doesn't delete posts yet
2022-06-29 20:48:28 +01:00
FloatingGhost
32fbd2e4e3
fix all tests
2022-06-11 16:14:22 +01:00
FloatingGhost
6a19fbac2f
add copyright notice for forked files
2022-01-20 12:48:16 +00:00
FloatingGhost
ccc5c59c50
re-add fetching by url
2021-12-15 10:58:09 +00:00
sadposter
d1bb10c88e
fix empty queries returning 50 results
2021-12-14 15:02:11 +00:00
sadposter
8378c3a8bc
extra cool
2021-12-14 14:48:24 +00:00
FloatingGhost
0d7bbee430
add timeouts
2021-12-14 14:35:46 +00:00
sadposter
8f78cb3050
Merge branch 'develop' of gitssh.ihatebeinga.live:IHBAGang/pleroma into develop
2021-12-14 14:01:09 +00:00
sadposter
5d901c337e
fix inbound federation
2021-12-14 13:58:16 +00:00
FloatingGhost
703f53c08f
Search through users and hashtags as well
2021-12-14 13:55:14 +00:00
sadposter
f341e68622
fix bug in inbound
2021-12-12 19:31:47 +00:00
sadposter
23c758bbe7
enforce visibility
2021-12-12 18:25:20 +00:00
FloatingGhost
0fbf7faf85
Remove IO inspect
2021-12-12 17:35:35 +00:00
