Commit graph

190 commits

Author SHA1 Message Date
Alex Gleason
f04ca2b6ff
Rework language and media columns to use Nostrify search_ext column 2025-02-02 19:32:43 -06:00
Alex Gleason
b4184631c3
Merge remote-tracking branch 'origin/main' into feat-search-mime-type 2025-02-02 17:47:10 -06:00
Alex Gleason
2165e649bc
Remove Stickynotes, replace all occurrences of console.log with logi 2025-01-27 18:11:32 -06:00
P. Reis
e388925815 Merge branch 'main' into feat-search-mime-type 2025-01-22 17:11:03 -03:00
P. Reis
b037be44a4 feat: add mime_type column in nostr_events, add the following NIP 50 search extensions:
exact_mime_type, example: 'exact_mime_type:image/png' (uses hash index)
partial_mime_type, example 'partial_mime_type:image' (uses b-tree index)
only_media, example 'only_media:true' (sometimes uses index)
2025-01-22 17:01:10 -03:00
Alex Gleason
7fdfb806f4
pipeline: skip refetch of encountered events 2025-01-21 17:31:55 -06:00
Alex Gleason
e3294e5351
pipeline: block events too far in the future 2024-12-17 14:58:40 -06:00
Alex Gleason
e766f6c757
pipeline: improve error handling, include special treatment for ephemeral and NIP-46 events 2024-10-31 16:06:58 -05:00
Alex Gleason
4df61c0c59
pipeline: remove "event already in database" check 2024-10-19 20:55:09 -05:00
Alex Gleason
7fbda4a56b
Move push notification rendering to its own view 2024-10-15 17:13:39 -05:00
Alex Gleason
8bf0a443db
pipeline: Promise.all -> Promise.allSettled 2024-10-15 16:27:48 -05:00
Alex Gleason
95d970d8d0
webpush: add metrics and pipeline error handling 2024-10-14 18:06:22 -05:00
Alex Gleason
462f4ad786
Add placeholder data to push notification 2024-10-14 17:44:49 -05:00
Alex Gleason
4c5d98f402
webpush: don't notify author about own events 2024-10-14 17:31:05 -05:00
Alex Gleason
30a5d9a20f
webpush: fix query error in pipeline 2024-10-14 16:24:13 -05:00
Alex Gleason
b4e63afb8c
Merge remote-tracking branch 'origin/main' into push 2024-10-11 18:03:20 -05:00
P. Reis
36d09af467 feat: make lande great again
create detectLanguage() function that removes emojis, links and other weird invisible characters
2024-10-11 14:28:01 -03:00
P. Reis
1cb13b141a feat: improve setLanguage() function, remove links and emojis from event.content before using lande 2024-10-10 22:46:37 -03:00
Alex Gleason
8823c0987d
Actually push ?? 2024-10-08 18:37:23 -05:00
Alex Gleason
a10e810068
Create push_subscriptions table 2024-10-02 13:14:37 -05:00
Alex Gleason
f50b41f22b
Refactor PolicyWorker error handling 2024-09-25 15:01:40 -05:00
Alex Gleason
9f02215c04
Rethrow the error 2024-09-24 16:20:42 -05:00
Alex Gleason
3469374d8e
pipeline: insert event even if stats fail 2024-09-24 16:15:26 -05:00
Alex Gleason
fe7a8aa8a7
Merge remote-tracking branch 'origin/main' into policy-signal 2024-09-23 18:06:11 -05:00
Alex Gleason
6d0611dafe
Pass signal into policy 2024-09-23 18:04:12 -05:00
P. Reis
42371bcc31 fix: catch updateStats() function 2024-09-23 17:47:55 -03:00
P. Reis
92d8f9b8c2 refactor(pipeline.ts): use correct Stickynotes, and not legacy Debug 2024-09-23 15:36:05 -03:00
Alex Gleason
c4391ccd99
pipeline: fix events not being pushed through streaming API
Fixes https://gitlab.com/soapbox-pub/ditto/-/issues/206
2024-09-22 11:49:37 -05:00
Alex Gleason
ab727c3940 Merge branch 'move-author-search-to-author-stats' into 'main'
Order search by followers count & Move author search to author stats

Closes #140

See merge request soapbox-pub/ditto!500
2024-09-20 13:57:31 +00:00
Alex Gleason
5dca8d4950
pipeline: let ditto admin skip the policy 2024-09-19 21:57:59 -05:00
P. Reis
ebeb150463 refactor: use search in author_stats 2024-09-19 19:37:13 -03:00
Alex Gleason
d32b12c814
Block NIP-70 protected events 2024-09-17 09:44:46 -05:00
Alex Gleason
a87497380a
Make pipeline query easier to look at 2024-09-15 19:22:14 -05:00
Alex Gleason
8510f22d1b
Only save the nip05 in author search if it's valid 2024-09-15 18:33:16 -05:00
Alex Gleason
8da223ad6c
Merge remote-tracking branch 'origin/main' into language-detection 2024-09-15 17:25:36 -05:00
Alex Gleason
c24d11c6f3
Support NIP-50 language extension 2024-09-15 12:40:58 -05:00
P. Reis
be76197e3a refactor: remove handleAuthorSearch() function and put its logic inside parseMetadata() function 2024-09-13 16:20:52 -03:00
P. Reis
a974f4230d Merge branch 'main' into enchance-profile-search 2024-09-13 10:34:45 -03:00
P. Reis
9d2667679f feat(pipeline.ts): create handleAuthorSearch() function 2024-09-13 10:28:54 -03:00
Alex Gleason
c50c63f954
pipeline: purifyEvent before passing it to storage 2024-09-12 13:10:36 -05:00
Alex Gleason
d67f2a27ea
stats: use the NPostgres transaction method to avoid transactions within transactions 2024-09-12 11:30:57 -05:00
Alex Gleason
55ee8eaf74
Fix stat inflation 2024-09-12 11:09:54 -05:00
Alex Gleason
ebc0250d81
DittoDB.getInstance() -> Storages.kysely() 2024-09-11 13:23:06 -05:00
Alex Gleason
8efd6fbb20
Remove unattached_media table, replace with LRUCache, fix media upload order problem 2024-09-07 10:24:56 -05:00
Alex Gleason
5454942a2c
Update Prometheus metrics to conform to best practices 2024-09-07 08:52:02 -05:00
Alex Gleason
552de01a17
Rework DittoDB to return an object 2024-08-11 19:02:27 -05:00
Alex Gleason
8960bdcca9
Add Policy metrics 2024-07-30 15:47:55 -05:00
P. Reis
797c866830 refactor: storeEvent does not return event, move kysely into a variable above 2024-06-24 12:07:33 -03:00
P. Reis
fdb720386d fix(handleZaps): reject all kinds but 9735 2024-06-23 23:51:10 -03:00
P. Reis
e1ee3bd8e9 refactor: remove scavenger, put logic directly into pipeline 2024-06-23 23:45:32 -03:00