magmaus3/continuwuity
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
4888 commits 37 branches 19 tags 14 MiB
Commit graph

925 commits

Author SHA1 Message Date
Jason Volk
31c2968bb2 move db files command w/ filter args; misc related cleanup 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-29 23:21:08 +00:00
Jason Volk
936161d89e reduce bottommost compression underrides 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-29 03:09:13 +00:00
Jason Volk
98f9570547 add option to disable rocksdb checksums 
reference runtime state for default option initialization

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-28 18:38:47 +00:00
Jason Volk
13335042b7 enable the paranoid-checks options in debug mode 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-28 18:36:00 +00:00
Jason Volk
d0b4a619af furnish batch interface with trait 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-28 18:36:00 +00:00
Jason Volk
9ad4f20da4 propagate underflow as error result, not index bounds panic 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-26 17:48:53 +00:00
Jason Volk
186c459584 use scalar for file shape; increase shape for small-type columns 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-26 17:48:53 +00:00
Jason Volk
29a19ba437 add write_to_cache to descriptor 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-26 17:48:53 +00:00
morguldir
6a7fe3ab7c limit wal archive size to 1gb 
Signed-off-by: morguldir <morguldir@protonmail.com>
 2025-01-25 02:01:36 -05:00
Jason Volk
94f2384fb0 fix missing iteration-optimized read options on several stream types 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-25 01:35:18 +00:00
Jason Volk
52adae7553 add sequence method to db engine; improve engine interface/tracing 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-25 01:35:18 +00:00
Jason Volk
49023aa295 use database for resolver caches 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-22 02:16:51 +00:00
Jason Volk
0c96891008 add CBOR support to database schema 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-22 00:52:48 +00:00
Jason Volk
dda27ffcb1 add some compaction related interfaces 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-18 12:05:07 +00:00
Jason Volk
19f6d9d0e1 add index-compression and auto-readahead to descriptor 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 12:12:44 +00:00
Jason Volk
277b4951e8 add compression-shaping; tweak default compression levels 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 11:50:17 +00:00
Jason Volk
3dae02b886 add preferred jemalloc config 
add muzzy/dirty configuration mallctl interface

add program argument for --gc-muzzy=false

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-18 01:30:41 +00:00
Jason Volk
abf33013e3 check-in additional database test related 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:48:47 +00:00
Jason Volk
96e85adc32 use cache builder for row and table cache options 
add cache check using multi-get path

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:48:47 +00:00
Jason Volk
fc1170e12a additional tracing span tweaks 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jason Volk
bab40a3747 enable hashing on large-block indexes 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jason Volk
aad42bdaa0 reduce block size on small tables 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jason Volk
3759d1be6c tweak per-column write_buffer down from default 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-20 04:17:04 +00:00
Jade Ellis
2cc6ad8df3 implement /login/get_token (MSC3882) 2025-01-17 17:40:53 -05:00
Jason Volk
9ebb39ca4f
add missing cfg_attr on deserialisation db test 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2025-01-15 14:34:50 -05:00
strawberry
5a1c41e66b knocking implementation 
Signed-off-by: strawberry <strawberry@puppygock.gay>

add sync bit of knocking

Signed-off-by: strawberry <strawberry@puppygock.gay>
 2025-01-13 14:15:16 -05:00
Jason Volk
66231676f1 gracefully ignore unknown columns; add dropped flag in descriptor 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 22:29:05 +00:00
Jason Volk
16fa2eca87 add conf item for write buffer size 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
6a0f9add0c refactor database engine/options; add column descriptors 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
02f19cf951 tweak tracing spans; inlines 
db deserializer tracing instrument cover

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
685b127f99 simplify iterator state constructor arguments 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-10 07:03:34 +00:00
Jason Volk
44e6b1af3c fixes for tests to be run in release-mode 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-09 19:56:42 +00:00
Jason Volk
94c8683836 improve db pool topology configuration 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-09 18:14:23 +00:00
Jason Volk
d36167ab64 partially revert 9a9c071e82; use std threads for db pool. 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-09 18:14:23 +00:00
strawberry
7a349fdc58
use latest sccache, bump nix flake lock, cache everything in rust-cache 
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2025-01-02 19:13:27 -05:00
Jason Volk
77d7e8a3ad add json array to serde_json::Value db deserialization without Raw 2025-01-02 06:52:32 +00:00
Jason Volk
2259e2c82f batch queries to maximize throughput 
query-side streams for first level of callsites

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
1792711d09 support core affinity mask 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
c5b94be5b8 remove dev_release_log_level cfg 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
2bbb28bb88 get device info with libc using major/minor 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
b56e480b3c integrate some std io error kinds with our status code abstraction 
associate rocksdb error kinds with std io error kinds

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
74eb30c106 add LIFO scheduling for database frontend pool workers 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
7a6d657558 configurable dynamic stream concurrency scalar 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
b195107053 optimize for multi-queue storage topologies with affinity 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
a3d87be22f enable atomic_flush for database columns 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
98e6c81e49 offload remaining db iterator initial seeks on cache miss 
consume task budget on cache hit

Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
14341bb906 simplify and improve db iter State init interface 
Signed-off-by: Jason Volk <jason@zemos.net>
 2025-01-01 23:28:01 -05:00
Jason Volk
4d46df2af5 abort tasks for non-async pool shudown 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-18 14:16:23 -05:00
Jason Volk
5f7636f177
set dbpool thread name (gated by tokio_unstable) 
Signed-off-by: Jason Volk <jason@zemos.net>
Signed-off-by: strawberry <strawberry@puppygock.gay>
 2024-12-18 13:31:41 -05:00
Jason Volk
ad8cbcaac1 check cache prior to offloading iterator seek 
Signed-off-by: Jason Volk <jason@zemos.net>
 2024-12-18 13:29:43 -05:00