Skip to content

Reduce allocation pressure in DBScan refill by reusing buffers#198

Open
asmit27rai wants to merge 1 commit into
hoytech:masterfrom
asmit27rai:195
Open

Reduce allocation pressure in DBScan refill by reusing buffers#198
asmit27rai wants to merge 1 commit into
hoytech:masterfrom
asmit27rai:195

Conversation

@asmit27rai

Copy link
Copy Markdown

Fix: #195

How to test it:

  1. Build
make clean && make -j4
  1. Start server
./strfry relay (Terminal 1)
  1. Benchmark
python3 scripts/populate_test_db.py --relay ws://localhost:7777 --events 10000
python3 scripts/write_rate_sweep.py --relay ws://localhost:7777 \
       --rates 100,500,1000 --duration 30 --output result1.json
  1. Full Benchmark
python3 scripts/populate_test_db.py --relay ws://localhost:7777 --events 20000
python3 scripts/write_rate_sweep.py --relay ws://localhost:7777 \
       --rates 0,100,500,1000,2000,5000 --duration 60 --output result2.json
  1. Correctness Check
python3 scripts/populate_test_db.py --relay ws://localhost:7777 --events 5000
python3 scripts/capture_req_results.py --relay ws://localhost:7777 \
       --filter '{"kinds":[1],"limit":100}' \
       --filter '{"kinds":[0,3],"limit":50}'

Signed-off-by: asmit27rai <raiasmit10@gmail.com>
@asmit27rai

Copy link
Copy Markdown
Author

@hoytech As discussed, here is a approach i tried with some tests.
Please test it locally.
Thank You.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

perf: investigate cold cursor seek latency on paused query resume under mixed read+write load

1 participant