Skip to content

WIP: Hashtags, Blocks: Rework for performance.

lain requested to merge make-hashtags-fast-again into develop

Edit:

Things that need to be changed / checked:

  • The blocking behavior is currently not exactly the same as the old one. This should be changed.
  • Getting the block behavior and tags correct involves updating every single activity so the triggers trigger. We can't do this in one step because it takes forever. We probably should do this for the last, let's say, 100_000 activities on migration, and have a task that people are advised to run that updates old activities in batches of 1000 or so (because these are writes, so they block any other action on that activity).

An extended experiment on speeding things up. Observations:

  • 'Preloading', that is, joining on objects, seems to trash performance. Avoiding the join until as late as possible is generally the way to go.
  • Performance depends on the few initial queries that you run, because they set the query plan in stone unless you use the new force_custom_plan option. See https://blog.soykaf.com/post/postgresql-elixir-troubles/.

Benchmarks, all run with force_custom_plan

Before the change

RUM enabled: false

19:07:58.894 [warn]  Found files in the emoji folder. These will be ignored, please move them to a subdirectory
Found files: test.png
Found 200000 activities, won't generate new ones
Database contains 67 posts tagged with tag_0
Database contains 300 posts tagged with tag_1
Database contains 617 posts tagged with tag_2
Database contains 1131 posts tagged with tag_3
Database contains 1788 posts tagged with tag_4
Database contains 2405 posts tagged with tag_5
Database contains 3453 posts tagged with tag_6
Database contains 4475 posts tagged with tag_7
Database contains 5581 posts tagged with tag_8
Database contains 6963 posts tagged with tag_9
Database contains 8338 posts tagged with tag_10
Database contains 9888 posts tagged with tag_11
Database contains 11871 posts tagged with tag_12
Database contains 13516 posts tagged with tag_13
Database contains 15762 posts tagged with tag_14
Database contains 17973 posts tagged with tag_15
Database contains 20025 posts tagged with tag_16
Database contains 22702 posts tagged with tag_17
Database contains 25092 posts tagged with tag_18
Database contains 28053 posts tagged with tag_19
Database contains 0 posts tagged with tag_20
Not all of your protocols have been consolidated. In order to achieve the
best possible accuracy for benchmarks, please ensure protocol
consolidation is enabled in your benchmarking environment.

Operating System: Linux
CPU Information: AMD Ryzen Threadripper 3970X 32-Core Processor
Number of Available Cores: 64
Available memory: 62.73 GB
Elixir 1.9.4
Erlang 22.2.6

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
parallel: 1
inputs: For ["tag_0", "tag_1"], For ["tag_2", "tag_3"], For ["tag_4", "tag_5"], For ["tag_6", "tag_7"], For ["tag_8", "tag_9"], For ["tag_10", "tag_11"], For ["tag_12", "tag_13"], For ["tag_14", "tag_15"], For ["tag_16", "tag_17"], For ["tag_18", "tag_19"], For ["tag_20"]
Estimated total run time: 2.57 min

Benchmarking Hashtag fetching, all with input For ["tag_0", "tag_1"]...
Benchmarking Hashtag fetching, all with input For ["tag_2", "tag_3"]...
Benchmarking Hashtag fetching, all with input For ["tag_4", "tag_5"]...
Benchmarking Hashtag fetching, all with input For ["tag_6", "tag_7"]...
Benchmarking Hashtag fetching, all with input For ["tag_8", "tag_9"]...
Benchmarking Hashtag fetching, all with input For ["tag_10", "tag_11"]...
Benchmarking Hashtag fetching, all with input For ["tag_12", "tag_13"]...
Benchmarking Hashtag fetching, all with input For ["tag_14", "tag_15"]...
Benchmarking Hashtag fetching, all with input For ["tag_16", "tag_17"]...
Benchmarking Hashtag fetching, all with input For ["tag_18", "tag_19"]...
Benchmarking Hashtag fetching, all with input For ["tag_20"]...
Benchmarking Hashtag fetching, any with input For ["tag_0", "tag_1"]...
Benchmarking Hashtag fetching, any with input For ["tag_2", "tag_3"]...
Benchmarking Hashtag fetching, any with input For ["tag_4", "tag_5"]...
Benchmarking Hashtag fetching, any with input For ["tag_6", "tag_7"]...
Benchmarking Hashtag fetching, any with input For ["tag_8", "tag_9"]...
Benchmarking Hashtag fetching, any with input For ["tag_10", "tag_11"]...
Benchmarking Hashtag fetching, any with input For ["tag_12", "tag_13"]...
Benchmarking Hashtag fetching, any with input For ["tag_14", "tag_15"]...
Benchmarking Hashtag fetching, any with input For ["tag_16", "tag_17"]...
Benchmarking Hashtag fetching, any with input For ["tag_18", "tag_19"]...
Benchmarking Hashtag fetching, any with input For ["tag_20"]...

##### With input For ["tag_0", "tag_1"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        470.47        2.13 ms     ±7.05%        2.12 ms        2.52 ms
Hashtag fetching, any         83.06       12.04 ms    ±14.73%       12.41 ms       14.79 ms

Comparison: 
Hashtag fetching, all        470.47
Hashtag fetching, any         83.06 - 5.66x slower +9.91 ms

##### With input For ["tag_2", "tag_3"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        481.73        2.08 ms     ±8.75%        2.08 ms        2.51 ms
Hashtag fetching, any         30.26       33.05 ms     ±4.76%       32.88 ms       38.91 ms

Comparison: 
Hashtag fetching, all        481.73
Hashtag fetching, any         30.26 - 15.92x slower +30.97 ms

##### With input For ["tag_4", "tag_5"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        479.16        2.09 ms     ±8.87%        2.10 ms        2.50 ms
Hashtag fetching, any         14.91       67.09 ms     ±3.16%       66.99 ms       71.11 ms

Comparison: 
Hashtag fetching, all        479.16
Hashtag fetching, any         14.91 - 32.15x slower +65.00 ms

##### With input For ["tag_6", "tag_7"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        507.52        1.97 ms     ±9.03%        1.97 ms        2.40 ms
Hashtag fetching, any          8.63      115.93 ms     ±2.06%      115.67 ms      121.92 ms

Comparison: 
Hashtag fetching, all        507.52
Hashtag fetching, any          8.63 - 58.84x slower +113.96 ms

##### With input For ["tag_8", "tag_9"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        493.22        2.03 ms     ±8.34%        2.02 ms        2.48 ms
Hashtag fetching, any          5.69      175.84 ms     ±1.75%      175.95 ms      186.00 ms

Comparison: 
Hashtag fetching, all        493.22
Hashtag fetching, any          5.69 - 86.73x slower +173.81 ms

##### With input For ["tag_10", "tag_11"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        501.20        2.00 ms     ±9.28%        2.00 ms        2.49 ms
Hashtag fetching, any          4.02      249.03 ms     ±1.39%      248.80 ms      256.18 ms

Comparison: 
Hashtag fetching, all        501.20
Hashtag fetching, any          4.02 - 124.81x slower +247.03 ms

##### With input For ["tag_12", "tag_13"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        473.43        2.11 ms     ±9.13%        2.11 ms        2.61 ms
Hashtag fetching, any          2.94      339.59 ms     ±0.86%      339.11 ms      345.63 ms

Comparison: 
Hashtag fetching, all        473.43
Hashtag fetching, any          2.94 - 160.77x slower +337.48 ms

##### With input For ["tag_14", "tag_15"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        466.54        2.14 ms     ±8.49%        2.15 ms        2.58 ms
Hashtag fetching, any          2.25      445.02 ms     ±2.50%      444.94 ms      470.71 ms

Comparison: 
Hashtag fetching, all        466.54
Hashtag fetching, any          2.25 - 207.62x slower +442.87 ms

##### With input For ["tag_16", "tag_17"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        487.96        2.05 ms     ±7.51%        2.06 ms        2.46 ms
Hashtag fetching, any          1.80      555.94 ms     ±1.20%      557.14 ms      567.78 ms

Comparison: 
Hashtag fetching, all        487.96
Hashtag fetching, any          1.80 - 271.28x slower +553.89 ms

##### With input For ["tag_18", "tag_19"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        482.80        2.07 ms     ±6.94%        2.07 ms        2.46 ms
Hashtag fetching, any          1.48      675.71 ms     ±1.22%      674.85 ms      693.22 ms

Comparison: 
Hashtag fetching, all        482.80
Hashtag fetching, any          1.48 - 326.23x slower +673.64 ms

##### With input For ["tag_20"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, any        485.36        2.06 ms     ±7.83%        2.07 ms        2.43 ms
Hashtag fetching, all        483.07        2.07 ms     ±8.82%        2.08 ms        2.46 ms

Comparison: 
Hashtag fetching, any        485.36
Hashtag fetching, all        483.07 - 1.00x slower +0.00979 ms
Not all of your protocols have been consolidated. In order to achieve the
best possible accuracy for benchmarks, please ensure protocol
consolidation is enabled in your benchmarking environment.

Operating System: Linux
CPU Information: AMD Ryzen Threadripper 3970X 32-Core Processor
Number of Available Cores: 64
Available memory: 62.73 GB
Elixir 1.9.4
Erlang 22.2.6

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
parallel: 1
inputs: For #tag_0, For #tag_1, For #tag_2, For #tag_3, For #tag_4, For #tag_5, For #tag_6, For #tag_7, For #tag_8, For #tag_9, For #tag_10, For #tag_11, For #tag_12, For #tag_13, For #tag_14, For #tag_15, For #tag_16, For #tag_17, For #tag_18, For #tag_19, For #tag_20
Estimated total run time: 2.45 min

Benchmarking Hashtag fetching with input For #tag_0...
Benchmarking Hashtag fetching with input For #tag_1...
Benchmarking Hashtag fetching with input For #tag_2...
Benchmarking Hashtag fetching with input For #tag_3...
Benchmarking Hashtag fetching with input For #tag_4...
Benchmarking Hashtag fetching with input For #tag_5...
Benchmarking Hashtag fetching with input For #tag_6...
Benchmarking Hashtag fetching with input For #tag_7...
Benchmarking Hashtag fetching with input For #tag_8...
Benchmarking Hashtag fetching with input For #tag_9...
Benchmarking Hashtag fetching with input For #tag_10...
Benchmarking Hashtag fetching with input For #tag_11...
Benchmarking Hashtag fetching with input For #tag_12...
Benchmarking Hashtag fetching with input For #tag_13...
Benchmarking Hashtag fetching with input For #tag_14...
Benchmarking Hashtag fetching with input For #tag_15...
Benchmarking Hashtag fetching with input For #tag_16...
Benchmarking Hashtag fetching with input For #tag_17...
Benchmarking Hashtag fetching with input For #tag_18...
Benchmarking Hashtag fetching with input For #tag_19...
Benchmarking Hashtag fetching with input For #tag_20...

##### With input For #tag_0 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        189.34        5.28 ms     ±7.45%        5.29 ms        6.31 ms

##### With input For #tag_1 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         95.06       10.52 ms    ±13.75%       10.88 ms       13.00 ms

##### With input For #tag_2 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         61.01       16.39 ms    ±11.37%       16.62 ms       20.54 ms

##### With input For #tag_3 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         41.04       24.37 ms     ±5.72%       24.39 ms       27.18 ms

##### With input For #tag_4 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         29.74       33.63 ms     ±5.34%       33.49 ms       37.87 ms

##### With input For #tag_5 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         23.65       42.29 ms     ±4.19%       42.17 ms       46.72 ms

##### With input For #tag_6 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         17.62       56.76 ms     ±4.44%       56.45 ms       65.42 ms

##### With input For #tag_7 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         14.16       70.63 ms     ±3.43%       70.56 ms       77.80 ms

##### With input For #tag_8 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         11.85       84.36 ms     ±2.37%       84.44 ms       87.79 ms

##### With input For #tag_9 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          9.75      102.55 ms     ±1.83%      102.78 ms      108.15 ms

##### With input For #tag_10 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          8.25      121.24 ms     ±1.84%      121.15 ms      125.49 ms

##### With input For #tag_11 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          7.12      140.48 ms     ±1.69%      140.42 ms      146.25 ms

##### With input For #tag_12 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          6.05      165.25 ms     ±1.36%      166.05 ms      168.93 ms

##### With input For #tag_13 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          5.33      187.70 ms     ±2.01%      188.74 ms      195.34 ms

##### With input For #tag_14 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          4.61      216.81 ms     ±1.10%      216.91 ms      220.47 ms

##### With input For #tag_15 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          4.09      244.46 ms     ±2.00%      244.04 ms      258.17 ms

##### With input For #tag_16 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          3.71      269.24 ms     ±1.59%      268.14 ms      276.48 ms

##### With input For #tag_17 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          3.29      304.32 ms     ±1.44%      303.97 ms      312.29 ms

##### With input For #tag_18 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          2.98      335.44 ms     ±1.32%      335.33 ms      343.37 ms

##### With input For #tag_19 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching          2.69      372.03 ms     ±1.88%      371.35 ms      387.06 ms

##### With input For #tag_20 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        488.23        2.05 ms     ±8.55%        2.05 ms        2.44 ms

After the changes

RUM enabled: false

19:17:28.875 [warn]  Found files in the emoji folder. These will be ignored, please move them to a subdirectory
Found files: test.png
Found 200000 activities, won't generate new ones
Database contains 67 posts tagged with tag_0
Database contains 300 posts tagged with tag_1
Database contains 617 posts tagged with tag_2
Database contains 1131 posts tagged with tag_3
Database contains 1788 posts tagged with tag_4
Database contains 2405 posts tagged with tag_5
Database contains 3453 posts tagged with tag_6
Database contains 4475 posts tagged with tag_7
Database contains 5581 posts tagged with tag_8
Database contains 6963 posts tagged with tag_9
Database contains 8338 posts tagged with tag_10
Database contains 9888 posts tagged with tag_11
Database contains 11871 posts tagged with tag_12
Database contains 13516 posts tagged with tag_13
Database contains 15762 posts tagged with tag_14
Database contains 17973 posts tagged with tag_15
Database contains 20025 posts tagged with tag_16
Database contains 22702 posts tagged with tag_17
Database contains 25092 posts tagged with tag_18
Database contains 28053 posts tagged with tag_19
Database contains 0 posts tagged with tag_20
Not all of your protocols have been consolidated. In order to achieve the
best possible accuracy for benchmarks, please ensure protocol
consolidation is enabled in your benchmarking environment.

Operating System: Linux
CPU Information: AMD Ryzen Threadripper 3970X 32-Core Processor
Number of Available Cores: 64
Available memory: 62.73 GB
Elixir 1.9.4
Erlang 22.2.6

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
parallel: 1
inputs: For ["tag_0", "tag_1"], For ["tag_2", "tag_3"], For ["tag_4", "tag_5"], For ["tag_6", "tag_7"], For ["tag_8", "tag_9"], For ["tag_10", "tag_11"], For ["tag_12", "tag_13"], For ["tag_14", "tag_15"], For ["tag_16", "tag_17"], For ["tag_18", "tag_19"], For ["tag_20"]
Estimated total run time: 2.57 min

Benchmarking Hashtag fetching, all with input For ["tag_0", "tag_1"]...
Benchmarking Hashtag fetching, all with input For ["tag_2", "tag_3"]...
Benchmarking Hashtag fetching, all with input For ["tag_4", "tag_5"]...
Benchmarking Hashtag fetching, all with input For ["tag_6", "tag_7"]...
Benchmarking Hashtag fetching, all with input For ["tag_8", "tag_9"]...
Benchmarking Hashtag fetching, all with input For ["tag_10", "tag_11"]...
Benchmarking Hashtag fetching, all with input For ["tag_12", "tag_13"]...
Benchmarking Hashtag fetching, all with input For ["tag_14", "tag_15"]...
Benchmarking Hashtag fetching, all with input For ["tag_16", "tag_17"]...
Benchmarking Hashtag fetching, all with input For ["tag_18", "tag_19"]...
Benchmarking Hashtag fetching, all with input For ["tag_20"]...
Benchmarking Hashtag fetching, any with input For ["tag_0", "tag_1"]...
Benchmarking Hashtag fetching, any with input For ["tag_2", "tag_3"]...
Benchmarking Hashtag fetching, any with input For ["tag_4", "tag_5"]...
Benchmarking Hashtag fetching, any with input For ["tag_6", "tag_7"]...
Benchmarking Hashtag fetching, any with input For ["tag_8", "tag_9"]...
Benchmarking Hashtag fetching, any with input For ["tag_10", "tag_11"]...
Benchmarking Hashtag fetching, any with input For ["tag_12", "tag_13"]...
Benchmarking Hashtag fetching, any with input For ["tag_14", "tag_15"]...
Benchmarking Hashtag fetching, any with input For ["tag_16", "tag_17"]...
Benchmarking Hashtag fetching, any with input For ["tag_18", "tag_19"]...
Benchmarking Hashtag fetching, any with input For ["tag_20"]...

##### With input For ["tag_0", "tag_1"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        664.72        1.50 ms     ±9.62%        1.50 ms        1.86 ms
Hashtag fetching, any        304.63        3.28 ms     ±8.34%        3.30 ms        3.84 ms

Comparison: 
Hashtag fetching, all        664.72
Hashtag fetching, any        304.63 - 2.18x slower +1.78 ms

##### With input For ["tag_2", "tag_3"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        686.69        1.46 ms    ±10.71%        1.47 ms        1.79 ms
Hashtag fetching, any        250.62        3.99 ms     ±9.12%        3.98 ms        4.88 ms

Comparison: 
Hashtag fetching, all        686.69
Hashtag fetching, any        250.62 - 2.74x slower +2.53 ms

##### With input For ["tag_4", "tag_5"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        670.90        1.49 ms    ±10.19%        1.50 ms        1.85 ms
Hashtag fetching, any        314.39        3.18 ms     ±8.26%        3.18 ms        3.81 ms

Comparison: 
Hashtag fetching, all        670.90
Hashtag fetching, any        314.39 - 2.13x slower +1.69 ms

##### With input For ["tag_6", "tag_7"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        719.28        1.39 ms     ±8.67%        1.39 ms        1.71 ms
Hashtag fetching, any        385.86        2.59 ms     ±8.36%        2.60 ms        3.10 ms

Comparison: 
Hashtag fetching, all        719.28
Hashtag fetching, any        385.86 - 1.86x slower +1.20 ms

##### With input For ["tag_8", "tag_9"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        693.46        1.44 ms     ±9.43%        1.44 ms        1.78 ms
Hashtag fetching, any        470.86        2.12 ms    ±10.79%        2.07 ms        2.73 ms

Comparison: 
Hashtag fetching, all        693.46
Hashtag fetching, any        470.86 - 1.47x slower +0.68 ms

##### With input For ["tag_10", "tag_11"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        774.38        1.29 ms     ±8.35%        1.28 ms        1.61 ms
Hashtag fetching, any        443.17        2.26 ms    ±10.60%        2.23 ms        2.88 ms

Comparison: 
Hashtag fetching, all        774.38
Hashtag fetching, any        443.17 - 1.75x slower +0.97 ms

##### With input For ["tag_12", "tag_13"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        710.79        1.41 ms    ±10.15%        1.41 ms        1.73 ms
Hashtag fetching, any        497.81        2.01 ms    ±13.29%        1.92 ms        2.74 ms

Comparison: 
Hashtag fetching, all        710.79
Hashtag fetching, any        497.81 - 1.43x slower +0.60 ms

##### With input For ["tag_14", "tag_15"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        708.94        1.41 ms     ±9.57%        1.41 ms        1.75 ms
Hashtag fetching, any        490.17        2.04 ms    ±10.65%        2.02 ms        2.64 ms

Comparison: 
Hashtag fetching, all        708.94
Hashtag fetching, any        490.17 - 1.45x slower +0.63 ms

##### With input For ["tag_16", "tag_17"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        671.47        1.49 ms     ±9.64%        1.49 ms        1.86 ms
Hashtag fetching, any        432.06        2.31 ms    ±10.39%        2.32 ms        2.91 ms

Comparison: 
Hashtag fetching, all        671.47
Hashtag fetching, any        432.06 - 1.55x slower +0.83 ms

##### With input For ["tag_18", "tag_19"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        687.17        1.46 ms     ±9.25%        1.46 ms        1.79 ms
Hashtag fetching, any        459.35        2.18 ms    ±12.83%        2.22 ms        2.77 ms

Comparison: 
Hashtag fetching, all        687.17
Hashtag fetching, any        459.35 - 1.50x slower +0.72 ms

##### With input For ["tag_20"] #####
Name                            ips        average  deviation         median         99th %
Hashtag fetching, all        714.23        1.40 ms     ±9.54%        1.39 ms        1.75 ms
Hashtag fetching, any        677.30        1.48 ms     ±9.17%        1.48 ms        1.81 ms

Comparison: 
Hashtag fetching, all        714.23
Hashtag fetching, any        677.30 - 1.05x slower +0.0763 ms
Not all of your protocols have been consolidated. In order to achieve the
best possible accuracy for benchmarks, please ensure protocol
consolidation is enabled in your benchmarking environment.

Operating System: Linux
CPU Information: AMD Ryzen Threadripper 3970X 32-Core Processor
Number of Available Cores: 64
Available memory: 62.73 GB
Elixir 1.9.4
Erlang 22.2.6

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
parallel: 1
inputs: For #tag_0, For #tag_1, For #tag_2, For #tag_3, For #tag_4, For #tag_5, For #tag_6, For #tag_7, For #tag_8, For #tag_9, For #tag_10, For #tag_11, For #tag_12, For #tag_13, For #tag_14, For #tag_15, For #tag_16, For #tag_17, For #tag_18, For #tag_19, For #tag_20
Estimated total run time: 2.45 min

Benchmarking Hashtag fetching with input For #tag_0...
Benchmarking Hashtag fetching with input For #tag_1...
Benchmarking Hashtag fetching with input For #tag_2...
Benchmarking Hashtag fetching with input For #tag_3...
Benchmarking Hashtag fetching with input For #tag_4...
Benchmarking Hashtag fetching with input For #tag_5...
Benchmarking Hashtag fetching with input For #tag_6...
Benchmarking Hashtag fetching with input For #tag_7...
Benchmarking Hashtag fetching with input For #tag_8...
Benchmarking Hashtag fetching with input For #tag_9...
Benchmarking Hashtag fetching with input For #tag_10...
Benchmarking Hashtag fetching with input For #tag_11...
Benchmarking Hashtag fetching with input For #tag_12...
Benchmarking Hashtag fetching with input For #tag_13...
Benchmarking Hashtag fetching with input For #tag_14...
Benchmarking Hashtag fetching with input For #tag_15...
Benchmarking Hashtag fetching with input For #tag_16...
Benchmarking Hashtag fetching with input For #tag_17...
Benchmarking Hashtag fetching with input For #tag_18...
Benchmarking Hashtag fetching with input For #tag_19...
Benchmarking Hashtag fetching with input For #tag_20...

##### With input For #tag_0 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        411.71        2.43 ms     ±9.01%        2.43 ms        2.92 ms

##### With input For #tag_1 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        314.07        3.18 ms     ±8.28%        3.18 ms        3.96 ms

##### With input For #tag_2 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        239.70        4.17 ms     ±7.77%        4.15 ms        5.08 ms

##### With input For #tag_3 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        209.58        4.77 ms    ±11.46%        4.77 ms        6.00 ms

##### With input For #tag_4 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        238.47        4.19 ms    ±11.42%        4.20 ms        5.18 ms

##### With input For #tag_5 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        272.50        3.67 ms    ±12.90%        3.69 ms        4.70 ms

##### With input For #tag_6 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        309.05        3.24 ms    ±10.84%        3.24 ms        4.10 ms

##### With input For #tag_7 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        333.41        3.00 ms     ±9.01%        2.99 ms        3.77 ms

##### With input For #tag_8 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        440.39        2.27 ms    ±10.74%        2.26 ms        2.86 ms

##### With input For #tag_9 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        431.97        2.31 ms    ±10.12%        2.31 ms        2.82 ms

##### With input For #tag_10 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        440.35        2.27 ms     ±9.09%        2.20 ms        2.84 ms

##### With input For #tag_11 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        479.87        2.08 ms    ±10.53%        2.01 ms        2.81 ms

##### With input For #tag_12 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        434.08        2.30 ms     ±9.02%        2.28 ms        2.85 ms

##### With input For #tag_13 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        481.80        2.08 ms    ±10.90%        2.01 ms        2.72 ms

##### With input For #tag_14 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        484.70        2.06 ms     ±8.21%        2.02 ms        2.55 ms

##### With input For #tag_15 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        467.51        2.14 ms    ±10.49%        2.07 ms        2.73 ms

##### With input For #tag_16 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        499.21        2.00 ms    ±10.44%        1.96 ms        2.67 ms

##### With input For #tag_17 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        510.53        1.96 ms     ±7.83%        1.94 ms        2.49 ms

##### With input For #tag_18 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        504.76        1.98 ms     ±9.58%        1.93 ms        2.64 ms

##### With input For #tag_19 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        528.63        1.89 ms     ±8.72%        1.85 ms        2.50 ms

##### With input For #tag_20 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        680.38        1.47 ms    ±10.58%        1.47 ms        1.86 ms

Without skipping the preload

RUM enabled: false

17:09:19.252 [warn]  Found files in the emoji folder. These will be ignored, please move them to a subdirectory
Found files: test.png
Found 200000 activities, won't generate new ones
Database contains 67 posts tagged with tag_0
Database contains 300 posts tagged with tag_1
Database contains 617 posts tagged with tag_2
Database contains 1131 posts tagged with tag_3
Database contains 1788 posts tagged with tag_4
Database contains 2405 posts tagged with tag_5
Database contains 3453 posts tagged with tag_6
Database contains 4475 posts tagged with tag_7
Database contains 5581 posts tagged with tag_8
Database contains 6963 posts tagged with tag_9
Database contains 8338 posts tagged with tag_10
Database contains 9888 posts tagged with tag_11
Database contains 11871 posts tagged with tag_12
Database contains 13516 posts tagged with tag_13
Database contains 15762 posts tagged with tag_14
Database contains 17973 posts tagged with tag_15
Database contains 20025 posts tagged with tag_16
Database contains 22702 posts tagged with tag_17
Database contains 25092 posts tagged with tag_18
Database contains 28053 posts tagged with tag_19
Database contains 0 posts tagged with tag_20
Not all of your protocols have been consolidated. In order to achieve the
best possible accuracy for benchmarks, please ensure protocol
consolidation is enabled in your benchmarking environment.

Operating System: Linux
CPU Information: AMD Ryzen Threadripper 3970X 32-Core Processor
Number of Available Cores: 64
Available memory: 62.73 GB
Elixir 1.9.4
Erlang 22.2.6

Benchmark suite executing with the following configuration:
warmup: 2 s
time: 5 s
memory time: 0 ns
parallel: 1
inputs: For #tag_0, For #tag_1, For #tag_2, For #tag_3, For #tag_4, For #tag_5, For #tag_6, For #tag_7, For #tag_8, For #tag_9, For #tag_10, For #tag_11, For #tag_12, For #tag_13, For #tag_14, For #tag_15, For #tag_16, For #tag_17, For #tag_18, For #tag_19, For #tag_20
Estimated total run time: 2.45 min

Benchmarking Hashtag fetching with input For #tag_0...
Benchmarking Hashtag fetching with input For #tag_1...
Benchmarking Hashtag fetching with input For #tag_2...
Benchmarking Hashtag fetching with input For #tag_3...
Benchmarking Hashtag fetching with input For #tag_4...
Benchmarking Hashtag fetching with input For #tag_5...
Benchmarking Hashtag fetching with input For #tag_6...
Benchmarking Hashtag fetching with input For #tag_7...
Benchmarking Hashtag fetching with input For #tag_8...
Benchmarking Hashtag fetching with input For #tag_9...
Benchmarking Hashtag fetching with input For #tag_10...
Benchmarking Hashtag fetching with input For #tag_11...
Benchmarking Hashtag fetching with input For #tag_12...
Benchmarking Hashtag fetching with input For #tag_13...
Benchmarking Hashtag fetching with input For #tag_14...
Benchmarking Hashtag fetching with input For #tag_15...
Benchmarking Hashtag fetching with input For #tag_16...
Benchmarking Hashtag fetching with input For #tag_17...
Benchmarking Hashtag fetching with input For #tag_18...
Benchmarking Hashtag fetching with input For #tag_19...
Benchmarking Hashtag fetching with input For #tag_20...

##### With input For #tag_0 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        183.96        5.44 ms     ±7.00%        5.39 ms        6.39 ms

##### With input For #tag_1 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         96.50       10.36 ms    ±14.51%       10.63 ms       13.22 ms

##### With input For #tag_2 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching         62.59       15.98 ms    ±12.75%       16.26 ms       20.48 ms

##### With input For #tag_3 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        161.21        6.20 ms     ±9.30%        6.25 ms        7.40 ms

##### With input For #tag_4 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        172.56        5.79 ms    ±10.38%        5.81 ms        6.95 ms

##### With input For #tag_5 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        194.50        5.14 ms     ±9.34%        5.17 ms        6.22 ms

##### With input For #tag_6 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        220.58        4.53 ms     ±9.58%        4.53 ms        5.51 ms

##### With input For #tag_7 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        231.68        4.32 ms     ±8.66%        4.33 ms        5.20 ms

##### With input For #tag_8 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        264.59        3.78 ms     ±7.52%        3.79 ms        4.47 ms

##### With input For #tag_9 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        258.57        3.87 ms     ±7.55%        3.87 ms        4.64 ms

##### With input For #tag_10 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        258.54        3.87 ms     ±8.44%        3.87 ms        4.74 ms

##### With input For #tag_11 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        259.32        3.86 ms     ±8.74%        3.89 ms        4.65 ms

##### With input For #tag_12 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        255.27        3.92 ms     ±8.69%        3.93 ms        4.66 ms

##### With input For #tag_13 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        271.12        3.69 ms     ±7.89%        3.72 ms        4.42 ms

##### With input For #tag_14 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        257.64        3.88 ms     ±7.19%        3.88 ms        4.63 ms

##### With input For #tag_15 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        262.14        3.81 ms     ±8.80%        3.83 ms        4.61 ms

##### With input For #tag_16 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        266.21        3.76 ms     ±8.94%        3.78 ms        4.53 ms

##### With input For #tag_17 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        254.50        3.93 ms     ±9.55%        3.92 ms        4.81 ms

##### With input For #tag_18 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        261.85        3.82 ms     ±6.94%        3.83 ms        4.52 ms

##### With input For #tag_19 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        255.63        3.91 ms     ±8.06%        3.92 ms        4.73 ms

##### With input For #tag_20 #####
Name                       ips        average  deviation         median         99th %
Hashtag fetching        458.47        2.18 ms     ±6.78%        2.18 ms        2.51 ms
Edited by lain

Merge request reports