q(80)/d68ukllhk7ec73f2kccg.auto)
SurrealDB 3.0 benchmarks: a new foundation for performance
When we began our benchmarking journey with SurrealDB 2.0, we set out to answer a simple but important question: how does SurrealDB perform in the real world?
Since then, SurrealDB has seen rapidly growing traction - including enterprises like Tencent and Later.com running in production at significant scale, across high-throughput, business-critical workloads. As adoption has increased, so has the importance of demonstrating not just raw performance, but predictable, production-ready performance.
Last year we shared those early results openly, along with our methodology and learnings, in our first benchmarking report.
With SurrealDB 3.0, we’re taking the next major step in that journey. Today, we’re excited to announce our new benchmarks for SurrealDB 3.0 - and more importantly, the architectural changes that make these results possible.
Benchmarking a multi-model database
As mentioned in our previous benchmarking blog, benchmarking a multi-model database is more complex than comparing single-purpose systems. SurrealDB unifies relational, document, graph, time-series, key-value, vector, geospatial, and full-text workloads in one engine, spanning everything from embedded deployments to distributed clusters.
This versatility makes fair benchmarking challenging, since different databases vary widely in durability guarantees, disk flushing behaviour, and configuration trade-offs. For our benchmarks, we’ve done our best to keep comparisons as balanced and transparent as possible - and we always welcome feedback on how to improve the methodology further.
Because SurrealDB can replace entire stacks of databases and supporting tools, the best way to benchmark SurrealDB is often through a like-for-like proof of concept against multiple existing systems (we have customers like Tencent who reduced nine separate tools down to one with SurrealDB).
Our open-source benchmarking tool
We built our own internal benchmarking tool - crud-bench - in Rust to properly evaluate SurrealDB across the wide range of workloads it supports. Unlike many generic benchmarking suites, crud-bench is designed to test not just basic CRUD operations, but also the broader feature set that makes SurrealDB unique, across embedded, networked, and remote deployments. It allows us to compare SQL, NoSQL, key-value, and embedded systems in a consistent way, while continuously measuring the performance impact of changes inside SurrealDB itself. For more details on how the tool work, check the crud-bench GitHub repo and the explanation in the previous 2.0 benchmark blog.
SurrealDB 3.0: a new execution engine
The foundation
SurrealDB 3.0 has been largely focused on stability and getting the right foundations in place. We rearchitected the internals in ways that would have been nearly impossible under the previous design, and the performance results we're seeing now are a direct consequence of that work.
The biggest change is the query execution engine. We took inspiration from the broader database community and moved SurrealQL's execution model to a more standard pipeline: AST → LogicalPlan → ExecutionPlan, with basic query optimisations applied throughout. The new engine is fully streaming internally, and in a future minor release we will make it stream end-to-end.
Right now, the new execution engine covers read-only statements. In the coming minor releases we'll expand it to handle all of our workloads.
TL;DR Now let’s get to the benchmarks themselves. The tl;dr for the numbers below are as follows:
Graph queries are between 8-22x faster.
Large table scans with
LIMIT,START, andSTART + LIMITare 3-6x faster.The query planner is smarter. Queries like
SELECT * FROM table WHERE id = record:42that previously triggered full table scans now resolve in sub-millisecond time, a 4000x+ improvement. This is especially important for a query language like SurrealQL which is very close to standard SQL in whichWHERE id =is one of the most common patterns.ORDER BY queries are 3-4x faster across all storage engines.
HNSW vector search is up to 8x faster. Indexed vector similarity queries dropped from ~35 seconds to ~4.5 seconds.
The new execution model enables significantly improved concurrency and throughput.
Complex GROUP BY queries with multiple aggregations are up to 55% faster, with the biggest gains on multi-aggregation and deduplication workloads.
Benchmarks
In-Memory
| Test | Category | SurrealDB 2 | SurrealDB 2 | SurrealDB 2 | SurrealDB 2 | SurrealDB 3 | SurrealDB 3 | SurrealDB 3 | SurrealDB 3 | Mean % v3 vs. v2 | OPS % v3. vs v2 | Query |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mean (ms) | P50 (ms) | P99 (ms) | Operations Per Second (OPS) | Mean (ms) | P50 (ms) | P99 (ms) | Operations Per Second (OPS) | |||||
| [C]reate | CRUD | 1.94 | 1.95 | 2.97 | 147538.6 | 0.72 | 0.68 | 1.73 | 396504.5 | -62.9% | +168.7% | |
| [R]ead | CRUD | 0.37 | 0.34 | 1.06 | 757976.6 | 0.58 | 0.54 | 1.48 | 488252.1 | +56.8% | -35.6% | |
| [U]pdate | CRUD | 2.58 | 2.56 | 3.25 | 111466.6 | 0.73 | 0.70 | 1.72 | 389693.8 | -71.7% | +249.6% | |
| [S]can::count_all (2000) | Scans | 204.97 | 187.65 | 602.11 | 1277.8 | 113.99 | 63.65 | 695.29 | 2100.1 | -44.4% | +64.3% | |
| [S]can::limit_id (2000) | Scans | 5.32 | 3.82 | 18.45 | 47510.8 | 1.73 | 1.68 | 3.60 | 126780.2 | -67.5% | +166.8% | |
| [S]can::limit_all (2000) | Scans | 17.45 | 4.50 | 83.33 | 15053.5 | 2.46 | 2.39 | 5.38 | 97982.9 | -85.9% | +550.9% | |
| [S]can::limit_start_id (2000) | Scans | 7.45 | 3.33 | 39.13 | 33909.7 | 10.81 | 11.57 | 20.29 | 24360.7 | +45.1% | -28.2% | |
| [S]can::limit_start_all (2000) | Scans | 18.11 | 6.61 | 85.50 | 14419.5 | 11.14 | 10.84 | 27.95 | 23733.8 | -38.5% | +64.6% | |
| [S]can::select_where_id (2000) | Scans | 0.49 | 0.38 | 1.15 | 401422.2 | 0.66 | 0.60 | 1.42 | 319614.6 | +34.7% | -20.4% | SELECT * FROM record:42 |
| [S]can::select_where_id_eq (2000) | Scans | 3935.65 | 3792.89 | 7335.94 | 70.9 | 0.68 | 0.65 | 1.46 | 309409.5 | -100.0% | +436179.7% | SELECT * FROM record WHERE id = record:42 |
| [S]can::select_where_gt (2000) | Scans | 5242.39 | 5062.65 | 9895.93 | 52.9 | 6235.40 | 2277.38 | 37093.38 | 43.8 | +18.9% | -17.2% | SELECT * FROM record WHERE number > 4625 |
| [S]can::select_where_in (2000) | Scans | 9745.80 | 9388.03 | 17924.10 | 28.4 | 6221.91 | 1434.62 | 30867.46 | 44.3 | -36.2% | +55.8% | SELECT * FROM record WHERE age IN [5, 15, 25, 35, 45, 55, 65] |
| [S]can::select_where_multi_and (2000) | Scans | 6065.92 | 5787.65 | 12107.77 | 45.7 | 6238.46 | 1468.41 | 25018.37 | 44.2 | +2.8% | -3.2% | SELECT * FROM record WHERE city = 'london' AND age > 50 |
| [S]can::select_where_order_limit (2000) | Scans | 5196.36 | 4997.12 | 9936.90 | 53.3 | 5762.22 | 1320.96 | 40730.62 | 48.7 | +10.9% | -8.7% | SELECT * FROM record WHERE number > 4625 ORDER BY age LIMIT 50 |
| [S]can::select_where_order_desc_limit (2000) | Scans | 5191.97 | 4980.73 | 10117.12 | 53.5 | 5842.42 | 2734.08 | 42303.49 | 47.1 | +12.5% | -11.8% | SELECT * FROM record WHERE score < 7.5 ORDER BY number DESC LIMIT 50 |
| [S]can::select_where_multi_order_limit (2000) | Scans | 6271.61 | 6008.83 | 11698.17 | 44.3 | 5830.96 | 2605.05 | 40992.77 | 48.4 | -7.0% | +9.2% | SELECT * FROM record WHERE age > 85 AND active = true ORDER BY city, score DESC LIMIT 50 |
| [S]can::select_omit_limit (2000) | Scans | 18.09 | 7.01 | 94.08 | 14490.0 | 2.83 | 2.64 | 6.51 | 81951.6 | -84.4% | +465.6% | SELECT * OMIT words, embedding, tags FROM record LIMIT 100 |
| [S]can::select_fields_where_limit (2000) | Scans | 16.15 | 6.39 | 76.16 | 16178.0 | 111.41 | 110.53 | 253.82 | 2305.7 | +589.8% | -85.7% | SELECT name, city, age, number FROM record WHERE score > 50.0 LIMIT 100 |
| [S]can::select_order_by (2000) | Scans | 17270.90 | 16482.30 | 33013.76 | 16.1 | 5274.94 | 1211.39 | 37027.84 | 53.5 | -69.5% | +231.8% | SELECT * FROM record ORDER BY number LIMIT 100 |
| [S]can::select_order_by_multi (2000) | Scans | 17387.92 | 16793.60 | 32702.46 | 16.0 | 5192.82 | 1178.62 | 37158.91 | 53.7 | -70.1% | +235.3% | SELECT * FROM record ORDER BY city, number DESC LIMIT 100 |
| [S]can::select_group_count (2000) | Scans | 5989.63 | 5799.94 | 11632.64 | 46.4 | 5436.81 | 1871.87 | 32440.32 | 50.4 | -9.2% | +8.7% | SELECT city, count() as total FROM record GROUP BY city |
| [S]can::select_group_sum (2000) | Scans | 6754.21 | 6520.83 | 12361.73 | 41.1 | 5635.44 | 2951.17 | 24936.45 | 49.2 | -16.6% | +19.8% | SELECT city, math::sum(number) as total FROM record GROUP BY city |
| [S]can::select_group_avg (2000) | Scans | 6766.85 | 6553.60 | 12582.91 | 40.9 | 5529.88 | 1335.30 | 31604.74 | 49.4 | -18.3% | +20.9% | SELECT city, math::mean(age) as avg_age FROM record GROUP BY city |
| [S]can::select_group_multi_agg (2000) | Scans | 9738.26 | 9363.45 | 18513.92 | 28.5 | 6203.12 | 4567.04 | 28491.78 | 43.8 | -36.3% | +53.4% | SELECT city, math::sum(number) as s1, math::sum(number) as s2, math::mean(age) as avg_age FROM record GROUP BY city |
| [S]can::select_group_all (2000) | Scans | 7492.08 | 7221.25 | 13910.01 | 37.1 | 5561.68 | 2719.74 | 21889.02 | 49.5 | -25.8% | +33.7% | SELECT count() as c, math::sum(number) as total, math::mean(age) as avg_age FROM record GROUP ALL |
| [S]can::select_group_order_limit (2000) | Scans | 7603.12 | 7278.59 | 14917.63 | 36.5 | 5798.60 | 1380.35 | 40796.16 | 48.1 | -23.7% | +31.6% | SELECT city, count() as total, math::mean(score) as avg_score FROM record GROUP BY city ORDER BY total DESC LIMIT 5 |
| [S]can::select_group_where (2000) | Scans | 7411.37 | 7159.81 | 13770.75 | 37.5 | 6459.82 | 2660.35 | 28786.69 | 42.7 | -12.8% | +13.8% | SELECT city, count() as total, math::sum(number) as sum FROM record WHERE age > 50 GROUP BY city |
| [S]can::select_group_dedup_agg (2000) | Scans | 9735.38 | 9388.03 | 17743.87 | 28.5 | 6278.25 | 4079.61 | 20692.99 | 43.9 | -35.5% | +54.0% | SELECT city, math::sum(number) as total, math::sum(number) as dup1, math::sum(number) as dup2 FROM record GROUP BY city |
| [S]can::select_split (2000) | Scans | 19.71 | 8.38 | 83.07 | 13415.2 | 8.85 | 6.68 | 32.96 | 28351.9 | -55.1% | +111.3% | SELECT * FROM record SPLIT tags LIMIT 100 |
| [S]can::select_fetch (2000) | Scans | 39.07 | 11.35 | 212.48 | 6802.6 | 7.58 | 7.47 | 15.54 | 34134.4 | -80.6% | +401.8% | SELECT * FROM record LIMIT 100 FETCH friend |
| [S]can::select_fetch_where_limit (2000) | Scans | 32.16 | 14.37 | 152.45 | 8366.1 | 125.95 | 120.00 | 283.90 | 2146.3 | +291.6% | -74.3% | SELECT * FROM record WHERE city = 'london' LIMIT 50 FETCH friend |
| [S]can::graph_out_depth1 (2000) | Scans | 2.30 | 1.64 | 9.50 | 105137.8 | 0.92 | 0.86 | 2.13 | 235676.0 | -60.0% | +124.2% | SELECT ->knows->record FROM record:1 |
| [S]can::graph_out_depth2 (2000) | Scans | 6.16 | 2.42 | 44.32 | 42125.8 | 1.67 | 1.60 | 3.43 | 135637.0 | -72.9% | +222.0% | SELECT ->knows->record->knows->record FROM record:1 |
| [S]can::graph_out_depth3 (2000) | Scans | 18.02 | 7.12 | 130.62 | 15001.7 | 3.02 | 2.69 | 7.82 | 82363.1 | -83.2% | +449.0% | SELECT ->knows->record->knows->record->knows->record FROM record:1 |
| [S]can::graph_in_depth1 (2000) | Scans | 2.72 | 1.76 | 10.34 | 90892.6 | 1.12 | 1.05 | 2.50 | 208621.0 | -58.8% | +129.5% | SELECT <-knows<-record FROM record:1 |
| [S]can::graph_bidirectional (2000) | Scans | 4.22 | 2.54 | 19.86 | 57673.0 | 1.39 | 1.16 | 3.68 | 169188.7 | -67.1% | +193.4% | SELECT knowsrecord FROM record:1 |
| [S]can::graph_edge_filter (2000) | Scans | 1.19 | 1.10 | 3.33 | 197478.8 | 1.12 | 0.98 | 3.61 | 189149.0 | -5.9% | -4.2% | SELECT ->knows[WHERE weight > 50]->record FROM record:1 |
| [S]can::graph_multi_out (2000) | Scans | 148.68 | 66.24 | 1050.62 | 1886.3 | 23.32 | 21.84 | 59.58 | 11405.3 | -84.3% | +504.6% | SELECT id, ->knows->record.name FROM record LIMIT 100 |
| [S]can::graph_multi_out_where (2000) | Scans | 51.38 | 31.45 | 357.12 | 5401.8 | 14.40 | 11.62 | 58.02 | 18555.1 | -72.0% | +243.5% | SELECT id, ->knows->(? WHERE number > 2500) FROM record LIMIT 50 |
| [S]can::graph_multi_count (2000) | Scans | 33.74 | 8.24 | 239.62 | 8098.3 | 9.32 | 9.02 | 19.86 | 28157.6 | -72.4% | +247.7% | SELECT id, count(->knows) as edge_count FROM record LIMIT 100 |
| [S]can::graph_depth2_limit (2000) | Scans | 78.83 | 35.71 | 558.59 | 3529.7 | 9.41 | 8.63 | 27.09 | 28104.7 | -88.1% | +696.2% | SELECT id, ->knows->record->knows->record FROM record LIMIT 20 |
| [S]can::graph_sub_where (2000) | Scans | 2.67 | 2.25 | 9.09 | 91237.9 | 2.01 | 1.87 | 4.53 | 120503.8 | -24.7% | +32.1% | SELECT name, ->knows->(SELECT * FROM record WHERE number > 2500) FROM record:1 |
| [S]can::graph_sub_group_all (2000) | Scans | 3.36 | 1.63 | 12.39 | 74807.0 | 1.93 | 1.89 | 4.13 | 126560.9 | -42.6% | +69.2% | SELECT ->knows->(SELECT COUNT() as c, math::mean(number) as avg_num FROM record GROUP ALL) FROM record:1 |
| [S]can::graph_sub_group_by (2000) | Scans | 3.25 | 1.83 | 17.55 | 78504.3 | 1.88 | 1.78 | 4.21 | 126496.6 | -42.2% | +61.1% | SELECT ->knows->(SELECT COUNT() as c, math::mean(number) as avg_num, city FROM record GROUP BY city) FROM record:1 |
| [S]can::subquery_inline (2000) | Scans | 724.85 | 171.01 | 4681.73 | 377.8 | 368.70 | 364.80 | 747.01 | 738.3 | -49.1% | +95.4% | SELECT *, (SELECT * FROM small_table) as sub FROM record LIMIT 100 |
| [S]can::subquery_count (2000) | Scans | 28.49 | 6.78 | 192.00 | 9262.4 | 61.72 | 60.73 | 117.50 | 4406.4 | +116.6% | -52.4% | SELECT *, (SELECT count() FROM small_table GROUP ALL) as sub_count FROM record LIMIT 100 |
| [S]can::subquery_from (2000) | Scans | 2918.72 | 2549.76 | 7938.05 | 94.6 | 1801.28 | 1751.04 | 4151.30 | 152.2 | -38.3% | +60.9% | SELECT city, math::mean(number) as avg FROM (SELECT * FROM record WHERE age > 50 LIMIT 10000) GROUP BY city |
| [S]can::pipeline_filter_group_order (2000) | Scans | 9341.45 | 8806.40 | 18595.84 | 29.7 | 6613.75 | 1528.83 | 47284.22 | 42.0 | -29.2% | +41.6% | SELECT city, count() as c, math::mean(age) as avg_age FROM record WHERE number > 1000 GROUP BY city ORDER BY c DESC LIMIT 5 |
| [S]can::index_standard (2000) | Scans | 3910.21 | 3764.22 | 7561.22 | 71.0 | 5241.54 | 3006.46 | 19890.17 | 51.9 | +34.0% | -26.9% | number = 42 |
| [I]ndex::index_standard | Index Build/Remove | 1003.26 | 1003.52 | 1003.52 | 1.0 | 504.19 | 504.32 | 504.32 | 2.0 | -49.7% | +98.0% | number = 42 |
| [S]can::index_standard::indexed (2000) | Indexed Scans | 4.11 | 2.83 | 15.38 | 61150.4 | 2.36 | 1.36 | 9.54 | 98303.1 | -42.6% | +60.8% | number = 42 |
| [R]emoveIndex::index_standard | Index Build/Remove | 380.54 | 380.67 | 380.67 | 2.6 | 80.67 | 80.70 | 80.70 | 12.4 | -78.8% | +370.7% | number = 42 |
| [S]can::index_composite (2000) | Scans | 6101.19 | 5812.22 | 11747.33 | 45.7 | 6171.27 | 2127.87 | 32555.01 | 43.8 | +1.1% | -4.2% | city = 'london' AND age > 50 |
| [I]ndex::index_composite | Index Build/Remove | 502.14 | 502.27 | 502.27 | 2.0 | 506.50 | 506.62 | 506.62 | 2.0 | +0.9% | -1.0% | city = 'london' AND age > 50 |
| [S]can::index_composite::indexed (2000) | Indexed Scans | 1504.21 | 469.25 | 8138.75 | 176.7 | 745.47 | 352.77 | 2779.14 | 366.3 | -50.4% | +107.2% | city = 'london' AND age > 50 |
| [R]emoveIndex::index_composite | Index Build/Remove | 338.82 | 338.94 | 338.94 | 3.0 | 89.50 | 89.53 | 89.53 | 11.2 | -73.6% | +278.3% | city = 'london' AND age > 50 |
| [S]can::index_range_merged (2000) | Scans | 7595.90 | 7274.49 | 14712.83 | 36.5 | 5641.66 | 1303.55 | 35946.50 | 48.7 | -25.7% | +33.5% | number > 100 AND number < 200 |
| [I]ndex::index_range_merged | Index Build/Remove | 1004.29 | 1004.54 | 1004.54 | 1.0 | 502.14 | 502.27 | 502.27 | 2.0 | -50.0% | +99.0% | number > 100 AND number < 200 |
| [S]can::index_range_merged::indexed (2000) | Indexed Scans | 478.07 | 187.01 | 2099.20 | 555.2 | 227.80 | 98.50 | 1127.42 | 1190.4 | -52.4% | +114.4% | number > 100 AND number < 200 |
| [R]emoveIndex::index_range_merged | Index Build/Remove | 360.32 | 360.45 | 360.45 | 2.8 | 92.19 | 92.22 | 92.22 | 10.8 | -74.4% | +289.6% | number > 100 AND number < 200 |
| [S]can::index_in (2000) | Scans | 7232.84 | 6938.62 | 13795.33 | 38.4 | 5404.26 | 1276.93 | 38699.01 | 51.5 | -25.3% | +34.1% | number IN [42, 100, 200, 300, 400] |
| [I]ndex::index_in | Index Build/Remove | 1004.29 | 1004.54 | 1004.54 | 1.0 | 502.40 | 502.53 | 502.53 | 2.0 | -50.0% | +99.0% | number IN [42, 100, 200, 300, 400] |
| [S]can::index_in::indexed (2000) | Indexed Scans | 25.35 | 8.71 | 113.98 | 10437.8 | 9.73 | 9.18 | 25.31 | 27169.0 | -61.6% | +160.3% | number IN [42, 100, 200, 300, 400] |
| [R]emoveIndex::index_in | Index Build/Remove | 373.89 | 374.01 | 374.01 | 2.7 | 82.78 | 82.81 | 82.81 | 12.1 | -77.9% | +352.1% | number IN [42, 100, 200, 300, 400] |
| [I]ndex::index_fulltext | Index Build/Remove | 51134.46 | 51150.85 | 51150.85 | 0.0 | 3511.30 | 3512.32 | 3512.32 | 0.3 | -93.1% | +1300.0% | words @@ 'hello' |
| [S]can::index_fulltext::indexed (2000) | Indexed Scans | 225.31 | 212.48 | 508.16 | 1216.5 | 760.70 | 709.63 | 1723.39 | 373.8 | +237.6% | -69.3% | words @@ 'hello' |
| [R]emoveIndex::index_fulltext | Index Build/Remove | 845.06 | 845.31 | 845.31 | 1.2 | 1679.87 | 1680.38 | 1680.38 | 0.6 | +98.8% | -49.2% | words @@ 'hello' |
| [I]ndex::index_hnsw | Index Build/Remove | 18604.03 | 18612.22 | 18612.22 | 0.1 | 12529.66 | 12533.76 | 12533.76 | 0.1 | -32.7% | +60.0% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
| [S]can::index_hnsw::indexed (2000) | Indexed Scans | 38581.61 | 38731.78 | 46137.34 | 7.3 | 4847.09 | 2347.01 | 16023.55 | 56.3 | -87.4% | +671.0% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
| [R]emoveIndex::index_hnsw | Index Build/Remove | 2190.34 | 2191.36 | 2191.36 | 0.5 | 390.78 | 390.91 | 390.91 | 2.6 | -82.2% | +456.5% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
SurrealKV
| Test | Category | SurrealDB 2 | SurrealDB 2 | SurrealDB 2 | SurrealDB 2 | SurrealDB 3 | SurrealDB 3 | SurrealDB 3 | SurrealDB 3 | Mean % | OPS % | Query |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mean | P50 | P99 | OPS | Mean | P50 | P99 | OPS | |||||
| [C]reate | CRUD | 221.27 | 221.44 | 227.58 | 1299.7 | 8.25 | 8.01 | 14.33 | 34830.7 | -96.3% | +2579.9% | |
| [R]ead | CRUD | 0.34 | 0.31 | 1.11 | 828781.5 | 0.60 | 0.56 | 1.45 | 477557.1 | +76.5% | -42.4% | |
| [U]pdate | CRUD | 222.01 | 222.85 | 229.25 | 1295.3 | 8.37 | 8.14 | 14.24 | 34330.5 | -96.2% | +2550.3% | |
| [S]can::count_all (2000) | Scans | 303.53 | 300.54 | 392.70 | 917.2 | 142.73 | 73.79 | 889.34 | 1738.6 | -53.0% | +89.6% | |
| [S]can::limit_id (2000) | Scans | 6.51 | 5.74 | 19.41 | 40313.3 | 2.07 | 1.93 | 4.33 | 108861.9 | -68.2% | +170.0% | |
| [S]can::limit_all (2000) | Scans | 16.51 | 8.02 | 103.17 | 16063.4 | 2.56 | 2.49 | 4.98 | 89964.2 | -84.5% | +460.1% | |
| [S]can::limit_start_id (2000) | Scans | 14.27 | 13.70 | 22.22 | 18977.0 | 5.82 | 5.61 | 13.61 | 44194.4 | -59.2% | +132.9% | |
| [S]can::limit_start_all (2000) | Scans | 21.48 | 20.56 | 36.90 | 12560.3 | 6.10 | 5.63 | 16.08 | 42894.7 | -71.6% | +241.5% | |
| [S]can::select_where_id (2000) | Scans | 0.51 | 0.48 | 1.02 | 400808.0 | 0.71 | 0.64 | 1.62 | 299184.1 | +39.2% | -25.4% | SELECT * FROM record:42 |
| [S]can::select_where_id_eq (2000) | Scans | 3478.94 | 3497.98 | 3784.70 | 81.6 | 0.69 | 0.65 | 1.58 | 320960.5 | -100.0% | +393137.5% | SELECT * FROM record WHERE id = record:42 |
| [S]can::select_where_gt (2000) | Scans | 4666.15 | 4681.73 | 5169.15 | 60.8 | 6071.58 | 1438.72 | 37355.52 | 45.0 | +30.1% | -25.9% | SELECT * FROM record WHERE number > 4625 |
| [S]can::select_where_in (2000) | Scans | 9275.42 | 9306.11 | 11386.88 | 30.5 | 6071.93 | 2686.97 | 25214.97 | 45.3 | -34.5% | +48.6% | SELECT * FROM record WHERE age IN [5, 15, 25, 35, 45, 55, 65] |
| [S]can::select_where_multi_and (2000) | Scans | 5509.79 | 5570.56 | 6885.38 | 51.2 | 6044.50 | 1395.71 | 29261.82 | 45.5 | +9.7% | -11.1% | SELECT * FROM record WHERE city = 'london' AND age > 50 |
| [S]can::select_where_order_limit (2000) | Scans | 4650.07 | 4677.63 | 5210.11 | 61.0 | 5504.01 | 1259.52 | 39682.05 | 50.3 | +18.4% | -17.6% | SELECT * FROM record WHERE number > 4625 ORDER BY age LIMIT 50 |
| [S]can::select_where_order_desc_limit (2000) | Scans | 4623.38 | 4640.77 | 5144.57 | 61.4 | 5777.77 | 2637.82 | 29245.44 | 48.3 | +25.0% | -21.4% | SELECT * FROM record WHERE score < 7.5 ORDER BY number DESC LIMIT 50 |
| [S]can::select_where_multi_order_limit (2000) | Scans | 5692.97 | 5726.21 | 6410.24 | 49.8 | 5590.58 | 1268.73 | 39518.21 | 50.1 | -1.8% | +0.5% | SELECT * FROM record WHERE age > 85 AND active = true ORDER BY city, score DESC LIMIT 50 |
| [S]can::select_omit_limit (2000) | Scans | 17.20 | 10.75 | 69.57 | 15569.4 | 3.97 | 3.13 | 11.89 | 64774.7 | -76.9% | +316.0% | SELECT * OMIT words, embedding, tags FROM record LIMIT 100 |
| [S]can::select_fields_where_limit (2000) | Scans | 16.06 | 15.87 | 32.09 | 16653.9 | 103.59 | 102.59 | 230.53 | 2450.0 | +545.0% | -85.3% | SELECT name, city, age, number FROM record WHERE score > 50.0 LIMIT 100 |
| [S]can::select_order_by (2000) | Scans | 15714.24 | 15343.61 | 26968.06 | 17.9 | 5016.71 | 1245.18 | 35815.42 | 55.5 | -68.1% | +210.7% | SELECT * FROM record ORDER BY number LIMIT 100 |
| [S]can::select_order_by_multi (2000) | Scans | 15943.91 | 15663.10 | 25149.44 | 17.6 | 5055.99 | 1144.83 | 35782.65 | 55.3 | -68.3% | +214.1% | SELECT * FROM record ORDER BY city, number DESC LIMIT 100 |
| [S]can::select_group_count (2000) | Scans | 4391.26 | 4411.39 | 4841.47 | 64.7 | 5236.94 | 1296.38 | 24690.69 | 53.0 | +19.3% | -18.1% | SELECT city, count() as total FROM record GROUP BY city |
| [S]can::select_group_sum (2000) | Scans | 5024.47 | 5050.37 | 5595.14 | 56.5 | 5485.56 | 1305.60 | 21790.72 | 50.4 | +9.2% | -10.9% | SELECT city, math::sum(number) as total FROM record GROUP BY city |
| [S]can::select_group_avg (2000) | Scans | 5023.77 | 5042.18 | 5591.04 | 56.5 | 5437.21 | 2476.03 | 20905.98 | 50.5 | +8.2% | -10.6% | SELECT city, math::mean(age) as avg_age FROM record GROUP BY city |
| [S]can::select_group_multi_agg (2000) | Scans | 7942.62 | 7962.62 | 10067.97 | 35.6 | 6081.36 | 1482.75 | 34471.93 | 45.0 | -23.4% | +26.5% | SELECT city, math::sum(number) as s1, math::sum(number) as s2, math::mean(age) as avg_age FROM record GROUP BY city |
| [S]can::select_group_all (2000) | Scans | 5757.57 | 5779.45 | 6496.26 | 49.2 | 5418.85 | 2301.95 | 26050.56 | 51.0 | -5.9% | +3.6% | SELECT count() as c, math::sum(number) as total, math::mean(age) as avg_age FROM record GROUP ALL |
| [S]can::select_group_order_limit (2000) | Scans | 5832.72 | 5853.18 | 6516.73 | 48.6 | 5534.30 | 1387.52 | 40239.10 | 49.6 | -5.1% | +2.0% | SELECT city, count() as total, math::mean(score) as avg_score FROM record GROUP BY city ORDER BY total DESC LIMIT 5 |
| [S]can::select_group_where (2000) | Scans | 6046.34 | 6070.27 | 6877.18 | 46.9 | 6354.95 | 3026.94 | 42303.49 | 43.5 | +5.1% | -7.2% | SELECT city, count() as total, math::sum(number) as sum FROM record WHERE age > 50 GROUP BY city |
| [S]can::select_group_dedup_agg (2000) | Scans | 7959.49 | 7987.20 | 9388.03 | 35.5 | 6055.39 | 2525.18 | 24264.70 | 45.0 | -23.9% | +26.7% | SELECT city, math::sum(number) as total, math::sum(number) as dup1, math::sum(number) as dup2 FROM record GROUP BY city |
| [S]can::select_split (2000) | Scans | 18.00 | 10.84 | 79.10 | 14812.0 | 8.66 | 7.49 | 29.54 | 28485.5 | -51.9% | +92.3% | SELECT * FROM record SPLIT tags LIMIT 100 |
| [S]can::select_fetch (2000) | Scans | 35.99 | 15.23 | 158.34 | 7481.3 | 8.96 | 8.94 | 16.72 | 29309.5 | -75.1% | +291.8% | SELECT * FROM record LIMIT 100 FETCH friend |
| [S]can::select_fetch_where_limit (2000) | Scans | 30.70 | 19.18 | 225.79 | 8690.9 | 114.08 | 109.06 | 249.73 | 2375.0 | +271.6% | -72.7% | SELECT * FROM record WHERE city = 'london' LIMIT 50 FETCH friend |
| [S]can::graph_out_depth1 (2000) | Scans | 5.00 | 4.47 | 15.54 | 52630.3 | 1.55 | 1.39 | 4.02 | 148160.1 | -69.0% | +181.5% | SELECT ->knows->record FROM record:1 |
| [S]can::graph_out_depth2 (2000) | Scans | 14.70 | 12.67 | 39.94 | 18594.4 | 3.29 | 3.16 | 7.62 | 77306.4 | -77.6% | +315.8% | SELECT ->knows->record->knows->record FROM record:1 |
| [S]can::graph_out_depth3 (2000) | Scans | 42.04 | 41.41 | 73.28 | 6604.0 | 8.30 | 8.21 | 17.15 | 31839.6 | -80.3% | +382.1% | SELECT ->knows->record->knows->record->knows->record FROM record:1 |
| [S]can::graph_in_depth1 (2000) | Scans | 4.95 | 3.74 | 19.12 | 53273.6 | 1.43 | 1.40 | 2.81 | 161031.4 | -71.1% | +202.3% | SELECT <-knows<-record FROM record:1 |
| [S]can::graph_bidirectional (2000) | Scans | 11.14 | 9.79 | 34.46 | 24621.8 | 2.54 | 2.54 | 5.10 | 97824.2 | -77.2% | +297.3% | SELECT knowsrecord FROM record:1 |
| [S]can::graph_edge_filter (2000) | Scans | 2.41 | 1.68 | 9.48 | 100491.2 | 1.23 | 1.21 | 3.08 | 188866.9 | -49.0% | +87.9% | SELECT ->knows[WHERE weight > 50]->record FROM record:1 |
| [S]can::graph_multi_out (2000) | Scans | 436.45 | 437.76 | 549.38 | 643.7 | 70.48 | 46.37 | 350.98 | 3918.3 | -83.9% | +508.7% | SELECT id, ->knows->record.name FROM record LIMIT 100 |
| [S]can::graph_multi_out_where (2000) | Scans | 173.91 | 173.44 | 235.39 | 1610.2 | 36.83 | 30.30 | 136.32 | 7433.1 | -78.8% | +361.6% | SELECT id, ->knows->(? WHERE number > 2500) FROM record LIMIT 50 |
| [S]can::graph_multi_count (2000) | Scans | 94.20 | 94.33 | 127.23 | 2968.2 | 16.70 | 16.83 | 34.30 | 15934.7 | -82.3% | +436.8% | SELECT id, count(->knows) as edge_count FROM record LIMIT 100 |
| [S]can::graph_depth2_limit (2000) | Scans | 246.73 | 247.42 | 315.13 | 1139.2 | 47.07 | 40.61 | 126.97 | 5844.6 | -80.9% | +413.0% | SELECT id, ->knows->record->knows->record FROM record LIMIT 20 |
| [S]can::graph_sub_where (2000) | Scans | 5.50 | 4.21 | 22.61 | 48232.8 | 2.10 | 2.01 | 4.43 | 115625.9 | -61.8% | +139.7% | SELECT name, ->knows->(SELECT * FROM record WHERE number > 2500) FROM record:1 |
| [S]can::graph_sub_group_all (2000) | Scans | 5.84 | 4.98 | 22.11 | 45269.5 | 2.27 | 2.16 | 5.96 | 109630.7 | -61.1% | +142.2% | SELECT ->knows->(SELECT COUNT() as c, math::mean(number) as avg_num FROM record GROUP ALL) FROM record:1 |
| [S]can::graph_sub_group_by (2000) | Scans | 5.90 | 4.60 | 23.89 | 44952.6 | 2.21 | 2.12 | 5.83 | 108263.4 | -62.5% | +140.8% | SELECT ->knows->(SELECT COUNT() as c, math::mean(number) as avg_num, city FROM record GROUP BY city) FROM record:1 |
| [S]can::subquery_inline (2000) | Scans | 596.32 | 601.60 | 757.76 | 471.7 | 366.11 | 367.36 | 721.41 | 744.9 | -38.6% | +57.9% | SELECT *, (SELECT * FROM small_table) as sub FROM record LIMIT 100 |
| [S]can::subquery_count (2000) | Scans | 75.35 | 75.52 | 91.52 | 3716.0 | 42.73 | 31.77 | 160.00 | 6505.7 | -43.3% | +75.1% | SELECT *, (SELECT count() FROM small_table GROUP ALL) as sub_count FROM record LIMIT 100 |
| [S]can::subquery_from (2000) | Scans | 2723.41 | 2576.38 | 6225.92 | 102.0 | 1730.69 | 1651.71 | 4349.95 | 157.1 | -36.5% | +54.1% | SELECT city, math::mean(number) as avg FROM (SELECT * FROM record WHERE age > 50 LIMIT 10000) GROUP BY city |
| [S]can::pipeline_filter_group_order (2000) | Scans | 7624.09 | 7667.71 | 9846.78 | 37.0 | 6318.85 | 2078.72 | 45940.74 | 43.4 | -17.1% | +17.3% | SELECT city, count() as c, math::mean(age) as avg_age FROM record WHERE number > 1000 GROUP BY city ORDER BY c DESC LIMIT 5 |
| [S]can::index_standard (2000) | Scans | 3454.12 | 3471.36 | 3756.03 | 82.3 | 5071.34 | 2295.81 | 18661.38 | 53.8 | +46.8% | -34.6% | number = 42 |
| [I]ndex::index_standard | Index Build/Remove | 1513.98 | 1514.49 | 1514.49 | 0.7 | 1008.38 | 1008.64 | 1008.64 | 1.0 | -33.4% | +50.0% | number = 42 |
| [S]can::index_standard::indexed (2000) | Indexed Scans | 6.04 | 3.60 | 30.45 | 43641.0 | 2.64 | 2.33 | 6.56 | 83230.9 | -56.3% | +90.7% | number = 42 |
| [R]emoveIndex::index_standard | Index Build/Remove | 445.31 | 445.44 | 445.44 | 2.2 | 102.82 | 102.85 | 102.85 | 9.7 | -76.9% | +332.6% | number = 42 |
| [S]can::index_composite (2000) | Scans | 5489.27 | 5513.22 | 6172.67 | 51.6 | 6131.84 | 2908.16 | 25247.74 | 44.7 | +11.7% | -13.5% | city = 'london' AND age > 50 |
| [I]ndex::index_composite | Index Build/Remove | 1513.98 | 1514.49 | 1514.49 | 0.7 | 1011.97 | 1012.22 | 1012.22 | 1.0 | -33.2% | +50.0% | city = 'london' AND age > 50 |
| [S]can::index_composite::indexed (2000) | Indexed Scans | 1509.67 | 1138.69 | 6754.30 | 183.2 | 1976.73 | 1980.41 | 2918.40 | 141.0 | +30.9% | -23.1% | city = 'london' AND age > 50 |
| [R]emoveIndex::index_composite | Index Build/Remove | 421.76 | 421.89 | 421.89 | 2.4 | 148.54 | 148.61 | 148.61 | 6.7 | -64.8% | +184.0% | city = 'london' AND age > 50 |
| [S]can::index_range_merged (2000) | Scans | 7044.30 | 7139.33 | 11755.52 | 39.8 | 5572.12 | 2281.47 | 28049.41 | 49.1 | -20.9% | +23.4% | number > 100 AND number < 200 |
| [I]ndex::index_range_merged | Index Build/Remove | 1513.98 | 1514.49 | 1514.49 | 0.7 | 1012.48 | 1012.74 | 1012.74 | 1.0 | -33.1% | +50.0% | number > 100 AND number < 200 |
| [S]can::index_range_merged::indexed (2000) | Indexed Scans | 453.72 | 293.38 | 3262.46 | 608.9 | 608.72 | 602.62 | 1054.72 | 457.5 | +34.2% | -24.9% | number > 100 AND number < 200 |
| [R]emoveIndex::index_range_merged | Index Build/Remove | 445.06 | 445.18 | 445.18 | 2.2 | 146.75 | 146.81 | 146.81 | 6.8 | -67.0% | +202.7% | number > 100 AND number < 200 |
| [S]can::index_in (2000) | Scans | 6744.01 | 6819.84 | 9224.19 | 41.8 | 5253.10 | 4562.94 | 13754.37 | 52.5 | -22.1% | +25.5% | number IN [42, 100, 200, 300, 400] |
| [I]ndex::index_in | Index Build/Remove | 1512.96 | 1513.47 | 1513.47 | 0.7 | 1011.97 | 1012.22 | 1012.22 | 1.0 | -33.1% | +50.0% | number IN [42, 100, 200, 300, 400] |
| [S]can::index_in::indexed (2000) | Indexed Scans | 30.92 | 26.13 | 146.30 | 8937.5 | 12.73 | 11.19 | 34.27 | 21115.7 | -58.8% | +136.3% | number IN [42, 100, 200, 300, 400] |
| [R]emoveIndex::index_in | Index Build/Remove | 456.32 | 456.45 | 456.45 | 2.2 | 131.52 | 131.58 | 131.58 | 7.6 | -71.2% | +247.0% | number IN [42, 100, 200, 300, 400] |
| [I]ndex::index_fulltext | Index Build/Remove | 55689.22 | 55705.60 | 55705.60 | 0.0 | 81756.16 | 81788.93 | 81788.93 | 0.0 | +46.8% | -50.0% | words @@ 'hello' |
| [S]can::index_fulltext::indexed (2000) | Indexed Scans | 204.39 | 192.25 | 460.54 | 1343.2 | 296.32 | 289.79 | 470.27 | 942.0 | +45.0% | -29.9% | words @@ 'hello' |
| [R]emoveIndex::index_fulltext | Index Build/Remove | 969.98 | 970.24 | 970.24 | 1.0 | 2239.49 | 2240.51 | 2240.51 | 0.5 | +130.9% | -56.3% | words @@ 'hello' |
| [I]ndex::index_hnsw | Index Build/Remove | 19587.07 | 19595.26 | 19595.26 | 0.1 | 13545.47 | 13549.57 | 13549.57 | 0.1 | -30.8% | +40.0% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
| [S]can::index_hnsw::indexed (2000) | Indexed Scans | 35710.91 | 35880.96 | 42565.63 | 7.9 | 4622.45 | 2022.40 | 20660.22 | 59.4 | -87.1% | +654.4% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
| [R]emoveIndex::index_hnsw | Index Build/Remove | 2509.82 | 2510.85 | 2510.85 | 0.4 | 820.48 | 820.74 | 820.74 | 1.2 | -67.3% | +205.0% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
RocksDB
| Test | Category | SurrealDB v2 | SurrealDB v3 | Mean % v3 vs. v2 | OPS % v3. vs v2 | Query | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mean (ms) | P50 (ms) | P99 (ms) | Operations Per Second (OPS) | Mean (ms) | P50 (ms) | P99 (ms) | Operations Per Second (OPS) | |||||
| [C]reate | CRUD | 9.99 | 7.40 | 27.26 | 28778.2 | 8.52 | 8.12 | 15.05 | 33768.3 | -14.7% | +17.3% | |
| [R]ead | CRUD | 0.37 | 0.35 | 0.96 | 757343.3 | 0.59 | 0.56 | 1.32 | 484147.0 | +59.5% | -36.1% | |
| [U]pdate | CRUD | 8.34 | 7.37 | 24.21 | 34370.8 | 8.50 | 8.07 | 15.28 | 33828.1 | +1.9% | -1.6% | |
| [S]can::count_all (2001) | Scans | 153.00 | 152.57 | 206.72 | 1821.8 | 132.74 | 79.17 | 836.10 | 1771.7 | -13.2% | -2.7% | |
| [S]can::limit_id (2001) | Scans | 5.32 | 3.50 | 19.38 | 48199.9 | 1.94 | 1.87 | 4.31 | 123328.7 | -63.5% | +155.9% | |
| [S]can::limit_all (2001) | Scans | 16.29 | 5.74 | 93.25 | 16194.5 | 2.45 | 2.37 | 5.17 | 95975.1 | -85.0% | +492.6% | |
| [S]can::limit_start_id (2001) | Scans | 12.08 | 11.45 | 19.86 | 22395.3 | 6.07 | 5.89 | 13.27 | 42606.3 | -49.8% | +90.2% | |
| [S]can::limit_start_all (2001) | Scans | 20.45 | 19.52 | 36.67 | 13197.6 | 6.28 | 6.35 | 11.65 | 40970.0 | -69.3% | +210.4% | |
| [S]can::select_where_id (2001) | Scans | 0.63 | 0.60 | 1.45 | 334303.5 | 0.75 | 0.72 | 1.62 | 291755.1 | +19.0% | -12.7% | SELECT * FROM record:42 |
| [S]can::select_where_id_eq (2001) | Scans | 3313.50 | 3328.00 | 3667.97 | 85.7 | 0.72 | 0.68 | 1.43 | 302257.9 | -100.0% | +352510.7% | SELECT * FROM record WHERE id = record:42 |
| [S]can::select_where_gt (2001) | Scans | 4576.38 | 4595.71 | 5132.29 | 62.0 | 5955.45 | 1940.48 | 34865.15 | 45.2 | +30.1% | -27.0% | SELECT * FROM record WHERE number > 4625 |
| [S]can::select_where_in (2001) | Scans | 9134.11 | 9035.77 | 14049.28 | 30.7 | 5944.41 | 1398.78 | 26902.53 | 46.0 | -34.9% | +50.0% | SELECT * FROM record WHERE age IN [5, 15, 25, 35, 45, 55, 65] |
| [S]can::select_where_multi_and (2001) | Scans | 5394.01 | 5439.49 | 6299.65 | 52.4 | 6047.01 | 2850.82 | 29048.83 | 45.5 | +12.1% | -13.1% | SELECT * FROM record WHERE city = 'london' AND age > 50 |
| [S]can::select_where_order_limit (2001) | Scans | 4543.69 | 4571.14 | 5328.90 | 62.4 | 5556.69 | 2512.89 | 39550.97 | 50.3 | +22.3% | -19.4% | SELECT * FROM record WHERE number > 4625 ORDER BY age LIMIT 50 |
| [S]can::select_where_order_desc_limit (2001) | Scans | 4505.67 | 4526.08 | 5054.46 | 63.0 | 5695.88 | 1316.86 | 40271.87 | 49.1 | +26.4% | -22.0% | SELECT * FROM record WHERE score < 7.5 ORDER BY number DESC LIMIT 50 |
| [S]can::select_where_multi_order_limit (2001) | Scans | 5628.40 | 5632.00 | 6496.26 | 50.4 | 5495.20 | 2529.28 | 39354.37 | 50.4 | -2.4% | +0.0% | SELECT * FROM record WHERE age > 85 AND active = true ORDER BY city, score DESC LIMIT 50 |
| [S]can::select_omit_limit (2001) | Scans | 16.68 | 8.02 | 66.94 | 16042.6 | 3.85 | 3.55 | 8.41 | 66553.8 | -76.9% | +314.9% | SELECT * OMIT words, embedding, tags FROM record LIMIT 100 |
| [S]can::select_fields_where_limit (2001) | Scans | 14.19 | 8.23 | 104.00 | 18728.2 | 104.58 | 105.79 | 229.25 | 2460.3 | +637.0% | -86.9% | SELECT name, city, age, number FROM record WHERE score > 50.0 LIMIT 100 |
| [S]can::select_order_by (2001) | Scans | 15667.41 | 15466.50 | 24051.71 | 17.9 | 4932.92 | 1131.52 | 35454.97 | 56.2 | -68.5% | +214.1% | SELECT * FROM record ORDER BY number LIMIT 100 |
| [S]can::select_order_by_multi (2001) | Scans | 15902.27 | 15859.71 | 23724.03 | 17.6 | 5037.95 | 1140.73 | 35782.65 | 55.7 | -68.3% | +215.8% | SELECT * FROM record ORDER BY city, number DESC LIMIT 100 |
| [S]can::select_group_count (2001) | Scans | 4235.10 | 4255.74 | 4685.82 | 67.0 | 5091.89 | 2222.08 | 28442.62 | 53.6 | +20.2% | -20.1% | SELECT city, count() as total FROM record GROUP BY city |
| [S]can::select_group_sum (2001) | Scans | 4881.45 | 4902.91 | 5513.22 | 58.1 | 5309.39 | 2457.60 | 24150.01 | 51.4 | +8.8% | -11.6% | SELECT city, math::sum(number) as total FROM record GROUP BY city |
| [S]can::select_group_avg (2001) | Scans | 4900.75 | 4927.49 | 5853.18 | 57.8 | 5371.33 | 2373.63 | 23150.59 | 51.3 | +9.6% | -11.3% | SELECT city, math::mean(age) as avg_age FROM record GROUP BY city |
| [S]can::select_group_multi_agg (2001) | Scans | 7782.85 | 7692.29 | 11689.98 | 36.0 | 6111.42 | 2177.02 | 43122.69 | 45.4 | -21.5% | +25.9% | SELECT city, math::sum(number) as s1, math::sum(number) as s2, math::mean(age) as avg_age FROM record GROUP BY city |
| [S]can::select_group_all (2001) | Scans | 5624.71 | 5648.38 | 6807.55 | 50.3 | 5421.68 | 1243.13 | 38567.93 | 51.5 | -3.6% | +2.5% | SELECT count() as c, math::sum(number) as total, math::mean(age) as avg_age FROM record GROUP ALL |
| [S]can::select_group_order_limit (2001) | Scans | 5721.24 | 5746.69 | 6877.18 | 49.5 | 5529.63 | 1285.12 | 39813.12 | 50.2 | -3.3% | +1.5% | SELECT city, count() as total, math::mean(score) as avg_score FROM record GROUP BY city ORDER BY total DESC LIMIT 5 |
| [S]can::select_group_where (2001) | Scans | 5949.82 | 5980.16 | 7020.54 | 47.5 | 6311.33 | 1435.65 | 44924.93 | 44.0 | +6.1% | -7.3% | SELECT city, count() as total, math::sum(number) as sum FROM record WHERE age > 50 GROUP BY city |
| [S]can::select_group_dedup_agg (2001) | Scans | 7813.47 | 7782.40 | 12566.53 | 35.8 | 6125.32 | 1422.34 | 43352.06 | 45.6 | -21.6% | +27.4% | SELECT city, math::sum(number) as total, math::sum(number) as dup1, math::sum(number) as dup2 FROM record GROUP BY city |
| [S]can::select_split (2001) | Scans | 17.45 | 8.52 | 76.67 | 15307.9 | 8.70 | 7.90 | 26.96 | 27658.5 | -50.1% | +80.7% | SELECT * FROM record SPLIT tags LIMIT 100 |
| [S]can::select_fetch (2001) | Scans | 35.19 | 18.22 | 154.24 | 7564.1 | 8.06 | 7.65 | 17.25 | 32357.4 | -77.1% | +327.8% | SELECT * FROM record LIMIT 100 FETCH friend |
| [S]can::select_fetch_where_limit (2001) | Scans | 30.11 | 17.47 | 157.82 | 8892.6 | 113.41 | 112.96 | 241.53 | 2388.4 | +276.7% | -73.1% | SELECT * FROM record WHERE city = 'london' LIMIT 50 FETCH friend |
| [S]can::graph_out_depth1 (2001) | Scans | 4.78 | 3.47 | 23.97 | 54273.4 | 1.00 | 0.90 | 2.71 | 235728.9 | -79.1% | +334.3% | SELECT ->knows->record FROM record:1 |
| [S]can::graph_out_depth2 (2001) | Scans | 14.39 | 13.40 | 41.38 | 19118.8 | 1.73 | 1.64 | 3.96 | 136232.2 | -88.0% | +612.6% | SELECT ->knows->record->knows->record FROM record:1 |
| [S]can::graph_out_depth3 (2001) | Scans | 41.42 | 40.64 | 70.85 | 6724.3 | 2.78 | 2.66 | 6.22 | 89577.1 | -93.3% | +1232.1% | SELECT ->knows->record->knows->record->knows->record FROM record:1 |
| [S]can::graph_in_depth1 (2001) | Scans | 4.90 | 3.26 | 31.68 | 54000.1 | 1.12 | 1.06 | 2.17 | 191369.2 | -77.1% | +254.4% | SELECT <-knows<-record FROM record:1 |
| [S]can::graph_bidirectional (2001) | Scans | 10.62 | 8.96 | 37.05 | 25771.5 | 1.14 | 1.12 | 2.48 | 194426.5 | -89.3% | +654.4% | SELECT knowsrecord FROM record:1 |
| [S]can::graph_edge_filter (2001) | Scans | 2.37 | 1.62 | 10.97 | 102130.8 | 1.02 | 1.02 | 2.23 | 227036.8 | -57.0% | +122.3% | SELECT ->knows[WHERE weight > 50]->record FROM record:1 |
| [S]can::graph_multi_out (2001) | Scans | 426.98 | 427.26 | 556.54 | 659.4 | 23.02 | 22.24 | 57.70 | 11551.7 | -94.6% | +1651.9% | SELECT id, ->knows->record.name FROM record LIMIT 100 |
| [S]can::graph_multi_out_where (2001) | Scans | 170.00 | 169.98 | 229.63 | 1648.7 | 13.99 | 12.90 | 43.04 | 19133.9 | -91.8% | +1060.6% | SELECT id, ->knows->(? WHERE number > 2500) FROM record LIMIT 50 |
| [S]can::graph_multi_count (2001) | Scans | 90.26 | 90.11 | 127.30 | 3098.7 | 8.96 | 8.57 | 19.90 | 28929.8 | -90.1% | +833.6% | SELECT id, count(->knows) as edge_count FROM record LIMIT 100 |
| [S]can::graph_depth2_limit (2001) | Scans | 238.54 | 238.21 | 314.88 | 1176.5 | 9.82 | 8.58 | 27.34 | 27000.0 | -95.9% | +2195.0% | SELECT id, ->knows->record->knows->record FROM record LIMIT 20 |
| [S]can::graph_sub_where (2001) | Scans | 5.40 | 4.33 | 20.86 | 49395.5 | 2.17 | 1.97 | 5.13 | 111209.4 | -59.8% | +125.1% | SELECT name, ->knows->(SELECT * FROM record WHERE number > 2500) FROM record:1 |
| [S]can::graph_sub_group_all (2001) | Scans | 5.72 | 4.29 | 18.56 | 46438.1 | 2.12 | 2.00 | 6.71 | 113671.0 | -62.9% | +144.8% | SELECT ->knows->(SELECT COUNT() as c, math::mean(number) as avg_num FROM record GROUP ALL) FROM record:1 |
| [S]can::graph_sub_group_by (2001) | Scans | 5.65 | 4.14 | 25.34 | 47104.9 | 1.98 | 1.86 | 4.98 | 121859.2 | -65.0% | +158.7% | SELECT ->knows->(SELECT COUNT() as c, math::mean(number) as avg_num, city FROM record GROUP BY city) FROM record:1 |
| [S]can::subquery_inline (2001) | Scans | 585.17 | 592.38 | 1038.85 | 476.7 | 352.05 | 215.17 | 1627.13 | 774.7 | -39.8% | +62.5% | SELECT *, (SELECT * FROM small_table) as sub FROM record LIMIT 100 |
| [S]can::subquery_count (2001) | Scans | 71.02 | 71.36 | 85.82 | 3947.0 | 63.50 | 66.94 | 75.84 | 4299.9 | -10.6% | +8.9% | SELECT *, (SELECT count() FROM small_table GROUP ALL) as sub_count FROM record LIMIT 100 |
| [S]can::subquery_from (2001) | Scans | 2708.90 | 2523.14 | 6467.58 | 102.4 | 1731.46 | 1722.37 | 4065.28 | 157.7 | -36.1% | +53.9% | SELECT city, math::mean(number) as avg FROM (SELECT * FROM record WHERE age > 50 LIMIT 10000) GROUP BY city |
| [S]can::pipeline_filter_group_order (2001) | Scans | 7471.20 | 7467.01 | 9805.82 | 37.6 | 6498.49 | 4476.93 | 37322.75 | 42.9 | -13.0% | +13.8% | SELECT city, count() as c, math::mean(age) as avg_age FROM record WHERE number > 1000 GROUP BY city ORDER BY c DESC LIMIT 5 |
| [S]can::index_standard (2001) | Scans | 3307.64 | 3323.90 | 3678.21 | 85.9 | 5077.27 | 4583.42 | 13803.52 | 53.8 | +53.5% | -37.3% | number = 42 |
| [I]ndex::index_standard | Index Build/Remove | 1010.43 | 1010.69 | 1010.69 | 1.0 | 1011.97 | 1012.22 | 1012.22 | 1.0 | +0.2% | +0.0% | number = 42 |
| [S]can::index_standard::indexed (2001) | Indexed Scans | 6.95 | 3.85 | 45.41 | 38213.8 | 2.22 | 1.32 | 9.04 | 107603.5 | -68.1% | +181.6% | number = 42 |
| [R]emoveIndex::index_standard | Index Build/Remove | 275.84 | 275.97 | 275.97 | 3.6 | 217.79 | 217.85 | 217.85 | 4.6 | -21.0% | +26.8% | number = 42 |
| [S]can::index_composite (2001) | Scans | 5403.80 | 5427.20 | 6381.57 | 52.4 | 5945.42 | 1396.73 | 25198.59 | 45.9 | +10.0% | -12.3% | city = 'london' AND age > 50 |
| [I]ndex::index_composite | Index Build/Remove | 1006.34 | 1006.59 | 1006.59 | 1.0 | 1018.11 | 1018.37 | 1018.37 | 1.0 | +1.2% | -1.0% | city = 'london' AND age > 50 |
| [S]can::index_composite::indexed (2001) | Indexed Scans | 1494.50 | 1143.81 | 5808.13 | 184.7 | 762.39 | 325.63 | 3713.02 | 362.3 | -49.0% | +96.1% | city = 'london' AND age > 50 |
| [R]emoveIndex::index_composite | Index Build/Remove | 769.28 | 769.53 | 769.53 | 1.3 | 223.81 | 223.87 | 223.87 | 4.5 | -70.9% | +243.8% | city = 'london' AND age > 50 |
| [S]can::index_range_merged (2001) | Scans | 6974.03 | 6995.97 | 9388.03 | 40.3 | 5446.44 | 1481.73 | 28508.16 | 50.5 | -21.9% | +25.3% | number > 100 AND number < 200 |
| [I]ndex::index_range_merged | Index Build/Remove | 1012.48 | 1012.74 | 1012.74 | 1.0 | 1014.53 | 1014.78 | 1014.78 | 1.0 | +0.2% | +0.0% | number > 100 AND number < 200 |
| [S]can::index_range_merged::indexed (2001) | Indexed Scans | 456.57 | 231.42 | 2619.39 | 595.9 | 237.86 | 86.46 | 1260.54 | 1148.8 | -47.9% | +92.8% | number > 100 AND number < 200 |
| [R]emoveIndex::index_range_merged | Index Build/Remove | 271.74 | 271.87 | 271.87 | 3.7 | 216.13 | 216.19 | 216.19 | 4.6 | -20.5% | +25.5% | number > 100 AND number < 200 |
| [S]can::index_in (2001) | Scans | 6644.39 | 6696.96 | 10321.92 | 42.3 | 5037.32 | 1242.11 | 32260.10 | 53.8 | -24.2% | +27.4% | number IN [42, 100, 200, 300, 400] |
| [I]ndex::index_in | Index Build/Remove | 1010.43 | 1010.69 | 1010.69 | 1.0 | 1011.97 | 1012.22 | 1012.22 | 1.0 | +0.2% | +0.0% | number IN [42, 100, 200, 300, 400] |
| [S]can::index_in::indexed (2001) | Indexed Scans | 30.15 | 24.11 | 144.38 | 9168.9 | 9.00 | 8.72 | 21.41 | 29209.8 | -70.1% | +218.6% | number IN [42, 100, 200, 300, 400] |
| [R]emoveIndex::index_in | Index Build/Remove | 279.94 | 280.06 | 280.06 | 3.6 | 228.03 | 228.09 | 228.09 | 4.4 | -18.5% | +22.7% | number IN [42, 100, 200, 300, 400] |
| [I]ndex::index_fulltext | Index Build/Remove | 73302.02 | 73334.78 | 73334.78 | 0.0 | 94273.54 | 94306.30 | 94306.30 | 0.0 | +28.6% | +0.0% | words @@ 'hello' |
| [S]can::index_fulltext::indexed (2001) | Indexed Scans | 217.18 | 202.37 | 485.63 | 1267.2 | 199.83 | 192.90 | 408.06 | 1388.3 | -8.0% | +9.6% | words @@ 'hello' |
| [R]emoveIndex::index_fulltext | Index Build/Remove | 435.07 | 435.20 | 435.20 | 2.3 | 3038.21 | 3039.23 | 3039.23 | 0.3 | +598.3% | -85.7% | words @@ 'hello' |
| [I]ndex::index_hnsw | Index Build/Remove | 15544.32 | 15548.42 | 15548.42 | 0.1 | 14544.90 | 14548.99 | 14548.99 | 0.1 | -6.4% | +16.7% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
| [S]can::index_hnsw::indexed (2001) | Indexed Scans | 35562.02 | 35782.65 | 42139.65 | 7.9 | 4524.91 | 3153.92 | 15179.77 | 60.0 | -87.3% | +659.9% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
| [R]emoveIndex::index_hnsw | Index Build/Remove | 1546.75 | 1547.26 | 1547.26 | 0.7 | 1295.87 | 1296.38 | 1296.38 | 0.8 | -16.2% | +18.5% | SELECT * FROM record WHERE embedding [0.5, 0.3, 0.7, 0.1] |
More performance improvements coming
We have a roadmap of performance-related improvements that we'll be rolling out across the coming minor releases. Here's what to expect:
Expanding the new executor to cover write workloads and all remaining statement types
End-to-end streaming, pushing the streaming model from internal execution all the way to the client
Indexing improvements, including better index planning, reduced scan overhead, expanded index types, and optimised composite index strategies
Continued optimisation of the planning and execution pipeline itself
For now, you can start reaping the benefits of the new executor on read-heavy workloads, and expect it to get better with every release.
What’s next?
These benchmarks are just the beginning. This release focuses on measuring the performance gains in SurrealDB 3.0 compared directly to SurrealDB v2.x, highlighting the impact of the new foundations.
Next, we’ll expand this work with a broader benchmarking iteration that compares SurrealDB against other databases and platforms across a wider range of workloads. Stay tuned - there’s much more to come.
If you have any questions, feedback, or want to dive deeper into the results, feel free to reach out to us or join our Discord community to chat directly with the community and team.
q(50)/d68ukllhk7ec73f2kc9g.auto)