- Welcome to the OpenSearch performance benchmarking page. This page displays the results of ongoing performance testing for recent and upcoming versions of the OpenSearch software. You can view key performance metrics across different workloads with the dashboard visualizations below. + Welcome to the OpenSearch performance benchmarking page. You can see the results of ongoing performance testing for recent and upcoming versions of the OpenSearch software. You can view key performance metrics across different workloads with the dashboard visualizations by clicking on the dashboards link in the left column.
+The OpenSearch Project benchmarks the performance of OpenSearch releases to measure performance stability and gather data to inform software development. As an open-source project, we make this information publicly available in order to share it with the OpenSearch community.
+Questions or contributions? Connect with the OpenSearch community in the #performance channel on our public Slack. @@ -64,66 +49,3 @@ benchmark_height_mobile: 6000
To learn more about OpenSearch performance improvements through version 2.14, read this blog post.
- - - - diff --git a/benchmarks/nyc_taxis.md b/benchmarks/nyc_taxis.md new file mode 100644 index 0000000000..a9d5c42a54 --- /dev/null +++ b/benchmarks/nyc_taxis.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + + diff --git a/benchmarks/pmc.md b/benchmarks/pmc.md new file mode 100644 index 0000000000..fb1cd1d5f2 --- /dev/null +++ b/benchmarks/pmc.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + + diff --git a/benchmarks/vectorsearch-faiss-cohere-10m.md b/benchmarks/vectorsearch-faiss-cohere-10m.md new file mode 100644 index 0000000000..56f63597d6 --- /dev/null +++ b/benchmarks/vectorsearch-faiss-cohere-10m.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + + diff --git a/benchmarks/vectorsearch-faiss-cohere-1m.md b/benchmarks/vectorsearch-faiss-cohere-1m.md new file mode 100644 index 0000000000..a539a9b857 --- /dev/null +++ b/benchmarks/vectorsearch-faiss-cohere-1m.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + + diff --git a/benchmarks/vectorsearch-lucene-cohere-10m.md b/benchmarks/vectorsearch-lucene-cohere-10m.md new file mode 100644 index 0000000000..acb802d5ce --- /dev/null +++ b/benchmarks/vectorsearch-lucene-cohere-10m.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + + diff --git a/benchmarks/vectorsearch-lucene-cohere-1m.md b/benchmarks/vectorsearch-lucene-cohere-1m.md new file mode 100644 index 0000000000..1dc37353d5 --- /dev/null +++ b/benchmarks/vectorsearch-lucene-cohere-1m.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + + diff --git a/benchmarks/vectorsearch-nmslib-cohere-10m.md b/benchmarks/vectorsearch-nmslib-cohere-10m.md new file mode 100644 index 0000000000..d4d6e3b147 --- /dev/null +++ b/benchmarks/vectorsearch-nmslib-cohere-10m.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + + diff --git a/benchmarks/vectorsearch-nmslib-cohere-1m.md b/benchmarks/vectorsearch-nmslib-cohere-1m.md new file mode 100644 index 0000000000..7a4f4ef823 --- /dev/null +++ b/benchmarks/vectorsearch-nmslib-cohere-1m.md @@ -0,0 +1,34 @@ +--- +layout: dashboard_layout +title: OpenSearch Performance Benchmarks +dashboards: + - name: HTTP_LOGS + url: /benchmarks/http_logs + - name: NYC_TAXIS + url: /benchmarks/nyc_taxis + - name: PMC + url: /benchmarks/pmc + - name: Big5 + url: /benchmarks/Big5 + - name: Vectorsearch-nmslib-Cohere-1m + url: /benchmarks/vectorsearch-nmslib-cohere-1m + - name: Vectorsearch-nmslib-Cohere-10m + url: /benchmarks/vectorsearch-nmslib-cohere-10m + - name: Vectorsearch-faiss-Cohere-1m + url: /benchmarks/vectorsearch-faiss-cohere-1m + - name: Vectorsearch-faiss-Cohere-10m + url: /benchmarks/vectorsearch-faiss-cohere-10m + - name: Vectorsearch-lucene-Cohere-1m + url: /benchmarks/vectorsearch-lucene-cohere-1m + - name: Vectorsearch-lucene-Cohere-10m + url: /benchmarks/vectorsearch-lucene-cohere-10m + - name: Concurrent Segment Search Big5 + url: /benchmarks/concurrent_segment_search_big5 + - name: Concurrent Segment Search NYC_TAXIS + url: /benchmarks/concurrent_segment_search_nyc + - name: Concurrent Segment Search NOAA + url: /benchmarks/concurrent_segment_search_noaa +benchmark_domain: 'benchmarks.opensearch.org' +--- + +