Skip to content

Performance

Jump to bottom
Valentina edited this page Feb 22, 2023 · 59 revisions

Performance

Framework Version Archive Mode HTML XLSX Comments
Intel® Distribution
of OpenVINO™ Toolkit		 2022.1 ZIP
TAR.GZ 		Docker LINK XLSX Metrics:
  • FPS
Parameters:
  • Default number of threads in the latency mode
  • Optimal number of streams in the throughput mode, number of streams equals number of requests
Intel® Distribution
of OpenVINO™ Toolkit		 2021.4 ZIP
TAR.GZ 		Docker LINK XLSX Metrics:
  • FPS
Parameters:
  • Default number of threads in the latency mode
  • Optimal number of streams in the throughput mode, number of streams equals number of requests
Intel® Distribution
of OpenVINO™ Toolkit		 2020.2 ZIP
TAR.GZ 		Docker Public Models
Intel Models 		— Metrics:
  • FPS
Parameters:
  • Default number of threads in the latency mode
  • Optimal number of streams in the throughput mode, number of streams equals number of requests
Intel® Distribution
of OpenVINO™ Toolkit		 R3 ZIP
TAR.GZ 		Docker LINK — Metrics:
  • FPS
Parameters:
  • Default number of threads in the sync mode
  • Optimal number of streams in the async mode, number of streams equals number of requests
Intel® Distribution
of OpenVINO™ Toolkit		 R5.01 ZIP
TAR.GZ 		Host LINK — Metrics:
  • Latency (for the sync mode) and average time of the single pass (for the async mode)
  • FPS
Parameters:
  • Number of threads in the sync mode is written in the table header ("Thread count")
  • Number of requests and streams in the async mode is written in the table header ("Async request count" and "Stream count")

Note: DLI supports two execution modes. The first one is an execution on Docker container, and the second one is a direct execution on the host.

Clone this wiki locally