Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ONAKA NO HAJIMARI #16

Closed
cureseven opened this issue Dec 10, 2023 · 14 comments
Closed

ONAKA NO HAJIMARI #16

cureseven opened this issue Dec 10, 2023 · 14 comments
Assignees

Comments

@cureseven
Copy link
Member

#1 の感想戦

@pinkumohikan
Copy link
Member

pinkumohikan commented Dec 10, 2023

ベンチコマンド

$ ssh isucon-bench "cd ~/isucon13/bench && ./bin/bench_linux_amd64 run --enable-ssl --target https://pipe.u.isucon.dev --nameserver 35.78.167.13 > bench.log 2>&1 && tail -n 10 bench.log"

@pinkumohikan
Copy link
Member

@mism-mism

$ make bench
ssh isucon-bench "cd ~/isucon13/bench && ./bin/bench_linux_amd64 run --enable-ssl --target https://pipe.u.isucon.dev --nameserver 35.78.167.13 > bench.log 2>&1 && tail -n 10 bench.log"
2023-12-10T06:39:00.651Z	info	staff-logger	bench/bench.go:172	SSL接続が有効になっています
2023-12-10T06:39:00.651Z	info	isupipe-benchmarker	SSL接続が有効になっています
2023-12-10T06:39:00.651Z	info	staff-logger	bench/bench.go:193	webapp: https://pipe.u.isucon.dev:443
2023-12-10T06:39:00.651Z	info	staff-logger	bench/bench.go:194	nameserver: 35.78.167.13:53
2023-12-10T06:39:00.651Z	info	isupipe-benchmarker	静的ファイルチェックを行います
2023-12-10T06:39:00.651Z	info	isupipe-benchmarker	静的ファイルチェックが完了しました
2023-12-10T06:39:00.651Z	info	isupipe-benchmarker	webappの初期化を行います
2023-12-10T06:39:02.347Z	info	isupipe-benchmarker	ベンチマーク走行前のデータ整合性チェックを行います
{"pass":false,"score":0,"messages":["整合性チェックに失敗しました","アイコン未設定の場合は、NoImage.jpgを返さなければなりません"],"language":"golang","resolved_count":0}

@mism-mism
Copy link
Collaborator

#17

ssh isucon-bench "cd ~/isucon13/bench && ./bin/bench_linux_amd64 run --enable-ssl --target https://pipe.u.isucon.dev --nameserver 35.78.167.13 > bench.log 2>&1 && tail -n 10 bench.log"
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:323      [シナリオ viewer] 181 回成功
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ aggressive-streamer-moderate-fail] 1 回失敗
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ streamer-cold-reserve-fail] 6 回失敗
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ streamer-moderate-fail] 1 回失敗
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-report-fail] 2 回失敗
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-spam-fail] 2 回失敗
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:329      DNSAttacker並列数: 15
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:330      名前解決成功数: 180982
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:331      名前解決失敗数: 6
2023-12-10T07:04:07.595Z        info    staff-logger    bench/bench.go:335      スコア: 35381

@cureseven
Copy link
Member Author

cureseven commented Dec 10, 2023

計測できるようになった
スコア: 31116

Top 20 Sort By Total
Count    Total     Mean   Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max    2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
 1859  189.976   0.1022   0.0928   0.000   0.079   0.238   0.301   0.393   0.451   1856    0    3    0    36362827          0      19560      78352  GET /api/livestream/<num>/livecomment
  417  163.116   0.3912   0.0715   0.031   0.391   0.483   0.505   0.549   0.568    414    0    3    0    25996941          0      62342      63962  GET /api/livestream/search?limit=<num> HTTP/1.1
 1894  148.732   0.0785   0.0722   0.000   0.059   0.185   0.229   0.296   0.367   1890    0    4    0    30888524          0      16308      73689  GET /api/livestream/<num>/reaction
    9  131.113  14.5681   6.6361   3.767  20.000  20.002  20.002  20.002  20.002      2    0    7    0         202          0         22        102  GET /api/livestream/<num>/statistics
 3056   55.011   0.0180   0.0037   0.001   0.017   0.023   0.025   0.031   0.063   3052    0    3    1     1435280          0        469        522  POST /api/register HTTP/1.1
  480   53.531   0.1115   0.0379   0.000   0.116   0.151   0.163   0.188   0.194    476    0    4    0      558700          0       1163       1463  POST /api/livestream/reservation HTTP/1.1
16959   41.771   0.0025   0.0020   0.000   0.002   0.005   0.006   0.008   0.085  16959    0    0    0  1053961091          0      62147     171855  GET /api/user/*/icon
 2418   27.442   0.0113   0.0053   0.001   0.010   0.018   0.022   0.031   0.049   2416    0    2    0     4671715         57       1932       2742  POST /api/livestream/<num>/livecomment
 3091   18.758   0.0061   0.0025   0.002   0.006   0.009   0.010   0.015   0.048   3070    0    0   21       54329         14         17        154  POST /api/icon HTTP/1.1
 1711   17.314   0.0101   0.0048   0.001   0.009   0.016   0.019   0.026   0.047   1710    0    1    0     3172042          0       1853       2206  POST /api/livestream/<num>/reaction
   29   16.957   0.5847   0.3369   0.083   0.729   0.909   0.970   1.036   1.036     29    0    0    0     3425241      97565     118111     148172  GET /api/livestream/search?tag=<tag>
 3060   11.453   0.0037   0.0034   0.001   0.003   0.006   0.007   0.010   0.122   3058    0    2    0         128          0          0         64  POST /api/login HTTP/1.1
 1012    4.780   0.0047   0.0045   0.000   0.003   0.010   0.013   0.022   0.039   1012    0    0    0      591147          3        584      22512  GET /api/livestream HTTP/1.1
   22    3.291   0.1496   0.0816   0.020   0.119   0.247   0.309   0.318   0.318     22    0    0    0        3038        133        138        154  GET /api/user/*/statistics
  528    1.996   0.0038   0.0057   0.001   0.003   0.007   0.009   0.026   0.097    526    0    0    2      120063          3        227      19229  GET /api/livestream/<num>/report
    1    1.781   1.7810   0.0000   1.781   1.781   1.781   1.781   1.781   1.781      1    0    0    0          27         27         27         27  POST /api/initialize HTTP/1.1
  474    1.475   0.0031   0.0021   0.000   0.003   0.005   0.007   0.010   0.020    474    0    0    0     2888154       6089       6093       6095  GET /api/tag HTTP/1.1
  393    1.099   0.0028   0.0017   0.000   0.002   0.005   0.006   0.008   0.011    393    0    0    0       22420          5         57        521  GET /api/livestream/<num>/ngwords
  261    0.938   0.0036   0.0023   0.001   0.003   0.007   0.008   0.011   0.016    261    0    0    0        6003         23         23         23  POST /api/livestream/<num>/moderate
  163    0.455   0.0028   0.0019   0.000   0.002   0.005   0.006   0.011   0.013    163    0    0    0           0          0          0          0  POST /api/livestream/<num>/enter

@cureseven
Copy link
Member Author

top-slow.log

@cureseven
Copy link
Member Author

@pinkumohikan
Copy link
Member

@pinkumohikan

GET /api/livestream/search?limit=

見る

@cureseven
Copy link
Member Author

cureseven commented Dec 10, 2023

@cureseven

9  131.113  14.5681   6.6361   3.767  20.000  20.002  20.002  20.002  20.002      2    0    7    0         202          0         22        102  GET /api/livestream/<num>/statistics

みる

@mism-mism
Copy link
Collaborator

タグをキャッシュした
#18

Top 20 Sort By Total
Count    Total     Mean   Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max    2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
   13  159.397  12.2613   8.3930   1.506  19.903  20.003  20.003  20.003  20.003      2    0   11    0         202          0         15        102  GET /api/livestream/<num>/statistics
 2213  149.898   0.0677   0.0583   0.000   0.053   0.147   0.191   0.258   0.371   2211    0    2    0    43383255          0      19603     100569  GET /api/livestream/<num>/livecomment
  788  139.923   0.1776   0.0338   0.025   0.172   0.224   0.243   0.270   0.337    785    0    3    0    49537068          0      62864      64072  GET /api/livestream/search?limit=<num> HTTP/1.1
 2247  107.956   0.0480   0.0402   0.000   0.038   0.103   0.127   0.177   0.254   2247    0    0    0    36476274          3      16233      93254  GET /api/livestream/<num>/reaction
20314   80.711   0.0040   0.0028   0.000   0.003   0.007   0.009   0.014   0.081  20314    0    0    0  1285390991       6969      63276     171855  GET /api/user/*/icon
  573   53.119   0.0927   0.0331   0.000   0.092   0.134   0.144   0.168   0.203    569    0    4    0      667977          0       1165       1469  POST /api/livestream/reservation HTTP/1.1
 2737   48.764   0.0178   0.0035   0.001   0.017   0.022   0.024   0.029   0.058   2734    0    2    1     1285560          0        469        522  POST /api/register HTTP/1.1
 3007   39.011   0.0130   0.0061   0.001   0.012   0.020   0.023   0.030   0.094   3005    0    2    0     5785729          0       1924       2646  POST /api/livestream/<num>/livecomment
 2781   23.379   0.0084   0.0036   0.002   0.008   0.013   0.015   0.021   0.030   2735    0    0   46       52495         14         18        154  POST /api/icon HTTP/1.1
 2028   21.384   0.0105   0.0051   0.001   0.010   0.017   0.019   0.027   0.086   2028    0    0    0     3758054       1552       1853       2212  POST /api/livestream/<num>/reaction
 2742   15.965   0.0058   0.0036   0.000   0.005   0.010   0.012   0.016   0.101   2740    0    2    0         128          0          0         64  POST /api/login HTTP/1.1
   33   15.409   0.4669   0.2530   0.057   0.552   0.697   0.794   0.800   0.800     33    0    0    0     4097292      92577     124160     163251  GET /api/livestream/search?tag=<tag>
 1527    8.926   0.0058   0.0045   0.000   0.005   0.012   0.014   0.023   0.039   1527    0    0    0     1075419          3        704      22517  GET /api/livestream HTTP/1.1
 1019    5.090   0.0050   0.0045   0.000   0.004   0.009   0.011   0.023   0.050   1015    0    0    4      187587          3        184      13844  GET /api/livestream/<num>/report
  760    3.302   0.0043   0.0029   0.000   0.004   0.008   0.010   0.015   0.028    760    0    0    0       65121          5         85        673  GET /api/livestream/<num>/ngwords
   26    3.023   0.1163   0.0711   0.017   0.112   0.212   0.260   0.268   0.268     26    0    0    0        3573        133        137        156  GET /api/user/*/statistics
  512    2.709   0.0053   0.0028   0.001   0.005   0.009   0.011   0.014   0.021    512    0    0    0       11776         23         23         23  POST /api/livestream/<num>/moderate
    1    1.735   1.7350   0.0000   1.735   1.735   1.735   1.735   1.735   1.735      1    0    0    0          27         27         27         27  POST /api/initialize HTTP/1.1
  204    0.783   0.0038   0.0028   0.000   0.003   0.007   0.009   0.012   0.020    204    0    0    0           0          0          0          0  POST /api/livestream/<num>/enter
  571    0.783   0.0014   0.0012   0.000   0.001   0.002   0.003   0.008   0.010    571    0    0    0     3478895       6089       6092       6095  GET /api/tag HTTP/1.1
ssh isucon-bench "cd ~/isucon13/bench && ./bin/bench_linux_amd64 run --enable-ssl --target https://pipe.u.isucon.dev --nameserver 35.78.167.13 > bench.log 2>&1 && tail -n 10 bench.log"
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:323      [シナリオ viewer] 192 回成功, 2 回失敗
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ aggressive-streamer-moderate-fail] 2 回失敗
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ streamer-moderate-fail] 2 回失敗
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-fail] 2 回失敗
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-report-fail] 2 回失敗
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-spam-fail] 7 回失敗
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:329      DNSAttacker並列数: 15
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:330      名前解決成功数: 181775
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:331      名前解決失敗数: 0
2023-12-10T08:14:11.083Z        info    staff-logger    bench/bench.go:335      スコア: 37929

@cureseven
Copy link
Member Author

mism-mism added a commit that referenced this issue Dec 10, 2023
iconを304で返せるようにした
#16
@mism-mism
Copy link
Collaborator

mism-mism commented Dec 10, 2023

ssh isucon-bench "cd ~/isucon13/bench && ./bin/bench_linux_amd64 run --enable-ssl --target https://pipe.u.isucon.dev --nameserver 35.78.167.13 > bench.log 2>&1 && tail -n 10 bench.log"
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [シナリオ viewer-spam] 971 回成功, 7 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [シナリオ viewer] 211 回成功
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ aggressive-streamer-moderate-fail] 6 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ streamer-moderate-fail] 4 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-report-fail] 1 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-spam-fail] 7 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:329      DNSAttacker並列数: 15
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:330      名前解決成功数: 182302
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:331      名前解決失敗数: 0
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:335      スコア: 42715
Top 20 Sort By Total
Count    Total     Mean   Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max   2xx    3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
   13  176.520  13.5785   7.0854   3.693  20.000  20.002  20.003  20.003  20.003     2      0   11    0         202          0         15        102  GET /api/livestream/<num>/statistics
 2540  172.027   0.0677   0.0603   0.001   0.052   0.153   0.199   0.261   0.370  2537      0    3    0    50858954          0      20023     122442  GET /api/livestream/<num>/livecomment
  828  141.398   0.1708   0.0346   0.026   0.165   0.222   0.234   0.268   0.327   827      0    1    0    52201390          0      63045      64092  GET /api/livestream/search?limit=<num> HTTP/1.1
 2575  126.670   0.0492   0.0427   0.001   0.039   0.106   0.137   0.188   0.295  2572      0    3    0    44223714          0      17174     115758  GET /api/livestream/<num>/reaction
  568   53.368   0.0940   0.0352   0.000   0.095   0.138   0.146   0.165   0.190   564      0    4    0      662296          0       1166       1460  POST /api/livestream/reservation HTTP/1.1
 2881   48.791   0.0169   0.0034   0.000   0.016   0.020   0.023   0.029   0.056  2877      0    3    1     1352700          0        469        522  POST /api/register HTTP/1.1
 3343   43.322   0.0130   0.0067   0.001   0.012   0.020   0.022   0.027   0.192  3342      0    1    0     6461622         87       1932       2715  POST /api/livestream/<num>/livecomment
 2333   23.853   0.0102   0.0046   0.001   0.010   0.016   0.018   0.022   0.063  2333      0    0    0     4329521       1552       1855       2203  POST /api/livestream/<num>/reaction
 2925   23.411   0.0080   0.0030   0.002   0.007   0.012   0.014   0.017   0.027  2893      0    0   32       53018         14         18        154  POST /api/icon HTTP/1.1
22828   19.835   0.0009   0.0009   0.000   0.001   0.002   0.002   0.004   0.018    31  22797    0    0     1961038          0         85      84841  GET /api/user/*/icon
 2885   15.600   0.0054   0.0041   0.000   0.005   0.009   0.010   0.013   0.146  2883      0    2    0         128          0          0         64  POST /api/login HTTP/1.1
   34   15.038   0.4423   0.2464   0.057   0.521   0.715   0.758   0.846   0.846    34      0    0    0     4132727      86980     121550     164152  GET /api/livestream/search?tag=<tag>
 1555    8.725   0.0056   0.0049   0.000   0.005   0.011   0.013   0.019   0.128  1555      0    0    0     1122206          3        721      22537  GET /api/livestream HTTP/1.1
 1073    5.253   0.0049   0.0046   0.000   0.004   0.009   0.012   0.020   0.069  1065      0    0    8      190962          3        177      13555  GET /api/livestream/<num>/report
   27    3.330   0.1233   0.0703   0.016   0.112   0.232   0.234   0.259   0.259    27      0    0    0        3725        133        137        158  GET /api/user/*/statistics
  799    3.149   0.0039   0.0023   0.001   0.003   0.007   0.008   0.011   0.023   799      0    0    0       73251          5         91        801  GET /api/livestream/<num>/ngwords
  526    2.835   0.0054   0.0034   0.001   0.005   0.009   0.011   0.015   0.035   526      0    0    0       12098         23         23         23  POST /api/livestream/<num>/moderate
    1    1.740   1.7400   0.0000   1.740   1.740   1.740   1.740   1.740   1.740     1      0    0    0          27         27         27         27  POST /api/initialize HTTP/1.1
  223    0.923   0.0041   0.0031   0.000   0.003   0.007   0.009   0.013   0.029   223      0    0    0           0          0          0          0  POST /api/livestream/<num>/enter
  212    0.787   0.0037   0.0021   0.000   0.003   0.007   0.008   0.010   0.011   212      0    0    0           0          0          0          0  DELETE /api/livestream/<num>/exit

@mism-mism
Copy link
Collaborator

mism-mism commented Dec 10, 2023

Top 20 Sort By Total
Count    Total     Mean   Stddev     Min   P50.0   P90.0   P95.0   P99.0     Max    2xx  3xx  4xx  5xx  TotalBytes   MinBytes  MeanBytes   MaxBytes  Request
- 20314   80.711   0.0040   0.0028   0.000   0.003   0.007   0.009   0.014   0.081  20314    0    0    0  1285390991       6969      63276     171855  GET /api/user/*/icon
+ 22828   19.835   0.0009   0.0009   0.000   0.001   0.002   0.002   0.004   0.018    31  22797    0    0     1961038          0         85      84841  GET /api/user/*/icon

@mism-mism
Copy link
Collaborator

#19 マージでこの点数

ssh isucon-bench "cd ~/isucon13/bench && ./bin/bench_linux_amd64 run --enable-ssl --target https://pipe.u.isucon.dev --nameserver 35.78.167.13 > bench.log 2>&1 && tail -n 10 bench.log"
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [シナリオ viewer-spam] 971 回成功, 7 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [シナリオ viewer] 211 回成功
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ aggressive-streamer-moderate-fail] 6 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ streamer-moderate-fail] 4 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-report-fail] 1 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:323      [失敗シナリオ viewer-spam-fail] 7 回失敗
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:329      DNSAttacker並列数: 15
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:330      名前解決成功数: 182302
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:331      名前解決失敗数: 0
2023-12-10T08:49:54.771Z        info    staff-logger    bench/bench.go:335      スコア: 42715

@mism-mism
Copy link
Collaborator

top-slow.log

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants