Skip to content

Commit

Permalink
Merge branch 'main' into xml
Browse files Browse the repository at this point in the history
  • Loading branch information
babenek committed Jan 19, 2024
2 parents ab73a1e + 269ff93 commit 879193b
Show file tree
Hide file tree
Showing 5 changed files with 71 additions and 72 deletions.
3 changes: 1 addition & 2 deletions .github/workflows/benchmark.yml
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ jobs:

- name: Generate Data Asset
if: steps.cache-data.outputs.cache-hit != 'true'
run: python download_data.py --data_dir data
run: python download_data.py --data_dir data --jobs $(nproc)


# # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # #
Expand Down Expand Up @@ -334,4 +334,3 @@ jobs:
exit ${exit_code}
# # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # #

42 changes: 22 additions & 20 deletions cicd/benchmark.txt
Original file line number Diff line number Diff line change
@@ -1,15 +1,17 @@
DATA: 19360133 valid lines. MARKUP: 73578 items
DATA: 19379397 valid lines. MARKUP: 74012 items
Category Positives Negatives Template
-------------------------- ----------- ----------- ----------
Authentication Key & Token 83 1 31
Generic Secret 1063 15 203
Generic Token 336 45 559
Other 823 62713 624
Password 1396 112 4096
Predefined Pattern 342 2 39
Private Key 1009 28 4
Seed, Salt, Nonce 46 4 4
TOTAL: 5098 62920 5560
Authentication Key & Token 93 2 31
Generic Secret 1063 16 204
Generic Token 332 47 558
Other 845 63051 610
Password 1416 118 4140
Predefined Pattern 375 3 11
Private Key 1012 29 0
Seed, Salt, Nonce 48 4 4
TOTAL: 5184 63270 5558
Detected Credentials: 6135
credsweeper result_cnt : 5250, lost_cnt : 0, true_cnt : 4369, false_cnt : 881
FileType FileNumber ValidLines Positives Negatives Template
--------------- ------------ ------------ ----------- ----------- ----------
224 41595 44 845 80
Expand Down Expand Up @@ -245,13 +247,13 @@ TOTAL: 11250 19360133 5098 62920 556
Detected Credentials: 6025
credsweeper result_cnt : 5166, lost_cnt : 0, true_cnt : 4295, false_cnt : 871
Category TP FP TN FN FPR FNR ACC PRC RCL F1
-------------------------- ---- ---- -------- ---- --------- --------- -------- -------- -------- --------
Authentication Key & Token 67 4 28 16 0.125 0.192771 0.826087 0.943662 0.807229 0.87013
Generic Secret 978 4 214 85 0.0183486 0.0799624 0.930523 0.995927 0.920038 0.956479
Generic Token 290 12 592 46 0.0198676 0.136905 0.938298 0.960265 0.863095 0.909091
Other 576 716 62621 247 0.0113046 0.300122 0.984991 0.44582 0.699878 0.544681
Password 1000 130 4078 396 0.0308935 0.283668 0.906138 0.884956 0.716332 0.791766
Predefined Pattern 332 1 40 10 0.0243902 0.0292398 0.971279 0.996997 0.97076 0.983704
Private Key 1009 2 30 0 0.0625 0.998079 0.998022 1 0.99901
Seed, Salt, Nonce 43 2 6 3 0.25 0.0652174 0.907407 0.955556 0.934783 0.945055
4295 871 19354164 803 4.5e-05 0.157513 0.999914 0.831398 0.842487 0.836906
-------------------------- ---- ---- -------- ---- --------- ---------- -------- -------- -------- --------
Authentication Key & Token 76 5 28 17 0.151515 0.182796 0.825397 0.938272 0.817204 0.873563
Generic Secret 979 7 213 84 0.0318182 0.0790216 0.929072 0.992901 0.920978 0.955588
Generic Token 295 12 593 37 0.0198347 0.111446 0.947705 0.960912 0.888554 0.923318
Other 595 722 62939 250 0.0113413 0.295858 0.984932 0.451784 0.704142 0.550416
Password 1012 131 4127 404 0.0307656 0.285311 0.90571 0.885389 0.714689 0.790934
Predefined Pattern 356 2 12 19 0.142857 0.0506667 0.946015 0.994413 0.949333 0.971351
Private Key 1011 0 29 1 0.00098814 0.999039 1 0.999012 0.999506
Seed, Salt, Nonce 45 2 6 3 0.25 0.0625 0.910714 0.957447 0.9375 0.947368
4369 881 19373332 815 4.547e-05 0.157215 0.999912 0.83219 0.842785 0.837454
Loading

0 comments on commit 879193b

Please sign in to comment.