Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Markup and hook demo #192

Merged
merged 3 commits into from
Feb 19, 2025
Merged

Markup and hook demo #192

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
f9e0543
Markup and hook demo
babenek Feb 16, 2025
cfa376a
additional markup
babenek Feb 18, 2025
261c723
action update
babenek Feb 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 14 additions & 14 deletions .ci/benchmark.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
META MD5 0631d3c69c1ece61c31ad976cc91e2f4
DATA MD5 36faeaaa7c34d72fdb9d65b8854dd17a
DATA: 16334259 interested lines. MARKUP: 59619 items
META MD5 ca7df6f221973c63ef270098b293ccbf
DATA MD5 83bfc3d7c7da81ae313827f3bda09197
DATA: 16334259 interested lines. MARKUP: 59620 items
FileType FileNumber ValidLines Positives Negatives Templates
--------------- ------------ ------------ ----------- ----------- -----------
194 28342 71 415 90
194 28342 72 415 89
.1 2 641 2 5
.admx 1 26 1
.adoc 1 158 13 5 1
Expand Down Expand Up @@ -63,7 +63,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.gd 1 37 1
.gml 3 3075 16
.gni 3 5017 19
.go 1081 568661 640 4109 744
.go 1081 568661 640 4111 744
.golden 5 1168 1 13 29
.gradle 45 3265 2 90 100
.graphql 7 420 13
Expand Down Expand Up @@ -113,7 +113,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.markdown 3 139 3 1
.markerb 3 12 3
.marko 1 21 2
.md 674 148660 758 2334 595
.md 674 148660 759 2334 594
.mdx 3 549 7
.mjml 1 18 1
.mjs 22 4424 71 341
Expand Down Expand Up @@ -153,11 +153,11 @@ FileType FileNumber ValidLines Positives Negatives Templat
.pug 2 193 2
.purs 1 69 4
.pxd 1 150 4 2
.py 886 290215 675 3235 720
.py 886 290215 676 3235 720
.pyi 4 1361 9
.pyp 1 167 1
.pyx 2 1094 23
.r 4 62 4 2 1
.r 4 62 5 2
.rake 2 51 2
.rb 834 128817 283 2444 614
.re 1 31 1
Expand Down Expand Up @@ -222,7 +222,7 @@ FileType FileNumber ValidLines Positives Negatives Templat
.yml 420 36296 546 910 374
.zsh 6 872 12
.zsh-theme 1 97 1
TOTAL: 10026 16334259 11993 46618 5024
TOTAL: 10026 16334259 11997 46620 5021
credsweeper result_cnt : 0, lost_cnt : 0, true_cnt : 0, false_cnt : 0
Rules Positives Negatives Templates Reported TP FP TN FN FPR FNR ACC PRC RCL F1
------------------------------ ----------- ----------- ----------- ---------- ---- ---- ----- ----- -------- -------- -------- ----- -------- ----
Expand All @@ -231,7 +231,7 @@ AWS Client ID 170 19 0
AWS Multi 82 10 0 0 0 10 82 0.000000 1.000000 0.108696 0.000000
AWS S3 Bucket 67 23 0 0 0 23 67 0.000000 1.000000 0.255556 0.000000
Atlassian Old PAT token 3 7 0 0 0 7 3 0.000000 1.000000 0.700000 0.000000
Auth 416 2744 81 0 0 2825 416 0.000000 1.000000 0.871645 0.000000
Auth 417 2744 81 0 0 2825 417 0.000000 1.000000 0.871376 0.000000
Azure Access Token 19 0 0 0 0 0 19 1.000000 0.000000 0.000000
BASE64 Private Key 12 4 0 0 0 4 12 0.000000 1.000000 0.250000 0.000000
BASE64 encoded PEM Private Key 7 0 0 0 0 0 7 1.000000 0.000000 0.000000
Expand All @@ -244,7 +244,7 @@ CMD Token 6 0 0
Certificate 24 471 0 0 0 471 24 0.000000 1.000000 0.951515 0.000000
Credential 91 422 76 0 0 498 91 0.000000 1.000000 0.845501 0.000000
Docker Swarm Token 2 0 0 0 0 0 2 1.000000 0.000000 0.000000
Dropbox App secret 59 139 0 0 0 139 59 0.000000 1.000000 0.702020 0.000000
Dropbox App secret 59 141 0 0 0 141 59 0.000000 1.000000 0.705000 0.000000
Facebook Access Token 0 1 0 0 0 1 0 0.000000 1.000000
Firebase Domain 6 1 0 0 0 1 6 0.000000 1.000000 0.142857 0.000000
Github Old Token 1 0 0 0 0 0 1 1.000000 0.000000 0.000000
Expand All @@ -261,7 +261,7 @@ Key 3911 15717 483
Nonce 93 49 0 0 0 49 93 0.000000 1.000000 0.345070 0.000000
Other 9 7447 5 0 0 7452 9 0.000000 1.000000 0.998794 0.000000
PEM Private Key 1019 1483 0 0 0 1483 1019 0.000000 1.000000 0.592726 0.000000
Password 1936 7530 2637 0 0 10167 1936 0.000000 1.000000 0.840040 0.000000
Password 1938 7530 2635 0 0 10165 1938 0.000000 1.000000 0.839874 0.000000
SQL Password 44 13 0 0 0 13 44 0.000000 1.000000 0.228070 0.000000
Salesforce Credentials 2 0 0 0 0 0 2 1.000000 0.000000 0.000000
Salt 48 75 1 0 0 76 48 0.000000 1.000000 0.612903 0.000000
Expand All @@ -272,6 +272,6 @@ Stripe Credentials 2 0 0
Tencent WeChat API App ID 6 0 0 0 0 0 6 1.000000 0.000000 0.000000
Token 645 4170 453 0 0 4623 645 0.000000 1.000000 0.877563 0.000000
Twilio Credentials 30 39 0 0 0 39 30 0.000000 1.000000 0.565217 0.000000
URL Credentials 217 156 209 0 0 365 217 0.000000 1.000000 0.627148 0.000000
URL Credentials 218 156 208 0 0 364 218 0.000000 1.000000 0.625430 0.000000
UUID 1075 265 0 0 0 265 1075 0.000000 1.000000 0.197761 0.000000
11993 46618 5024 0 0 0 46618 11993 0.000000 1.000000 0.795380 0.000000
11997 46620 5021 0 0 0 46620 11997 0.000000 1.000000 0.795332 0.000000
38 changes: 19 additions & 19 deletions .github/workflows/review.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,12 +21,12 @@ jobs:
steps:

- name: Harden Runner
uses: step-security/harden-runner@91182cccc01eb5e619899d80e4e971d6181294a7 # v2.10.1
uses: step-security/harden-runner@cb605e52c26070c328afc4562f0b4ada7618a84e # v2.10.4 - 2025.01.20
with:
egress-policy: audit

- name: Checkout CredData
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2 - 2024.10.23
with:
ref: ${{ github.event.pull_request.head.sha }}

Expand All @@ -40,7 +40,7 @@ jobs:

- name: Cache head review
id: cache-data
uses: actions/cache@6849a6489940f00c2f30c0fb92c6274307ccb58a # v4.1.2
uses: actions/cache@1bd1e32a3bdc45362d1e726936510720a7c30a57 # v4.2.0 - 2024.12.05
with:
path: |
review_head.txt
Expand All @@ -50,7 +50,7 @@ jobs:
- name: Cache tmp
if: steps.cache-data.outputs.cache-hit != 'true'
id: cache-tmp
uses: actions/cache@6849a6489940f00c2f30c0fb92c6274307ccb58a # v4.1.2
uses: actions/cache@1bd1e32a3bdc45362d1e726936510720a7c30a57 # v4.2.0 - 2024.12.05
with:
path: tmp
key: cred-data-${{ hashFiles('snapshot.yaml') }}
Expand All @@ -61,7 +61,7 @@ jobs:

- name: Set up Python 3.10
if: steps.cache-data.outputs.cache-hit != 'true'
uses: actions/setup-python@65d7f2d534ac1bc67fcd62888c5f4f3d2cb2b236 # v4.7.1
uses: actions/setup-python@42375524e23c412d93fb67b49958b491fce71c38 # v5.4.0 - 2025.01.28
with:
python-version: "3.10"

Expand All @@ -86,7 +86,7 @@ jobs:

- name: Upload artifact
if: always()
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0 - 2025.01.09
with:
name: review_head
path: |
Expand All @@ -105,12 +105,12 @@ jobs:
steps:

- name: Harden Runner
uses: step-security/harden-runner@91182cccc01eb5e619899d80e4e971d6181294a7 # v2.10.1
uses: step-security/harden-runner@cb605e52c26070c328afc4562f0b4ada7618a84e # v2.10.4 - 2025.01.20
with:
egress-policy: audit

- name: Checkout CredData
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2 - 2024.10.23
with:
ref: ${{ github.event.pull_request.base.sha }}

Expand All @@ -124,7 +124,7 @@ jobs:

- name: Cache base review
id: cache-data
uses: actions/cache@6849a6489940f00c2f30c0fb92c6274307ccb58a # v4.1.2
uses: actions/cache@1bd1e32a3bdc45362d1e726936510720a7c30a57 # v4.2.0 - 2024.12.05
with:
path: |
review_base.txt
Expand All @@ -134,7 +134,7 @@ jobs:
- name: Cache tmp
if: steps.cache-data.outputs.cache-hit != 'true'
id: cache-tmp
uses: actions/cache@6849a6489940f00c2f30c0fb92c6274307ccb58a # v4.1.2
uses: actions/cache@1bd1e32a3bdc45362d1e726936510720a7c30a57 # v4.2.0 - 2024.12.05
with:
path: tmp
key: cred-data-${{ hashFiles('snapshot.yaml') }}
Expand All @@ -145,7 +145,7 @@ jobs:

- name: Set up Python 3.10
if: steps.cache-data.outputs.cache-hit != 'true'
uses: actions/setup-python@65d7f2d534ac1bc67fcd62888c5f4f3d2cb2b236 # v4.7.1
uses: actions/setup-python@42375524e23c412d93fb67b49958b491fce71c38 # v5.4.0 - 2025.01.28
with:
python-version: "3.10"

Expand All @@ -160,7 +160,7 @@ jobs:

- name: Upload artifact
if: always()
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0 - 2025.01.09
with:
name: review_base
path: |
Expand All @@ -178,15 +178,15 @@ jobs:
steps:

- name: Harden Runner
uses: step-security/harden-runner@91182cccc01eb5e619899d80e4e971d6181294a7 # v2.10.1
uses: step-security/harden-runner@cb605e52c26070c328afc4562f0b4ada7618a84e # v2.10.4 - 2025.01.20
with:
egress-policy: audit

- name: install ansi2html
run: sudo apt update && sudo apt install colorized-logs

- name: Download all workflow run artifacts
uses: actions/download-artifact@fa0a91b85d4f404e444e00e005971372dc801d16 # v4.1.8
uses: actions/download-artifact@fa0a91b85d4f404e444e00e005971372dc801d16 # v4.1.8 - 2024.07.05

- name: Get diff for review
run: |
Expand All @@ -199,7 +199,7 @@ jobs:

- name: Upload artifact
if: always()
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0 - 2025.01.09
with:
name: review_diff
path: |
Expand All @@ -215,17 +215,17 @@ jobs:
steps:

- name: Harden Runner
uses: step-security/harden-runner@91182cccc01eb5e619899d80e4e971d6181294a7 # v2.10.1
uses: step-security/harden-runner@cb605e52c26070c328afc4562f0b4ada7618a84e # v2.10.4 - 2025.01.20
with:
egress-policy: audit

- name: Checkout CredData
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2 - 2024.10.23
with:
ref: ${{ github.event.pull_request.head.sha }}

- name: Set up Python 3.10
uses: actions/setup-python@65d7f2d534ac1bc67fcd62888c5f4f3d2cb2b236 # v4.7.1
uses: actions/setup-python@42375524e23c412d93fb67b49958b491fce71c38 # v5.4.0 - 2025.01.28
with:
python-version: "3.10"

Expand Down Expand Up @@ -272,7 +272,7 @@ jobs:

- name: Upload artifact
if: always()
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0
uses: actions/upload-artifact@65c4c4a1ddee5b72f698fdd19549f0f0fb45cf08 # v4.6.0 - 2025.01.09
with:
name: reports
path: |
Expand Down
5 changes: 5 additions & 0 deletions .pre-commit-config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
repos:
- repo: https://github.com/Samsung/CredSweeper
rev: v1.10.6
hooks:
- id: CredSweeper
2 changes: 1 addition & 1 deletion meta/0fc802c8.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
28099,2cb279b2,GitHub,0fc802c8,data/0fc802c8/other/2cb279b2.md,51,51,T,T,28,37,F,F,Any,,,Secret,2.82,9,F,F,F,Password
28520,d2ddd43d,GitHub,0fc802c8,data/0fc802c8/other/d2ddd43d.md,15,15,Template,F,26,32,F,F,CharsOnly,,,Token,2.25,6,F,F,F,API:Token
28626,2cb279b2,GitHub,0fc802c8,data/0fc802c8/other/2cb279b2.md,117,117,T,T,19,28,F,F,Any,,,Secret,2.82,9,F,F,F,Password
30640,ce4a4371,GitHub,0fc802c8,data/0fc802c8/other/ce4a4371,24,24,Template,T,16,24,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
30640,ce4a4371,GitHub,0fc802c8,data/0fc802c8/other/ce4a4371,24,24,T,T,16,24,F,F,CharsOnly,,,Secret,2.75,8,F,F,F,Password
34138,60eff9d3,GitHub,0fc802c8,data/0fc802c8/src/60eff9d3.yml,6,6,T,T,30,39,F,F,Any,,,Secret,2.82,9,F,F,F,Password
41519,6a2adfaa,GitHub,0fc802c8,data/0fc802c8/src/6a2adfaa.yaml,444,444,T,T,16,33,F,F,CharsOnly,,,Secret,3.41,17,F,F,F,Password
41520,7ae146e0,GitHub,0fc802c8,data/0fc802c8/src/7ae146e0.yml,159,159,F,F,,,F,F,,,,,0,0,F,F,F,Secret
Expand Down
4 changes: 2 additions & 2 deletions meta/28728ab4.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -165,7 +165,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
29061,f0b5d46b,GitHub,28728ab4,data/28728ab4/src/f0b5d46b.toml,17,17,Template,T,31,44,F,F,Any,,,Secret,2.9,13,F,F,F,Password
29121,1749c62f,GitHub,28728ab4,data/28728ab4/src/1749c62f.toml,14,14,Template,F,21,28,F,F,Any,,,Key,2.41,7,F,F,F,API:Key
29122,3ec8668b,GitHub,28728ab4,data/28728ab4/src/3ec8668b.toml,22,22,Template,T,27,54,F,F,Any,,,Secret,3.61,27,F,F,F,Key:Secret
29133,81d18044,GitHub,28728ab4,data/28728ab4/test/81d18044.go,209,209,F,T,34,49,F,F,Any,,,Key,3.89,55,F,F,F,API:Key
29133,81d18044,GitHub,28728ab4,data/28728ab4/test/81d18044.go,209,209,F,T,34,49,F,F,Any,,,Key,3.89,55,F,F,F,API:Key:Dropbox App secret
29136,81d18044,GitHub,28728ab4,data/28728ab4/test/81d18044.go,119,119,F,T,31,46,F,F,Any,,,Key,3.78,55,F,F,F,API:Key
29146,81d18044,GitHub,28728ab4,data/28728ab4/test/81d18044.go,130,130,F,T,31,46,F,F,Any,,,Key,3.8,55,F,F,F,Key:API
29152,87277328,GitHub,28728ab4,data/28728ab4/test/87277328.go,85,85,Template,F,15,17,F,F,CharsOnly,,,Secret,1.0,2,F,F,F,Password
Expand Down Expand Up @@ -271,7 +271,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
30813,2e0df5af,GitHub,28728ab4,data/28728ab4/test/2e0df5af.go,23,23,Template,F,21,24,F,F,CharsOnly,,,Secret,1.58,3,F,F,F,Key:Secret
30814,b58a3506,GitHub,28728ab4,data/28728ab4/test/b58a3506.go,28,28,Template,T,17,23,F,F,CharsOnly,,,Token,2.25,6,F,F,F,Token
30824,dc6fa5f4,GitHub,28728ab4,data/28728ab4/src/dc6fa5f4.toml,14,14,Template,F,23,30,F,F,Any,,,Key,2.41,7,F,F,F,API:Key
30869,b955ab7a,GitHub,28728ab4,data/28728ab4/src/b955ab7a.go,47,47,F,T,84,99,T,F,CharsOnly,,,Key,3.24,15,F,F,F,API:Key
30869,b955ab7a,GitHub,28728ab4,data/28728ab4/src/b955ab7a.go,47,47,F,T,84,99,T,F,CharsOnly,,,Key,3.24,15,F,F,F,API:Key:Dropbox App secret
30889,b955ab7a,GitHub,28728ab4,data/28728ab4/src/b955ab7a.go,46,46,F,T,81,96,T,F,CharsOnly,,,Key,3.24,15,F,F,F,API:Key
30933,04bab67b,GitHub,28728ab4,data/28728ab4/test/04bab67b.go,64,64,F,F,,,F,F,,,,,0,0,F,F,F,Password
30957,df475944,GitHub,28728ab4,data/28728ab4/test/df475944.go,59,59,Template,F,52,58,F,F,,,,,0.0,0,F,F,F,Password
Expand Down
2 changes: 1 addition & 1 deletion meta/49b08818.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ Id,FileID,Domain,RepoName,FilePath,LineStart,LineEnd,GroundTruth,WithWords,Value
30115,24013877,GitHub,49b08818,data/49b08818/src/24013877.R,4,4,F,F,23,121,F,F,,,,,0.0,0,F,F,F,Auth
30339,1cafa8a2,GitHub,49b08818,data/49b08818/src/1cafa8a2.txt,1,1,F,F,83,90,F,F,,,,,0.0,0,F,F,F,Key
30347,f12dd9ee,GitHub,49b08818,data/49b08818/src/f12dd9ee.txt,1,1,Template,T,51,60,T,F,CharsOnly,,,Secret,3.17,9,F,F,F,Password
30630,5759a792,GitHub,49b08818,data/49b08818/src/5759a792.R,5,5,Template,T,16,25,F,F,CharsOnly,,,Secret,3.17,9,F,F,F,Password
30630,5759a792,GitHub,49b08818,data/49b08818/src/5759a792.R,5,5,T,T,16,25,F,F,CharsOnly,,,Secret,3.17,9,F,F,F,Password
31068,af53983f,GitHub,49b08818,data/49b08818/src/af53983f.py,5,5,Template,F,12,19,F,F,CharsOnly,,,Unknown,2.81,7,F,F,F,Key
31443,17c30e05,GitHub,49b08818,data/49b08818/src/17c30e05.py,4,4,F,F,24,122,F,F,,,,,0.0,0,F,F,F,Auth
32265,341ddfa2,GitHub,49b08818,data/49b08818/src/341ddfa2.ex,10,10,Template,T,49,60,F,F,Any,,,Secret,3.28,11,F,F,F,Password
Expand Down
Loading
Loading