File tree
487 files changed
+678595
-2461601
lines changed- benchmarks/cpp
- utils
- cpp
- include/tensorrt_llm
- batch_manager
- common
- executor
- kernels
- runtime
- micro_benchmarks
- tensorrt_llm
- batch_manager
- aarch64-linux-gnu
- x86_64-linux-gnu
- x86_64-windows-msvc
- common
- executor
- aarch64-linux-gnu
- x86_64-linux-gnu
- x86_64-windows-msvc
- kernels
- contextFusedMultiHeadAttention
- cubin
- cutlass_kernels/fpA_intB_gemm
- decoderMaskedMultiheadAttention
- decoderXQAImplJIT/nvrtcWrapper
- aarch64-linux-gnu
- x86_64-linux-gnu
- x86_64-windows-msvc
- instantiation
- internal_cutlass_kernels
- aarch64-linux-gnu
- x86_64-linux-gnu
- x86_64-windows-msvc
- speculativeDecoding
- weightOnlyBatchedGemv
- layers
- plugins
- eaglePlugin
- gptAttentionCommon
- gptAttentionPlugin
- mixtureOfExperts
- weightOnlyGroupwiseQuantMatmulPlugin
- pybind
- batch_manager
- executor
- runtime
- tests
- kernels/sampling
- layers
- resources/scripts
- docs/source/performance
- examples
- baichuan
- bloom
- chatglm
- commandr
- cpp/executor
- dbrx
- deepseek_v1
- draft_target_model
- eagle
- falcon
- gemma
- gptj
- gptneox
- gpt
- grok
- internlm
- jais
- llama
- lookahead
- mamba
- medusa
- mixtral
- mllama
- model_api
- mpt
- multimodal
- nemotron
- opt
- phi
- prompt_lookup
- quantization
- qwenvl
- qwen
- recurrentgemma
- redrafter
- sdxl
- skywork
- smaug
- whisper
- tensorrt_llm
- bench
- benchmark
- utils
- build
- dataclasses
- utils
- commands
- layers
- llmapi
- models
- bert
- eagle
- qwen
- unet
- pp
- runtime
- tests
- bindings
- llmapi
- _perf_evaluator
- model/eagle
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
487 files changed
+678595
-2461601
lines changedLines changed: 5 additions & 3 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
17 | 17 |
| |
18 | 18 |
| |
19 | 19 |
| |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
20 | 25 |
| |
21 | 26 |
| |
22 | 27 |
| |
23 |
| - | |
24 |
| - | |
25 |
| - | |
26 | 28 |
| |
27 | 29 |
| |
28 | 30 |
| |
|
Lines changed: 2 additions & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
25 | 25 |
| |
26 | 26 |
| |
27 | 27 |
| |
28 |
| - | |
| 28 | + | |
29 | 29 |
| |
30 | 30 |
| |
31 | 31 |
| |
| |||
40 | 40 |
| |
41 | 41 |
| |
42 | 42 |
| |
| 43 | + |
Lines changed: 43 additions & 0 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
352 | 352 |
| |
353 | 353 |
| |
354 | 354 |
| |
| 355 | + | |
| 356 | + | |
| 357 | + | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
| 361 | + | |
| 362 | + | |
| 363 | + | |
| 364 | + | |
| 365 | + | |
| 366 | + | |
| 367 | + | |
| 368 | + | |
| 369 | + | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
| 373 | + | |
| 374 | + | |
| 375 | + | |
| 376 | + | |
| 377 | + | |
| 378 | + | |
| 379 | + | |
| 380 | + | |
| 381 | + | |
| 382 | + | |
| 383 | + | |
| 384 | + | |
| 385 | + | |
| 386 | + | |
| 387 | + | |
| 388 | + | |
| 389 | + | |
| 390 | + | |
| 391 | + | |
| 392 | + | |
| 393 | + | |
| 394 | + | |
| 395 | + | |
| 396 | + | |
| 397 | + |
0 commit comments