Third party package updates #472

piyush-jena · 2025-04-15T22:29:21Z

Description of changes:

Adds patches for kubernetes 1.25 to 1.27 from the latest upstream: https://github.com/aws/eks-distro/tree/main/projects/kubernetes/kubernetes
~~Update nvidia-container-toolkit v1.17.4 → v1.17.5~~
~~Update nvidia-k8s-device-plugin v0.17.0 → v0.17.1~~
Update ecr-credential-provider v1.32.1 → v1.32.2

Testing done:

 NAME                                         TYPE        STATE       PASSED   FAILED   SKIPPED   BUILD ID         LAST UPDATE
 aarch64-aws-k8s-125-conformance              Test        passed         363        0      6706   d2a85f05-dirty   2025-04-16T02:47:16Z
 aarch64-aws-k8s-125-ipv6-conformance         Test        passed         363        0      6706   d2a85f05-dirty   2025-04-16T03:00:05Z
 aarch64-aws-k8s-125-ipv6-quick               Test        passed           4        0      7065   d2a85f05-dirty   2025-04-16T01:14:50Z
 aarch64-aws-k8s-125-nvidia-conformance       Test        passed         363        0      6706   d2a85f05-dirty   2025-04-16T02:37:12Z
 aarch64-aws-k8s-125-nvidia-quick             Test        passed           4        0      7065   d2a85f05-dirty   2025-04-16T00:56:57Z
 aarch64-aws-k8s-125-quick                    Test        passed           4        0      7065   d2a85f05-dirty   2025-04-16T01:14:19Z
 aarch64-aws-k8s-126-conformance              Test        passed         371        0      6701   d2a85f05-dirty    2025-04-16T05:15:32Z
 aarch64-aws-k8s-126-ipv6-conformance         Test        passed         371        0      6701   d2a85f05-dirty   2025-04-16T03:07:52Z
 aarch64-aws-k8s-126-ipv6-quick               Test        passed           4        0      7068   d2a85f05-dirty   2025-04-16T01:18:05Z
 aarch64-aws-k8s-126-nvidia-conformance       Test        passed         371        0      6701   d2a85f05-dirty    2025-04-16T05:12:01Z
 aarch64-aws-k8s-126-nvidia-quick             Test        passed           4        0      7068   d2a85f05-dirty   2025-04-16T01:15:10Z
 aarch64-aws-k8s-126-quick                    Test        passed           4        0      7068   d2a85f05-dirty   2025-04-16T01:15:40Z
 aarch64-aws-k8s-127-conformance              Test        passed         382        0      6832   d2a85f05-dirty   2025-04-16T03:02:53Z
 aarch64-aws-k8s-127-ipv6-conformance         Test        passed         382        0      6832   d2a85f05-dirty   2025-04-16T03:11:01Z
 aarch64-aws-k8s-127-ipv6-quick               Test        passed           5        0      7209   d2a85f05-dirty   2025-04-16T01:17:20Z
 aarch64-aws-k8s-127-nvidia-conformance       Test        passed         382        0      6832   d2a85f05-dirty    2025-04-16T05:21:09Z
 aarch64-aws-k8s-127-nvidia-quick             Test        passed           5        0      7209   d2a85f05-dirty   2025-04-16T01:14:39Z
 aarch64-aws-k8s-127-quick                    Test        passed           5        0      7209   d2a85f05-dirty   2025-04-16T01:14:29Z
 x86-64-aws-k8s-125-conformance               Test        passed         363        0      6706   d2a85f05-dirty   2025-04-16T00:05:29Z
 x86-64-aws-k8s-125-ipv6-conformance          Test        passed         363        0      6706   d2a85f05-dirty   2025-04-16T00:15:52Z
 x86-64-aws-k8s-125-ipv6-quick                Test        passed           4        0      7065   d2a85f05-dirty   2025-04-15T22:31:50Z
 x86-64-aws-k8s-125-nvidia-conformance        Test        passed         363        0      6706   d2a85f05-dirty   2025-04-16T00:08:52Z
 x86-64-aws-k8s-125-nvidia-quick              Test        passed           4        0      7065   d2a85f05-dirty   2025-04-15T22:30:50Z
 x86-64-aws-k8s-125-quick                     Test        passed           4        0      7065   d2a85f05-dirty   2025-04-15T22:31:21Z
 x86-64-aws-k8s-126-conformance               Test        passed         371        0      6701   d2a85f05-dirty   2025-04-16T00:08:13Z
 x86-64-aws-k8s-126-ipv6-conformance          Test        passed         371        0      6701   d2a85f05-dirty   2025-04-16T00:16:59Z
 x86-64-aws-k8s-126-ipv6-quick                Test        passed           4        0      7068   d2a85f05-dirty   2025-04-15T22:32:20Z
 x86-64-aws-k8s-126-nvidia-conformance        Test        passed         371        0      6701   d2a85f05-dirty   2025-04-16T02:36:01Z
 x86-64-aws-k8s-126-nvidia-quick              Test        passed           4        0      7068   d2a85f05-dirty   2025-04-15T22:32:31Z
 x86-64-aws-k8s-126-quick                     Test        passed           4        0      7068   d2a85f05-dirty   2025-04-15T22:30:39Z
 x86-64-aws-k8s-127-conformance               Test        passed         382        0      6832   d2a85f05-dirty   2025-04-16T00:14:24Z
 x86-64-aws-k8s-127-ipv6-conformance          Test        passed         382        0      6832   d2a85f05-dirty   2025-04-16T00:26:57Z
 x86-64-aws-k8s-127-ipv6-quick                Test        passed           5        0      7209   d2a85f05-dirty   2025-04-15T22:32:59Z
 x86-64-aws-k8s-127-nvidia-conformance        Test        passed         382        0      6832   d2a85f05-dirty   2025-04-16T00:13:24Z
 x86-64-aws-k8s-127-nvidia-quick              Test        passed           5        0      7209   d2a85f05-dirty   2025-04-15T22:31:27Z
 x86-64-aws-k8s-127-quick                     Test        passed           5        0      7209   d2a85f05-dirty   2025-04-15T22:31:03Z

nvidia-smoke-test for k8s-1.25 - All tests passed
nvidia-smoke-test for k8s-1.26 - All tests passed
nvidia-smoke-test for k8s-1.27 - All tests passed

[fedora@xxxxxxxxxxxxxxxx kubernetes]$ kubectl logs nvidia-pod

=========================================
  Running sample UnifiedMemoryPerf
=========================================

GPU Device 0: "Turing" with compute capability 7.5

Running ........................................................

Overall Time For matrixMultiplyPerf 

Printing Average of 20 measurements in (ms)
Size_KB  UMhint UMhntAs  UMeasy   0Copy MemCopy CpAsync CpHpglk CpPglAs
4         0.210   0.218   0.322   0.018   0.035   0.029   0.038   0.029
16        0.237   0.245   0.477   0.043   0.066   0.057   0.068   0.065
64        0.326   0.369   0.751   0.136   0.174   0.162   0.139   0.132
256       0.872   0.908   1.326   0.759   0.631   0.582   0.492   0.482
1024      3.116   3.394   3.574   5.075   2.531   2.340   1.994   1.974
4096     12.097  11.311  14.541  34.921   9.661   9.567   9.033   8.845
16384    57.290  54.821  67.666 298.469  49.458  49.102  46.070  46.066

NOTE: The CUDA Samples are not meant for performance measurements. Results may vary when GPU Boost is enabled.

=========================================
  Running sample deviceQuery
=========================================

./deviceQuery Starting...

 CUDA Device Query (Runtime API) version (CUDART static linking)

Detected 1 CUDA Capable device(s)

Device 0: "Tesla T4"
  CUDA Driver Version / Runtime Version          12.2 / 11.4
  CUDA Capability Major/Minor version number:    7.5
  Total amount of global memory:                 14931 MBytes (15655829504 bytes)
  (040) Multiprocessors, (064) CUDA Cores/MP:    2560 CUDA Cores
  GPU Max Clock rate:                            1590 MHz (1.59 GHz)
  Memory Clock rate:                             5001 Mhz
  Memory Bus Width:                              256-bit
  L2 Cache Size:                                 4194304 bytes
  Maximum Texture Dimension Size (x,y,z)         1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
  Total amount of constant memory:               65536 bytes
  Total amount of shared memory per block:       49152 bytes
  Total shared memory per multiprocessor:        65536 bytes
  Total number of registers available per block: 65536
  Warp size:                                     32
  Maximum number of threads per multiprocessor:  1024
  Maximum number of threads per block:           1024
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
  Maximum memory pitch:                          2147483647 bytes
  Texture alignment:                             512 bytes
  Concurrent copy and kernel execution:          Yes with 3 copy engine(s)
  Run time limit on kernels:                     No
  Integrated GPU sharing Host Memory:            No
  Support host page-locked memory mapping:       Yes
  Alignment requirement for Surfaces:            Yes
  Device has ECC support:                        Enabled
  Device supports Unified Addressing (UVA):      Yes
  Device supports Managed Memory:                Yes
  Device supports Compute Preemption:            Yes
  Supports Cooperative Kernel Launch:            Yes
  Supports MultiDevice Co-op Kernel Launch:      Yes
  Device PCI Domain ID / Bus ID / location ID:   0 / 0 / 30
  Compute Mode:
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >

deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 12.2, CUDA Runtime Version = 11.4, NumDevs = 1
Result = PASS

=========================================
  Running sample globalToShmemAsyncCopy
=========================================

[globalToShmemAsyncCopy] - Starting...
GPU Device 0: "Turing" with compute capability 7.5

MatrixA(1280,1280), MatrixB(1280,1280)
Running kernel = 0 - AsyncCopyMultiStageLargeChunk
Computing result using CUDA Kernel...
done
Performance= 336.58 GFlop/s, Time= 12.461 msec, Size= 4194304000 Ops, WorkgroupSize= 256 threads/block
Checking computed result for correctness: Result = PASS

NOTE: The CUDA Samples are not meant for performance measurements. Results may vary when GPU Boost is enabled.

=========================================
  Running sample immaTensorCoreGemm
=========================================

Initializing...
GPU Device 0: "Turing" with compute capability 7.5

M: 4096 (16 x 256)
N: 4096 (16 x 256)
K: 4096 (16 x 256)
Preparing data for GPU...
Required shared memory size: 64 Kb
Computing... using high performance kernel compute_gemm_imma 
Time: 4.263872 ms
TOPS: 32.23

=========================================
  Running sample reductionMultiBlockCG
=========================================

reductionMultiBlockCG Starting...

GPU Device 0: "Turing" with compute capability 7.5

33554432 elements
numThreads: 1024
numBlocks: 40

Launching SinglePass Multi Block Cooperative Groups kernel
Average time: 1.158770 ms
Bandwidth:    115.827795 GB/s

GPU result = 1.992401361465
CPU result = 1.992401361465

=========================================
  Running sample shfl_scan
=========================================

Starting shfl_scan
GPU Device 0: "Turing" with compute capability 7.5

> Detected Compute SM 7.5 hardware with 40 multi-processors
Starting shfl_scan
GPU Device 0: "Turing" with compute capability 7.5

> Detected Compute SM 7.5 hardware with 40 multi-processors
Computing Simple Sum test
---------------------------------------------------
Initialize test data [1, 1, 1...]
Scan summation for 65536 elements, 256 partial sums
Partial summing 256 elements with 1 blocks of size 256
Test Sum: 65536
Time (ms): 0.028704
65536 elements scanned in 0.028704 ms -> 2283.166260 MegaElements/s
CPU verify result diff (GPUvsCPU) = 0
CPU sum (naive) took 0.030500 ms

Computing Integral Image Test on size 1920 x 1080 synthetic data
---------------------------------------------------
Method: Fast  Time (GPU Timer): 0.050784 ms Diff = 0
Method: Vertical Scan  Time (GPU Timer): 0.128256 ms 
CheckSum: 2073600, (expect 1920x1080=2073600)

=========================================
  Running sample simpleAWBarrier
=========================================

./simpleAWBarrier starting...
GPU Device 0: "Turing" with compute capability 7.5

Launching normVecByDotProductAWBarrier kernel with numBlocks = 40 blockSize = 1024
Result = PASSED
./simpleAWBarrier completed, returned OK

=========================================
  Running sample simpleAtomicIntrinsics
=========================================

simpleAtomicIntrinsics starting...
GPU Device 0: "Turing" with compute capability 7.5

Processing time: 124.762001 (ms)
simpleAtomicIntrinsics completed, returned OK

=========================================
  Running sample simpleVoteIntrinsics
=========================================

[simpleVoteIntrinsics]
GPU Device 0: "Turing" with compute capability 7.5

> GPU device has 40 Multi-Processors, SM 7.5 compute capabilities

[VOTE Kernel Test 1/3]
        Running <<Vote.Any>> kernel1 ...
        OK

[VOTE Kernel Test 2/3]
        Running <<Vote.All>> kernel2 ...
        OK

[VOTE Kernel Test 3/3]
        Running <<Vote.Any>> kernel3 ...
        OK
        Shutting down...

=========================================
  Running sample vectorAdd
=========================================

[Vector addition of 50000 elements]
Copy input data from the host memory to the CUDA device
CUDA kernel launch with 196 blocks of 256 threads
Copy output data from the CUDA device to the host memory
Test PASSED
Done

=========================================
  Running sample warpAggregatedAtomicsCG
=========================================

GPU Device 0: "Turing" with compute capability 7.5

CPU max matches GPU max

Warp Aggregated Atomics PASSED

default       nvidia-pod-x86-64                 0/1     Completed   0          60s
default       nvidia-pod-aarch64                0/1     Completed   0          54s

Events:
  Type    Reason     Age   From               Message
  ----    ------     ----  ----               -------
  Normal  Scheduled  63s   default-scheduler  Successfully assigned default/nvidia-pod to xxxxxxxxxxxxxxxx.us-west-2.compute.internal
  Normal  Pulling    63s   kubelet            Pulling image "public.ecr.aws/xxxxxxx/nvidia-smoke-test:latest"
  Normal  Pulled     56s   kubelet            Successfully pulled image "public.ecr.aws/xxxxxxx/nvidia-smoke-test:latest" in 6.825257197s (6.825268734s including waiting)
  Normal  Created    56s   kubelet            Created container nvidia-smoke-test
  Normal  Started    56s   kubelet            Started container nvidia-smoke-test

Terms of contribution:

By submitting this pull request, I agree that this contribution is dual-licensed under the terms of both the Apache License, version 2.0, and the MIT license.

Signed-off-by: Piyush Jena <[email protected]>

KCSesh · 2025-04-17T22:27:47Z

Some interesting changes here we might want to run a few extra tests on:

k8s-device-plugin:

nvidia-container-toolkit:

Add CUDA forward compatibility hook NVIDIA/nvidia-container-toolkit#948

KCSesh

See comments above for k8s-device-plugin and nvidia-container-toolkit

Signed-off-by: Piyush Jena <[email protected]>

piyush-jena added 3 commits April 15, 2025 22:19

packages: update kubernetes-1.25

1d0c190

Signed-off-by: Piyush Jena <[email protected]>

packages: update kubernetes-1.26

e72c951

Signed-off-by: Piyush Jena <[email protected]>

packages: update kubernetes-1.27

468d225

Signed-off-by: Piyush Jena <[email protected]>

piyush-jena marked this pull request as draft April 15, 2025 23:02

piyush-jena marked this pull request as ready for review April 16, 2025 21:42

koooosh approved these changes Apr 17, 2025

View reviewed changes

vigh-m approved these changes Apr 17, 2025

View reviewed changes

piyush-jena requested a review from arnaldo2792 April 17, 2025 22:25

KCSesh self-requested a review April 17, 2025 22:28

KCSesh requested changes Apr 17, 2025

View reviewed changes

packages: update ecr-credential-provider-1.32 to v1.32.2

4a812c6

Signed-off-by: Piyush Jena <[email protected]>

piyush-jena force-pushed the 3p-updates branch from ac239d1 to 4a812c6 Compare April 17, 2025 22:37

KCSesh approved these changes Apr 18, 2025

View reviewed changes

piyush-jena merged commit bc2ade2 into bottlerocket-os:develop Apr 18, 2025
2 checks passed

piyush-jena deleted the 3p-updates branch June 11, 2025 18:39

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Third party package updates #472

Third party package updates #472

Uh oh!

piyush-jena commented Apr 15, 2025 •

edited

Loading

Uh oh!

KCSesh commented Apr 17, 2025

Uh oh!

KCSesh left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Third party package updates #472

Third party package updates #472

Uh oh!

Conversation

piyush-jena commented Apr 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

KCSesh commented Apr 17, 2025

Uh oh!

KCSesh left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

piyush-jena commented Apr 15, 2025 •

edited

Loading