Skip to content

Commit ba40331

Browse files
committed
minor correction - space/table update
1 parent a6d27e1 commit ba40331

File tree

1 file changed

+12
-15
lines changed

1 file changed

+12
-15
lines changed

โ€Žbeginner_source/ddp_series_theory.rst

+12-15
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ Authors: `Suraj Subramanian <https://github.com/suraj813>`__
2323

2424
* ํŒŒ์ดํ† ์น˜ `๋น„๋ถ„์‚ฐ ํ•™์Šต <https://tutorials.pytorch.kr/beginner/basics/quickstart_tutorial.html>`__ ์— ์ต์ˆ™ํ•  ๊ฒƒ
2525

26-
์•„๋ž˜์˜ ์˜์ƒ์ด๋‚˜ `์œ ํˆฌ๋ธŒ ์˜์ƒ youtube <https://www.youtube.com/watch/Cvdhwx-OBBo>`__์„ ๋”ฐ๋ผ ์ง„ํ–‰ํ•˜์„ธ์š”.
26+
์•„๋ž˜์˜ ์˜์ƒ์ด๋‚˜ `์œ ํˆฌ๋ธŒ ์˜์ƒ youtube <https://www.youtube.com/watch/Cvdhwx-OBBo>`__ ์„ ๋”ฐ๋ผ ์ง„ํ–‰ํ•˜์„ธ์š”.
2727

2828
.. raw:: html
2929

@@ -47,20 +47,17 @@ Authors: `Suraj Subramanian <https://github.com/suraj813>`__
4747
`DP <https://pytorch.org/docs/stable/generated/torch.nn.DataParallel.html>`__ ๋Š” ๋ฐ์ดํ„ฐ ๋ณ‘๋ ฌ ์ฒ˜๋ฆฌ์˜ ์ด์ „ ์ ‘๊ทผ ๋ฐฉ์‹์ž…๋‹ˆ๋‹ค.
4848
DP ๋Š” ๊ฐ„๋‹จํ•˜์ง€๋งŒ, (ํ•œ ์ค„๋งŒ ์ถ”๊ฐ€ํ•˜๋ฉด ๋จ) ์„ฑ๋Šฅ์€ ํ›จ์”ฌ ๋–จ์–ด์ง‘๋‹ˆ๋‹ค. DDP๋Š” ์•„๋ž˜์™€ ๊ฐ™์€ ๋ฐฉ์‹์œผ๋กœ ์•„ํ‚คํ…์ฒ˜๋ฅผ ๊ฐœ์„ ํ•ฉ๋‹ˆ๋‹ค.
4949

50-
+-------------------------------------+------------------------------+
51-
| ``DataParallel`` | ``DistributedDataParallel`` |
52-
+=====================================+==============================+
53-
| ์ž‘์—… ๋ถ€ํ•˜๊ฐ€ ํผ; ์ „ํŒŒ๋  ๋•Œ๋งˆ๋‹ค | ๋ชจ๋ธ์ด ํ•œ ๋ฒˆ๋งŒ ๋ณต์ œ๋จ |
54-
| ๋ชจ๋ธ์ด ๋ณต์ œ ๋ฐ ์‚ญ์ œ๋จ | |
55-
+-------------------------------------+------------------------------+
56-
| ๋‹จ์ผ ๋…ธ๋“œ ๋ณ‘๋ ฌ ์ฒ˜๋ฆฌ๋งŒ ๊ฐ€๋Šฅ | ์—ฌ๋Ÿฌ ๋จธ์‹ ์œผ๋กœ ํ™•์žฅ ๊ฐ€๋Šฅ |
57-
| | |
58-
+-------------------------------------+------------------------------+
59-
| ๋А๋ฆผ; ๋‹จ์ผ ํ”„๋กœ์„ธ์Šค์—์„œ ๋ฉ€ํ‹ฐ ์Šค๋ ˆ๋”ฉ | ๋น ๋ฆ„ (no GIL contention) |
60-
| (multithreading)์„ ์‚ฌ์šฉํ•˜๊ธฐ ๋•Œ๋ฌธ์— | ๋ฉ€ํ‹ฐ ํ”„๋กœ์„ธ์‹ฑ์„ ์‚ฌ์šฉํ•˜๊ธฐ ๋•Œ๋ฌธ์— GIL |
61-
| Global Interpreter Lock (GIL) | ์ถฉ๋Œ ์—†์Œ |
62-
| ์ถฉ๋Œ์ด ๋ฐœ์ƒ | |
63-
+-------------------------------------+------------------------------+
50+
.. list-table::
51+
:header-rows: 1
52+
53+
* - ``DataParallel``
54+
- ``DistributedDataParallel``
55+
* - ์ž‘์—… ๋ถ€ํ•˜๊ฐ€ ํผ; ์ „ํŒŒ๋  ๋•Œ๋งˆ๋‹ค ๋ชจ๋ธ์ด ๋ณต์ œ ๋ฐ ์‚ญ์ œ๋จ
56+
- ๋ชจ๋ธ์ด ํ•œ ๋ฒˆ๋งŒ ๋ณต์ œ๋จ
57+
* - ๋‹จ์ผ ๋…ธ๋“œ ๋ณ‘๋ ฌ ์ฒ˜๋ฆฌ๋งŒ ๊ฐ€๋Šฅ
58+
- ์—ฌ๋Ÿฌ ๋จธ์‹ ์œผ๋กœ ํ™•์žฅ ๊ฐ€๋Šฅ
59+
* - ๋А๋ฆผ; ๋‹จ์ผ ํ”„๋กœ์„ธ์Šค์—์„œ ๋ฉ€ํ‹ฐ ์Šค๋ ˆ๋”ฉ์„ ์‚ฌ์šฉํ•˜๊ธฐ ๋•Œ๋ฌธ์— Global Interpreter Lock (GIL) ์ถฉ๋Œ์ด ๋ฐœ์ƒ
60+
- ๋น ๋ฆ„; ๋ฉ€ํ‹ฐ ํ”„๋กœ์„ธ์‹ฑ์„ ์‚ฌ์šฉํ•˜๊ธฐ ๋•Œ๋ฌธ์— GIL ์ถฉ๋Œ ์—†์Œ
6461

6562

6663
์ฝ์„๊ฑฐ๋ฆฌ

0 commit comments

Comments
ย (0)