Skip to content

Commit 199e4a2

Browse files
chore: fixed readme doubling
1 parent af62701 commit 199e4a2

File tree

1 file changed

+0
-30
lines changed

1 file changed

+0
-30
lines changed

README.md

Lines changed: 0 additions & 30 deletions
Original file line numberDiff line numberDiff line change
@@ -120,36 +120,6 @@ mysql -h 127.0.0.1 -usgarland -ppassword test -e 0.02s user 0.01s system 0% cp
120120

121121
Or, in terms of ratios, using chunking is approximately 3x as fast as the baseline, while loading a CSV is approximately 4x as fast as the baseline.
122122

123-
```
124-
# baseline
125-
❯ time mysql -h localhost -usgarland -ppassword test < test.sql
126-
mysql -h localhost -usgarland -ppassword test < test.sql 32.75s user 10.90s system 14% cpu 4:55.91 total
127-
# no unique checks
128-
❯ time mysql -h localhost -usgarland -ppassword test < test.sql
129-
mysql -h localhost -usgarland -ppassword test < test.sql 25.11s user 8.67s system 14% cpu 3:48.38 total
130-
# no unique checks, single insert, 1 gb buffer size
131-
❯ time mysql -h localhost -usgarland -ppassword --max-allowed-packet=1073741824 test < test.sql
132-
mysql -h localhost -usgarland -ppassword --max-allowed-packet=1073741824 test 10.64s user 0.91s system 7% cpu 2:28.29 total
133-
```
134-
135-
### Loading data
136-
137-
For MySQL, if you have access to the host (i.e. not DBaaS), by far the fastest method to load data is by using [LOAD DATA INFILE](https://dev.mysql.com/doc/refman/8.0/en/load-data.html). To do this, you first need to create the table. GenSQL generates a table definition separately from the data CSV, named `tbl_create.sql`. You can use the `mysql` client to create the table like so:
138-
139-
```shell
140-
mysql -h $HOST -u $USER -p $SCHEMA < tbl_create.sql
141-
```
142-
143-
And then, from within the `mysql` client:
144-
145-
```mysql
146-
mysql> LOAD DATA INFILE '/path/to/your/file.csv' INTO TABLE $TABLE_NAME FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY "'" IGNORE 1 LINES;
147-
Query OK, 1000 rows affected (1.00 sec)
148-
Records: 1000 Deleted: 0 Skipped: 0 Warnings: 0
149-
```
150-
151-
Otherwise, you can use the same method for `tbl_create.sql` for the entirety of the data load. It will be significantly slower, but with `autocommit=0` (set for you by default), it's manageable.
152-
153123
## Benchmarks
154124

155125
**NOTE: THESE ARE NOT CURRENT, AND SHOULD NOT BE RELIED ON**

0 commit comments

Comments
 (0)