(base) user@desktop:/data/openwebtext$ python fetch_urls.py
Downloaded RS_2012-12.bz2
Downloaded RS_v2_2008-06.xz
Downloaded RS_2012-05.bz2
Downloaded RS_v2_2009-09.xz
Downloaded RS_v2_2007-11.xz
Downloaded RS_v2_2010-05.xz
Downloaded RS_2012-01.bz2
Downloaded RS_2020-04.zst
Downloaded RS_v2_2006-06.xz
Downloaded RS_v2_2010-02.xz
Downloaded RS_v2_2006-02.xz
Downloaded RS_2012-09.bz2
Downloaded RS_v2_2010-04.xz
Traceback (most recent call last):
File "fetch_urls.py", line 39, in <module>
main()
File "fetch_urls.py", line 33, in main
curl.perform()
pycurl.error: (18, 'transfer closed with 1265259864 bytes remaining to read')
(base) user@desktop:/data/openwebtext$