使用python 3将大型csv文件转换为excel

这是我的代码隐蔽csv文件到xlsx文件，对于小尺寸的CSV文件这个代码工作正常，但是当我尝试更大的CSV文件，它显示一个错误。

import os import glob import csv from xlsxwriter.workbook import Workbook for csvfile in glob.glob(os.path.join('.', 'file.csv')): workbook = Workbook(csvfile[:-4] + '.xlsx') worksheet = workbook.add_worksheet() with open(csvfile, 'r', encoding='utf8') as f: reader = csv.reader(f) for r, row in enumerate(reader): for c, col in enumerate(row): worksheet.write(r, c, col) workbook.close() 

错误是

 File "CsvToExcel.py", line 12, in <module> for r, row in enumerate(reader): _csv.Error: field larger than field limit (131072) Exception ignored in: <bound method Workbook.__del__ of <xlsxwriter.workbook.Workbook object at 0x7fff4e731470>> Traceback (most recent call last): File "/usr/local/lib/python3.5/dist-packages/xlsxwriter/workbook.py", line 153, in __del__ Exception: Exception caught in workbook destructor. Explicit close() may be required for workbook. 

Answer 1

在使用大文件时，最好使用'constant_memory'来控制内存的使用，如：

 workbook = Workbook(csvfile + '.xlsx', {'constant_memory': True}). 

Ref： xlsxwriter.readthedocs.org/en/latest/working_with_memory.htm l