超大文件打不开,分割下
时间:2018-03-30 12:08:53
收藏:0
阅读:230
同事说大文本文件打不开,写个程序分割下就行了啊。。。
#!/usr/bin/env python3
# -*- coding:utf-8 -*-
# author: edit by infaaf
# mail: infaaf@126.com
# split big file per 10000
with open(‘source.txt‘) as f:
linenum = 1
filenum=1
for line in f:
if linenum >3:
linenum=1
filenum+=1
with open(‘sourcesplit_%s‘%filenum,‘a‘) as outf:
outf.write(line.strip()+"\n")
print("linenum: %s, filenum: %s"%(linenum,filenum))
print(line.strip())
linenum+=1原文:http://blog.51cto.com/13606158/2092860
评论(0)