1.分割 -- split命令
可以指定按行数分割和按字节大小分割两种模式。
(1) 按行数分割
$ split -l 300 large_file.txt new_file_prefix
加上-d,使用数字后缀;加上--verbose,显示分割进度:
$ split -l50000 -d large_file.txt part_ --verbose
(2) 按字节大小分割
$ split -b 10m large_file.log new_file_prefix
2.合并 -- cat命令
$ cat part_* > merge_file.txt
[注] split命令语法:
$ split --h Usage: split [OPTION]... [FILE [PREFIX]] Output pieces of FILE to PREFIXaa, PREFIXab, ...; default size is 1000 lines, and default PREFIX is 'x'. With no FILE, or when FILE is -, read standard input. Mandatory arguments to long options are mandatory for short options too. -a, --suffix-length=N generate suffixes of length N (default 2) 后缀名称的长度 (默认为2) --additional-suffix=SUFFIX append an additional SUFFIX to file names -b, --bytes=SIZE put SIZE bytes per output file 每个输出文件的字节大小 -C, --line-bytes=SIZE put at most SIZE bytes of records per output file 每个输出文件每行的最大字节大小 -d use numeric suffixes starting at 0, not alphabetic 使用数字后缀代替字母后缀 --numeric-suffixes[=FROM] same as -d, but allow setting the start value -e, --elide-empty-files do not generate empty output files with '-n' 不产生空的输出文件 --filter=COMMAND write to shell COMMAND; file name is $FILE 写入到shell命令行 -l, --lines=NUMBER put NUMBER lines/records per output file 设定每个输出文件的行数,默认行数是1000行 -n, --number=CHUNKS generate CHUNKS output files; see explanation below 产生chunks文件 -t, --separator=SEP use SEP instead of newline as the record separator; 使用新字符分割 '