sorting - Unix Sort Merge Workaround -


i have around five-hundred 23m files of data trying sort 1 database. have sorted them individually using sort, , trying merge them using sort --merge, whole sample sorted together. plan split them five-hundred files again.

the issue running drive congested, , have 805gb available according df. when run sort --merge file1 file2 file3... receive error sort has failed due no more space left on drive.

are there tips how work around or solve issue, or solution free more space?

as comments say, sounds /tmp partition filling up. try sort -t . --merge file1 file2 file3 change directory (and partition) sort uses temporary storage.


Comments

Popular posts from this blog

java - Date formats difference between yyyy-MM-dd'T'HH:mm:ss and yyyy-MM-dd'T'HH:mm:ssXXX -

c# - Get rid of xmlns attribute when adding node to existing xml -