Split a huge file in to equal parts
How to split a file in to equal parts without knowing the number of records in the input file?
Suppose you don't know how many records are in a dataset, but you want to divide the records as equal as possible among the output datasets. We can split a file into equal number parts by using ICETOOL with a small keyword SPLIT / SPLITBY. The all output files will have same number of records. The below code split the file into three equal parts.
Re: Split a huge file in to equal parts
Nominate this article for Article of the month - Jul 2009
|All times are GMT +5.5. The time now is 08:25.|