HADOOP-12558. distcp documentation is woefully out of date. Contributed by Dinesh Chitlangia.
This commit is contained in:
parent
1e15c7e855
commit
914b0cf15f
|
@ -240,6 +240,7 @@ Flag | Description | Notes
|
|||
`-skipcrccheck` | Whether to skip CRC checks between source and target paths. |
|
||||
`-blocksperchunk <blocksperchunk>` | Number of blocks per chunk. When specified, split files into chunks to copy in parallel | If set to a positive value, files with more blocks than this value will be split into chunks of `<blocksperchunk>` blocks to be transferred in parallel, and reassembled on the destination. By default, `<blocksperchunk>` is 0 and the files will be transmitted in their entirety without splitting. This switch is only applicable when the source file system implements getBlockLocations method and the target file system implements concat method. |
|
||||
`-copybuffersize <copybuffersize>` | Size of the copy buffer to use. By default, `<copybuffersize>` is set to 8192B |
|
||||
`-xtrack <path>` | Save information about missing source files to the specified path. | This option is only valid with `-update` option. This is an experimental property and it cannot be used with `-atomic` option.
|
||||
|
||||
Architecture of DistCp
|
||||
----------------------
|
||||
|
|
Loading…
Reference in New Issue