Zhe Zhang
|
ced438a4bf
|
HDFS-8899. Erasure Coding: use threadpool for EC recovery tasks on DataNode. Contributed by Rakesh R.
Change-Id: I9429706ae3c9b10a9274c07b98da6ed54cce192b
|
2015-09-15 10:43:13 -07:00 |
Andrew Wang
|
c2ebab67ac
|
HDFS-7351. Document the HDFS Erasure Coding feature. Contributed by Uma Maheswara Rao G and Zhe Zhang.
|
2015-09-15 10:16:45 -07:00 |
Vinayakumar B
|
ce02b5532c
|
HDFS-8975. Erasure coding : Fix random failure in TestSafeModeWithStripedFile (Contributed by J.Andreina)
|
2015-09-12 13:29:25 +05:30 |
|
Zhe Zhang
|
96d6b516b2
|
HDFS-8853. Erasure Coding: Provide ECSchema validation when setting EC policy. Contributed by J.Andreina.
Change-Id: I9211d9728480225a407d82e6c0bea1a928adfa11
|
2015-09-10 16:31:37 -07:00 |
Zhe Zhang
|
f62237bc2f
|
HDFS-8833. Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones.
|
2015-09-09 23:07:55 -07:00 |
Jing Zhao
|
60bd765ac1
|
HDFS-8978. Erasure coding: fix 2 failed tests of DFSStripedOutputStream. Contributed by Walter Su.
|
2015-09-02 17:41:08 -07:00 |
|
Jing Zhao
|
ddf4e78547
|
HDFS-8937. Erasure coding: do not throw exception when setting replication factor on EC files. Contributed by Gao Rui.
|
2015-09-02 11:45:45 -07:00 |
Walter Su
|
164cbe6439
|
HDFS-8909. Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature. Contributed by Jing Zhao.
|
2015-08-27 16:02:30 +08:00 |
|
Walter Su
|
067ec8c2b1
|
HDFS-8838. Erasure Coding: Tolerate datanode failures in DFSStripedOutputStream when the data length is small. Contributed by Tsz Wo Nicholas Sze.
|
2015-08-27 09:11:23 +08:00 |
|
Zhe Zhang
|
b57c9a35f7
|
HDFS-8220. Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize.
|
2015-08-14 15:16:58 -07:00 |
|
Zhe Zhang
|
1d37a88121
|
HDFS-8854. Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs. Contributed by Walter Su.
|
2015-08-13 10:04:45 -07:00 |
|
Jing Zhao
|
fbf7e81ca0
|
HDFS-8827. Erasure Coding: Fix NPE when NameNode processes over-replicated striped blocks. Contributed by Walter Su and Takuya Fukudome.
|
2015-08-07 11:25:20 -07:00 |
boli2
|
8799363db1
|
HDFS-8857. Erasure Coding: Fix ArrayIndexOutOfBoundsException in TestWriteStripedFileWithFailure. Contributed by Li Bo
|
2015-08-05 22:11:50 -04:00 |
|
Zhe Zhang
|
4de48211c6
|
HDFS-8399. Erasure Coding: unit test the behaviour of BlockManager recovery work for the deleted blocks. Contributed by Rakesh R.
|
2015-08-04 15:23:39 -07:00 |
|
Jing Zhao
|
9312b168e2
|
HDFS-8804. Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation. Contributed by Jing Zhao.
|
2015-08-03 17:03:15 -07:00 |
|
Zhe Zhang
|
ba90c02853
|
HDFS-8202. Improve end to end stirpping file test to add erasure recovering test. Contributed by Xinwei Qin.
|
2015-07-31 12:16:15 -07:00 |
|
Walter Su
|
4a72be6e0e
|
HDFS-8769. Erasure coding: unit test for SequentialBlockGroupIdGenerator. Contributed by Rakesh R.
|
2015-07-25 10:07:40 +08:00 |
|
Jing Zhao
|
95b499a367
|
HDFS-8798. Erasure Coding: fix DFSStripedInputStream/DFSStripedOutputStream re-fetch token when expired. Contributed by Walter Su.
|
2015-07-24 13:52:50 -07:00 |
|
Jing Zhao
|
c2c26e6ea7
|
HDFS-8813. Erasure Coding: Client no need to decode missing parity blocks. Contributed by Walter Su.
|
2015-07-23 11:42:02 -07:00 |
|
Jing Zhao
|
5956d23b64
|
HDFS-8781. Erasure Coding: Correctly handle BlockManager#InvalidateBlocks for striped block. Contributed by Yi Liu.
|
2015-07-21 17:00:49 -07:00 |
|
Jing Zhao
|
f8f7a923b7
|
HDFS-8760. Erasure Coding: reuse BlockReader when reading the same block in pread. Contributed by Jing Zhao.
|
2015-07-21 15:47:26 -07:00 |
|
Walter Su
|
06394e3760
|
HDFS-8433. Erasure coding: set blockToken in LocatedStripedBlock. Contributed by Walter Su.
|
2015-07-20 10:18:34 +08:00 |
|
Zhe Zhang
|
4fdd9abd7e
|
HDFS-8787. Erasure coding: rename BlockInfoContiguousUC and BlockInfoStripedUC to be consistent with trunk.
|
2015-07-15 20:13:04 -07:00 |
|
Zhe Zhang
|
7e091de136
|
HDFS-8058. Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile. Contributed by Zhe Zhang and Yi Liu.
|
2015-07-15 09:49:32 -07:00 |
yliu
|
f32d9a1758
|
HDFS-8619. Erasure Coding: revisit replica counting for striped blocks. (Jing Zhao via yliu)
|
2015-07-15 22:35:19 +08:00 |
|
Jing Zhao
|
0a93712f3b
|
HDFS-8734. Erasure Coding: fix one cell need two packets. Contributed by Walter Su.
|
2015-07-14 13:10:51 -07:00 |
|
Jing Zhao
|
6ff957be88
|
HDFS-8702. Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block. Contributed by Kai Sasaki.
|
2015-07-14 10:55:58 -07:00 |
|
Jing Zhao
|
b1e6429a6b
|
HDFS-8669. Erasure Coding: handle missing internal block locations in DFSStripedInputStream. Contributed by Jing Zhao.
|
2015-07-13 11:41:18 -07:00 |
|
boli2
|
f4098dfae4
|
HDFS-8744. Erasure Coding: the number of chunks in packet is not updated when writing parity data. Contributed by Li Bo
|
2015-07-13 00:41:36 -04:00 |
|
Jing Zhao
|
e692c7dd92
|
HDFS-8484. Erasure coding: Two contiguous blocks occupy IDs belong to same striped group. Contributed by Walter Su.
|
2015-07-09 14:07:37 -07:00 |
|
Jing Zhao
|
2470a7bf88
|
HDFS-8563. Erasure Coding: fsck handles file smaller than a full stripe. Contributed by Walter Su.
|
2015-07-09 10:55:28 -07:00 |
|
Walter Su
|
48f3830f21
|
HDFS-8719. Erasure Coding: client generates too many small packets when writing parity data. Contributed by Li Bo.
|
2015-07-09 16:18:05 +08:00 |
|
Jing Zhao
|
2c494a8436
|
HDFS-8461. Erasure coding: fix priority level of UnderReplicatedBlocks for striped block. Contributed by Walter Su.
|
2015-07-06 16:39:47 -07:00 |
|
yliu
|
ee01a09500
|
HDFS-8684. Erasure Coding: fix some block number calculation for striped block. (yliu)
|
2015-07-06 19:14:18 +08:00 |
|
Vinayakumar B
|
0b7af27b9a
|
HDFS-8468. 2 RPC calls for every file read in DFSClient#open(..) resulting in double Audit log entries (Contributed by Vinayakumar B)
|
2015-06-30 11:02:13 +05:30 |
Tsz-Wo Nicholas Sze
|
093907d728
|
HDFS-8253. DFSStripedOutputStream.closeThreads releases cellBuffers multiple times. Contributed by Kai Sasaki
|
2015-06-24 23:39:05 +08:00 |
|
Jing Zhao
|
d920cdab91
|
HDFS-8567. Erasure Coding: SafeMode handles file smaller than a full stripe. Contributed by Walter Su.
|
2015-06-23 22:29:28 -07:00 |
|
Jing Zhao
|
8c423a8163
|
HDFS-8602. Erasure Coding: Client can't read(decode) the EC files which have corrupt blocks. Contributed by Jing Zhao and Kai Sasaki.
|
2015-06-19 14:07:38 -07:00 |
|
Jing Zhao
|
448cb7df67
|
HDFS-8543. Erasure Coding: processOverReplicatedBlock() handles striped block. Contributed by Walter Su.
|
2015-06-19 11:53:05 -07:00 |
|
Jing Zhao
|
3682e01984
|
HDFS-8254. Avoid assigning a leading streamer in StripedDataStreamer to tolerate datanode failure. Contributed by Tsz Wo Nicholas Sze.
|
2015-06-19 10:23:45 -07:00 |
|
Vinayakumar B
|
05c696882e
|
HDFS-8466. Refactor BlockInfoContiguous and fix NPE in TestBlockInfo#testCopyConstructor() (Contributed by Vinayakumar B)
Missed CHANGES.txt entry
|
2015-06-18 14:19:49 +05:30 |
|
Jing Zhao
|
c12a974ccf
|
HDFS-8580. Erasure coding: Persist cellSize in BlockInfoStriped and StripedBlocksFeature. Contributed by Walter Su.
|
2015-06-17 11:35:31 -07:00 |
|
yliu
|
49d5cff490
|
HDFS-8559. Erasure Coding: fix non-protobuf fsimage for striped blocks. (Jing Zhao via yliu)
|
2015-06-14 15:39:19 +08:00 |
|
Jing Zhao
|
683332b36d
|
HDFS-8585. Erasure Coding: Remove dataBlockNum and parityBlockNum from StripedBlockProto. Contributed by Yi Liu.
|
2015-06-12 14:48:53 -07:00 |
|
Vinayakumar B
|
98d340745b
|
HDFS-8450. Erasure Coding: Consolidate erasure coding zone related implementation into a single class (Contributed by Rakesh R)
|
2015-06-11 10:48:02 +05:30 |
|
Walter Su
|
b7d6ea8e91
|
HDFS-8571. Fix TestErasureCodingCli test. Contributed by Vinayakumar B.
|
2015-06-11 10:26:07 +08:00 |
|
Vinayakumar B
|
c5d4652ded
|
HDFS-8556. Erasure Coding: Fix usage of 'createZone' (Contributed by Vinayakumar B)
|
2015-06-10 10:42:45 +05:30 |
|
Zhe Zhang
|
2eee19cd1d
|
HDFS-8460. Erasure Coding: stateful read result doesn't match data occasionally because of flawed test. Contributed by Walter Su.
|
2015-06-05 13:39:37 -07:00 |
|
Zhe Zhang
|
c0929ab3c2
|
HDFS-8319. Erasure Coding: support decoding for stateful read. Contributed by Jing Zhao.
|
2015-06-04 18:16:41 -07:00 |
|
yliu
|
a31eada33a
|
HDFS-8328. Follow-on to update decode for DataNode striped blocks reconstruction. (yliu)
|
2015-06-04 14:41:38 +08:00 |