Jing Zhao
|
1a8139e6ad
|
Fix merge conflicts.
|
2015-05-26 11:59:55 -07:00 |
|
Jing Zhao
|
9593776e34
|
HDFS-8235. Erasure Coding: Create DFSStripedInputStream in DFSClient#open. Contributed by Kai Sasaki.
|
2015-05-26 11:59:55 -07:00 |
Vinayakumar B
|
5eb17e5726
|
HDFS-8189. ClientProtocol#createErasureCodingZone API was wrongly annotated as Idempotent (Contributed by Vinayakumar B)
|
2015-05-26 11:59:55 -07:00 |
|
Vinayakumar B
|
f9eb95c31d
|
HDFS-8230. Erasure Coding: Ignore DatanodeProtocol#DNA_ERASURE_CODING_RECOVERY commands from standbynode if any (Contributed by Vinayakumar B)
|
2015-05-26 11:59:54 -07:00 |
Zhe Zhang
|
89d3378578
|
HDFS-8033. Erasure coding: stateful (non-positional) read from files in striped layout. Contributed by Zhe Zhang.
|
2015-05-26 11:59:54 -07:00 |
|
Zhe Zhang
|
f5d4a95ef5
|
HDFS-8228. Erasure Coding: SequentialBlockGroupIdGenerator#nextValue may cause block id conflicts. Contributed by Jing Zhao.
|
2015-05-26 11:59:54 -07:00 |
|
Jing Zhao
|
3f2c6938f1
|
HDFS-8223. Should calculate checksum for parity blocks in DFSStripedOutputStream. Contributed by Yi Liu.
|
2015-05-26 11:59:54 -07:00 |
|
Jing Zhao
|
eb612b0b70
|
HDFS-8233. Fix DFSStripedOutputStream#getCurrentBlockGroupBytes when the last stripe is at the block group boundary. Contributed by Jing Zhao.
|
2015-05-26 11:59:53 -07:00 |
Kai Zheng
|
fcd54ecce2
|
HDFS-8136. Client gets and uses EC schema when reads and writes a stripping file. Contributed by Kai Sasaki
|
2015-05-26 11:59:53 -07:00 |
|
Zhe Zhang
|
e8df2581c3
|
HDFS-8156. Add/implement necessary APIs even we just have the system default schema. Contributed by Kai Zheng.
|
2015-05-26 11:59:53 -07:00 |
Uma Maheswara Rao G
|
014d8675c5
|
HDFS-8024. Erasure Coding: ECworker frame, basics, bootstraping and configuration. (Contributed by Uma Maheswara Rao G)
|
2015-05-26 11:59:52 -07:00 |
|
Zhe Zhang
|
2f11109bb0
|
HDFS-8212. DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver. Contributed by Tsz Wo Nicholas Sze.
|
2015-05-26 11:59:52 -07:00 |
|
Zhe Zhang
|
e9d85bbf30
|
HDFS-8216. TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader. Contributed by Tsz Wo Nicholas Sze.
|
2015-05-26 11:59:52 -07:00 |
Tsz-Wo Nicholas Sze
|
e107886d6f
|
HDFS-8190. StripedBlockUtil.getInternalBlockLength may have overflow error.
|
2015-05-26 11:59:52 -07:00 |
|
Zhe Zhang
|
922631f04f
|
HDFS-8188. Erasure coding: refactor client-related code to sync with HDFS-8082 and HDFS-8169. Contributed by Zhe Zhang.
|
2015-05-26 11:59:51 -07:00 |
|
Vinayakumar B
|
dfba46ab57
|
HDFS-8181. createErasureCodingZone sets retryCache state as false always (Contributed by Uma Maheswara Rao G)
|
2015-05-26 11:59:51 -07:00 |
|
Vinayakumar B
|
a1c9425265
|
HDFS-8146. Protobuf changes for BlockECRecoveryCommand and its fields for making it ready for transfer to DN (Contributed by Uma Maheswara Rao G)
|
2015-05-26 11:59:51 -07:00 |
|
Jing Zhao
|
f6e1160ef1
|
HDFS-8145. Fix the editlog corruption exposed by failed TestAddStripedBlocks. Contributed by Jing Zhao.
|
2015-05-26 11:59:46 -07:00 |
|
Jing Zhao
|
ab76e1fe36
|
HDFS-7937. Erasure Coding: INodeFile quota computation unit tests. Contributed by Kai Sasaki.
|
2015-05-26 11:59:13 -07:00 |
|
Jing Zhao
|
cd458c38a0
|
HDFS-8166. DFSStripedOutputStream should not create empty blocks. Contributed by Jing Zhao.
|
2015-05-26 11:59:13 -07:00 |
|
Zhe Zhang
|
64f8f0a145
|
HDFS-8167. BlockManager.addBlockCollectionWithCheck should check if the block is a striped block. Contributed by Hui Zheng.
|
2015-05-26 11:59:12 -07:00 |
|
Tsz-Wo Nicholas Sze
|
4c039b0876
|
HDFS-7994. Detect if resevered EC Block ID is already used during namenode startup. Contributed by Hui Zheng
|
2015-05-26 11:59:12 -07:00 |
|
Jing Zhao
|
5e8837dd6c
|
HDFS-8120. Erasure coding: created util class to analyze striped block groups. Contributed by Zhe Zhang and Li Bo.
|
2015-05-26 11:59:12 -07:00 |
|
Vinayakumar B
|
ceb3d1c170
|
HDFS-7349. Support DFS command for the EC encoding (Contributed by Vinayakumar B)
|
2015-05-26 11:59:11 -07:00 |
|
Vinayakumar B
|
2c277802c1
|
HDFS-8027. Erasure Coding: Update CHANGES-HDFS-7285.txt with branch commits (Vinayakumar B)
|
2015-05-26 11:59:11 -07:00 |
|
Vinayakumar B
|
04c23d95d0
|
HDFS-8123. Erasure Coding: Better to move EC related proto messages to a separate erasurecoding proto file (Contrubuted by Rakesh R)
|
2015-05-26 11:59:11 -07:00 |
|
Zhe Zhang
|
3b56a5aa9e
|
HDFS-8114. Erasure coding: Add auditlog FSNamesystem#createErasureCodingZone if this operation fails. Contributed by Rakesh R.
|
2015-05-26 11:59:10 -07:00 |
|
Zhe Zhang
|
a32c4dc38a
|
HDFS-8122. Erasure Coding: Support specifying ECSchema during creation of ECZone. Contributed by Vinayakumar B.
|
2015-05-26 11:59:06 -07:00 |
|
Zhe Zhang
|
35797b0889
|
HDFS-7936. Erasure coding: resolving conflicts in the branch when merging trunk changes (this commit mainly addresses HDFS-8081 and HDFS-8048. Contributed by Zhe Zhang.
|
2015-05-26 11:58:40 -07:00 |
|
Vinayakumar B
|
f53e402635
|
HDFS-8090. Erasure Coding: Add RPC to client-namenode to list all ECSchemas loaded in Namenode. (Contributed by Vinayakumar B)
|
2015-05-26 11:58:40 -07:00 |
|
Kai Zheng
|
4970f2a2ab
|
HDFS-7889 Subclass DFSOutputStream to support writing striping layout files. Contributed by Li Bo
|
2015-05-26 11:58:40 -07:00 |
|
Jing Zhao
|
4d0bc724f2
|
HDFS-8077. Erasure coding: fix bugs in EC zone and symlinks. Contributed by Jing Zhao and Zhe Zhang.
|
2015-05-26 11:58:32 -07:00 |
|
Kai Zheng
|
c4a0d88366
|
HDFS-8104 Make hard-coded values consistent with the system default schema first before remove them. Contributed by Kai Zheng
|
2015-05-26 11:55:17 -07:00 |
|
Kai Zheng
|
1a37b0fe9a
|
HDFS-8074 Define a system-wide default EC schema. Contributed by Kai Zheng
|
2015-05-26 11:55:16 -07:00 |
|
Vinayakumar B
|
2ca3e38feb
|
HDFS-8023. Erasure Coding: retrieve eraure coding schema for a file from NameNode (Contributed by Vinayakumar B)
Added missed file
|
2015-05-26 11:55:16 -07:00 |
|
Vinayakumar B
|
16484f0030
|
HDFS-8023. Erasure Coding: retrieve eraure coding schema for a file from NameNode (Contributed by Vinayakumar B)
|
2015-05-26 11:55:16 -07:00 |
|
Zhe Zhang
|
bff59392ee
|
HDFS-7782. Erasure coding: pread from files in striped layout. Contributed by Zhe Zhang and Jing Zhao
|
2015-05-26 11:55:15 -07:00 |
|
Zhe Zhang
|
91c741a2a1
|
HDFS-7782. Erasure coding: pread from files in striped layout. Contributed by Zhe Zhang and Jing Zhao
|
2015-05-26 11:55:15 -07:00 |
|
Vinayakumar B
|
aac73c21c3
|
HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang.
Updated CHANGES-HDFS-EC-7285.txt
|
2015-05-26 11:55:15 -07:00 |
|
Vinayakumar B
|
d25ca09cf6
|
HADOOP-11782 Correct two thrown messages in ECSchema class. Contributed by Xinwei Qin
Updated CHANGES-HDFS-EC-7285.txt
|
2015-05-26 11:55:14 -07:00 |
|
Zhe Zhang
|
146ce7a978
|
HDFS-7969. Erasure coding: NameNode support for lease recovery of striped block groups. Contributed by Zhe Zhang.
|
2015-05-26 11:55:14 -07:00 |
|
Zhe Zhang
|
c243319eab
|
HDFS-7936. Erasure coding: resolving conflicts in the branch when merging trunk changes (this commit is for HDFS-8035). Contributed by Zhe Zhang
|
2015-05-26 11:55:13 -07:00 |
|
Zhe Zhang
|
e54a74b566
|
HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang.
|
2015-05-26 11:55:13 -07:00 |
|
Zhe Zhang
|
1af8c14862
|
HDFS-7839. Erasure coding: implement facilities in NameNode to create and manage EC zones. Contributed by Zhe Zhang
|
2015-05-26 11:55:07 -07:00 |
|
Zhe Zhang
|
578019d6a2
|
HDFS-7936. Erasure coding: resolving conflicts in the branch when merging (this commit is for conflicts from HDFS-6945). Contributed by Zhe Zhang.
|
2015-05-26 11:44:47 -07:00 |
|
Zhe Zhang
|
9edc73d123
|
HDFS-7617. Add unit tests for editlog transactions for EC. Contributed by Hui Zheng.
|
2015-05-26 11:44:47 -07:00 |
Vinayakumar B
|
af8eaacdb4
|
HDFS-8027. Erasure Coding: Update CHANGES-HDFS-7285.txt with branch commits (Vinayakumar B)
|
2015-05-26 11:44:46 -07:00 |
|
Jing Zhao
|
cd655ee817
|
HDFS-8005. Erasure Coding: simplify striped block recovery work computation and add tests. Contributed by Jing Zhao.
|
2015-05-26 11:44:42 -07:00 |
|
Jing Zhao
|
abf833a7b2
|
HDFS-7907. Erasure Coding: track invalid, corrupt, and under-recovery striped blocks in NameNode. Contributed by Jing Zhao.
|
2015-05-26 11:43:44 -07:00 |
|
Zhe Zhang
|
97378e4cd0
|
HDFS-7936. Erasure coding: resolving conflicts in the branch when merging (this commit is for HDFS-7742)
|
2015-05-26 11:43:43 -07:00 |