Commit Graph

11049 Commits

Author SHA1 Message Date
Zhe Zhang 1af8c14862 HDFS-7839. Erasure coding: implement facilities in NameNode to create and manage EC zones. Contributed by Zhe Zhang 2015-05-26 11:55:07 -07:00
Zhe Zhang 578019d6a2 HDFS-7936. Erasure coding: resolving conflicts in the branch when merging (this commit is for conflicts from HDFS-6945). Contributed by Zhe Zhang. 2015-05-26 11:44:47 -07:00
Kai Zheng 98ea3ec0da HADOOP-11782 Correct two thrown messages in ECSchema class. Contributed by Xinwei Qin 2015-05-26 11:44:47 -07:00
Zhe Zhang 9edc73d123 HDFS-7617. Add unit tests for editlog transactions for EC. Contributed by Hui Zheng. 2015-05-26 11:44:47 -07:00
Vinayakumar B af8eaacdb4 HDFS-8027. Erasure Coding: Update CHANGES-HDFS-7285.txt with branch commits (Vinayakumar B) 2015-05-26 11:44:46 -07:00
Jing Zhao cd655ee817 HDFS-8005. Erasure Coding: simplify striped block recovery work computation and add tests. Contributed by Jing Zhao. 2015-05-26 11:44:42 -07:00
Jing Zhao abf833a7b2 HDFS-7907. Erasure Coding: track invalid, corrupt, and under-recovery striped blocks in NameNode. Contributed by Jing Zhao. 2015-05-26 11:43:44 -07:00
Zhe Zhang 97378e4cd0 HDFS-7936. Erasure coding: resolving conflicts in the branch when merging (this commit is for HDFS-7742) 2015-05-26 11:43:43 -07:00
Zhe Zhang d9af36b9bd HADOOP-11664. Loading predefined EC schemas from configuration. Contributed by Kai Zheng. 2015-05-26 11:43:43 -07:00
Tsz-Wo Nicholas Sze 9d1175b8fb HDFS-7716. Add a test for BlockGroup support in FSImage. Contributed by Takuya Fukudome 2015-05-26 11:43:43 -07:00
Zhe Zhang ea2e60fbcc HDFS-7936. Erasure coding: resolving conflicts when merging with HDFS-7903, HDFS-7435, HDFS-7930, HDFS-7960 (this commit is for HDFS-7960) 2015-05-26 11:43:42 -07:00
Jing Zhao d0d75a8339 HDFS-7827. Erasure Coding: support striped blocks in non-protobuf fsimage. Contributed by Hui Zheng. 2015-05-26 11:43:42 -07:00
Jing Zhao 46dac3595f HDFS-7864. Erasure Coding: Update safemode calculation for striped blocks. Contributed by GAO Rui. 2015-05-26 11:43:42 -07:00
Zhe Zhang 544f75d651 HDFS-7936. Erasure coding: resolving conflicts when merging with HDFS-7903, HDFS-7435 and HDFS-7930 (this commit is for HDFS-7930 only) 2015-05-26 11:43:42 -07:00
Kai Zheng df297245a7 HADOOP-11647. Reed-Solomon ErasureCoder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Kai Zheng 90d332d6be HADOOP-11707. Add factory to create raw erasure coder. Contributed by Kai Zheng 2015-05-26 11:43:41 -07:00
Zhe Zhang 57a84c0d14 HDFS-7369. Erasure coding: distribute recovery work for striped blocks to DataNode. Contributed by Zhe Zhang. 2015-05-26 11:43:37 -07:00
Kai Zheng e3dbfeb138 Updated CHANGES-HDFS-EC-7285.txt accordingly 2015-05-26 11:42:05 -07:00
Kai Zheng c3bc083405 HADOOP-11706 Refine a little bit erasure coder API 2015-05-26 11:42:04 -07:00
Jing Zhao a38a37c634 HDFS-7912. Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks. Contributed by Jing Zhao. 2015-05-26 11:41:59 -07:00
Jing Zhao 26773d9d6c HDFS-7826. Erasure Coding: Update INodeFile quota computation for striped blocks. Contributed by Kai Sasaki. 2015-05-26 11:32:26 -07:00
Jing Zhao 11585883a9 HDFS-7936. Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435. Contributed by Zhe Zhang. 2015-05-26 11:32:26 -07:00
Kai Zheng 68caf8728e Fixed a compiling issue introduced by HADOOP-11705. 2015-05-26 11:32:26 -07:00
drankye 292e367d07 HADOOP-11705. Make erasure coder configurable. Contributed by Kai Zheng 2015-05-26 11:32:25 -07:00
Jing Zhao f05c21285e HDFS-7853. Erasure coding: extend LocatedBlocks to support reading from striped files. Contributed by Jing Zhao. 2015-05-26 11:32:25 -07:00
Vinayakumar B 8f89d7489d HADOOP-11646. Erasure Coder API for encoding and decoding of block group ( Contributed by Kai Zheng ) 2015-05-26 11:32:25 -07:00
Jing Zhao 39a0a85fb7 HDFS-7872. Erasure Coding: INodeFile.dumpTreeRecursively() supports to print striped blocks. Contributed by Takuya Fukudome. 2015-05-26 11:32:25 -07:00
drankye c0945a8971 HADOOP-11643. Define EC schema API for ErasureCodec. Contributed by Kai Zheng 2015-05-26 11:32:24 -07:00
Jing Zhao 1e1e930407 HDFS-7837. Erasure Coding: allocate and persist striped blocks in NameNode. Contributed by Jing Zhao. 2015-05-26 11:32:20 -07:00
Zhe Zhang 9af1f4779b Addendum fix for HDFS-7749 to be compatible with HDFS-7993 2015-05-26 11:07:16 -07:00
Jing Zhao 9f2f583f40 HDFS-7749. Erasure Coding: Add striped block support in INodeFile. Contributed by Jing Zhao. 2015-05-26 11:07:15 -07:00
drankye dae27f6dd1 HADOOP-11542. Raw Reed-Solomon coder in pure Java. Contributed by Kai Zheng 2015-05-26 11:07:15 -07:00
Jing Zhao ba93714920 HDFS-7716. Erasure Coding: extend BlockInfo to handle EC info. Contributed by Jing Zhao. 2015-05-26 11:07:11 -07:00
Kai Zheng b29f3bde4d HADOOP-11541. Raw XOR coder 2015-05-26 11:03:35 -07:00
Vinayakumar B 9f19eb9fcf HADOOP-11534. Minor improvements for raw erasure coders ( Contributed by Kai Zheng ) 2015-05-26 11:03:35 -07:00
Uma Maheswara Rao G e50bcea83d HADOOP-11514. Raw Erasure Coder API for concrete encoding and decoding (Kai Zheng via umamahesh) 2015-05-26 11:03:35 -07:00
Jing Zhao ec48013426 Fix Compilation Error in TestAddBlockgroup.java after the merge 2015-05-26 11:03:34 -07:00
Zhe Zhang 0c1da5a030 HDFS-7652. Process block reports for erasure coded blocks. Contributed by Zhe Zhang 2015-05-26 11:03:34 -07:00
Zhe Zhang bc2833b1c9 HDFS-7339. Allocating and persisting block groups in NameNode. Contributed by Zhe Zhang 2015-05-26 11:03:34 -07:00
Vinayakumar B f166e67a23 HDFS-7347. Configurable erasure coding policy for individual files and directories ( Contributed by Zhe Zhang ) 2015-05-26 11:03:34 -07:00
Tsuyoshi Ozawa 022f49d59e MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi. 2015-05-26 23:59:02 +09:00
Tsuyoshi Ozawa 9a3d617b63 YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka. 2015-05-26 19:07:40 +09:00
Akira Ajisaka 56996a685e HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru. 2015-05-26 16:16:21 +09:00
Xuan 39077dba2e YARN-2238. Filtering on UI sticks even if I move away from the page.
Contributed by Jian He
2015-05-25 22:39:16 -07:00
Haohui Mai ada233b7cd HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang. 2015-05-24 22:30:32 -07:00
Jian He 446d51591e YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan 2015-05-22 15:58:22 -07:00
Xuan 455b3acf0e YARN-3701. Isolating the error of generating a single app report when
getting all apps from generic history service. Contributed by Zhijie
Shen
2015-05-22 14:34:39 -07:00
Colin Patrick Mccabe f34638399a HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe) 2015-05-22 12:51:03 -07:00
Tsuyoshi Ozawa b27ce3c531 MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS. 2015-05-22 23:29:53 +09:00
Vinayakumar B 55ed6558ba HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) 2015-05-22 16:45:19 +05:30