Commit Graph

11994 Commits

Author SHA1 Message Date
Haohui Mai 715b9c6499 HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-09-04 11:45:31 -07:00
Jing Zhao 8928729c80 HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 2015-09-04 11:42:22 -07:00
Haohui Mai d16c4eee18 HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-09-04 10:41:09 -07:00
Jason Lowe 6eaca2e363 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 2015-09-04 15:30:53 +00:00
Varun Vasudev 40d222e862 YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles. 2015-09-04 14:31:51 +05:30
Andrew Wang c83d13c649 HDFS-9021. Use a yellow elephant rather than a blue one in diagram. 2015-09-03 16:27:20 -07:00
Haohui Mai ed78b14ebc HDFS-9002. Move o.a.h.hdfs.net/*Peer classes to hdfs-client. Contributed by Mingliang Liu. 2015-09-03 15:32:53 -07:00
Jakob Homan c2d2c1802a HDFS-8939. Test(S)WebHdfsFileContextMainOperations failing on branch-2. Contributed by Chris Nauroth.
(cherry picked from commit 9871f57d41)
2015-09-03 13:26:54 -07:00
Colin Patrick Mccabe 53c38cc89a HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe) 2015-09-03 11:22:47 -07:00
Arpit Agarwal 524ba8708b HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:47 -07:00
Tsuyoshi Ozawa 0ebc658105 HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 2015-09-03 23:32:42 +09:00
Tsuyoshi Ozawa 355eaaa33d HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan. 2015-09-03 22:48:53 +09:00
Tsuyoshi Ozawa 9a87f81ce6 HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. 2015-09-03 22:34:25 +09:00
Varun Vasudev b469ac531a YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R. 2015-09-03 16:40:10 +05:30
Akira Ajisaka c92e31bd65 HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar. 2015-09-03 19:40:34 +09:00
Jian He 09c64ba1ba YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 2015-09-02 17:45:23 -07:00
Jing Zhao 60bd765ac1 HDFS-8978. Erasure coding: fix 2 failed tests of DFSStripedOutputStream. Contributed by Walter Su. 2015-09-02 17:41:08 -07:00
Ming Ma d31a41c359 HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) 2015-09-02 15:55:42 -07:00
Jing Zhao de928d566a HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee. 2015-09-02 15:19:04 -07:00
Andrew Wang afc88b396f HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton. 2015-09-02 13:46:00 -07:00
Colin Patrick Mccabe c006c3a1e6 HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe) 2015-09-02 12:36:14 -07:00
Jing Zhao ddf4e78547 HDFS-8937. Erasure coding: do not throw exception when setting replication factor on EC files. Contributed by Gao Rui. 2015-09-02 11:45:45 -07:00
Rohith Sharma K S 7d6687fe76 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 2015-09-02 15:22:48 +05:30
Rohith Sharma K S 095ab9ab5f YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks) 2015-09-02 14:13:33 +05:30
Akira Ajisaka 65ccf2b125 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 2015-09-02 14:28:38 +09:00
Akira Ajisaka 00804e2457 Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
This reverts commit 75a2560e51.
2015-09-02 12:22:16 +09:00
yliu 5652131d2e HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 08:58:51 +08:00
Zhe Zhang 53358fe680 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 2015-09-01 14:48:37 -07:00
Zhe Zhang ab56fcdb12 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 2015-09-01 14:30:25 -07:00
Vinod Kumar Vavilapalli 4620767156 YARN-3222. Added the missing CHANGES.txt entry. 2015-09-01 13:43:10 -07:00
Andrew Wang 0eb9b19325 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder. 2015-09-01 10:57:32 -07:00
Tsuyoshi Ozawa dd149adeac HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun. 2015-09-02 02:01:51 +09:00
Akira Ajisaka 2e251a7674 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 2015-09-01 20:55:33 +09:00
Tsuyoshi Ozawa faa38e1aa4 YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R. 2015-09-01 17:54:49 +09:00
Varun Vasudev bf669b6d9f YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan. 2015-09-01 14:19:11 +05:30
yliu f4d96be6c6 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:20:56 +08:00
Andrew Wang 7ad3556ed3 HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. 2015-08-31 18:17:14 -07:00
Colin Patrick Mccabe 24f6a7c956 HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe) 2015-08-31 18:06:30 -07:00
yliu 8fa41d9dd4 HDFS-8946. Improve choosing datanode storage for block placement. (yliu) 2015-09-01 08:52:50 +08:00
Jian He 4eaa7fd3ea Move YARN-4092 to 2.7.2 2015-08-31 17:43:36 -07:00
Jian He a3fd2ccc86 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 2015-08-31 17:33:24 -07:00
Haohui Mai 826ae1c26d HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu. 2015-08-31 13:54:14 -07:00
Jing Zhao caa04de149 HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao. 2015-08-31 11:48:09 -07:00
Vinod Kumar Vavilapalli cf831565e8 YARN-2945. Fixing the CHANGES.txt to have the right JIRA number. 2015-08-30 20:01:47 -07:00
Jakob Homan 837fb75e8e HDFS-8155. Support OAuth2 in WebHDFS. 2015-08-29 18:37:05 -07:00
Lei Xu 6ab2d19f5c HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:59:30 -07:00
Arpit Agarwal bdbe53c676 HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:52:37 -07:00
Haohui Mai e2c9b288b2 HDFS-8925. Move BlockReaderLocal to hdfs-client. Contributed by Mingliang Liu. 2015-08-28 14:38:36 -07:00
Colin Patrick Mccabe b94b56806d HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list (Daniel Templeton) 2015-08-28 14:21:46 -07:00
Haohui Mai 6d12cd8d60 HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu. 2015-08-28 14:14:32 -07:00