Commit Graph

9955 Commits

Author SHA1 Message Date
Akira Ajisaka 772fe0f478 HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar.
(cherry picked from commit c92e31bd65)
2015-09-03 19:41:36 +09:00
Jian He cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
(cherry picked from commit 09c64ba1ba)
2015-09-02 17:46:04 -07:00
Ming Ma f81d12668f HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma)
(cherry picked from commit d31a41c359)
2015-09-02 15:57:55 -07:00
Jing Zhao 1d56325a80 HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee.
(cherry picked from commit de928d566a)
2015-09-02 15:19:29 -07:00
Andrew Wang e1943e4471 HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton.
(cherry picked from commit afc88b396f)
2015-09-02 13:49:23 -07:00
Colin Patrick Mccabe 5e4bc2640d HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe)
(cherry picked from commit c006c3a1e6)
2015-09-02 12:47:00 -07:00
Rohith Sharma K S 6e41aa64a5 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)
(cherry picked from commit 7d6687fe76)
2015-09-02 15:27:33 +05:30
Rohith Sharma K S 7ecdf51441 YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks)
(cherry picked from commit 095ab9ab5f)
2015-09-02 14:28:50 +05:30
Akira Ajisaka 25efccba01 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 65ccf2b125)
2015-09-02 14:30:23 +09:00
Akira Ajisaka a61c0f5ca1 Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula."
This reverts commit 98446ee695.
2015-09-02 12:26:25 +09:00
yliu 0fb6b68101 HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 09:01:31 +08:00
Vinod Kumar Vavilapalli acb3000187 YARN-3222. Added the missing CHANGES.txt entry.
(cherry picked from commit 4620767156)
2015-09-01 13:44:10 -07:00
Andrew Wang 7d833a3058 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder.
(cherry picked from commit 0eb9b19325)
2015-09-01 10:59:39 -07:00
Tsuyoshi Ozawa b1499ab0fe HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun.
(cherry picked from commit dd149adeac)
2015-09-02 02:02:10 +09:00
Akira Ajisaka 236c4ab511 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N.
(cherry picked from commit 2e251a7674)
2015-09-01 20:56:46 +09:00
Tsuyoshi Ozawa d3d65f62b3 YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R.
(cherry picked from commit faa38e1aa4)
2015-09-01 17:55:53 +09:00
Varun Vasudev 855e0f8b00 YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan.
(cherry picked from commit bf669b6d9f)
2015-09-01 14:20:54 +05:30
yliu 2345627ad3 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:25:11 +08:00
Andrew Wang 8dbe2a12bb HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract.
(cherry picked from commit 7ad3556ed3)
2015-08-31 18:19:12 -07:00
Colin Patrick Mccabe b52ae6140b HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe)
(cherry picked from commit 24f6a7c956)
2015-08-31 18:06:48 -07:00
yliu d852ec1f77 HDFS-8946. Improve choosing datanode storage for block placement. (yliu) 2015-09-01 08:51:32 +08:00
Jian He 21b478e1bf Move YARN-4092 to 2.7.2
(cherry picked from commit 4eaa7fd3ea)
2015-08-31 17:44:04 -07:00
Jian He 48f5161cd5 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
(cherry picked from commit a3fd2ccc86)
2015-08-31 17:34:49 -07:00
Haohui Mai 94ab3b9e8f HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu. 2015-08-31 13:54:42 -07:00
Jing Zhao f39c749f2a HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao.
(cherry picked from commit caa04de149)
2015-08-31 11:48:32 -07:00
Vinod Kumar Vavilapalli 0191dae2ec YARN-2945. Fixing the CHANGES.txt to have the right JIRA number.
(cherry picked from commit cf831565e8)
2015-08-30 20:02:36 -07:00
Jakob Homan 94944ba4f6 HDFS-8155. Support OAuth2 in WebHDFS.
(cherry picked from commit 837fb75e8e)
2015-08-29 18:38:21 -07:00
Lei Xu de42fce390 HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:58:57 -07:00
Arpit Agarwal f1d5f1417e HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:57:53 -07:00
Haohui Mai a3d0534558 HDFS-8925. Move BlockReaderLocal to hdfs-client. Contributed by Mingliang Liu. 2015-08-28 14:38:23 -07:00
Colin Patrick Mccabe 159969f658 HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list (Daniel Templeton)
(cherry picked from commit b94b56806d)
2015-08-28 14:22:05 -07:00
Haohui Mai dea531a3d5 HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu. 2015-08-28 14:13:59 -07:00
Zhihai Xu 297bda600e MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu
(cherry picked from commit cbb249534a)
2015-08-28 12:20:49 -07:00
Kihwal Lee 5184779418 HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee.
(cherry picked from commit b6ceee9bf4)
2015-08-28 13:19:28 -05:00
Junping Du 792b9c0eaf YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang.
(cherry picked from commit beb65c9465)
2015-08-28 05:58:45 -07:00
yliu 5f9b323eb0 HDFS-8963. Fix incorrect sign extension of xattr length in HDFS-8900. (Colin Patrick McCabe via yliu) 2015-08-28 10:53:53 +08:00
Haohui Mai 07a19325c4 Revert "HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu."
This reverts commit 0ae19f76f4.
2015-08-27 16:09:51 -07:00
Haohui Mai 0ae19f76f4 HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu. 2015-08-27 15:49:26 -07:00
Jian He 306c535395 YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S
(cherry picked from commit a9c8ea71aa)
2015-08-27 13:27:34 -07:00
Haohui Mai 1b01d163a2 HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer. 2015-08-27 13:03:29 -07:00
Andrew Wang 7a668981f5 HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin.
(cherry picked from commit 90fe7bcc3b)
2015-08-27 10:17:04 -07:00
Haohui Mai f4b2348503 HDFS-8961. Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager. Contributed by Mingliang Liu. 2015-08-27 09:13:37 -07:00
Haohui Mai af1e2993c7 HDFS-8962. Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf. Contributed by Mingliang Liu. 2015-08-27 09:05:28 -07:00
Harsh J 574f3a98ce HDFS-2390. dfsadmin -setBalancerBandwidth does not validate -ve value. Contributed by Gautam Gopalakrishnan.
(cherry picked from commit 0bf285413f)
2015-08-27 16:23:22 +05:30
Vinayakumar B d63122979f HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina)
(cherry picked from commit fdb56f74f3)
2015-08-27 13:07:35 +05:30
Haohui Mai 2f3faf39ef HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai. 2015-08-26 18:14:49 -07:00
Jing Zhao 10c4d6df61 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su.
(cherry picked from commit f44b599003)
2015-08-26 16:28:38 -07:00
Haohui Mai f0f6f1c7e9 HDFS-8951. Move the shortcircuit package to hdfs-client. Contributed by Mingliang Liu. 2015-08-26 14:22:33 -07:00
Colin Patrick Mccabe 9264b7e119 HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe)
(cherry picked from commit a4d9acc51d)
2015-08-25 14:30:15 -07:00
yliu df5dbf317d HDFS-8900. Compact XAttrs to optimize memory footprint. (yliu) 2015-08-25 16:14:11 +08:00