9535 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
148412bb30 Fixed more FilesSystemRMStateStore issues. Contributed by Vinod Kumar Vavilapalli.
(cherry picked from commit 9acd24fec408c182683968ae2c75ca2c38866a60)
2015-05-28 15:27:01 -07:00
cnauroth
33648268ce HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay.
(cherry picked from commit 860b8373c3a851386b8cd2d4265dd35e5aabc941)
2015-05-28 15:01:57 -07:00
cnauroth
39f451e721 HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic.
(cherry picked from commit 94e7d49a6dab7e7f4e873dcca67e7fcc98e7e1f8)

Conflicts:
	hadoop-project/pom.xml
2015-05-28 12:32:55 -07:00
Allen Wittenauer
6c71ac7b6b HADOOP-11930. test-patch in offline mode should tell maven to be in offline mode (Sean Busbey via aw) 2015-05-28 12:12:19 -07:00
Colin Patrick Mccabe
4b108a441d HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit a1140959dab3f35accbd6c66abfa14f94ff7dcec)
2015-05-28 12:03:07 -07:00
Colin Patrick Mccabe
2a56adc550 HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread. (zhouyingchao via cmccabe)
(cherry picked from commit 246cefa089156a50bf086b8b1e4d4324d66dc58c)
2015-05-28 11:54:24 -07:00
Colin Patrick Mccabe
b9752f24a6 HDFS-8407. libhdfs hdfsListDirectory must set errno to 0 on success (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit d2d95bfe886a7fdf9d58fd5c47ec7c0158393afb)
2015-05-28 11:38:44 -07:00
Xuan
550b55146d YARN-3723. Need to clearly document primaryFilter and otherInfo value
type. Contributed by Zhijie Shen

(cherry picked from commit 3077c299da4c5142503c9f92aad4b82349b2fde2)
2015-05-28 10:20:33 -07:00
Allen Wittenauer
1a3ccf4724 HADOOP-12030. test-patch should only report on newly introduced findbugs warnings. (Sean Busbey via aw) 2015-05-28 09:54:17 -07:00
Allen Wittenauer
e6a171e7a2 HADOOP-12035. shellcheck plugin displays a wrong version potentially (Kengo Seki via aw) 2015-05-28 09:11:52 -07:00
Allen Wittenauer
7da2636232 HADOOP-12004. test-patch breaks with reexec in certain situations (Sean Busbey via aw) 2015-05-28 08:16:02 -07:00
Devaraj K
7116141d7d YARN-3722. Merge multiple TestWebAppUtils into
o.a.h.yarn.webapp.util.TestWebAppUtils. Contributed by Masatake Iwasaki.

(cherry picked from commit 7e509f58439b1089462f51f9a0f9782faec7d198)
2015-05-28 15:36:13 +05:30
cnauroth
25db341278 HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer.
(cherry picked from commit 50eeea13000f0c82e0567410f0f8b611248f8c1b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs.cmd
2015-05-27 22:56:04 -07:00
Zhijie Shen
839f81a632 YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
(cherry picked from commit 54504133f41e36eaea6bb06c7b9ddb249468ecd7)
2015-05-27 16:53:47 -07:00
Andrew Wang
a634809895 HDFS-8482. Rename BlockInfoContiguous to BlockInfo. Contributed by Zhe Zhang.
(cherry picked from commit ff83459f192f7cc4ce864f0b1f01e1e08243be83)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfo.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
2015-05-27 15:42:12 -07:00
Wangda Tan
4790495538 YARN-3581. Deprecate -directlyAccessNodeLabelStore in RMAdminCLI. (Naganarasimha G R via wangda)
(cherry picked from commit cab7674e54c4fe56838668462de99a6787841309)
2015-05-27 15:37:14 -07:00
Wangda Tan
7cd0874dfd MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda)
(cherry picked from commit 3164e7d83875aa6b7435d1dfe61ac280aa277f1c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
2015-05-27 14:43:20 -07:00
cnauroth
6ed8989a6f YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
2015-05-27 14:21:15 -07:00
Wangda Tan
8857cba72e YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)
(cherry picked from commit ec0a852a37d5c91a62d3d0ff3ddbd9d58235b312)
2015-05-27 13:15:55 -07:00
Haohui Mai
3f321be24d Addendum of HDFS-8135. 2015-05-27 13:14:51 -07:00
Haohui Mai
cc348fead7 Revert HDFS-8135 in branch-2. 2015-05-27 11:06:17 -07:00
Akira Ajisaka
9670762a82 HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki.
(cherry picked from commit bb1816328a36ec3f8c6bd9fdb950d9a4ec8388c8)
2015-05-27 18:05:08 +09:00
Wangda Tan
0728a86b3a YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
(cherry picked from commit cdbd66be111c93c85a409d47284e588c453ecae9)
2015-05-26 16:00:17 -07:00
Colin Patrick Mccabe
3dec58dd78 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
(cherry picked from commit 7dba7005b79994106321b0f86bc8f4ea51a3c185)
2015-05-26 12:40:41 -07:00
Jian He
5e7be094ec YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch
(cherry picked from commit 10732d515f62258309f98e4d7d23249f80b1847d)
2015-05-26 12:02:36 -07:00
Vinod Kumar Vavilapalli
a67cb4826b YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
(cherry picked from commit 500a1d9c76ec612b4e737888f4be79951c11591d)
2015-05-26 11:39:40 -07:00
Tsuyoshi Ozawa
e694c3339e MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi.
(cherry picked from commit 022f49d59e404678d0f322bb1b67208f3c17b7ef)
2015-05-26 23:59:20 +09:00
Tsuyoshi Ozawa
cf5c1adf4f YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka.
(cherry picked from commit 9a3d617b6325d8918f2833c3e9ce329ecada9242)
2015-05-26 19:08:01 +09:00
Akira Ajisaka
70615947bd HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru.
(cherry picked from commit 56996a685e6201cb186cea866d22418289174574)
2015-05-26 16:17:27 +09:00
Xuan
84245ff3b2 YARN-2238. Filtering on UI sticks even if I move away from the page.
Contributed by Jian He

(cherry picked from commit 39077dba2e877420e7470df253f6154f6ecc64ec)
2015-05-25 22:41:02 -07:00
Haohui Mai
f70b9d9241 HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang. 2015-05-24 22:30:50 -07:00
Jian He
03af057a47 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan
(cherry picked from commit 446d51591e6e99cc60a85c4b9fbac379a8caa49d)
2015-05-22 15:59:00 -07:00
Xuan
33be070a5e YARN-3701. Isolating the error of generating a single app report when
getting all apps from generic history service. Contributed by Zhijie
Shen

(cherry picked from commit 455b3acf0e82b214e06bd7b538968252945cd3c4)
2015-05-22 14:35:51 -07:00
Colin Patrick Mccabe
97ebe1b2cf HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe)
(cherry picked from commit f34638399abdca2e6d3bc5502508819dd747861c)
2015-05-22 12:57:29 -07:00
Tsuyoshi Ozawa
6042b53a74 MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS.
(cherry picked from commit b27ce3c5318a40bc79565783961f6675dcdcb14a)
2015-05-22 23:30:12 +09:00
Vinayakumar B
19895a41ad HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
(cherry picked from commit 55ed6558bad5d76ce4ebf958fc101a48032a0cd1)

Conflicts:
	hadoop-common-project/hadoop-common/pom.xml
2015-05-22 16:46:50 +05:30
Junping Du
5fb61d71b1 YARN-3594. WintuilsProcessStubExecutor.startStreamReader leaks streams. Contributed by Lars Francke.
(cherry picked from commit 132d909d4a6509af9e63e24cbb719be10006b6cd)
2015-05-22 04:25:18 -07:00
Vinayakumar B
658f5cf985 HDFS-8268. Port conflict log for data node server is not sufficient (Contributed by Mohammad Shahid Khan)
(cherry picked from commit 0c6638c2ea278bd460df88e7118945e461266a8b)
2015-05-22 16:15:39 +05:30
Akira Ajisaka
b95d21c379 HADOOP-11594. Improve the readability of site index of documentation. Contributed by Masatake Iwasaki.
(cherry picked from commit ab7958f22774ac2a8d1dad322453ff1db16a1565)
2015-05-22 16:54:46 +09:00
Akira Ajisaka
01e5de9120 HADOOP-11955. Fix a typo in the cluster setup doc. Contributed by Yanjun Wang.
(cherry picked from commit b2a40942c1bf19d19756443267107d3cfa39b53b)
2015-05-22 16:09:24 +09:00
Akira Ajisaka
6cd7672878 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki.
(cherry picked from commit 07007bdbc8900cfe8421f4829b1444fc9e7aceb7)
2015-05-22 14:15:37 +09:00
Arpit Agarwal
a073e5bd31 HDFS-8454. Remove unnecessary throttling in TestDatanodeDeath. (Arpit Agarwal) 2015-05-21 20:44:07 -07:00
Vinod Kumar Vavilapalli
673bd9708f YARN-3684. Changed ContainerExecutor's primary lifecycle methods to use a more extensible mechanism of context objects. Contributed by Sidharta Seethana.
(cherry picked from commit 53fafcf061616516c24e2e2007a66a93d23d3e25)
2015-05-21 15:51:19 -07:00
Karthik Kambatla
e8ac88d4fe YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha)
(cherry picked from commit a8b50e46737c11936ba72c427da69b2365a07aac)
2015-05-21 13:39:40 -07:00
Xiaoyu Yao
61d7ccb27e HDFS-8451. DFSClient probe for encryption testing interprets empty URI property for enabled. Contributed by Steve Loughran.
(cherry picked from commit 05e04f34f27149537fdb89f46af26bee14531ca4)
2015-05-21 11:59:11 -07:00
Haohui Mai
0b909d028f HDFS-8421. Move startFile() and related functions into FSDirWriteFileOp. Contributed by Haohui Mai. 2015-05-21 08:06:13 -07:00
Devaraj K
157ecb2241 YARN-3646. Applications are getting stuck some times in case of retry
policy forever. Contributed by Raju Bairishetti.

(cherry picked from commit 0305316d6932e6f1a05021354d77b6934e57e171)
2015-05-21 20:16:09 +05:30
Akira Ajisaka
6d7e7ef1c4 YARN-3694. Fix dead link for TimelineServer REST API. Contributed by Jagadesh Kiran N.
(cherry picked from commit a5def580879428bc7af3c030ef33554e0519f072)
2015-05-21 23:15:17 +09:00
Akira Ajisaka
b578f76bed HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru.
(cherry picked from commit 0e4f1081c7a98e1c0c4f922f5e2afe467a0d763f)
2015-05-21 17:53:18 +09:00
Akira Ajisaka
185cddfd6a HDFS-4383. Document the lease limits. Contributed by Arshad Mohammad.
(cherry picked from commit dc8434ab2b177ca9673bd8eecf7b185d4c4ffb31)
2015-05-21 17:31:47 +09:00