Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,276 Commits 326 Branches 371 Tags
Commit Graph

9276 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Allen Wittenauer
e6a171e7a2 HADOOP-12035. shellcheck plugin displays a wrong version potentially (Kengo Seki via aw) 2015-05-28 09:11:52 -07:00
Allen Wittenauer
7da2636232 HADOOP-12004. test-patch breaks with reexec in certain situations (Sean Busbey via aw) 2015-05-28 08:16:02 -07:00
Devaraj K
7116141d7d YARN-3722. Merge multiple TestWebAppUtils into 
o.a.h.yarn.webapp.util.TestWebAppUtils. Contributed by Masatake Iwasaki.

(cherry picked from commit 7e509f58439b1089462f51f9a0f9782faec7d198)
 2015-05-28 15:36:13 +05:30
cnauroth
25db341278 HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. 
(cherry picked from commit 50eeea13000f0c82e0567410f0f8b611248f8c1b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs.cmd
 2015-05-27 22:56:04 -07:00
Zhijie Shen
839f81a632 YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong. 
(cherry picked from commit 54504133f41e36eaea6bb06c7b9ddb249468ecd7)
 2015-05-27 16:53:47 -07:00
Andrew Wang
a634809895 HDFS-8482. Rename BlockInfoContiguous to BlockInfo. Contributed by Zhe Zhang. 
(cherry picked from commit ff83459f192f7cc4ce864f0b1f01e1e08243be83)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfo.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
 2015-05-27 15:42:12 -07:00
Wangda Tan
4790495538 YARN-3581. Deprecate -directlyAccessNodeLabelStore in RMAdminCLI. (Naganarasimha G R via wangda) 
(cherry picked from commit cab7674e54c4fe56838668462de99a6787841309)
 2015-05-27 15:37:14 -07:00
Wangda Tan
7cd0874dfd MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda) 
(cherry picked from commit 3164e7d83875aa6b7435d1dfe61ac280aa277f1c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
 2015-05-27 14:43:20 -07:00
cnauroth
6ed8989a6f YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch. 
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
 2015-05-27 14:21:15 -07:00
Wangda Tan
8857cba72e YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda) 
(cherry picked from commit ec0a852a37d5c91a62d3d0ff3ddbd9d58235b312)
 2015-05-27 13:15:55 -07:00
Haohui Mai
3f321be24d Addendum of HDFS-8135. 2015-05-27 13:14:51 -07:00
Haohui Mai
cc348fead7 Revert HDFS-8135 in branch-2. 2015-05-27 11:06:17 -07:00
Akira Ajisaka
9670762a82 HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki. 
(cherry picked from commit bb1816328a36ec3f8c6bd9fdb950d9a4ec8388c8)
 2015-05-27 18:05:08 +09:00
Wangda Tan
0728a86b3a YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda) 
(cherry picked from commit cdbd66be111c93c85a409d47284e588c453ecae9)
 2015-05-26 16:00:17 -07:00
Colin Patrick Mccabe
3dec58dd78 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 
(cherry picked from commit 7dba7005b79994106321b0f86bc8f4ea51a3c185)
 2015-05-26 12:40:41 -07:00
Jian He
5e7be094ec YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch 
(cherry picked from commit 10732d515f62258309f98e4d7d23249f80b1847d)
 2015-05-26 12:02:36 -07:00
Vinod Kumar Vavilapalli
a67cb4826b YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev. 
(cherry picked from commit 500a1d9c76ec612b4e737888f4be79951c11591d)
 2015-05-26 11:39:40 -07:00
Tsuyoshi Ozawa
e694c3339e MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi. 
(cherry picked from commit 022f49d59e404678d0f322bb1b67208f3c17b7ef)
 2015-05-26 23:59:20 +09:00
Tsuyoshi Ozawa
cf5c1adf4f YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka. 
(cherry picked from commit 9a3d617b6325d8918f2833c3e9ce329ecada9242)
 2015-05-26 19:08:01 +09:00
Akira Ajisaka
70615947bd HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru. 
(cherry picked from commit 56996a685e6201cb186cea866d22418289174574)
 2015-05-26 16:17:27 +09:00
Xuan
84245ff3b2 YARN-2238. Filtering on UI sticks even if I move away from the page. 
Contributed by Jian He

(cherry picked from commit 39077dba2e877420e7470df253f6154f6ecc64ec)
 2015-05-25 22:41:02 -07:00
Haohui Mai
f70b9d9241 HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang. 2015-05-24 22:30:50 -07:00
Jian He
03af057a47 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan 
(cherry picked from commit 446d51591e6e99cc60a85c4b9fbac379a8caa49d)
 2015-05-22 15:59:00 -07:00
Xuan
33be070a5e YARN-3701. Isolating the error of generating a single app report when 
getting all apps from generic history service. Contributed by Zhijie
Shen

(cherry picked from commit 455b3acf0e82b214e06bd7b538968252945cd3c4)
 2015-05-22 14:35:51 -07:00
Colin Patrick Mccabe
97ebe1b2cf HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe) 
(cherry picked from commit f34638399abdca2e6d3bc5502508819dd747861c)
 2015-05-22 12:57:29 -07:00
Tsuyoshi Ozawa
6042b53a74 MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS. 
(cherry picked from commit b27ce3c5318a40bc79565783961f6675dcdcb14a)
 2015-05-22 23:30:12 +09:00
Vinayakumar B
19895a41ad HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) 
(cherry picked from commit 55ed6558bad5d76ce4ebf958fc101a48032a0cd1)

Conflicts:
	hadoop-common-project/hadoop-common/pom.xml
 2015-05-22 16:46:50 +05:30
Junping Du
5fb61d71b1 YARN-3594. WintuilsProcessStubExecutor.startStreamReader leaks streams. Contributed by Lars Francke. 
(cherry picked from commit 132d909d4a6509af9e63e24cbb719be10006b6cd)
 2015-05-22 04:25:18 -07:00
Vinayakumar B
658f5cf985 HDFS-8268. Port conflict log for data node server is not sufficient (Contributed by Mohammad Shahid Khan) 
(cherry picked from commit 0c6638c2ea278bd460df88e7118945e461266a8b)
 2015-05-22 16:15:39 +05:30
Akira Ajisaka
b95d21c379 HADOOP-11594. Improve the readability of site index of documentation. Contributed by Masatake Iwasaki. 
(cherry picked from commit ab7958f22774ac2a8d1dad322453ff1db16a1565)
 2015-05-22 16:54:46 +09:00
Akira Ajisaka
01e5de9120 HADOOP-11955. Fix a typo in the cluster setup doc. Contributed by Yanjun Wang. 
(cherry picked from commit b2a40942c1bf19d19756443267107d3cfa39b53b)
 2015-05-22 16:09:24 +09:00
Akira Ajisaka
6cd7672878 HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki. 
(cherry picked from commit 07007bdbc8900cfe8421f4829b1444fc9e7aceb7)
 2015-05-22 14:15:37 +09:00
Arpit Agarwal
a073e5bd31 HDFS-8454. Remove unnecessary throttling in TestDatanodeDeath. (Arpit Agarwal) 2015-05-21 20:44:07 -07:00
Vinod Kumar Vavilapalli
673bd9708f YARN-3684. Changed ContainerExecutor's primary lifecycle methods to use a more extensible mechanism of context objects. Contributed by Sidharta Seethana. 
(cherry picked from commit 53fafcf061616516c24e2e2007a66a93d23d3e25)
 2015-05-21 15:51:19 -07:00
Karthik Kambatla
e8ac88d4fe YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha) 
(cherry picked from commit a8b50e46737c11936ba72c427da69b2365a07aac)
 2015-05-21 13:39:40 -07:00
Xiaoyu Yao
61d7ccb27e HDFS-8451. DFSClient probe for encryption testing interprets empty URI property for enabled. Contributed by Steve Loughran. 
(cherry picked from commit 05e04f34f27149537fdb89f46af26bee14531ca4)
 2015-05-21 11:59:11 -07:00
Haohui Mai
0b909d028f HDFS-8421. Move startFile() and related functions into FSDirWriteFileOp. Contributed by Haohui Mai. 2015-05-21 08:06:13 -07:00
Devaraj K
157ecb2241 YARN-3646. Applications are getting stuck some times in case of retry 
policy forever. Contributed by Raju Bairishetti.

(cherry picked from commit 0305316d6932e6f1a05021354d77b6934e57e171)
 2015-05-21 20:16:09 +05:30
Akira Ajisaka
6d7e7ef1c4 YARN-3694. Fix dead link for TimelineServer REST API. Contributed by Jagadesh Kiran N. 
(cherry picked from commit a5def580879428bc7af3c030ef33554e0519f072)
 2015-05-21 23:15:17 +09:00
Akira Ajisaka
b578f76bed HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru. 
(cherry picked from commit 0e4f1081c7a98e1c0c4f922f5e2afe467a0d763f)
 2015-05-21 17:53:18 +09:00
Akira Ajisaka
185cddfd6a HDFS-4383. Document the lease limits. Contributed by Arshad Mohammad. 
(cherry picked from commit dc8434ab2b177ca9673bd8eecf7b185d4c4ffb31)
 2015-05-21 17:31:47 +09:00
Haohui Mai
e30f91644f HADOOP-11772. RPC Invoker relies on static ClientCache which has synchronized(this) blocks. Contributed by Haohui Mai. 2015-05-20 20:11:00 -07:00
Jian He
7c3895c8f6 YARN-3654. ContainerLogsPage web UI should not have meta-refresh. Contributed by Xuan Gong 
(cherry picked from commit 6329bd00fa1f17cc9555efa496ea7607ad93e0ce)
 2015-05-20 17:21:19 -07:00
Jian He
521378ffa3 YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan 
(cherry picked from commit 8966d4217969eb71767ba83a3ff2b5bb38189b19)
 2015-05-20 16:30:44 -07:00
Xuan
a665b22cfa YARN-3681. yarn cmd says "could not find main class 'queue'" in windows. Contributed by Craig Welch and Varun Saxena 2015-05-20 14:42:59 -07:00
Wangda Tan
d3193fd1d7 Move YARN-2918 from 2.8.0 to 2.7.1 
(cherry picked from commit 03f897fd1a3779251023bae358207069b89addbf)
 2015-05-20 13:50:11 -07:00
Haohui Mai
ed320da2ba HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni. 2015-05-19 18:28:34 -07:00
Wangda Tan
b5ba6979b7 YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda) 
(cherry picked from commit 563eb1ad2ae848a23bbbf32ebfaf107e8fa14e87)
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
 2015-05-19 17:37:24 -07:00
Tsuyoshi Ozawa
d022c5aba8 YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli. 
(cherry picked from commit 7401e5b5e8060b6b027d714b5ceb641fcfe5b598)
 2015-05-20 09:01:42 +09:00
Wangda Tan
7b97f049ee YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda) 
(cherry picked from commit b37da52a1c4fb3da2bd21bfadc5ec61c5f953a59)
 2015-05-19 16:35:23 -07:00