Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,268 Commits 326 Branches 371 Tags
Commit Graph

1840 Commits

Author SHA1 Message Date
cnauroth
6ed8989a6f YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch. 
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
 2015-05-27 14:21:15 -07:00
Wangda Tan
8857cba72e YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda) 
(cherry picked from commit ec0a852a37d5c91a62d3d0ff3ddbd9d58235b312)
 2015-05-27 13:15:55 -07:00
Wangda Tan
0728a86b3a YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda) 
(cherry picked from commit cdbd66be111c93c85a409d47284e588c453ecae9)
 2015-05-26 16:00:17 -07:00
Jian He
5e7be094ec YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch 
(cherry picked from commit 10732d515f62258309f98e4d7d23249f80b1847d)
 2015-05-26 12:02:36 -07:00
Vinod Kumar Vavilapalli
a67cb4826b YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev. 
(cherry picked from commit 500a1d9c76ec612b4e737888f4be79951c11591d)
 2015-05-26 11:39:40 -07:00
Tsuyoshi Ozawa
cf5c1adf4f YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka. 
(cherry picked from commit 9a3d617b6325d8918f2833c3e9ce329ecada9242)
 2015-05-26 19:08:01 +09:00
Xuan
84245ff3b2 YARN-2238. Filtering on UI sticks even if I move away from the page. 
Contributed by Jian He

(cherry picked from commit 39077dba2e877420e7470df253f6154f6ecc64ec)
 2015-05-25 22:41:02 -07:00
Jian He
03af057a47 YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan 
(cherry picked from commit 446d51591e6e99cc60a85c4b9fbac379a8caa49d)
 2015-05-22 15:59:00 -07:00
Xuan
33be070a5e YARN-3701. Isolating the error of generating a single app report when 
getting all apps from generic history service. Contributed by Zhijie
Shen

(cherry picked from commit 455b3acf0e82b214e06bd7b538968252945cd3c4)
 2015-05-22 14:35:51 -07:00
Vinayakumar B
19895a41ad HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) 
(cherry picked from commit 55ed6558bad5d76ce4ebf958fc101a48032a0cd1)

Conflicts:
	hadoop-common-project/hadoop-common/pom.xml
 2015-05-22 16:46:50 +05:30
Junping Du
5fb61d71b1 YARN-3594. WintuilsProcessStubExecutor.startStreamReader leaks streams. Contributed by Lars Francke. 
(cherry picked from commit 132d909d4a6509af9e63e24cbb719be10006b6cd)
 2015-05-22 04:25:18 -07:00
Vinod Kumar Vavilapalli
673bd9708f YARN-3684. Changed ContainerExecutor's primary lifecycle methods to use a more extensible mechanism of context objects. Contributed by Sidharta Seethana. 
(cherry picked from commit 53fafcf061616516c24e2e2007a66a93d23d3e25)
 2015-05-21 15:51:19 -07:00
Karthik Kambatla
e8ac88d4fe YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha) 
(cherry picked from commit a8b50e46737c11936ba72c427da69b2365a07aac)
 2015-05-21 13:39:40 -07:00
Devaraj K
157ecb2241 YARN-3646. Applications are getting stuck some times in case of retry 
policy forever. Contributed by Raju Bairishetti.

(cherry picked from commit 0305316d6932e6f1a05021354d77b6934e57e171)
 2015-05-21 20:16:09 +05:30
Jian He
7c3895c8f6 YARN-3654. ContainerLogsPage web UI should not have meta-refresh. Contributed by Xuan Gong 
(cherry picked from commit 6329bd00fa1f17cc9555efa496ea7607ad93e0ce)
 2015-05-20 17:21:19 -07:00
Jian He
521378ffa3 YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan 
(cherry picked from commit 8966d4217969eb71767ba83a3ff2b5bb38189b19)
 2015-05-20 16:30:44 -07:00
Xuan
a665b22cfa YARN-3681. yarn cmd says "could not find main class 'queue'" in windows. Contributed by Craig Welch and Varun Saxena 2015-05-20 14:42:59 -07:00
Wangda Tan
b5ba6979b7 YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda) 
(cherry picked from commit 563eb1ad2ae848a23bbbf32ebfaf107e8fa14e87)
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
 2015-05-19 17:37:24 -07:00
Tsuyoshi Ozawa
d022c5aba8 YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli. 
(cherry picked from commit 7401e5b5e8060b6b027d714b5ceb641fcfe5b598)
 2015-05-20 09:01:42 +09:00
Wangda Tan
7b97f049ee YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda) 
(cherry picked from commit b37da52a1c4fb3da2bd21bfadc5ec61c5f953a59)
 2015-05-19 16:35:23 -07:00
Jian He
adb90c7f52 YARN-2821. Fixed a problem that DistributedShell AM may hang if restarted. Contributed by Varun Vasudev 
(cherry picked from commit 7438966586f1896ab3e8b067d47a4af28a894106)
 2015-05-19 14:21:48 -07:00
Colin Patrick Mccabe
9534e533dc HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe) 
(cherry picked from commit 470c87dbc6c24dd3b370f1ad9e7ab1f6dabd2080)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestReplicationPolicy.java
        hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/JspHelper.java
 2015-05-19 11:15:04 -07:00
Ravi Prakash
084e453629 YARN-3302. TestDockerContainerExecutor should run automatically if it can detect docker in the usual place (Ravindra Kumar Naik via raviprak) 
(cherry picked from commit c97f32e7b9d9e1d4c80682cc01741579166174d1)
 2015-05-19 10:30:24 -07:00
Xuan
d39039d54d YARN-3601. Fix UT TestRMFailover.testRMWebAppRedirect. Contributed by Weiwei Yang 
(cherry picked from commit 5009ad4a7f712fc578b461ecec53f7f97eaaed0c)
 2015-05-19 09:57:13 -07:00
Xuan
3ceb2ffe54 YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen 
(cherry picked from commit 76afd28862c1f27011273659a82cd45903a77170)
 2015-05-18 13:19:01 -07:00
Xuan
802676e1be YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Contributed by Weiwei Yang 
(cherry picked from commit b0ad644083a0dfae3a39159ac88b6fc09d846371)
 2015-05-15 22:41:13 -07:00
Jason Lowe
ce64720516 YARN-2421. RM still allocates containers to an app in the FINISHING state. Contributed by Chang Li 
(cherry picked from commit f7e051c4310024d4040ad466c34432c72e88b0fc)
 2015-05-15 22:10:16 +00:00
Junping Du
cc671349bc YARN-3505 addendum: fix an issue in previous patch. 
(cherry picked from commit 03a293aed6de101b0cae1a294f506903addcaa75)
 2015-05-15 06:40:28 -07:00
Vinod Kumar Vavilapalli
ad3196e016 Fixing HDFS state-store. Contributed by Arun Suresh. 
(cherry picked from commit 9a2a9553eee454ecd18120535d3e845f86fc3584)
 2015-05-14 16:57:03 -07:00
Ravi Prakash
4caadaa8bb YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak) 
(cherry picked from commit 53fe4eff09fdaeed75a8cad3a26156bf963a8d37)
 2015-05-14 15:56:36 -07:00
Junping Du
bc13c7d84b YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong. 
(cherry picked from commit 15ccd967ee3e7046a50522089f67ba01f36ec76a)
 2015-05-14 10:59:48 -07:00
Wangda Tan
3a11baa15f YARN-3362. Add node label usage in RM CapacityScheduler web UI. (Naganarasimha G R via wangda) 
(cherry picked from commit 0e85044e26da698c45185585310ae0e99448cd80)
 2015-05-13 17:01:23 -07:00
Jason Lowe
a81ad81461 YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du 
(cherry picked from commit 711d77cc54a64b2c3db70bdacc6bf2245c896a4b)
 2015-05-13 21:08:45 +00:00
Wangda Tan
d49262a172 YARN-3521. Support return structured NodeLabel objects in REST API (Sunil G via wangda) 
(cherry picked from commit 7f19e7a2549a098236d06b29b7076bb037533f05)
 2015-05-13 13:43:57 -07:00
Wangda Tan
8555a5146d YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda) 
(cherry picked from commit d4f53fc9631d682cd79ba440aefa6750dcc898be)
 2015-05-13 13:33:38 -07:00
Xuan
487d9b0f3f YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch 
(cherry picked from commit 0f95921447ea547bdf9caf18f7fde46bc66031f8)
 2015-05-13 13:12:04 -07:00
Wangda Tan
3df8880bbe YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda) 
(cherry picked from commit 341a476812015d0d584b198b451ea9458645a47c)
 2015-05-13 13:07:05 -07:00
cnauroth
ddc4afeff2 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth. 2015-05-13 12:25:49 -07:00
Zhijie Shen
6043224458 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran. 
(cherry picked from commit fcd0702c10ce574b887280476aba63d6682d5271)
 2015-05-12 21:13:47 -07:00
Karthik Kambatla
9d6c63f8be YARN-3613. TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods. (nijel via kasha) 
(cherry picked from commit fe0df596271340788095cb43a1944e19ac4c2cf7)
 2015-05-12 10:45:51 -07:00
Devaraj K
5fceebd696 YARN-3629. NodeID is always printed as "null" in node manager 
initialization log. Contributed by nijel.

(cherry picked from commit 5c2f05cd9bad9bf9beb0f4ca18f4ae1bc3e84499)
 2015-05-12 22:22:40 +05:30
Devaraj K
f887243f88 YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug 
log for overall resource usage by all containers.  Contributed by
Naganarasimha G R.

(cherry picked from commit 8badd82ce256e4dc8c234961120d62a88358ab39)
 2015-05-12 16:56:26 +05:30
Wangda Tan
d06d2a96f5 YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda) 
(cherry picked from commit d6f6741296639a73f5306e3ebefec84a40ca03e5)
 2015-05-11 17:35:01 -07:00
Junping Du
a1a7deebf8 YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak. 
(cherry picked from commit 7e543c27fa2881aa65967be384a6203bd5b2304f)
 2015-05-11 05:28:25 -07:00
Karthik Kambatla
3cf4f24a9f YARN-3395. FairScheduler: Trim whitespaces when using username for queuename. (Zhihai Xu via kasha) 
(cherry picked from commit a60f78e98ed73ab320576c652c577f119ce70901)
 2015-05-09 15:41:49 -07:00
Karthik Kambatla
e8dd0bc4fd YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha) 
(cherry picked from commit 70fb37cd79a7eba6818313960624380bacfe0bb2)
 2015-05-09 14:35:13 -07:00
Xuan
acb342b77c YARN-1912. ResourceLocalizer started without any jvm memory control. 
Contributed by Masatake Iwasaki

(cherry picked from commit 6471d18bc72bc6c83ce31a03b5c5f5737847bb6d)
 2015-05-08 20:02:23 -07:00
Xuan
fc980247a6 YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu 
(cherry picked from commit 333f9a896d8a4407ce69cfd0dc8314587a339233)
 2015-05-08 17:54:46 -07:00
Zhijie Shen
ef096599c3 YARN-2206. Updated document for applications REST API response examples. Contributed by Kenji Kikushima and Brahma Reddy Battula. 
(cherry picked from commit 08f0ae403c649b28925d3b339b7b6de1d7ec2c0c)
 2015-05-08 16:41:29 -07:00
Karthik Kambatla
a7d8f21630 YARN-3271. FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability. (nijel via kasha) 
(cherry picked from commit 2fb44c8aaf7f35f425d80b133a28b1c1f305c3e6)
 2015-05-08 16:40:36 -07:00