Xuan
|
e27d5a13b0
|
YARN-3714. AM proxy filter can not get RM webapp address from
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki
|
2015-06-16 14:06:16 -07:00 |
Devaraj K
|
b039e69bb0
|
YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed
by Bibin A Chundatt.
|
2015-06-16 14:03:22 +05:30 |
|
Devaraj K
|
d8dcfa98e3
|
YARN-3794. TestRMEmbeddedElector fails because of ambiguous LOG reference.
Contributed by Chengbing Liu.
|
2015-06-12 13:42:49 +05:30 |
|
Xuan
|
5583f88bf7
|
YARN-3785. Support for Resource as an argument during submitApp call in
MockRM test class. Contributed by Sunil G
|
2015-06-10 21:40:48 -07:00 |
Zhijie Shen
|
8d0ef31632
|
YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong.
|
2015-06-08 23:14:58 -07:00 |
|
Xuan
|
2b2465dfac
|
YARN-3778. Fix Yarn resourcemanger CLI usage. Contributed by Brahma Reddy Battula
|
2015-06-08 15:43:03 -07:00 |
Jian He
|
960b8f19ca
|
YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla
|
2015-06-08 14:50:58 -07:00 |
|
Devaraj K
|
126321eded
|
YARN-3747. TestLocalDirsHandlerService should delete the created test
directory logDir2. Contributed by David Moore.
|
2015-06-08 15:32:13 +05:30 |
|
Devaraj K
|
c7ee6c151c
|
YARN-3780. Should use equals when compare Resource in
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
|
2015-06-08 11:54:55 +05:30 |
Karthik Kambatla
|
bd69ea408f
|
YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha)
|
2015-06-07 11:37:52 -07:00 |
|
Xuan
|
3e000a919f
|
YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong
|
2015-06-05 12:48:52 -07:00 |
|
Karthik Kambatla
|
75885852cc
|
YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha)
|
2015-06-05 09:39:41 -07:00 |
|
Zhijie Shen
|
18dd01d6bf
|
YARN-3766. Fixed the apps table column error of generic history web UI. Contributed by Xuan Gong.
|
2015-06-04 14:47:08 -07:00 |
|
Jian He
|
1970ca7cbc
|
YARN-2392. Add more diags about app retry limits on AM failures. Contributed by Steve Loughran
|
2015-06-04 11:14:09 -07:00 |
|
Jian He
|
6ad4e59cfc
|
YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan
|
2015-06-04 10:52:59 -07:00 |
Wangda Tan
|
ebd797c48f
|
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)
|
2015-06-04 10:22:57 -07:00 |
Junping Du
|
d7e7f6aa03
|
YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K.
|
2015-06-04 04:59:27 -07:00 |
|
Xuan
|
5766a04428
|
YARN-3749. We should make a copy of configuration when init
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
|
2015-06-03 17:20:15 -07:00 |
|
Zhijie Shen
|
bc85959edd
|
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4a9ec1a824.
|
2015-06-03 14:15:56 -07:00 |
|
Karthik Kambatla
|
edb9cd0f7a
|
YARN-3762. FairScheduler: CME on FSParentQueue#getQueueUserAclInfo. (kasha)
|
2015-06-03 13:47:24 -07:00 |
Jason Lowe
|
e13b671aa5
|
YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. Contributed by Rohith Sharmaks
|
2015-06-03 19:44:07 +00:00 |
|
Zhijie Shen
|
dbc4f64937
|
YARN-3751. Fixed AppInfo to check if used resources are null. Contributed by Sunil G.
|
2015-06-03 11:51:41 -07:00 |
|
Wangda Tan
|
5cc3fced95
|
YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)
|
2015-05-31 16:31:09 -07:00 |
|
Xuan
|
9686261ecb
|
YARN-2900. Application (Attempt and Container) Not Found in AHS results
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
|
2015-05-31 15:37:05 -07:00 |
|
Xuan
|
da05361c3b
|
Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results"
This reverts commit 06f8e9caba.
|
2015-05-31 00:26:04 -07:00 |
|
Xuan
|
06f8e9caba
|
YARN-2900. Application (Attempt and Container) Not Found in AHS results
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
|
2015-05-30 21:56:19 -07:00 |
|
Zhijie Shen
|
4a9ec1a824
|
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
|
2015-05-30 21:05:36 -07:00 |
|
Karthik Kambatla
|
a8acdd65b3
|
YARN-3467. Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI. (Anubhav Dhoot via kasha)
|
2015-05-30 13:36:24 -07:00 |
|
Zhijie Shen
|
eb6bf91eea
|
YARN-3740. Fixed the typo in the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong.
|
2015-05-29 18:17:48 -07:00 |
Robert Kanter
|
6aec13cb33
|
YARN-3713. Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition (zxu via rkanter)
|
2015-05-29 15:34:37 -07:00 |
|
Karthik Kambatla
|
3ae2a62501
|
YARN-3547. FairScheduler: Apps that have no resource demand should not participate scheduling. (Xianyin Xin via kasha)
|
2015-05-29 15:17:22 -07:00 |
Andrew Wang
|
7673d4f205
|
HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang)
|
2015-05-29 14:54:18 -07:00 |
Vinod Kumar Vavilapalli
|
9acd24fec4
|
Fixed more FilesSystemRMStateStore issues. Contributed by Vinod Kumar Vavilapalli.
|
2015-05-28 15:25:56 -07:00 |
|
Zhijie Shen
|
54504133f4
|
YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
|
2015-05-27 16:52:22 -07:00 |
Allen Wittenauer
|
d6e3164d4a
|
YARN-2355. MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container (Darrell Taylor via aw)
|
2015-05-27 16:40:56 -07:00 |
cnauroth
|
4102e5882e
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
|
2015-05-27 14:31:49 -07:00 |
|
Wangda Tan
|
ec0a852a37
|
YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)
|
2015-05-27 12:51:20 -07:00 |
|
Wangda Tan
|
cdbd66be11
|
YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
|
2015-05-26 15:58:47 -07:00 |
|
Jian He
|
10732d515f
|
YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch
|
2015-05-26 12:00:51 -07:00 |
|
Vinod Kumar Vavilapalli
|
500a1d9c76
|
YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
|
2015-05-26 11:38:35 -07:00 |
Tsuyoshi Ozawa
|
9a3d617b63
|
YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka.
|
2015-05-26 19:07:40 +09:00 |
|
Jian He
|
446d51591e
|
YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan
|
2015-05-22 15:58:22 -07:00 |
|
Xuan
|
455b3acf0e
|
YARN-3701. Isolating the error of generating a single app report when
getting all apps from generic history service. Contributed by Zhijie
Shen
|
2015-05-22 14:34:39 -07:00 |
Vinayakumar B
|
55ed6558ba
|
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
|
2015-05-22 16:45:19 +05:30 |
|
Junping Du
|
132d909d4a
|
YARN-3594. WintuilsProcessStubExecutor.startStreamReader leaks streams. Contributed by Lars Francke.
|
2015-05-22 04:23:25 -07:00 |
|
Vinod Kumar Vavilapalli
|
53fafcf061
|
YARN-3684. Changed ContainerExecutor's primary lifecycle methods to use a more extensible mechanism of context objects. Contributed by Sidharta Seethana.
|
2015-05-21 15:50:23 -07:00 |
|
Karthik Kambatla
|
4513761869
|
YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha)
|
2015-05-21 13:44:42 -07:00 |
|
Jian He
|
6329bd00fa
|
YARN-3654. ContainerLogsPage web UI should not have meta-refresh. Contributed by Xuan Gong
|
2015-05-20 17:20:21 -07:00 |
|
Jian He
|
8966d42179
|
YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan
|
2015-05-20 16:30:07 -07:00 |
|
Tsuyoshi Ozawa
|
7401e5b5e8
|
YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli.
|
2015-05-20 08:59:26 +09:00 |
|
Wangda Tan
|
563eb1ad2a
|
YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
|
2015-05-19 16:54:38 -07:00 |
|
Wangda Tan
|
b37da52a1c
|
YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda)
|
2015-05-19 16:34:17 -07:00 |
Colin Patrick Mccabe
|
470c87dbc6
|
HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe)
|
2015-05-19 10:50:15 -07:00 |
Ravi Prakash
|
c97f32e7b9
|
YARN-3302. TestDockerContainerExecutor should run automatically if it can detect docker in the usual place (Ravindra Kumar Naik via raviprak)
|
2015-05-19 10:28:11 -07:00 |
|
Xuan
|
76afd28862
|
YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen
|
2015-05-18 13:17:16 -07:00 |
|
Xuan
|
b0ad644083
|
YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Contributed by Weiwei Yang
|
2015-05-15 22:39:49 -07:00 |
|
Jason Lowe
|
f7e051c431
|
YARN-2421. RM still allocates containers to an app in the FINISHING state. Contributed by Chang Li
|
2015-05-15 22:09:30 +00:00 |
|
Junping Du
|
03a293aed6
|
YARN-3505 addendum: fix an issue in previous patch.
|
2015-05-15 06:39:39 -07:00 |
|
Vinod Kumar Vavilapalli
|
9a2a9553ee
|
Fixing HDFS state-store. Contributed by Arun Suresh.
|
2015-05-14 16:13:51 -07:00 |
Ravi Prakash
|
53fe4eff09
|
YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak)
|
2015-05-14 15:55:37 -07:00 |
|
Junping Du
|
15ccd967ee
|
YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong.
|
2015-05-14 10:58:12 -07:00 |
|
Wangda Tan
|
0e85044e26
|
YARN-3362. Add node label usage in RM CapacityScheduler web UI. (Naganarasimha G R via wangda)
|
2015-05-13 17:00:36 -07:00 |
|
Jason Lowe
|
711d77cc54
|
YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du
|
2015-05-13 21:06:47 +00:00 |
|
Wangda Tan
|
7f19e7a254
|
YARN-3521. Support return structured NodeLabel objects in REST API (Sunil G via wangda)
|
2015-05-13 13:43:17 -07:00 |
|
Xuan
|
0f95921447
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
|
2015-05-13 13:10:53 -07:00 |
|
Wangda Tan
|
341a476812
|
YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda)
|
2015-05-13 13:06:07 -07:00 |
|
Zhijie Shen
|
fcd0702c10
|
YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
|
2015-05-12 21:13:22 -07:00 |
|
Karthik Kambatla
|
fe0df59627
|
YARN-3613. TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods. (nijel via kasha)
|
2015-05-12 10:45:33 -07:00 |
|
Devaraj K
|
5c2f05cd9b
|
YARN-3629. NodeID is always printed as "null" in node manager
initialization log. Contributed by nijel.
|
2015-05-12 22:20:25 +05:30 |
|
Devaraj K
|
8badd82ce2
|
YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug
log for overall resource usage by all containers. Contributed by
Naganarasimha G R.
|
2015-05-12 16:54:38 +05:30 |
|
Wangda Tan
|
d6f6741296
|
YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda)
|
2015-05-11 17:31:15 -07:00 |
|
Junping Du
|
7e543c27fa
|
YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.
|
2015-05-11 05:27:07 -07:00 |
|
Karthik Kambatla
|
a60f78e98e
|
YARN-3395. FairScheduler: Trim whitespaces when using username for queuename. (Zhihai Xu via kasha)
|
2015-05-09 15:41:20 -07:00 |
|
Karthik Kambatla
|
70fb37cd79
|
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
|
2015-05-09 14:34:54 -07:00 |
|
Xuan
|
6471d18bc7
|
YARN-1912. ResourceLocalizer started without any jvm memory control.
Contributed by Masatake Iwasaki
|
2015-05-08 20:01:21 -07:00 |
|
Xuan
|
333f9a896d
|
YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu
|
2015-05-08 17:52:54 -07:00 |
|
Karthik Kambatla
|
2fb44c8aaf
|
YARN-3271. FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability. (nijel via kasha)
|
2015-05-08 16:39:10 -07:00 |
|
Robert Kanter
|
5658998845
|
YARN-3473. Fix RM Web UI configuration for some properties (rchiang via rkanter)
|
2015-05-08 16:23:10 -07:00 |
|
Jason Lowe
|
25e2b02122
|
YARN-3476. Nodemanager can fail to delete local logs if log aggregation fails. Contributed by Rohith
|
2015-05-08 22:45:52 +00:00 |
|
Jian He
|
d0b73287c2
|
YARN-3604. Fixed ZKRMStateStore#removeApplication to also disable watch. Contributed Zhihai Xu
|
2015-05-08 15:12:33 -07:00 |
|
Xuan
|
088156de43
|
YARN-2331. Distinguish shutdown during supervision vs. shutdown for
rolling upgrade. Contributed by Jason Lowe
|
2015-05-08 15:10:43 -07:00 |
|
Vinod Kumar Vavilapalli
|
f7a74d2491
|
YARN-3018. Unified the default value for the configuration property yarn.scheduler.capacity.node-locality-delay in code and default xml file. Contributed by Nijel SF.
|
2015-05-08 14:45:06 -07:00 |
|
Wangda Tan
|
f55d21d894
|
YARN-3593. Add label-type and Improve "DEFAULT_PARTITION" in Node Labels Page. (Naganarasimha G R via wangda)
|
2015-05-08 12:04:50 -07:00 |
Thomas Graves
|
5d708a4725
|
YARN-3600. AM container link is broken (Naganarasimha G R via tgraves
|
2015-05-08 16:35:40 +00:00 |
Robert (Bobby) Evans
|
bcf2890502
|
YARN-644: Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer
|
2015-05-08 11:11:01 -05:00 |
|
Devaraj K
|
241a72af0d
|
YARN-2784. Make POM project names consistent. Contributed by Rohith.
|
2015-05-08 19:23:53 +05:30 |
|
Tsuyoshi Ozawa
|
d18f10ad1b
|
MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
|
2015-05-08 15:59:46 +09:00 |
|
Devaraj K
|
ef3d66d462
|
YARN-3358. Audit log not present while refreshing Service ACLs.
Contributed by Varun Saxena.
|
2015-05-08 12:14:10 +05:30 |
|
Devaraj K
|
a28cd02ba0
|
YARN-3592. Fix typos in RMNodeLabelsManager. Contributed by Sunil G.
|
2015-05-08 10:54:36 +05:30 |
Akira Ajisaka
|
b167fe7605
|
YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo.
|
2015-05-08 11:14:45 +09:00 |
|
Jian He
|
f489a4ec96
|
YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan
|
2015-05-07 17:35:41 -07:00 |
|
Jian He
|
b88700dcd0
|
YARN-3584. Fixed attempt diagnostics format shown on the UI. Contributed by nijel
|
2015-05-07 13:54:07 -07:00 |
|
Zhijie Shen
|
daf3e4ef8b
|
YARN-3448. Added a rolling time-to-live LevelDB timeline store implementation. Contributed by Jonathan Eagles.
|
2015-05-07 10:01:51 -07:00 |
|
Akira Ajisaka
|
918af8efff
|
YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
|
2015-05-07 13:33:03 +09:00 |
|
Vinod Kumar Vavilapalli
|
4c7b9b6abe
|
YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based state-store to avoid crashing on duplicate deletes. Contributed by Zhihai Xu.
|
2015-05-06 17:51:17 -07:00 |
|
Junping Du
|
31b627b2a8
|
YARN-3580. [JDK8] TestClientRMService.testGetLabelsToNodes fails. Contributed by Robert Kanter.
|
2015-05-06 16:51:05 -07:00 |
|
Robert Kanter
|
b72507810a
|
YARN-3491. PublicLocalizer#addResource is too slow. (zxu via rkanter)
|
2015-05-06 14:19:06 -07:00 |
|
Jian He
|
0d3188fd25
|
YARN-3301. Fixed the format issue of the new RM attempt web page. Contributed by Xuan Gong
|
2015-05-06 13:45:00 -07:00 |
|
Xuan
|
a583a40693
|
YARN-3582. NPE in WebAppProxyServlet. Contributed by Jian He
|
2015-05-05 21:42:19 -07:00 |
|
Jian He
|
e4c3b52c89
|
YARN-3343. Increased TestCapacitySchedulerNodeLabelUpdate#testNodeUpdate timeout. Contributed by Rohith Sharmaks
|
2015-05-05 11:33:47 -07:00 |