Jian He
30569d930f
YARN-4153. TestAsyncDispatcher failed at branch-2.7. Contributed by Zhihai Xu
2015-09-14 17:48:31 +08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
c05ba079e3
Updating all CHANGES.txt files to move entires from future releases into 2.6.1
...
section given the large number of backports to 2.6.1.
(cherry picked from commit fbbb7ff1ed
)
(cherry picked from commit cbf90f93f9
)
2015-09-10 16:10:56 -07:00
Zhijie Shen
e48bffd055
YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
...
(cherry picked from commit 54504133f4
)
(cherry picked from commit 839f81a632
)
2015-09-10 11:56:27 -07:00
Hitesh Shah
f6b7dc24f0
YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.
...
(cherry picked from commit 265ed1fe80
)
(cherry picked from commit 55b794e7fa
)
2015-09-10 10:55:23 -07:00
Zhihai Xu
4b5767e456
YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.
...
(cherry picked from commit 16b9037dc1
)
2015-09-08 12:43:55 -07:00
Xuan
b55fb0ac44
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
...
state-store error occurs. Contributed by Jian He
(cherry picked from commit 9b78e6e33d
)
(cherry picked from commit a0b7ef15d0
)
2015-09-07 17:47:32 -07:00
Xuan
96b9455c6f
YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.
2015-09-07 17:23:56 -07:00
Jason Lowe
a7eed5128b
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
2015-09-04 16:24:03 +00:00
Jason Lowe
1275ba2cac
Revert "YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li"
...
This reverts commit 71172a0bfc
.
2015-09-04 16:06:19 +00:00
Jason Lowe
71172a0bfc
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
...
(cherry picked from commit 6eaca2e363
)
2015-09-04 15:32:14 +00:00
Varun Vasudev
5002f885fc
YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.
...
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppBlock.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMWebServices.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppAttemptInfo.java
2015-09-04 11:45:51 +05:30
Jian He
2d1ff2e1ca
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
...
(cherry picked from commit 09c64ba1ba
)
2015-09-02 17:46:24 -07:00
Rohith Sharma K S
c2ed7e4a09
YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)
...
(cherry picked from commit 7d6687fe76
)
2015-09-02 15:29:22 +05:30
Vinod Kumar Vavilapalli
015696fb81
YARN-3222. Added the missing CHANGES.txt entry.
...
(cherry picked from commit 4620767156
)
2015-09-01 13:44:51 -07:00
Tsuyoshi Ozawa
1b5bf58001
YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R.
...
(cherry picked from commit faa38e1aa4
)
2015-09-01 17:56:08 +09:00
Jian He
f44ed4f4b0
YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
...
(cherry picked from commit a3fd2ccc86
)
(cherry picked from commit 48f5161cd5
)
2015-08-31 17:46:27 -07:00
Vinod Kumar Vavilapalli
dce4ef20f8
YARN-2945. Fixing the CHANGES.txt to have the right JIRA number.
...
(cherry picked from commit cf831565e8
)
2015-08-30 20:03:28 -07:00
Vinod Kumar Vavilapalli
9faee040f9
Creating 2.6.2 entries in CHANGES.txt files.
...
(cherry picked from commit 33474939a0
)
2015-08-20 17:39:29 -07:00
Zhihai Xu
7409ed783e
YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao.
2015-08-18 12:08:20 -07:00
Jian He
de1c4121a1
YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe
...
(cherry picked from commit 7a445fcfab
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-08-13 16:15:44 -07:00
Xuan
617e294a63
YARN-3999. RM hangs on draing events. Contributed by Jian He
2015-08-11 18:27:23 -07:00
Vinod Kumar Vavilapalli
67ef0989bc
Adding release 2.6.1 to CHANGES.txt
2015-08-11 13:25:36 -07:00
Jonathan Eagles
dcffe43419
YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)
...
(cherry picked from commit 3cd02b9522
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/TestFifoScheduler.java
2015-08-03 10:53:43 -05:00
Jason Lowe
e1ae722a7d
YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt
...
(cherry picked from commit 32e490b6c0
)
2015-07-31 17:39:32 +00:00
Jason Lowe
e8410c0175
YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu
...
(cherry picked from commit ff9c13e0a7
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestContainerLogsPage.java
2015-07-24 22:27:52 +00:00
carlo curino
b465c5b907
YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed
...
(cherry picked from commit fc42fa8ae3
)
(cherry picked from commit bddc48ed86
)
2015-07-24 13:42:13 -07:00
Xuan
c65b6b760f
YARN-3967. Fetch the application report from the AHS if the RM does not
...
know about it. Contributed by Mit Desai
(cherry picked from commit fbd6063269
)
(cherry picked from commit 98ed4bca3b
)
2015-07-24 10:17:51 -07:00
carlo curino
76339bfb9f
YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)
...
(cherry picked from commit 0fcb4a8cf2
)
(cherry picked from commit 6a71a0a230
)
2015-07-24 08:54:59 -07:00
Jian He
65af0dffa5
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena
...
(cherry picked from commit 393fe71771
)
2015-07-21 15:06:32 -07:00
Arun Suresh
63e4ada517
YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)
...
(cherry picked from commit 9b272ccae7
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmcontainer/RMContainerImpl.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
2015-07-18 13:59:19 -07:00
Jonathan Eagles
009f5fbad6
YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles)
...
(cherry picked from commit 7faae0e6fe
)
2015-07-17 11:16:37 -05:00
Tsuyoshi Ozawa
d9427a16b1
YARN-3170. YARN architecture document needs updating. Contirubted by Brahma Reddy Battula.
...
(cherry picked from commit edcaae44c1
)
2015-07-15 15:43:49 +09:00
Jian He
9aa4411325
Revert "YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)"
...
This reverts commit aa067c6aa4
.
(cherry picked from commit 2466460d4c
)
2015-07-13 14:32:18 -07:00
Karthik Kambatla
8bb8006b71
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)
...
(cherry picked from commit aa067c6aa4
)
(cherry picked from commit ccf18705f7
)
2015-07-09 09:50:14 -07:00
Akira Ajisaka
148b4db7e0
YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit d6325745e2
)
(cherry picked from commit d260478d3a
)
2015-07-08 15:43:21 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
dcafd3ccd2
Release process for 2.7.1: Set the release date for 2.7.1.
...
(cherry picked from commit bf89ddb9b8
)
2015-07-06 16:41:38 -07:00
Wangda Tan
a6f6ba95ef
YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda)
2015-07-02 11:08:21 -07:00
Jason Lowe
055d9292a7
YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena
...
(cherry picked from commit b5cdf78e8e
)
2015-07-01 21:15:30 +00:00
Vinod Kumar Vavilapalli
2e99675c72
Adding release 2.7.2 to CHANGES.txt.
...
(cherry picked from commit aad6a7d5db
)
2015-06-28 16:33:49 -07:00
Jason Lowe
baf9e22284
YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena
...
(cherry picked from commit 40b256949a
)
2015-06-26 15:48:34 +00:00
Jason Lowe
41d9677740
YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula
...
(cherry picked from commit 8d58512d6e
)
2015-06-24 16:38:40 +00:00
Jason Lowe
37b89deccf
YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong
...
(cherry picked from commit 2a20dd9b61
)
2015-06-24 16:25:22 +00:00
Karthik Kambatla
6b1a156e27
YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)
...
(cherry picked from commit 5ebf2817e5
)
(cherry picked from commit 9656ee4ee7
)
2015-06-22 17:49:55 -07:00
Xuan
c0a419b134
YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
2015-06-17 16:27:01 -07:00
Tsuyoshi Ozawa
6c527f5514
YARN-3711. Documentation of ResourceManager HA should explain configurations about listen addresses. Contributed by Masatake Iwasaki.
...
(cherry picked from commit e8c514373f
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-06-16 10:16:15 +09:00
Jian He
a78ca0fadc
YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan
...
(cherry picked from commit 6ad4e59cfc
)
2015-06-04 10:53:47 -07:00
Wangda Tan
e74e4d7bb9
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)
...
(cherry picked from commit ebd797c48f
)
2015-06-04 10:26:06 -07:00
Jason Lowe
3d2c3f8648
YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. Contributed by Rohith Sharmaks
...
(cherry picked from commit e13b671aa5
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-06-03 19:46:51 +00:00
Xuan
b34825b0cb
YARN-3753. RM failed to come up with "java.io.IOException: Wait for ZKClient creation timed out". Contributed by Jian He
2015-06-02 10:28:14 -07:00
Xuan
1ad0d43fb4
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
...
This reverts commit 2032e8d1a0
.
2015-06-01 11:29:36 -07:00
Wangda Tan
3f926f4b20
YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)
...
(cherry picked from commit 5cc3fced95
)
2015-05-31 16:35:25 -07:00
Xuan
0943e0f5a8
YARN-2900. Application (Attempt and Container) Not Found in AHS results
...
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
2015-05-31 15:41:13 -07:00
Zhijie Shen
2032e8d1a0
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
2015-05-30 09:39:49 -07:00
Wangda Tan
bb8350388b
YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda)
2015-05-28 17:04:20 -07:00
Xuan
3f188272af
YARN-3723. Need to clearly document primaryFilter and otherInfo value
...
type. Contributed by Zhijie Shen
(cherry picked from commit 3077c299da
)
(cherry picked from commit 550b55146d
)
2015-05-28 10:21:06 -07:00
Wangda Tan
fb57a1aac8
YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
...
(cherry picked from commit cdbd66be11
)
2015-05-26 16:29:27 -07:00
Xuan
23994e824a
YARN-2238. Filtering on UI sticks even if I move away from the page.
...
Contributed by Jian He
(cherry picked from commit 39077dba2e
)
(cherry picked from commit 84245ff3b2
)
2015-05-25 22:41:41 -07:00
Xuan
eb4d1ed612
YARN-3701. Isolating the error of generating a single app report when
...
getting all apps from generic history service. Contributed by Zhijie
Shen
(cherry picked from commit 455b3acf0e
)
(cherry picked from commit 33be070a5e
)
2015-05-22 14:36:30 -07:00
Karthik Kambatla
c60054743f
YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha)
...
(cherry picked from commit a8b50e46737c11936ba72c427da69b2365a07aac)
(cherry picked from commit e8ac88d4fe
)
2015-05-21 13:43:22 -07:00
Devaraj K
b68c338b17
YARN-3646. Applications are getting stuck some times in case of retry
...
policy forever. Contributed by Raju Bairishetti.
(cherry picked from commit 0305316d69
)
2015-05-21 20:16:53 +05:30
Akira Ajisaka
7a8e076ffb
YARN-3694. Fix dead link for TimelineServer REST API. Contributed by Jagadesh Kiran N.
...
(cherry picked from commit a5def58087
)
(cherry picked from commit 6d7e7ef1c4
)
2015-05-21 23:15:59 +09:00
Jian He
ce45e4e82e
YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan
2015-05-20 17:06:59 -07:00
Xuan
b275818925
YARN-3681. yarn cmd says "could not find main class 'queue'" in windows. Contributed by Craig Welch and Varun Saxena
...
(cherry picked from commit a665b22cfa
)
2015-05-20 14:44:31 -07:00
Wangda Tan
114d41aeb2
Backport "YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan" to 2.7.1
2015-05-20 13:27:01 -07:00
Tsuyoshi Ozawa
6c7840f5b5
YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli.
...
(cherry picked from commit 7401e5b5e8
)
2015-05-20 09:02:30 +09:00
Xuan
f0399f56e5
YARN-3601. Fix UT TestRMFailover.testRMWebAppRedirect. Contributed by Weiwei Yang
...
(cherry picked from commit 5009ad4a7f
)
(cherry picked from commit d39039d54d
)
2015-05-19 09:57:44 -07:00
Xuan
411c09b613
YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Contributed by Weiwei Yang
...
(cherry picked from commit b0ad644083
)
(cherry picked from commit 802676e1be
)
2015-05-15 22:41:46 -07:00
Jason Lowe
5161751433
YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du
...
(cherry picked from commit 711d77cc54
)
2015-05-13 21:09:03 +00:00
Jason Lowe
7110499817
YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula
...
(cherry picked from commit 5e093f0d40
)
2015-05-13 20:38:52 +00:00
Jason Lowe
bfd28d6f7e
YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt.
...
(cherry picked from commit ac32fa187c
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-05-13 20:38:52 +00:00
Xuan
9527cdd12d
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
...
(cherry picked from commit 0f95921447
)
(cherry picked from commit 487d9b0f3f
)
2015-05-13 13:12:38 -07:00
Zhijie Shen
071e21cacd
YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
...
(cherry picked from commit fcd0702c10
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-05-12 21:19:33 -07:00
Wangda Tan
6b4adbf460
backport YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed (Jian He) to branch-2.7
2015-05-11 18:05:32 -07:00
Wangda Tan
84f7641f7e
YARN-3434. Interaction between reservations and userlimit can result in significant ULF violation. (Thomas Graves via wangda)
2015-05-11 15:14:06 -07:00
Jason Lowe
a75f4bed6e
YARN-3476. Nodemanager can fail to delete local logs if log aggregation fails. Contributed by Rohith
...
(cherry picked from commit 25e2b02122
)
2015-05-08 22:47:18 +00:00
Jason Lowe
1b95bf9e1b
YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R
...
(cherry picked from commit 9757864fd6
)
2015-05-08 13:48:21 +00:00
Devaraj K
ada2f74b17
YARN-3358. Audit log not present while refreshing Service ACLs.
...
Contributed by Varun Saxena.
(cherry picked from commit ef3d66d462
)
2015-05-08 12:16:13 +05:30
Vinod Kumar Vavilapalli
3d1d551c33
YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based state-store to avoid crashing on duplicate deletes. Contributed by Zhihai Xu.
...
(cherry picked from commit 4c7b9b6abe
)
2015-05-06 17:57:49 -07:00
Karthik Kambatla
419b8f68f4
Fix up author name to Jun Gong in CHANGES.txt for YARN-3469
...
(cherry picked from commit 5cda6fffd3
)
2015-05-06 17:57:36 -07:00
Karthik Kambatla
fbd4bbb07b
YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha)
...
(cherry picked from commit e516706b89
)
2015-05-06 17:57:13 -07:00
Jian He
4e8e9d717c
YARN-3301. Fixed the format issue of the new RM attempt web page. Contributed by Xuan Gong
2015-05-06 14:00:29 -07:00
Wangda Tan
3389bac42a
YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda)
...
(cherry picked from commit 7d46a806e7
)
(cherry picked from commit 4151e5729a
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-05-01 16:47:06 -07:00
Jian He
a38dbbc5b1
YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.
...
(cherry picked from commit 487374b7fe
)
(cherry picked from commit 1c601e492f
)
2015-04-30 13:51:13 -07:00
Zhijie Shen
04dd05989e
YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong.
2015-04-30 13:07:15 -07:00
Karthik Kambatla
396c41b1d4
YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha)
...
(cherry picked from commit 8f82970e0c
)
(cherry picked from commit 4cc38df7de
)
2015-04-28 21:07:32 -07:00
Karthik Kambatla
4ddcc7e5b5
YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha)
...
(cherry picked from commit 47279c3228
)
(cherry picked from commit 4045c41afe
)
2015-04-27 13:37:06 -07:00
Xuan
bec78f9b85
YARN-3516. killing ContainerLocalizer action doesn't take effect when
...
private localizer receives FETCH_FAILURE status. Contributed by zhihai
xu
(cherry picked from commit 0b3f8957a8
)
(cherry picked from commit 8f6053ae51
)
2015-04-27 13:35:38 -07:00
Karthik Kambatla
b5cc78e57e
YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha)
...
(cherry picked from commit 6495940eae
)
(cherry picked from commit 53e0bf5c17
)
2015-04-27 12:39:21 -07:00
Jian He
5cf35b98e1
YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks
...
(cherry picked from commit a1afbc48b5
)
2015-04-23 17:43:41 -07:00
Jian He
6cc0e9baa1
YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal
...
(cherry picked from commit 944a16579f
)
2015-04-23 17:40:56 -07:00
Karthik Kambatla
e1843c9a46
YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
...
(cherry picked from commit 20b49224eb
)
2015-04-23 17:39:50 -07:00
Jian He
b2568d69fc
YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen
...
(cherry picked from commit aa4a192feb
)
2015-04-23 11:08:16 -07:00
Steve Loughran
b3f2826bfb
YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel)
2015-04-23 09:22:09 +01:00
Vinod Kumar Vavilapalli
7dd5f42a76
Set the release date for 2.7.0
...
(cherry picked from commit d52de61544
)
2015-04-20 20:18:38 -07:00
Jian He
b493ec28a8
YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe
...
(cherry picked from commit f967fd2f21
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-04-20 10:41:17 -07:00
Wangda Tan
d6105d944c
YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda)
...
(cherry picked from commit f47a5763ac
)
2015-04-17 17:23:34 -07:00
Harsh J
d4a462c02e
YARN-3462. Patches applied for YARN-2424 are inconsistent between trunk and branch-2. Contributed by Naganarasimha G R.
2015-04-15 09:42:20 +05:30
Jason Lowe
70ac8cda41
YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda)
...
(cherry picked from commit 73d9e4c77b
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-04-10 13:52:34 +00:00
Vinod Kumar Vavilapalli
2b44fcaa53
Adding release 2.7.1 to CHANGES.txt
...
(cherry picked from commit 623fd46c1e
)
2015-04-09 14:01:23 -07:00
Vinod Kumar Vavilapalli
4c6867ff01
YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp.
...
(cherry picked from commit 9c5911294e
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-04-09 13:11:26 -07:00
Zhijie Shen
64cf079858
YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong.
...
(cherry picked from commit 8366a36ad3
)
2015-04-06 13:18:16 -07:00
Jian He
edc3cb736e
YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks
...
(cherry picked from commit 658097d6da
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/AppAttemptBlock.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerLeafQueueInfo.java
2015-04-06 13:17:31 -07:00
Zhijie Shen
cf33bc1050
Revert "YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong."
...
This reverts commit e4059b9cce
.
2015-04-01 16:41:25 -07:00
Zhijie Shen
e4059b9cce
YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong.
...
(cherry picked from commit 8366a36ad3
)
2015-04-01 13:49:51 -07:00
Vinod Kumar Vavilapalli
35af6f1802
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
...
(cherry picked from commit c358368f51
)
2015-03-30 10:11:49 -07:00
Xuan
646710318c
YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG.
...
Contributed by Varun Saxena
(cherry picked from commit e556198e71
)
2015-03-25 04:53:31 -07:00
Xuan
4dfd84ec08
YARN-3393. Getting application(s) goes wrong when app finishes before
...
starting the attempt. Contributed by Zhijie Shen
(cherry picked from commit 9fae455e26
)
2015-03-23 20:34:59 -07:00
cnauroth
57e297208d
YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
...
(cherry picked from commit 6ca1f12024
)
(cherry picked from commit 342c525eaa
)
2015-03-23 10:46:22 -07:00
Tsuyoshi Ozawa
d2e19160dc
YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R.
...
(cherry picked from commit 82eda771e0
)
2015-03-24 00:26:08 +09:00
Wangda Tan
57a0382f4b
YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda)
...
(cherry picked from commit 6bc7710ec7
)
2015-03-20 10:44:34 -07:00
Xuan
b63ff4c36d
YARN-2777. Mark the end of individual log in aggregated log. Contributed
...
by Varun Saxena
(cherry picked from commit 1a4b528691
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-03-20 10:28:24 -07:00
Jian He
e67bd31ac0
YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong
...
(cherry picked from commit 4e886eb9cb
)
2015-03-19 22:34:34 -07:00
Jian He
54e63c52c9
Backport part of YARN-3273 to rename CapacitySchedulerLeafQueueInfo#aMResourceLimit to AMResourceLimit. Contributed by Rohith Sharmaks
2015-03-17 22:08:10 -07:00
Karthik Kambatla
47e6fc2bf9
Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
...
This reverts commit c2b185def8
.
(cherry picked from commit 32b4330456
)
2015-03-17 12:32:14 -07:00
Tsuyoshi Ozawa
f15a2b23ca
YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu.
...
(cherry picked from commit 7522a643fa
)
2015-03-17 08:10:57 +09:00
Zhijie Shen
d702816e7d
YARN-2854. Updated the documentation of the timeline service and the generic history service. Contributed by Naganarasimha G R.
...
(cherry picked from commit fbe811d904
)
2015-03-16 11:02:06 -07:00
Tsuyoshi Ozawa
2b2f7f2b90
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
...
(cherry picked from commit 3da9a97cfb
)
2015-03-16 23:20:34 +09:00
Xuan
6ee45ae3a8
YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't
...
work in ATS / RM web ui. Contributed by Naganarasimha G R
(cherry picked from commit 3ff1ba2a7b
)
2015-03-15 20:28:09 -07:00
Jonathan Eagles
e4d8dddb49
YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles)
...
(cherry picked from commit 8180e676ab
)
2015-03-13 12:12:40 -05:00
Vinod Kumar Vavilapalli
0cd9eb9987
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
...
(cherry picked from commit 863079bb87
)
2015-03-12 13:34:33 -07:00
Xuan
8b008c8714
YARN-3338. Exclude jline dependency from YARN. Contributed by Zhijie
...
Shen
(cherry picked from commit 06ce1d9a6c
)
2015-03-12 10:26:38 -07:00
Zhijie Shen
ec9816b2b3
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
...
(cherry picked from commit 85f6d67fa7
)
2015-03-11 19:41:20 -07:00
Tsuyoshi Ozawa
a5a933a9a0
YARN-3295. Fix documentation nits found in markdown conversion. Contributed by Masatake Iwasaki.
...
(cherry picked from commit 30c428a858
)
2015-03-11 15:02:59 +09:00
Jian He
8c5642296d
YARN-3187. Documentation of Capacity Scheduler Queue mapping based on user or group. Contributed by Gururaj Shetty
...
(cherry picked from commit a380643d20
)
2015-03-10 11:17:16 -07:00
Jian He
d579fddf24
YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong
...
(cherry picked from commit c3003eba6f
)
2015-03-09 20:48:09 -07:00
Zhijie Shen
6527be374b
YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles.
...
(cherry picked from commit d6e05c5ee2
)
2015-03-09 15:52:06 -07:00
Junping Du
b91e1b0feb
YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable resource monitoring. Contributed by Hitesh Shah
...
(cherry picked from commit 7ce3c76353
)
2015-03-08 14:48:42 -07:00
Jason Lowe
ef3d9bdf6b
YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne
...
(cherry picked from commit 27e8ea820f
)
2015-03-06 22:45:09 +00:00
Jian He
6cef2c16de
YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
...
(cherry picked from commit 21101c01f2
)
2015-03-06 14:18:56 -08:00
Xuan
56c2050ab7
YARN-3227. Timeline renew delegation token fails when RM user's TGT is
...
expired. Contributed by Zhijie Shen
(cherry picked from commit d1abc5d4fc
)
2015-03-06 13:33:18 -08:00
Jian He
a5f3fb4dc1
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
...
(cherry picked from commit 95bfd087dc
)
2015-03-05 21:27:03 -08:00
Vinod Kumar Vavilapalli
9c8882546a
YARN-2786. Created a yarn cluster CLI and seeded with one command for listing node-labels collection. Contributed by Wangda Tan.
2015-03-05 10:56:28 -08:00
Tsuyoshi Ozawa
5680b41597
Update CHANGES.txt for YARN-2616 to fix indentation.
...
(cherry picked from commit 28b85a2116
)
2015-03-06 00:53:20 +09:00
Tsuyoshi Ozawa
6660c2f83b
YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi.
...
(cherry picked from commit 1b67209612
)
2015-03-05 19:56:59 +09:00
Karthik Kambatla
0d62e94887
YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)
...
(cherry picked from commit 8d88691d16
)
2015-03-04 19:49:21 -08:00
Karthik Kambatla
721d7b5741
YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha)
...
(cherry picked from commit 22426a1c9f
)
2015-03-04 18:07:33 -08:00
Karthik Kambatla
1749094fab
YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha)
...
(cherry picked from commit 53947f37c7
)
2015-03-04 17:39:39 -08:00
Jason Lowe
ab397194c3
YARN-3131. YarnClientImpl should check FAILED and KILLED state in submitApplication. Contributed by Chang Li
...
(cherry picked from commit 03cc22945e
)
2015-03-04 18:05:20 +00:00
Jian He
aafe571398
YARN-3285. (Backport YARN-3168) Convert branch-2 .apt.vm files of YARN to markdown. Contributed by Masatake Iwasaki
2015-03-03 16:44:59 -08:00
Wangda Tan
0a502c665b
YARN-3272. Surface container locality info in RM web UI (Jian He via wangda)
...
(cherry picked from commit e17e5ba9d7
)
2015-03-03 11:49:45 -08:00
Vinod Kumar Vavilapalli
253c78548b
YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan.
...
(cherry picked from commit 14dd647c55
)
2015-03-02 17:54:01 -08:00
Wangda Tan
19a8e48230
YARN-3270. Fix node label expression not getting set in ApplicationSubmissionContext (Rohit Agarwal via wangda)
...
(cherry picked from commit abac6eb9d5
)
2015-03-02 17:24:55 -08:00
Jian He
76b7283fa1
YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu
...
(cherry picked from commit 5d0bae550f
)
2015-03-02 14:43:12 -08:00
Wangda Tan
0b0be0056b
YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)
...
(cherry picked from commit edcecedc1c
)
2015-02-27 16:14:35 -08:00
Tsuyoshi Ozawa
79f73f4613
YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.
...
(cherry picked from commit 01a1621930
)
2015-02-28 00:57:01 +09:00
Konstantin V Shvachko
9e67f2cb0d
YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko.
2015-02-26 17:26:08 -08:00
Tsuyoshi Ozawa
dc348f4894
YARN-3217. Remove httpclient dependency from hadoop-yarn-server-web-proxy. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 773b6515ac
)
2015-02-27 00:25:12 +09:00
Devaraj K
f83d2e4410
YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against
...
all Schedulers even when using ParameterizedSchedulerTestBase. Contributed
by Anubhav Dhoot.
(cherry picked from commit 0d4296f0e0
)
2015-02-26 15:47:32 +05:30
Jason Lowe
257087417e
YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params. Contributed by Jian He
...
(cherry picked from commit 1a68fc4346
)
2015-02-25 16:15:35 +00:00
Tsuyoshi Ozawa
13e213c41a
YARN-3247. TestQueueMappings should use CapacityScheduler explicitly. Contributed by Zhihai Xu.
...
(cherry picked from commit 6cbd9f1113
)
2015-02-25 11:23:34 +09:00