Jason Lowe
493f072008
YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu
...
(cherry picked from commit 854d25b0c3
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestLocalResourcesTrackerImpl.java
2015-09-30 15:08:10 +00:00
Anubhav Dhoot
7c9a368b45
YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot)
...
(cherry picked from commit 9735afe967
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterLauncher.java
(cherry picked from commit 22f2501476
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockRM.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterLauncher.java
2015-09-28 20:57:08 -07:00
Xuan
4c6e24528d
YARN-3624. ApplicationHistoryServer should not reverse the order of the
...
filters it gets. Contributed by Mit Desai
(cherry picked from commit d1b9b85244
)
(cherry picked from commit bf3f08cc63
)
2015-09-24 15:04:37 -07:00
Xuan
dce9223622
YARN-3248. Display count of nodes blacklisted by apps in the web UI.
...
Contributed by Varun Vasudev
(cherry picked from commit 4728bdfa15
)
2015-09-23 14:44:42 -07:00
Zhijie Shen
6540d5aed7
YARN-3740. Fixed the typo in the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong.
...
(cherry picked from commit eb6bf91eea
)
(cherry picked from commit 68cddb894a
)
2015-09-23 13:54:30 -07:00
Jason Lowe
3fac56e824
YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai
2015-09-23 16:41:49 +00:00
Karthik Kambatla
f3fd5e30cd
YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
...
(cherry picked from commit 332b520a48
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
2015-09-17 23:35:47 -07:00
Jason Lowe
30ebb792f9
YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu
...
(cherry picked from commit 8c1cdb17a0
)
2015-09-15 20:23:11 +00:00
Jian He
30569d930f
YARN-4153. TestAsyncDispatcher failed at branch-2.7. Contributed by Zhihai Xu
2015-09-14 17:48:31 +08:00
Zhijie Shen
e48bffd055
YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
...
(cherry picked from commit 54504133f4
)
(cherry picked from commit 839f81a632
)
2015-09-10 11:56:27 -07:00
Hitesh Shah
f6b7dc24f0
YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.
...
(cherry picked from commit 265ed1fe80
)
(cherry picked from commit 55b794e7fa
)
2015-09-10 10:55:23 -07:00
Zhihai Xu
4b5767e456
YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.
...
(cherry picked from commit 16b9037dc1
)
2015-09-08 12:43:55 -07:00
Xuan
b55fb0ac44
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
...
state-store error occurs. Contributed by Jian He
(cherry picked from commit 9b78e6e33d
)
(cherry picked from commit a0b7ef15d0
)
2015-09-07 17:47:32 -07:00
Xuan
96b9455c6f
YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.
2015-09-07 17:23:56 -07:00
Jason Lowe
a7eed5128b
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
2015-09-04 16:24:03 +00:00
Jason Lowe
1275ba2cac
Revert "YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li"
...
This reverts commit 71172a0bfc
.
2015-09-04 16:06:19 +00:00
Jason Lowe
71172a0bfc
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
...
(cherry picked from commit 6eaca2e363
)
2015-09-04 15:32:14 +00:00
Varun Vasudev
5002f885fc
YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.
...
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppBlock.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMWebServices.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppAttemptInfo.java
2015-09-04 11:45:51 +05:30
Jian He
2d1ff2e1ca
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
...
(cherry picked from commit 09c64ba1ba
)
2015-09-02 17:46:24 -07:00
Rohith Sharma K S
c2ed7e4a09
YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)
...
(cherry picked from commit 7d6687fe76
)
2015-09-02 15:29:22 +05:30
Tsuyoshi Ozawa
1b5bf58001
YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R.
...
(cherry picked from commit faa38e1aa4
)
2015-09-01 17:56:08 +09:00
Jian He
f44ed4f4b0
YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
...
(cherry picked from commit a3fd2ccc86
)
(cherry picked from commit 48f5161cd5
)
2015-08-31 17:46:27 -07:00
Vinod Kumar Vavilapalli
f333e367e1
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
...
(cherry picked from commit 9da81a3955
)
2015-08-20 17:39:43 -07:00
Zhihai Xu
7409ed783e
YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao.
2015-08-18 12:08:20 -07:00
Jian He
de1c4121a1
YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe
...
(cherry picked from commit 7a445fcfab
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-08-13 16:15:44 -07:00
Xuan
617e294a63
YARN-3999. RM hangs on draing events. Contributed by Jian He
2015-08-11 18:27:23 -07:00
Jonathan Eagles
dcffe43419
YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)
...
(cherry picked from commit 3cd02b9522
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/TestFifoScheduler.java
2015-08-03 10:53:43 -05:00
Jason Lowe
e1ae722a7d
YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt
...
(cherry picked from commit 32e490b6c0
)
2015-07-31 17:39:32 +00:00
Jason Lowe
e8410c0175
YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu
...
(cherry picked from commit ff9c13e0a7
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestContainerLogsPage.java
2015-07-24 22:27:52 +00:00
Xuan
c65b6b760f
YARN-3967. Fetch the application report from the AHS if the RM does not
...
know about it. Contributed by Mit Desai
(cherry picked from commit fbd6063269
)
(cherry picked from commit 98ed4bca3b
)
2015-07-24 10:17:51 -07:00
carlo curino
76339bfb9f
YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)
...
(cherry picked from commit 0fcb4a8cf2
)
(cherry picked from commit 6a71a0a230
)
2015-07-24 08:54:59 -07:00
Jian He
65af0dffa5
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena
...
(cherry picked from commit 393fe71771
)
2015-07-21 15:06:32 -07:00
Arun Suresh
63e4ada517
YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)
...
(cherry picked from commit 9b272ccae7
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmcontainer/RMContainerImpl.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java
2015-07-18 13:59:19 -07:00
Jonathan Eagles
009f5fbad6
YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles)
...
(cherry picked from commit 7faae0e6fe
)
2015-07-17 11:16:37 -05:00
Tsuyoshi Ozawa
d9427a16b1
YARN-3170. YARN architecture document needs updating. Contirubted by Brahma Reddy Battula.
...
(cherry picked from commit edcaae44c1
)
2015-07-15 15:43:49 +09:00
Jian He
9aa4411325
Revert "YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)"
...
This reverts commit aa067c6aa4
.
(cherry picked from commit 2466460d4c
)
2015-07-13 14:32:18 -07:00
Karthik Kambatla
8bb8006b71
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)
...
(cherry picked from commit aa067c6aa4
)
(cherry picked from commit ccf18705f7
)
2015-07-09 09:50:14 -07:00
Akira Ajisaka
148b4db7e0
YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit d6325745e2
)
(cherry picked from commit d260478d3a
)
2015-07-08 15:43:21 +09:00
Wangda Tan
a6f6ba95ef
YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda)
2015-07-02 11:08:21 -07:00
Jason Lowe
055d9292a7
YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena
...
(cherry picked from commit b5cdf78e8e
)
2015-07-01 21:15:30 +00:00
Vinod Kumar Vavilapalli
a36f090c55
Preparing for 2.7.2 development: mvn versions:set -DnewVersion=2.7.2
2015-06-28 16:41:12 -07:00
Jason Lowe
baf9e22284
YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena
...
(cherry picked from commit 40b256949a
)
2015-06-26 15:48:34 +00:00
Jason Lowe
41d9677740
YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula
...
(cherry picked from commit 8d58512d6e
)
2015-06-24 16:38:40 +00:00
Jason Lowe
37b89deccf
YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong
...
(cherry picked from commit 2a20dd9b61
)
2015-06-24 16:25:22 +00:00
Karthik Kambatla
6b1a156e27
YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)
...
(cherry picked from commit 5ebf2817e5
)
(cherry picked from commit 9656ee4ee7
)
2015-06-22 17:49:55 -07:00
Xuan
c0a419b134
YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
2015-06-17 16:27:01 -07:00
Tsuyoshi Ozawa
6c527f5514
YARN-3711. Documentation of ResourceManager HA should explain configurations about listen addresses. Contributed by Masatake Iwasaki.
...
(cherry picked from commit e8c514373f
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-06-16 10:16:15 +09:00
Wangda Tan
6b05575c72
Add missing test file of YARN-3733
...
(cherry picked from commit 405bbcf68c
)
2015-06-04 13:19:41 -07:00
Jian He
a78ca0fadc
YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan
...
(cherry picked from commit 6ad4e59cfc
)
2015-06-04 10:53:47 -07:00
Wangda Tan
e74e4d7bb9
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)
...
(cherry picked from commit ebd797c48f
)
2015-06-04 10:26:06 -07:00
Jason Lowe
3d2c3f8648
YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. Contributed by Rohith Sharmaks
...
(cherry picked from commit e13b671aa5
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-06-03 19:46:51 +00:00
Xuan
b34825b0cb
YARN-3753. RM failed to come up with "java.io.IOException: Wait for ZKClient creation timed out". Contributed by Jian He
2015-06-02 10:28:14 -07:00
Xuan
1ad0d43fb4
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
...
This reverts commit 2032e8d1a0
.
2015-06-01 11:29:36 -07:00
Wangda Tan
3f926f4b20
YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)
...
(cherry picked from commit 5cc3fced95
)
2015-05-31 16:35:25 -07:00
Xuan
0943e0f5a8
YARN-2900. Application (Attempt and Container) Not Found in AHS results
...
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
2015-05-31 15:41:13 -07:00
Zhijie Shen
2032e8d1a0
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
2015-05-30 09:39:49 -07:00
Vinod Kumar Vavilapalli
9449b72429
Fixed more FilesSystemRMStateStore issues. Contributed by Vinod Kumar Vavilapalli.
...
(cherry picked from commit 9acd24fec4
)
2015-05-29 13:29:44 -07:00
Wangda Tan
bb8350388b
YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda)
2015-05-28 17:04:20 -07:00
Xuan
3f188272af
YARN-3723. Need to clearly document primaryFilter and otherInfo value
...
type. Contributed by Zhijie Shen
(cherry picked from commit 3077c299da
)
(cherry picked from commit 550b55146d
)
2015-05-28 10:21:06 -07:00
cnauroth
02ab202a2b
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
...
(cherry picked from commit 7bc33b63c78c6ee9a04c0c1511ef16e63f7f3074)
(cherry picked from commit 6ed8989a6f
)
2015-05-27 14:21:26 -07:00
Wangda Tan
fb57a1aac8
YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
...
(cherry picked from commit cdbd66be11
)
2015-05-26 16:29:27 -07:00
Xuan
23994e824a
YARN-2238. Filtering on UI sticks even if I move away from the page.
...
Contributed by Jian He
(cherry picked from commit 39077dba2e
)
(cherry picked from commit 84245ff3b2
)
2015-05-25 22:41:41 -07:00
Xuan
eb4d1ed612
YARN-3701. Isolating the error of generating a single app report when
...
getting all apps from generic history service. Contributed by Zhijie
Shen
(cherry picked from commit 455b3acf0e
)
(cherry picked from commit 33be070a5e
)
2015-05-22 14:36:30 -07:00
Karthik Kambatla
c60054743f
YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha)
...
(cherry picked from commit a8b50e46737c11936ba72c427da69b2365a07aac)
(cherry picked from commit e8ac88d4fe
)
2015-05-21 13:43:22 -07:00
Devaraj K
b68c338b17
YARN-3646. Applications are getting stuck some times in case of retry
...
policy forever. Contributed by Raju Bairishetti.
(cherry picked from commit 0305316d69
)
2015-05-21 20:16:53 +05:30
Jian He
ce45e4e82e
YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan
2015-05-20 17:06:59 -07:00
Xuan
b275818925
YARN-3681. yarn cmd says "could not find main class 'queue'" in windows. Contributed by Craig Welch and Varun Saxena
...
(cherry picked from commit a665b22cfa
)
2015-05-20 14:44:31 -07:00
Wangda Tan
114d41aeb2
Backport "YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan" to 2.7.1
2015-05-20 13:27:01 -07:00
Tsuyoshi Ozawa
6c7840f5b5
YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli.
...
(cherry picked from commit 7401e5b5e8
)
2015-05-20 09:02:30 +09:00
Xuan
f0399f56e5
YARN-3601. Fix UT TestRMFailover.testRMWebAppRedirect. Contributed by Weiwei Yang
...
(cherry picked from commit 5009ad4a7f
)
(cherry picked from commit d39039d54d
)
2015-05-19 09:57:44 -07:00
Xuan
411c09b613
YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Contributed by Weiwei Yang
...
(cherry picked from commit b0ad644083
)
(cherry picked from commit 802676e1be
)
2015-05-15 22:41:46 -07:00
Vinod Kumar Vavilapalli
3c51654d57
Fixing HDFS state-store. Contributed by Arun Suresh.
...
(cherry picked from commit 9a2a9553ee
)
(cherry picked from commit ad3196e016
)
2015-05-14 18:33:51 -07:00
Jason Lowe
5161751433
YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du
...
(cherry picked from commit 711d77cc54
)
2015-05-13 21:09:03 +00:00
Jason Lowe
7110499817
YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula
...
(cherry picked from commit 5e093f0d40
)
2015-05-13 20:38:52 +00:00
Jason Lowe
bfd28d6f7e
YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt.
...
(cherry picked from commit ac32fa187c
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-05-13 20:38:52 +00:00
Xuan
9527cdd12d
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
...
(cherry picked from commit 0f95921447
)
(cherry picked from commit 487d9b0f3f
)
2015-05-13 13:12:38 -07:00
cnauroth
82530ba0f1
HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth.
...
(cherry picked from commit ddc4afeff2
)
2015-05-13 12:26:02 -07:00
Zhijie Shen
071e21cacd
YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
...
(cherry picked from commit fcd0702c10
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-05-12 21:19:33 -07:00
Wangda Tan
6b4adbf460
backport YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed (Jian He) to branch-2.7
2015-05-11 18:05:32 -07:00
Wangda Tan
84f7641f7e
YARN-3434. Interaction between reservations and userlimit can result in significant ULF violation. (Thomas Graves via wangda)
2015-05-11 15:14:06 -07:00
Jason Lowe
a75f4bed6e
YARN-3476. Nodemanager can fail to delete local logs if log aggregation fails. Contributed by Rohith
...
(cherry picked from commit 25e2b02122
)
2015-05-08 22:47:18 +00:00
Jason Lowe
1b95bf9e1b
YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R
...
(cherry picked from commit 9757864fd6
)
2015-05-08 13:48:21 +00:00
Devaraj K
ada2f74b17
YARN-3358. Audit log not present while refreshing Service ACLs.
...
Contributed by Varun Saxena.
(cherry picked from commit ef3d66d462
)
2015-05-08 12:16:13 +05:30
Vinod Kumar Vavilapalli
3d1d551c33
YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based state-store to avoid crashing on duplicate deletes. Contributed by Zhihai Xu.
...
(cherry picked from commit 4c7b9b6abe
)
2015-05-06 17:57:49 -07:00
Karthik Kambatla
fbd4bbb07b
YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha)
...
(cherry picked from commit e516706b89
)
2015-05-06 17:57:13 -07:00
Jian He
4e8e9d717c
YARN-3301. Fixed the format issue of the new RM attempt web page. Contributed by Xuan Gong
2015-05-06 14:00:29 -07:00
Jian He
a38dbbc5b1
YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.
...
(cherry picked from commit 487374b7fe
)
(cherry picked from commit 1c601e492f
)
2015-04-30 13:51:13 -07:00
Zhijie Shen
04dd05989e
YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong.
2015-04-30 13:07:15 -07:00
Karthik Kambatla
396c41b1d4
YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha)
...
(cherry picked from commit 8f82970e0c
)
(cherry picked from commit 4cc38df7de
)
2015-04-28 21:07:32 -07:00
Karthik Kambatla
4ddcc7e5b5
YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha)
...
(cherry picked from commit 47279c3228
)
(cherry picked from commit 4045c41afe
)
2015-04-27 13:37:06 -07:00
Xuan
bec78f9b85
YARN-3516. killing ContainerLocalizer action doesn't take effect when
...
private localizer receives FETCH_FAILURE status. Contributed by zhihai
xu
(cherry picked from commit 0b3f8957a8
)
(cherry picked from commit 8f6053ae51
)
2015-04-27 13:35:38 -07:00
Karthik Kambatla
b5cc78e57e
YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha)
...
(cherry picked from commit 6495940eae
)
(cherry picked from commit 53e0bf5c17
)
2015-04-27 12:39:21 -07:00
Jian He
5cf35b98e1
YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks
...
(cherry picked from commit a1afbc48b5
)
2015-04-23 17:43:41 -07:00
Jian He
6cc0e9baa1
YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal
...
(cherry picked from commit 944a16579f
)
2015-04-23 17:40:56 -07:00
Karthik Kambatla
e1843c9a46
YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
...
(cherry picked from commit 20b49224eb
)
2015-04-23 17:39:50 -07:00
Jian He
b2568d69fc
YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen
...
(cherry picked from commit aa4a192feb
)
2015-04-23 11:08:16 -07:00
Steve Loughran
b3f2826bfb
YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel)
2015-04-23 09:22:09 +01:00
Jian He
b493ec28a8
YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe
...
(cherry picked from commit f967fd2f21
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-04-20 10:41:17 -07:00
Wangda Tan
d6105d944c
YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda)
...
(cherry picked from commit f47a5763ac
)
2015-04-17 17:23:34 -07:00
Akira Ajisaka
48d6e994bf
MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
...
(cherry picked from commit 1fa8075794
)
(cherry picked from commit 51c458a5c4
)
2015-04-16 10:16:48 -05:00
Harsh J
d4a462c02e
YARN-3462. Patches applied for YARN-2424 are inconsistent between trunk and branch-2. Contributed by Naganarasimha G R.
2015-04-15 09:42:20 +05:30
Jason Lowe
70ac8cda41
YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda)
...
(cherry picked from commit 73d9e4c77b
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-04-10 13:52:34 +00:00
Vinod Kumar Vavilapalli
a7fa46c2e0
Preparing for 2.7.1 development: mvn versions:set
2015-04-09 14:13:30 -07:00
Vinod Kumar Vavilapalli
4c6867ff01
YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp.
...
(cherry picked from commit 9c5911294e
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-04-09 13:11:26 -07:00
Zhijie Shen
64cf079858
YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong.
...
(cherry picked from commit 8366a36ad3
)
2015-04-06 13:18:16 -07:00
Jian He
edc3cb736e
YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks
...
(cherry picked from commit 658097d6da
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/AppAttemptBlock.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/CapacitySchedulerLeafQueueInfo.java
2015-04-06 13:17:31 -07:00
Zhijie Shen
cf33bc1050
Revert "YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong."
...
This reverts commit e4059b9cce
.
2015-04-01 16:41:25 -07:00
Zhijie Shen
e4059b9cce
YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong.
...
(cherry picked from commit 8366a36ad3
)
2015-04-01 13:49:51 -07:00
Vinod Kumar Vavilapalli
3acfde6d85
YARN-3304. Addendum patch. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. (Junping Du and Karthik Kambatla via vinodkv)
...
(cherry picked from commit 7610925e90
)
2015-03-31 17:29:18 -07:00
Vinod Kumar Vavilapalli
35af6f1802
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
...
(cherry picked from commit c358368f51
)
2015-03-30 10:11:49 -07:00
Haohui Mai
28095c26f7
HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng.
2015-03-25 12:30:58 -07:00
Xuan
646710318c
YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG.
...
Contributed by Varun Saxena
(cherry picked from commit e556198e71
)
2015-03-25 04:53:31 -07:00
Xuan
4dfd84ec08
YARN-3393. Getting application(s) goes wrong when app finishes before
...
starting the attempt. Contributed by Zhijie Shen
(cherry picked from commit 9fae455e26
)
2015-03-23 20:34:59 -07:00
cnauroth
57e297208d
YARN-3336. FileSystem memory leak in DelegationTokenRenewer.
...
(cherry picked from commit 6ca1f12024
)
(cherry picked from commit 342c525eaa
)
2015-03-23 10:46:22 -07:00
Tsuyoshi Ozawa
d2e19160dc
YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R.
...
(cherry picked from commit 82eda771e0
)
2015-03-24 00:26:08 +09:00
Wangda Tan
57a0382f4b
YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda)
...
(cherry picked from commit 6bc7710ec7
)
2015-03-20 10:44:34 -07:00
Xuan
b63ff4c36d
YARN-2777. Mark the end of individual log in aggregated log. Contributed
...
by Varun Saxena
(cherry picked from commit 1a4b528691
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-03-20 10:28:24 -07:00
Jian He
e67bd31ac0
YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong
...
(cherry picked from commit 4e886eb9cb
)
2015-03-19 22:34:34 -07:00
Jian He
54e63c52c9
Backport part of YARN-3273 to rename CapacitySchedulerLeafQueueInfo#aMResourceLimit to AMResourceLimit. Contributed by Rohith Sharmaks
2015-03-17 22:08:10 -07:00
Karthik Kambatla
47e6fc2bf9
Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)"
...
This reverts commit c2b185def8
.
(cherry picked from commit 32b4330456
)
2015-03-17 12:32:14 -07:00
Tsuyoshi Ozawa
f15a2b23ca
YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu.
...
(cherry picked from commit 7522a643fa
)
2015-03-17 08:10:57 +09:00
Zhijie Shen
d702816e7d
YARN-2854. Updated the documentation of the timeline service and the generic history service. Contributed by Naganarasimha G R.
...
(cherry picked from commit fbe811d904
)
2015-03-16 11:02:06 -07:00
Tsuyoshi Ozawa
2b2f7f2b90
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
...
(cherry picked from commit 3da9a97cfb
)
2015-03-16 23:20:34 +09:00
Xuan
6ee45ae3a8
YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't
...
work in ATS / RM web ui. Contributed by Naganarasimha G R
(cherry picked from commit 3ff1ba2a7b
)
2015-03-15 20:28:09 -07:00
Jonathan Eagles
e4d8dddb49
YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles)
...
(cherry picked from commit 8180e676ab
)
2015-03-13 12:12:40 -05:00
Vinod Kumar Vavilapalli
0cd9eb9987
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
...
(cherry picked from commit 863079bb87
)
2015-03-12 13:34:33 -07:00
Zhijie Shen
ec9816b2b3
YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
...
(cherry picked from commit 85f6d67fa7
)
2015-03-11 19:41:20 -07:00
Tsuyoshi Ozawa
a5a933a9a0
YARN-3295. Fix documentation nits found in markdown conversion. Contributed by Masatake Iwasaki.
...
(cherry picked from commit 30c428a858
)
2015-03-11 15:02:59 +09:00
Jian He
8c5642296d
YARN-3187. Documentation of Capacity Scheduler Queue mapping based on user or group. Contributed by Gururaj Shetty
...
(cherry picked from commit a380643d20
)
2015-03-10 11:17:16 -07:00
Jian He
d579fddf24
YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong
...
(cherry picked from commit c3003eba6f
)
2015-03-09 20:48:09 -07:00
Zhijie Shen
6527be374b
YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles.
...
(cherry picked from commit d6e05c5ee2
)
2015-03-09 15:52:06 -07:00
Tsuyoshi Ozawa
28f4e6b222
HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa)
...
(cherry picked from commit b46f9e72db
)
2015-03-09 19:54:45 +09:00
Junping Du
b91e1b0feb
YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable resource monitoring. Contributed by Hitesh Shah
...
(cherry picked from commit 7ce3c76353
)
2015-03-08 14:48:42 -07:00
Jason Lowe
ef3d9bdf6b
YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne
...
(cherry picked from commit 27e8ea820f
)
2015-03-06 22:45:09 +00:00
Jian He
6cef2c16de
YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
...
(cherry picked from commit 21101c01f2
)
2015-03-06 14:18:56 -08:00
Xuan
56c2050ab7
YARN-3227. Timeline renew delegation token fails when RM user's TGT is
...
expired. Contributed by Zhijie Shen
(cherry picked from commit d1abc5d4fc
)
2015-03-06 13:33:18 -08:00
Jian He
a5f3fb4dc1
YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
...
(cherry picked from commit 95bfd087dc
)
2015-03-05 21:27:03 -08:00
Vinod Kumar Vavilapalli
9c8882546a
YARN-2786. Created a yarn cluster CLI and seeded with one command for listing node-labels collection. Contributed by Wangda Tan.
2015-03-05 10:56:28 -08:00
Tsuyoshi Ozawa
6660c2f83b
YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi.
...
(cherry picked from commit 1b67209612
)
2015-03-05 19:56:59 +09:00
Karthik Kambatla
0d62e94887
YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)
...
(cherry picked from commit 8d88691d16
)
2015-03-04 19:49:21 -08:00
Karthik Kambatla
721d7b5741
YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha)
...
(cherry picked from commit 22426a1c9f
)
2015-03-04 18:07:33 -08:00
Karthik Kambatla
1749094fab
YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha)
...
(cherry picked from commit 53947f37c7
)
2015-03-04 17:39:39 -08:00
Jason Lowe
ab397194c3
YARN-3131. YarnClientImpl should check FAILED and KILLED state in submitApplication. Contributed by Chang Li
...
(cherry picked from commit 03cc22945e
)
2015-03-04 18:05:20 +00:00
Jian He
aafe571398
YARN-3285. (Backport YARN-3168) Convert branch-2 .apt.vm files of YARN to markdown. Contributed by Masatake Iwasaki
2015-03-03 16:44:59 -08:00
Jian He
888a445638
YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with a different port. Contributed by Rohith Sharmaks
...
(cherry picked from commit b2f1ec312e
)
2015-03-03 16:28:55 -08:00
Wangda Tan
0a502c665b
YARN-3272. Surface container locality info in RM web UI (Jian He via wangda)
...
(cherry picked from commit e17e5ba9d7
)
2015-03-03 11:49:45 -08:00
Vinod Kumar Vavilapalli
253c78548b
YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan.
...
(cherry picked from commit 14dd647c55
)
2015-03-02 17:54:01 -08:00
Wangda Tan
19a8e48230
YARN-3270. Fix node label expression not getting set in ApplicationSubmissionContext (Rohit Agarwal via wangda)
...
(cherry picked from commit abac6eb9d5
)
2015-03-02 17:24:55 -08:00
Jian He
76b7283fa1
YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu
...
(cherry picked from commit 5d0bae550f
)
2015-03-02 14:43:12 -08:00
Wangda Tan
0b0be0056b
YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)
...
(cherry picked from commit edcecedc1c
)
2015-02-27 16:14:35 -08:00