328 Commits

Author SHA1 Message Date
Weiwei Yang
c48dce09a2 YARN-8278. DistributedScheduling is not working in HA. Contributed by Bibin A Chundatt.
(Cherry picked from commit 2bb647bb91439e82cf7298e963bb5f7f80bbc3cb)
2018-05-15 18:55:31 +08:00
Rohith Sharma K S
317deaafc4 YARN-8217. RmAuthenticationFilterInitializer and TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator. Contributed by Suma Shivaprasad.
(cherry picked from commit ee2ce923a922bfc3e89ad6f0f6a25e776fe91ffb)
2018-05-03 18:21:11 +05:30
Lei Xu
3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Rohith Sharma K S
117984a2cb YARN-8022. ResourceManager UI cluster/app/<app-id> page fails to render. Contributed by Tarun Parimi.
(cherry picked from commit e6de10d0a6363bdaf767a7bdac7ad908d7786718)
2018-03-14 22:14:43 +05:30
Owen O'Malley
0f106df4d6 Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
This reverts commit 172b23af33554b7d58fd41b022d983bcc2433da7.

(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
2018-03-10 13:33:52 -08:00
Lei Xu
7b377f43d0 Preparing for 3.0.2 development 2018-02-06 10:50:37 -08:00
Weiwei Yang
3dc1ea6050 YARN-7608. Incorrect sTarget column causing DataTable warning on RM application and scheduler web page. Contributed by Gergely Novák. 2017-12-11 10:33:46 +08:00
Arun Suresh
6f123aae41 YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh)
(cherry picked from commit 37ca4169508c3003dbe9044fefd37eb8cd8c0503)
2017-12-03 22:23:46 -08:00
Arun Suresh
5884b8a80a YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM. (Juan Rodriguez Hortala via asuresh)
(cherry picked from commit b46ca7e73b8bac3fdbff0b13afe009308078acf2)
2017-11-22 19:19:52 -08:00
Andrew Wang
1c8d334287 Preparing for 3.0.1 development 2017-11-14 11:17:18 -08:00
Daniel Templeton
d2b16e3e83 YARN-7166. Container REST endpoints should report resource types
Change-Id: If9c2fe58d4cf758bb6b6cf363dc01f35f8720987
(cherry picked from commit 0de10680b7e5a9dfc85173bcfd338fd3656aa57f)
2017-11-08 16:51:20 -08:00
Wangda Tan
4af3deaeb0 YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
(cherry picked from commit df3855541af98a3805958f2b5b9db6be705d52ab)
2017-10-31 15:06:17 -07:00
Sunil G
bda5486dad YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev.
(cherry picked from commit dae65f3bef8ffa34d02a37041f1dfdfeeee91845)
2017-10-31 15:06:16 -07:00
Robert Kanter
cd9078df68 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ Addendum (misha@cloudera.com via rkanter)
(cherry picked from commit 088ffee7165d0e2e4fb9af7fb8f33626b0ed8ed3)
2017-10-26 15:55:23 -07:00
Carlo Curino
8b200ab395 YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino)
(cherry picked from commit 1c5c2b5dde6f2cffc587ca8f79a18828e1b1faf9)
2017-10-24 10:53:08 -07:00
Robert Kanter
61aba4f0c1 YARN-7320. Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_ (misha@cloudera.com via rkanter)
(cherry picked from commit 5da295a34e39b507e8291073782e0576cd06896a)
2017-10-23 18:02:11 -07:00
Carlo Curino
97b7d39a5f YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino)
(cherry picked from commit 13fcfb3d46ee7a0d606b4bb221d1cd66ef2a5a7c)
2017-10-12 10:40:44 -07:00
Jason Lowe
44f8b2a630 YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka
(cherry picked from commit ebb34c7053ee93296412591f83a776846765fda5)
2017-10-11 10:32:23 -05:00
Arun Suresh
b61d12e300 YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh).
(cherry picked from commit b733348dde18a242e6c9074c512116a8baf1d281)
2017-10-05 10:06:30 -07:00
Akira Ajisaka
b658ae002f
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
(cherry picked from commit c9b525bd943fe7e098e72fb9be5623862c7ab5ff)
2017-10-04 07:02:31 +09:00
Akira Ajisaka
2fa1d39952
YARN-6916. Moving logging APIs over to slf4j in hadoop-yarn-server-common. Contributed by Bibin A Chundatt and Akira Ajisaka.
(cherry picked from commit 4a877737182808fe3392a116762ba59973a477a6)
2017-10-04 06:08:00 +09:00
Junping Du
c3eade44d0 YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
(cherry picked from commit 3fddabc2fe4fbdb8ef3f9ce7558955c4f0794dcc)
2017-09-29 16:49:44 -07:00
Andrew Wang
5a4f37019a Preparing for 3.0.0 GA development 2017-09-28 11:32:01 -07:00
Junping Du
b58cc16171 YARN-7118. AHS REST API can return NullPointerException. Contributed by Billie Rinaldi.
(cherry picked from commit 4002bf0a9e7e3619a3bdcff071f0369cbf2873ad)
2017-09-22 14:00:40 -07:00
Wangda Tan
4dbf7a501a YARN-6991. "Kill application" button does not show error if other user tries to kill the application for secure cluster. (Suma Shivaprasad via wangda)
Change-Id: I7e7894b24609709f89064ee5882f055dbb09080b
(cherry picked from commit 263e2c692a4b0013766cd1f6b6d7ed674b2b1040)
2017-09-21 12:27:18 -07:00
Wangda Tan
d2e3818823 YARN-7173. Container update RM-NM communication fix for backward compatibility. (Arun Suresh via wangda)
Change-Id: I1c39ed5c59dee739ba5044b61b3ef5ed203b79c1
(cherry picked from commit e74d1be04be47969943b0501a4f335b0b5188287)
2017-09-12 08:09:47 -07:00
Sunil G
07cbb81e8b YARN-7163. RMContext need not to be injected to webapp and other Always Running services. Contributed by Rohith Sharma K S.
(cherry picked from commit 722ee841948db1f246f0056acec9a1ac464fe1f9)
2017-09-11 10:36:29 +05:30
Sunil G
f3c9b2e40e YARN-6992. Kill application button is visible even if the application is FINISHED in RM UI. Contributed by Suma Shivaprasad.
(cherry picked from commit 6f101e7df10d477cf7469f6979d0cb8269315a3e)
2017-09-09 06:25:53 +05:30
Arun Suresh
abe3085f23 YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
(cherry picked from commit 1f53ae79728065417c6a99eb6fcc8d3a080ab4cc)
2017-09-08 09:25:14 -07:00
Varun Saxena
3d00c8f394 Made fixes for whitespace errors and checstyle warnings before merge. 2017-08-30 11:29:54 +05:30
Rohith Sharma K S
e276c75ec1 YARN-7041. Nodemanager NPE running jobs with security off. Contributed by Varun Saxena. 2017-08-30 11:29:54 +05:30
Rohith Sharma K S
7594d1de7b YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena. 2017-08-30 11:29:53 +05:30
Jian He
d3f11e3f13 YARN-6638. [ATSv2 Security] Timeline reader side changes for loading auth filters and principals. Contributed by Varun Saxena 2017-08-30 11:29:53 +05:30
Jian He
879de51206 YARN-5647. [ATSv2 Security] Collector side changes for loading auth filters and principals. Contributed by Varun Saxena 2017-08-30 11:29:53 +05:30
Sangjin Lee
78b7e070d8 YARN-5638. Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery. Contributed by Li Lu. 2017-08-30 11:29:50 +05:30
Carlo Curino
cc8893edc0 YARN-7010. Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps). (Contributed by Giovanni Matteo Fumarola via curino) 2017-08-29 14:53:09 -07:00
Arun Suresh
75abc9a8e2 YARN-5603. Metrics for Federation StateStore. (Ellen Hui via asuresh) 2017-08-21 22:43:08 -07:00
Arun Suresh
8410d862d3 YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh) 2017-08-20 07:54:09 -07:00
Subru Krishnan
de462da04e YARN-6900. ZooKeeper based implementation of the FederationStateStore. (Íñigo Goiri via Subru). 2017-08-16 11:43:24 -07:00
Subru Krishnan
18f3603bce YARN-6996. Change javax.cache library implementation from JSR107 to Apache Geronimo. (Ray Chiang via Subru). 2017-08-14 11:10:00 -07:00
Subru Krishnan
ad2a350662 YARN-6970. Add PoolInitializationException as retriable exception in FederationFacade. (Giovanni Matteo Fumarola via Subru). 2017-08-08 16:48:29 -07:00
Jian He
acf9bd8b1d YARN-6890. Not display killApp button on UI if UI is unsecured but cluster is secured. Contributed by Junping Du 2017-08-08 11:09:38 -07:00
Subru Krishnan
c61f2c4198 YARN-6955. Handle concurrent register AM requests in FederationInterceptor. (Botong Huang via Subru). 2017-08-07 16:58:29 -07:00
Arun Suresh
35dc782923 YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh) 2017-08-03 21:15:40 -07:00
Subru Krishnan
0542e6f86e YARN-6932. Fix TestFederationRMFailoverProxyProvider test case failure. 2017-08-03 14:18:03 -07:00
Subru Krishnan
3e1dc7ece0 YARN-6821. Move FederationStateStore SQL DDL files from test resource to sbin.
(cherry picked from commit cd9db822f0c1efc52005b1c069d52910d88038d9)
2017-08-01 17:28:27 -07:00
Subru Krishnan
825108d08a YARN-6815. FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not.
(cherry picked from commit 8820693cd769065eed83193b673ec5d919d69500)
2017-08-01 17:28:27 -07:00
Subru Krishnan
43a97174fe YARN-3659. Federation: routing client invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit 52daa6d971ae408d121b3737ea8c0575e7e8516d)
2017-08-01 17:28:26 -07:00
Subru Krishnan
4cfec943b1 YARN-6724. Add ability to blacklist sub-clusters when invoking Routing policies. (Giovanni Matteo Fumarola via Subru).
(cherry picked from commit f8e5de59697cb78686f0e605dc7e93628b5f3297)
2017-08-01 17:28:26 -07:00
Subru Krishnan
70b1a757f1 YARN-6511. Federation: transparently spanning application across multiple sub-clusters. (Botong Huang via Subru).
(cherry picked from commit 8c988d235eaf0972783985b1ab24680d029aea79)
2017-08-01 17:28:26 -07:00