Arun Suresh
519aa0e804
YARN-7178. Add documentation for Container Update API. (asuresh)
...
(cherry picked from commit 24f8c5cce3
)
2017-10-27 22:57:46 -07:00
Jason Lowe
9093ad6168
YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
...
(cherry picked from commit 665bb147aa
)
2017-10-27 17:09:29 -05:00
Rohith Sharma K S
548116c3f5
YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi.
...
(cherry picked from commit 5c799ecf09
)
2017-10-27 22:51:41 +05:30
Sunil G
88c3b444bd
YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh.
...
(cherry picked from commit 792388e1c0
)
2017-10-27 21:11:48 +05:30
Junping Du
1f2a2ba2be
Add several jdiff xml files for 2.8.2 release.
...
(cherry picked from commit a25b5aa0cf
)
2017-10-26 23:20:24 -07:00
Subru Krishnan
a0dceec586
YARN-5516. Add REST API for supporting recurring reservations. (Sean Po via Subru).
...
(cherry picked from commit 25932da6d1
)
2017-10-26 20:16:01 -07:00
Arun Suresh
f6fde85c5c
YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh)
...
(cherry picked from commit 00bebb7e58
)
2017-10-26 20:04:33 -07:00
Arun Suresh
098a6b8f19
YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh)
...
(cherry picked from commit d82e797b65
)
2017-10-26 20:04:19 -07:00
Robert Kanter
7c26ae506a
YARN-7262. Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow (rkanter)
...
(cherry picked from commit b1de78619f
)
2017-10-26 17:51:05 -07:00
Robert Kanter
46783158f8
YARN-7358. TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler (haibochen via rkanter)
...
(cherry picked from commit 2da654e34a
)
2017-10-26 10:49:57 -07:00
Subru Krishnan
74aee8673f
YARN-4827. Document configuration of ReservationSystem for FairScheduler. (Yufei Gu via Subru).
...
(cherry picked from commit 3fae675383
)
2017-10-25 15:32:03 -07:00
Arun Suresh
774a575363
YARN-4687. Document Reservation ACLs (Contributed by Sean Po)
...
(cherry picked from commit 2e1d0ff4e9
)
2017-10-25 15:29:32 -07:00
Carlo Curino
fa86fdc3cc
YARN-7339. LocalityMulticastAMRMProxyPolicy should handle cancel request properly. (Botong Huang via curino)
...
Edited cherry-pick from 1c5c2b5dde
2017-10-25 13:56:35 -07:00
Eric Yang
f6d3c101a6
YARN-7353. Improved volume mount check for directories and unit test compatibility on RHEL7. Contributed by Eric Badger.
2017-10-24 17:01:08 -04:00
Inigo Goiri
89ad6adab3
YARN-3661. Basic Federation UI. Contributed by Inigo Goiri.
2017-10-24 13:55:13 -07:00
Robert Kanter
85eadec67b
YARN-7385. TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE (yufeigu via rkanter)
...
(cherry picked from commit 03af442e76
)
2017-10-24 13:43:27 -07:00
Robert Kanter
1d34a4805e
YARN-7382. NoSuchElementException in FairScheduler after failover causes RM crash (rkanter)
...
(cherry picked from commit 025c656572
)
2017-10-24 10:29:36 -07:00
Daniel Templeton
08cfd010a3
YARN-7357. Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations
...
(Contributed by Sen Zhao via Daniel Templeton)
(cherry picked from commit 0553f5a012e14c8ceb40a16161440384f9f3a9a8)
(cherry picked from commit 9da9023371
)
2017-10-23 13:52:15 -07:00
Eric Payne
ef0d6ff2e6
YARN-4163: Audit getQueueInfo and getApplications calls
...
(cherry picked from commit 921338cd86
)
2017-10-23 11:58:04 -05:00
Subru Krishnan
9bd77a6d9d
YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. (Tanuj Nayak via Subru).
2017-10-20 17:19:29 -07:00
Yufei Gu
93d71d97d4
YARN-7355. TestDistributedShell should be scheduler agnostic. (Contributed by Haibo)
...
(cherry picked from commit 6b7c87c945
)
2017-10-20 11:49:34 -07:00
Yufei Gu
378fa3ac7d
YARN-7261. Add debug message for better download latency monitoring. (Yufei Gu)
...
(cherry picked from commit 0799fde35e
)
2017-10-20 11:49:34 -07:00
Yufei Gu
4c4f28c9e7
YARN-4090. Make Collections.sort() more efficient by caching resource usage. (Contributed by Yufei Gu, Shilong Zhang and Xianyin Xin)
...
(cherry picked from commit 1f4cdf1068
)
(cherry picked from commit 96106b8f5f
)
2017-10-20 11:49:33 -07:00
Yufei Gu
f462461d4e
YARN-7359. TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic. (Contributed by Haibo Chen)
...
(cherry picked from commit 7b4b018780
)
2017-10-20 11:22:28 -07:00
Yufei Gu
1000811bcb
YARN-7294. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair Scheduler. (Contributed by Miklos Szegedi)
...
(cherry picked from commit cbd2b73ef8
)
2017-10-20 11:22:28 -07:00
Wangda Tan
2f476f4b2c
YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda)
2017-10-20 11:22:28 -07:00
Wangda Tan
6a3929f2b2
YARN-6608. Backport all SLS improvements from trunk to branch-2. (Carlo Curino via wangda)
2017-10-20 11:22:26 -07:00
Wangda Tan
bc2326f5f0
YARN-7170. Improve bower dependencies for YARN UI v2. (Sunil G via wangda)
2017-10-19 22:20:36 -07:00
vrushali
28c54989d6
Ensuring right apis are called as per jetty version in branch2 (trunk has different jetty)
2017-10-19 22:18:17 -07:00
Wangda Tan
017ac560f0
YARN-7338. Support same origin policy for cross site scripting prevention. (Sunil G via wangda)
2017-10-19 21:48:11 -07:00
vrushali
3a5f1a6c26
Fixing checktyle warnings during rebase
2017-10-18 02:06:49 +05:30
Sunil G
ec3fb45772
YARN-7022. Improve click interaction in queue topology in new YARN UI. Contributed by Abdullah Yousufi.
2017-10-18 02:06:49 +05:30
Sunil G
da104a3e78
YARN-7075. Better styling for donut charts in new YARN UI. Contributed by Da Ding.
2017-10-18 02:06:49 +05:30
Sunil G
1cf7ed8a28
YARN-7071. Add vcores and number of containers in new YARN UI node heat map. Contributed by Abdullah Yousufi.
2017-10-18 02:06:49 +05:30
Sunil G
65b90e1e1c
YARN-6386. Show decommissioning nodes in new YARN UI. Contributed by Elek Marton.
2017-10-18 02:06:49 +05:30
Sunil G
1a1f39c98c
YARN-5146. Support for Fair Scheduler in new YARN UI. Contributed by Abdullah Yousufi.
2017-10-18 02:06:49 +05:30
Sunil G
1635741390
YARN-6631. Refactor loader.js in new Yarn UI. Contributed by Akhil P B.
2017-10-18 02:06:49 +05:30
vrushali
6232c3aef3
Updating dependencies to work on branch-2
2017-10-18 02:06:49 +05:30
Sunil G
3aa8111594
YARN-6458. Use yarn package manager to lock down dependency versions for new web UI. Contributed by Sreenath Somarajapuram.
2017-10-18 02:06:49 +05:30
Sunil G
9e4e218ff0
YARN-6635. Refactor yarn-app pages in new YARN UI. Contributed by Akhil PB.
2017-10-18 02:06:49 +05:30
Sunil G
dd40f6f0cc
YARN-5705. Show timeline data from ATS v2 in new web UI. Contributed by Akhil PB.
2017-10-18 02:06:49 +05:30
Sunil G
458ba54ea5
YARN-6291. Introduce query parameters (sort, filter, etc.) for tables to keep state on refresh/navigation in new YARN UI. Contributed by Gergely Novák.
2017-10-18 02:06:48 +05:30
Sunil G
c069f4f937
YARN-6402. Move 'Long Running Services' to an independent tab at top level for new Yarn UI. Contributed by Akhil PB.
2017-10-18 02:06:48 +05:30
Sunil G
bef6b2f030
YARN-5153. Add a toggle button to switch between timeline view / table view for containers and application-attempts in new YARN UI. Contributed by Akhil PB.
2017-10-18 02:06:48 +05:30
Sunil G
deef8d5446
YARN-6258. localBaseAddress for CORS proxy configuration is not working when suffixed with forward slash in new YARN UI. Contributed by Gergely Novák.
2017-10-18 02:06:48 +05:30
Sunil G
16cc282725
YARN-5496. Make Node Heatmap Chart categories clickable in new YARN UI. Contributed by Gergely Novák.
2017-10-18 02:06:48 +05:30
Sunil G
bbd98cb019
YARN-6196. Improve Resource Donut chart with better label in Node page of new YARN UI. Contributed by Akhil PB.
2017-10-18 02:06:48 +05:30
Sunil G
03511fdaf8
YARN-5335. Use em-table in app/nodes pages for new YARN UI. Contributed by Sunil G.
2017-10-18 02:06:48 +05:30
Sunil G
148c7b8689
YARN-6184. Introduce loading icon in each page of new YARN UI. Contributed by Akhil PB.
2017-10-18 02:06:48 +05:30
Sunil G
981ccd9d90
YARN-6183. Few missing informations in Application and Application Attempt pages for new YARN UI. Contributed by Akhil PB.
2017-10-18 02:06:48 +05:30
Sunil G
9071c712d9
YARN-5912. Fix breadcrumb issues for various pages in new YARN UI. Contributed by Akhil P B.
2017-10-18 02:06:48 +05:30
Sunil G
2c93e8ee13
YARN-5917. Make navigation link active when selecting sub tabs in 'Applications' and 'Nodes' page for new UI. Contributed by Kai Sasaki.
2017-10-18 02:06:48 +05:30
Sunil G
0d1a53ad8e
YARN-5866. Fix few issues reported by jshint in new YARN UI. Contributed by Akhil P B.
2017-10-18 02:06:48 +05:30
Sunil G
d5271b03d3
YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB.
2017-10-18 02:06:48 +05:30
sunilg
011402e304
YARN-4849. Addendum patch to improve pom for yarn-ui. (Wangda Tan via Sunil G)
2017-10-18 02:06:48 +05:30
sunilg
4fba66c28e
YARN-5785. [YARN-3368] Accessing applications and containers list from Node page is throwing few exceptions in console. (Akhil P B and Sreenath Somarajapuram via Sunil G)
2017-10-18 02:06:48 +05:30
Sreenath Somarajapuram
6c68032291
YARN-5779. [YARN-3368] Addendum patch to document limits/notes of the new YARN UI . (Sunil G via Sreenath Somarajapuram)
2017-10-18 02:06:48 +05:30
sunilg
9ebb57dfc8
YARN-5490. [YARN-3368] Fix various alignment issues and broken breadcrumb link in Node page. (Akhil P B Tan via Sunil G)
2017-10-18 02:06:48 +05:30
sunilg
36f5091d6c
YARN-5497. [YARN-3368] Use different color for Undefined and Succeeded for Final State in applications page. (Akhil P B Tan via Sunil G)
2017-10-18 02:06:47 +05:30
sunilg
94c53e7985
YARN-5500. [YARN-3368] ‘Master node' link under application tab is broken. (Akhil P B Tan via Sunil G)
2017-10-18 02:06:47 +05:30
sunilg
addc399e8b
YARN-5772. [YARN-3368] Replace old Hadoop logo with new one (Akhil P B Tan via Sunil G)
2017-10-18 02:06:47 +05:30
sunilg
43f0627a8e
YARN-5779. [YARN-3368] Document limits/notes of the new YARN UI (Wangda Tan via Sunil G)
2017-10-18 02:06:47 +05:30
sunilg
29fc43e5a4
YARN-5741. [YARN-3368] Update UI2 documentation for new UI2 path (Kai Sasaki and Wangda Tan via Sunil G)
2017-10-18 02:06:47 +05:30
Wangda Tan
7513315758
YARN-5145. [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR. (Sunil G and Kai Sasaki via wangda)
2017-10-18 02:06:47 +05:30
sunilg
f1de967c67
YARN-4849. Addendum patch to remove unwanted files from rat exclusions. (Wangda Tan via Sunil G)
2017-10-18 02:06:47 +05:30
Wangda Tan
c0c124c2bf
YARN-5698. [YARN-3368] Launch new YARN UI under hadoop web app port. (Sunil G via wangda)
2017-10-18 02:06:47 +05:30
sunilg
8222307c30
YARN-5682. [YARN-3368] Fix maven build to keep all generated or downloaded files in target folder (Wangda Tan via Sunil G)
2017-10-18 02:06:47 +05:30
Wangda Tan
e5c0219228
YARN-4849. Addendum patch to fix javadocs. (Sunil G via wangda)
2017-10-18 02:06:47 +05:30
sunilg
542f661cc1
YARN-4849. Addendum patch to fix ASF warnings. (Wangda Tan via Sunil G)
2017-10-18 02:06:47 +05:30
sunilg
dd8ad34305
YARN-5503. [YARN-3368] Add missing hidden files in webapp folder for deployment (Sreenath Somarajapuram via Sunil G)
2017-10-18 02:06:47 +05:30
sunilg
ade1dd96b5
YARN-5504. [YARN-3368] Fix YARN UI build pom.xml (Sreenath Somarajapuram via Sunil G)
2017-10-18 02:06:47 +05:30
vrushali
1510fea062
Updating pom to be 2.9.0-SNAPSHOT instead of 3.0
2017-10-18 02:06:47 +05:30
sunilg
48336218d4
YARN-4849. Addendum patch to fix document. (Wangda Tan via Sunil G)
2017-10-18 02:06:47 +05:30
sunilg
a4021c9c36
YARN-5488. [YARN-3368] Applications table overflows beyond the page boundary(Harish Jaiprakash via Sunil G)
2017-10-18 02:06:46 +05:30
Wangda Tan
a53e981adf
YARN-5509. Build error due to preparing 3.0.0-alpha2 deployment. (Kai Sasaki via wangda)
2017-10-18 02:06:46 +05:30
sunilg
3e0dab4bfd
YARN-3334. [YARN-3368] Introduce REFRESH button in various UI pages (Sreenath Somarajapuram via Sunil G)
2017-10-18 02:06:46 +05:30
Sunil
30d1839aa0
YARN-5321. [YARN-3368] Add resource usage for application by node managers (Wangda Tan via Sunil G)
...
YARN-5320. [YARN-3368] Add resource usage by applications and queues to cluster overview page (Wangda Tan via Sunil G)
YARN-5322. [YARN-3368] Add a node heat chart map (Wangda Tan via Sunil G)
YARN-5347. [YARN-3368] Applications page improvements (Sreenath Somarajapuram via Sunil G)
YARN-5348. [YARN-3368] Node details page improvements (Sreenath Somarajapuram via Sunil G)
YARN-5346. [YARN-3368] Queues page improvements (Sreenath Somarajapuram via Sunil G)
YARN-5345. [YARN-3368] Cluster overview page improvements (Sreenath Somarajapuram via Sunil G)
YARN-5344. [YARN-3368] Generic UI improvements (Sreenath Somarajapuram via Sunil G)
2017-10-18 02:06:46 +05:30
Sunil
b41ca1a6ea
YARN-5161. [YARN-3368] Add Apache Hadoop logo in YarnUI home page. (Kai Sasaki via Sunil G)
2017-10-18 02:06:46 +05:30
Sunil
0490942c58
YARN-5183. [YARN-3368] Support for responsive navbar when window is resized. (Kai Sasaki via Sunil G)
2017-10-18 02:06:46 +05:30
Wangda Tan
bb606e3d4b
YARN-4515. [YARN-3368] Support hosting web UI framework inside YARN RM. (Sunil G via wangda)
...
YARN-5000. [YARN-3368] App attempt page is not loading when timeline server is not started (Sunil G via wangda)
YARN-5038. [YARN-3368] Application and Container pages shows wrong values when RM is stopped. (Sunil G via wangda)
2017-10-18 02:06:46 +05:30
Wangda Tan
67aa886ce7
YARN-5019. [YARN-3368] Change urls in new YARN ui from camel casing to hyphens. (Sunil G via wangda)
2017-10-18 02:06:46 +05:30
Wangda Tan
b414b5f2cf
YARN-4514. [YARN-3368] Cleanup hardcoded configurations, such as RM/ATS addresses. (Sunil G via wangda)
2017-10-18 02:06:46 +05:30
Wangda Tan
56654d8820
YARN-4849. [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses. (wangda)
2017-10-18 02:06:46 +05:30
Wangda Tan
217a87e975
YARN-4517. Add nodes page and fix bunch of license issues. (Varun Saxena via wangda)
2017-10-18 02:06:46 +05:30
Wangda Tan
8a75207d4c
YARN-4733. [YARN-3368] Initial commit of new YARN web UI. (wangda)
2017-10-18 02:06:46 +05:30
Subru Krishnan
5e7491d532
YARN-7311. Fix TestRMWebServicesReservation parametrization for fair scheduler. (Yufei Gu via Subru).
...
(cherry picked from commit 75323394fb
)
2017-10-17 12:43:36 -07:00
Haibo Chen
c0ee583656
YARN-7341. TestRouterWebServiceUtil#testMergeMetrics is flakey. (Robert Kanter via Haibo Chen)
...
(cherry picked from commit acabc657ff
)
2017-10-17 12:30:26 -07:00
Subru Krishnan
adf5ea73d6
YARN-7095. Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
...
(cherry picked from commit bac4e8cca8
)
2017-10-17 12:14:05 -07:00
Varun Saxena
56e0873e22
Fix javac, javadoc and checkstyle issues before branch-2 merge.
2017-10-17 23:36:41 +05:30
vrushali
8b98dba7ee
YARN-7190 Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath (Contributed by Varun Saxena via Vrushali C)
2017-10-17 23:36:41 +05:30
Varun Saxena
6ba1f34532
Fix problems in yarn.cmd due to rebase.
2017-10-17 23:36:41 +05:30
Haibo Chen
572ebd1a95
YARN-7063. TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2. (Varun Saxena via Haibo Chen)
2017-10-17 23:36:41 +05:30
Haibo Chen
d77530b227
YARN-7128. The error message in TimelineSchemaCreator is not enough to find out the error. (Jinjiang Ling via Haibo Chen)
...
(cherry picked from commit 661f5eb0c6
)
2017-10-17 23:36:41 +05:30
Rohith Sharma K S
27019b5a66
YARN-7130. ATSv2 documentation changes post merge. Contributed by Varun Saxena.
...
(cherry picked from commit 0bfb3a2566
)
2017-10-17 23:36:41 +05:30
Rohith Sharma K S
138d6fc083
YARN-7140. CollectorInfo should have Public visibility. Contributed by Varun Saxena.
...
(cherry picked from commit 4a83170be4
)
2017-10-17 23:36:40 +05:30
Varun Saxena
95f45b89d1
YARN-7152. [ATSv2] Registering timeline client before AMRMClient service init throw exception (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit ef87d34a0e
)
2017-10-17 23:36:40 +05:30
Junping Du
b3201b2dab
YARN-6534. ResourceManager failed due to TimelineClient try to init SSLFactory even https is not enabled. Contributed by Rohith Sharma K S.
...
(cherry picked from commit 09e36ff59c05b8bd54d346d1103de0a7300875c6)
(cherry picked from commit 94607214ce
)
2017-10-17 23:36:40 +05:30
Haibo Chen
6e2de8b417
YARN-6435. [ATSv2] Can't retrieve more than 1000 versions of metrics in time series. (Rohith Sharma K S via Haibo Chen)
...
(cherry picked from commit 461ee44d28
)
2017-10-17 23:36:40 +05:30
bibinchundatt
f7637b55bb
YARN-7141. Move logging APIs to slf4j in timelineservice after ATSv2 merge. Contributed by Varun Saxena
...
(cherry picked from commit dcd0bedcc8
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRMHATimelineCollectors.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/reader/security/TimelineReaderWhitelistAuthorizationFilter.java
2017-10-17 23:36:40 +05:30
Varun Saxena
1289b056ac
YARN-6958. Addedndum for Moving logging APIs over to slf4j in hadoop-yarn-server-timelineservice
2017-10-17 23:36:40 +05:30
Varun Saxena
87713f41b6
YARN-6905. Addendum to fix TestTimelineReaderWebServicesHBaseStorage due to missing FastNumberFormat
...
(cherry picked from commit e52f26e5cf
)
2017-10-17 23:36:40 +05:30
Vrushali C
a2598434ed
YARN-6905 Multiple HBaseTimelineStorage test failures due to missing FastNumberFormat (Contributed by Haibo Chen)
...
(cherry picked from commit 608a06cca5
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/src/test/java/org/apache/hadoop/yarn/server/timelineservice/storage/TestHBaseTimelineStorageEntities.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/common/HBaseTimelineStorageUtils.java
2017-10-17 23:36:40 +05:30
Varun Saxena
78a6ecccb3
Addendum for YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation
2017-10-17 23:36:40 +05:30
Varun Saxena
3d5bf1c06d
YARN-6047. Documentation updates for TimelineService v2. Contributed by Rohith Sharma K S, Vrushali C and Varun Saxena
2017-10-17 23:36:40 +05:30
Varun Saxena
a22c1c72c4
YARN-6316. Addendum for missing create option in documentation.
2017-10-17 23:36:40 +05:30
Varun Saxena
28bbe9ccd7
YARN-5577. [Atsv2] Document object passing in infofilters with an example (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit ea29e3bc27
)
2017-10-17 23:36:40 +05:30
Haibo Chen
0f51f15097
YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen)
2017-10-17 23:36:40 +05:30
Jian He
cbd5e89b24
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
...
(cherry picked from commit c6ce422a3423305ac665f80f039f61294adaa32c)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/rm/RMContainerAllocator.java
2017-10-17 23:36:40 +05:30
Varun Saxena
e5d63652df
YARN-6861. Addendum for YARN-6861 for compilation issue (Rohith Sharma K S via Varun Saxena)
2017-10-17 23:36:40 +05:30
Varun Saxena
186c99c6cc
YARN-6861. Reader API for sub application entities (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit 73ee0d4fc05354527a4be6db9e5b83d06fc94047)
2017-10-17 23:36:39 +05:30
Jian He
5c970f7c29
YARN-6134. [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active. Contributed by Varun Saxena
2017-10-17 23:36:39 +05:30
Rohith Sharma K S
5d9b4bd3e8
YARN-7041. Nodemanager NPE running jobs with security off. Contributed by Varun Saxena.
...
(cherry picked from commit e976bf10bb0d42e4d971358554ea736ddcdafd19)
2017-10-17 23:36:39 +05:30
Jian He
53ddf1b15f
YARN-7038. Addendum patch. Fix compilation error. Contributed by Varun Saxena
2017-10-17 23:36:39 +05:30
Rohith Sharma K S
4e1af68ae1
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
...
(cherry picked from commit 387dd3da87759860dd18bd8aa95c60d962b1e6a9)
2017-10-17 23:36:39 +05:30
Jian He
55e5742394
YARN-7006. [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol. Contributed by Varun Saxena
2017-10-17 23:36:39 +05:30
Jason Lowe
db2f7dd9bd
YARN-6820. Restrict read access to timelineservice v2 data. Contributed by Vrushali C
2017-10-17 23:36:39 +05:30
Rohith Sharma K S
cb75e1826e
YARN-6133. [ATSv2 Security] Renew delegation token for app automatically if an app collector is active. Contributed by Varun Saxena.
...
(cherry picked from commit ffb1f572b68e73efd6410ab74a334f4e5df543f2)
2017-10-17 23:36:39 +05:30
Rohith Sharma K S
5a7c272e0a
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
2017-10-17 23:36:39 +05:30
Varun Saxena
5bda387573
YARN-6874. Supplement timestamp for min start/max end time columns in flow run table to avoid overwrite (Vrushali C via Varun Saxena)
...
(cherry picked from commit 7b2cb0614a04e6d0e2bc6dfd5095b7535dffa678)
2017-10-17 23:36:39 +05:30
Varun Saxena
8d9d40aa53
Addendum for YARN-6102.
2017-10-17 23:36:39 +05:30
Varun Saxena
cb5d601b2e
Addendum for YARN-5648.
2017-10-17 23:36:39 +05:30
Jian He
8e4e5abbe6
YARN-5648. [ATSv2 Security] Client side changes for authentication. Contributed by Varun Saxena
...
(cherry picked from commit 3829100cf75e733b2b3a4e8c6806a3696f4ae658)
2017-10-17 23:36:39 +05:30
Jian He
50dd1372bf
YARN-6638. [ATSv2 Security] Timeline reader side changes for loading auth filters and principals. Contributed by Varun Saxena
...
(cherry picked from commit 7f06c46065936b88e9864c526bfcda3a89f3e257)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/src/test/java/org/apache/hadoop/yarn/server/timelineservice/reader/AbstractTimelineReaderHBaseTestBase.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/reader/TimelineReaderServer.java
2017-10-17 23:36:39 +05:30
Jian He
9577900a91
YARN-5647. [ATSv2 Security] Collector side changes for loading auth filters and principals. Contributed by Varun Saxena
...
(cherry picked from commit 79dae624793164cd4692c86992a511310145858a)
2017-10-17 23:36:39 +05:30
Varun Saxena
c8db08dfac
YARN-6734. Ensure sub-application user is extracted & sent to timeline service (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit 0443928d771e3e21825b4f487e8c0865ea641970)
2017-10-17 23:36:38 +05:30
Sunil G
4b65fe73ca
YARN-6102. RMActiveService context to be updated with new RMContext on failover. Contributed by Rohith Sharma K S.
...
(cherry picked from commit a657472b42
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/AdminService.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMActiveServiceContext.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMContextImpl.java
2017-10-17 23:36:38 +05:30
Rohith Sharma K S
4bea8af723
YARN-6888. Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created. Contributed by Vrushali C.
...
(cherry picked from commit 20dd6d18b7787e67ef96f3b6b92ea8415a8650fd)
2017-10-17 23:36:38 +05:30
Rohith Sharma K S
4014390ef4
YARN-6733. Add table for storing sub-application entities. Contributed by Vrushali C.
...
(cherry picked from commit 416312e3a7f0f83cc1c8549640c3ba75aaa3d887)
2017-10-17 23:36:38 +05:30
Vrushali C
0f751a7fec
YARN-6850 Ensure that supplemented timestamp is stored only for flow run metrics (Contributed by Varun Saxena via Vrushali C)
2017-10-17 23:36:38 +05:30
Rohith Sharma K S
484d7e9b39
YARN-4455. Support fetching metrics by time range. Contributed by Varun Saxena.
...
(cherry picked from commit 743e4731781a7d9a4a5f1f09adc510f193182158)
2017-10-17 23:36:38 +05:30
Rohith Sharma K S
d01a3f1ba2
YARN-6801. NPE in RM while setting collectors map in NodeHeartbeatResponse. Contributed by Vrushali C.
...
(cherry picked from commit 5791ced4bd864ff6c08cb2c3ee10ab62008f0168)
2017-10-17 23:36:38 +05:30
Varun Saxena
c4f042d4c1
YARN-6604. Allow metric TTL for Application table to be specified through cmd (Haibo Chen via Varun Saxena)
...
(cherry picked from commit 0b7bff706e
)
2017-10-17 23:36:38 +05:30
vrushali
48d2e4f519
YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C)
2017-10-17 23:36:38 +05:30
Varun Saxena
473f2f00ee
YARN-6658. Remove columnFor() methods of Columns in HBaseTimeline backend (Haibo Chen via Varun Saxena)
...
(cherry picked from commit f7cba98504a5e968bb6ae976d20b71c84a4664f2)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/apptoflow/AppToFlowColumn.java
2017-10-17 23:36:38 +05:30
Haibo Chen
d53038626e
YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
...
(cherry picked from commit 47474fffac
)
(cherry picked from commit 8817cb5c8424359b880c6d700e53092f0269c1bb)
2017-10-17 23:36:38 +05:30
Haibo Chen
9b4d4228fb
YARN-6561. Update exception message during timeline collector aux service initialization. (Vrushali C via Haibo Chen)
...
(cherry picked from commit 4c8b9d23a1b4f92bf370617a0b42ac68bdcf33ac)
2017-10-17 23:36:38 +05:30
Vrushali Channapattan
70315de4ff
YARN-6563 ConcurrentModificationException in TimelineCollectorManager while stopping RM (Contributed by Haibo Chen via Vrushali C)
2017-10-17 23:36:38 +05:30
Vrushali Channapattan
34570d4fc3
YARN-6375 App level aggregation should not consider metric values reported in the previous aggregation cycle (Varun Saxena via Vrushali C)
2017-10-17 23:36:38 +05:30
Naganarasimha
e1d2f6ebdd
YARN-6518. Fix warnings from Spotbugs in hadoop-yarn-server-timelineservice. Contributed by Weiwei Yang.
...
(cherry picked from commit 0f1af3178e
)
2017-10-17 23:36:37 +05:30
Varun Saxena
7338dbe5c0
YARN-6455. Enhance the timelinewriter.flush() race condition fix (Haibo Chen via Varun Saxena)
...
(cherry picked from commit 793bbf216d
)
2017-10-17 23:36:37 +05:30
Varun Saxena
c1f9f0529b
Addendum for YARN-5865. Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611
2017-10-17 23:36:37 +05:30
Varun Saxena
ebcb575a12
Addendum for YARN-4218. Metric for resource*time that was preempted.
2017-10-17 23:36:37 +05:30
Rohith Sharma K S
1072232741
YARN-6424. TimelineCollector is not stopped when an app finishes in RM. Contributed by Varun Saxena.
...
(cherry picked from commit 1a9439e299
)
2017-10-17 23:36:37 +05:30
Varun Saxena
16d8df68f6
YARN-6377. NMTimelinePublisher#serviceStop does not stop timeline clients (Haibo Chen via Varun Saxena)
...
(cherry picked from commit a4b5aa8493
)
2017-10-17 23:36:37 +05:30
Varun Saxena
fd88fa8083
YARN-6376. Exceptions caused by synchronous putEntities requests can be swallowed (Haibo Chen via Varun Saxena)
...
(cherry picked from commit b58777a9c9
)
2017-10-17 23:36:37 +05:30
Varun Saxena
debe526f08
YARN-6342. Make TimelineV2Client's drain timeout after stop configurable (Haibo Chen via Varun Saxena)
...
(cherry picked from commit 7c2bc444b3
)
2017-10-17 23:36:37 +05:30
Varun Saxena
203077cf2c
YARN-6357. Implement putEntitiesAsync API in TimelineCollector (Haibo Chen via Varun Saxena)
...
(cherry picked from commit 063b513b1c
)
2017-10-17 23:36:37 +05:30
Varun Saxena
9595c18eea
YARN-6146. Add Builder methods for TimelineEntityFilters (Haibo Chen via Varun Saxena)
...
(cherry picked from commit 7f09cd1d5ee70e0bdf24cdecd78cd3bc258a40f8)
2017-10-17 23:36:37 +05:30
Varun Saxena
1369abf5b0
YARN-6318. timeline service schema creator fails if executed from a remote machine (Sangjin Lee via Varun Saxena)
...
(cherry picked from commit 68ec0d9b471356d3adef15d78111126f57ee50f8)
2017-10-17 23:36:37 +05:30
Varun Saxena
6ec294b7fc
YARN-6237. Move UID constant to TimelineReaderUtils (Rohith Sharma K S via Varun Saxena)
...
(cherry picked from commit ec32c4265bbf436ae61b6efc71ca33b16b70a23d)
2017-10-17 23:36:37 +05:30