Robert Kanter
|
8a61525928
|
YARN-7308. TestApplicationACLs fails with FairScheduler (rkanter)
|
2017-10-16 15:34:32 -07:00 |
Nathan Roberts
|
4540ffd15f
|
YARN-7333. container-executor fails to remove entries from a directory that is not writable or executable. Contributed by Jason Lowe.
|
2017-10-16 17:00:38 -05:00 |
Junping Du
|
1fcbe7cf5f
|
YARN-7124. LogAggregationTFileController deletes/renames while file is open. Contributed by Jason Lowe.
|
2017-10-16 13:57:03 -07:00 |
Arun Suresh
|
a50be1b8f4
|
YARN-7275. NM Statestore cleanup for Container updates. (Kartheek Muthyala via asuresh)
|
2017-10-16 13:12:15 -07:00 |
Wangda Tan
|
87ea1dff9c
|
Addendum fix for: YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. (Wangda Tan)
Change-Id: If1fe4a62e07b25e6f1b8ba803495da87e2cb2df6
|
2017-10-14 10:41:58 -07:00 |
Haibo Chen
|
3fb4718886
|
YARN-7310. TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler. (Robert Kanter via Haibo Chen)
|
2017-10-13 15:49:21 -07:00 |
Yufei Gu
|
7a27c2c367
|
YARN-7270. Fix unsafe casting from long to int for class Resource and
its sub-classes. (Yufei)
|
2017-10-13 12:41:59 -07:00 |
Rohith Sharma K S
|
f4fb6695a3
|
YARN-7180. Remove class ResourceType. Contributed by Sunil G.
|
2017-10-13 15:17:05 +05:30 |
Carlo Curino
|
13fcfb3d46
|
YARN-7317. Fix overallocation resulted from ceiling in LocalityMulticastAMRMProxyPolicy. (contributed by Botong Huang via curino)
|
2017-10-12 10:38:58 -07:00 |
|
Wangda Tan
|
8bcc49e677
|
YARN-7205. Log improvements for the ResourceUtils. (Sunil G via wangda)
Change-Id: I0f5b7a7f68ec5d3e1d52211f83fdd089bc0bfd37
|
2017-10-11 15:25:28 -07:00 |
Sunil G
|
fa5cfc68f3
|
YARN-6620. Add support in NodeManager to isolate GPU devices by using CGroups. Contributed by Wangda Tan.
|
2017-10-11 23:44:33 +05:30 |
Jason Lowe
|
ebb34c7053
|
YARN-7082. TestContainerManagerSecurity failing in trunk. Contributed by Akira Ajisaka
|
2017-10-11 10:31:02 -05:00 |
|
Robert Kanter
|
ec8bf9e48a
|
YARN-7309. TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler (rkanter)
|
2017-10-10 10:18:42 -07:00 |
|
Sunil G
|
41351b05f3
|
YARN-7296. convertToProtoFormat(Resource r) is not setting for all resource types. Contributed by lovekesh bansal.
|
2017-10-10 12:02:18 +05:30 |
|
Wangda Tan
|
5cfbad68c0
|
YARN-7237. Cleanup usages of ResourceProfiles. (Wangda Tan)
Change-Id: I959c8531bd48231956068cb7d2312f3235549f9c
(cherry picked from commit 8536db5a7549fa44d9f9e444b41bd5978b5c6ae1)
|
2017-10-09 20:36:57 -07:00 |
Jonathan Hung
|
1d36b53ab6
|
YARN-7252. Removing queue then failing over results in exception
|
2017-10-09 11:11:23 -07:00 |
|
Jonathan Hung
|
09c5dfe937
|
YARN-7251. Misc changes to YARN-5734
|
2017-10-09 11:11:23 -07:00 |
|
Jonathan Hung
|
a3075de9ab
|
YARN-7238. Documentation for API based scheduler configuration management
|
2017-10-09 11:11:23 -07:00 |
|
Jonathan Hung
|
d6622daaa3
|
YARN-7046. Add closing logic to configuration store
|
2017-10-09 11:11:23 -07:00 |
|
Wangda Tan
|
ff39c0de20
|
YARN-6840. Implement zookeeper based store for scheduler configuration updates. (Jonathan Hung via wangda)
Change-Id: I9debea674fe8c7e4109d4ca136965a1ea4c48bcc
|
2017-10-09 11:11:23 -07:00 |
Xuan
|
4d8abd84f4
|
YARN-7024: Fix issues on recovery in LevelDB store. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
|
Xuan
|
4c8b208adb
|
YARN-6322: Disable queue refresh when configuration mutation is enabled. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
|
Xuan
|
74ba6ffa0b
|
YARN-5947: Create LeveldbConfigurationStore class using Leveldb as backing store. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
|
Xuan
|
04f9e80bb2
|
YARN-5953 addendum: Move QueueConfigInfo and SchedConfUpdateInfo to package org.apache.hadoop.yarn.webapp.dao
|
2017-10-09 11:11:23 -07:00 |
|
Xuan
|
916bdbd6be
|
YARN-5953:Create CLI for changing YARN configurations. (Jonathan Hung via xgong)
|
2017-10-09 11:11:23 -07:00 |
|
Xuan
|
e566fd8b58
|
YARN-6575. Support global configuration mutation in MutableConfProvider. (Jonathan Hung via Xuan Gong)
|
2017-10-09 11:11:23 -07:00 |
|
Wangda Tan
|
a4e6253046
|
YARN-5949. Add pluggable configuration ACL policy interface and implementation. (Jonathan Hung via wangda)
Change-Id: Ib98e82ff753bede21fcab2e6ca9ec1e7a5a2008f
|
2017-10-09 11:11:23 -07:00 |
|
Wangda Tan
|
d8a5136b1f
|
YARN-5952. Create REST API for changing YARN scheduler configurations. (Jonathan Hung via wangda)
|
2017-10-09 11:11:23 -07:00 |
|
Jonathan Hung
|
ef686635c1
|
YARN-5948. Implement MutableConfigurationManager for handling storage into configuration store
|
2017-10-09 11:11:23 -07:00 |
|
Xuan
|
e3579a8c3b
|
YARN-5946: Create YarnConfigurationStore interface and
InMemoryConfigurationStore class. Contributed by Jonathan Hung
|
2017-10-09 11:11:23 -07:00 |
|
Jonathan Hung
|
ef59cbe08a
|
YARN-5951. Changes to allow CapacityScheduler to use configuration store
|
2017-10-09 11:11:22 -07:00 |
Daniel Templeton
|
6d6ca4c923
|
YARN-2612 addendum: fixed javadoc error.
|
2017-10-09 14:12:13 +02:00 |
|
Sunil G
|
8137254a1f
|
YARN-7245. Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user. Contributed by Eric Payne.
|
2017-10-09 14:39:41 +05:30 |
|
Rohith Sharma K S
|
6fe6a72352
|
Revert "YARN-7180. Remove class ResourceType. Contributed by Sunil G."
This reverts commit 6bd81ab054.
|
2017-10-09 13:21:13 +05:30 |
|
Rohith Sharma K S
|
6bd81ab054
|
YARN-7180. Remove class ResourceType. Contributed by Sunil G.
|
2017-10-09 10:20:40 +05:30 |
|
Yufei Gu
|
72d22b753a
|
YARN-7207. Cache the RM proxy server address. (Yufei Gu)
|
2017-10-06 09:49:11 -07:00 |
|
Yufei Gu
|
49ae538164
|
YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage(addendum). (Yufei Gu)
|
2017-10-06 00:08:25 -07:00 |
|
Yufei Gu
|
99292adcef
|
YARN-2162. Add ability in Fair Scheduler to optionally configure maxResources in terms of percentage. (Yufei Gu)
|
2017-10-05 23:51:58 -07:00 |
|
Haibo Chen
|
c071aad5da
|
YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen)
|
2017-10-05 15:50:13 -07:00 |
Naganarasimha
|
d0046bb5c6
|
YARN-7285. ContainerExecutor always launches with priorities due to yarn-default property. Contributed by Jason Lowe.
|
2017-10-06 00:07:53 +05:30 |
Chris Trezzo
|
7e76f85bc6
|
YARN-2960. Add documentation for the YARN shared cache.
|
2017-10-05 10:38:41 -07:00 |
|
Arun Suresh
|
b733348dde
|
YARN-7258. Add Node and Rack Hints to Opportunistic Scheduler. (Kartheek Muthyala via asuresh).
|
2017-10-05 09:58:04 -07:00 |
|
Sunil G
|
f702c95754
|
YARN-6182. Fix alignment issues and missing information in new YARN UI's Queue page. Contributed by Akhil PB.
|
2017-10-05 11:34:44 +05:30 |
|
Sunil G
|
592bf2d550
|
YARN-7279. Fix typo in helper message of ContainerLauncher. Contributed by Elek, Marton.
|
2017-10-05 10:52:00 +05:30 |
Subru Krishnan
|
e6e614e380
|
YARN-5329. Placement Agent enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru).
|
2017-10-04 19:28:27 -07:00 |
Akira Ajisaka
|
2df1b2ac05
|
YARN-7044. TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable fails.
|
2017-10-05 06:07:32 +09:00 |
|
Akira Ajisaka
|
acf5b880d8
|
YARN-6975. Moving logging APIs over to slf4j in hadoop-yarn-server-tests, hadoop-yarn-server-web-proxy and hadoop-yarn-server-router. Contributed by Yeliang Cang.
|
2017-10-04 14:53:41 +09:00 |
Ray Chiang
|
67e12169b0
|
YARN-7219. Make AllocateRequestProto compatible with branch-2/branch-2.8. (rchiang)
|
2017-10-03 15:06:07 -07:00 |
|
Akira Ajisaka
|
c9b525bd94
|
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
|
2017-10-04 07:01:54 +09:00 |
|
Akira Ajisaka
|
4a87773718
|
YARN-6916. Moving logging APIs over to slf4j in hadoop-yarn-server-common. Contributed by Bibin A Chundatt and Akira Ajisaka.
|
2017-10-04 06:06:39 +09:00 |
Allen Wittenauer
|
4d5dd75b60
|
HADOOP-14908. CrossOriginFilter should trigger regex on more input (Johannes Alberti via aw)
|
2017-10-03 10:58:28 -07:00 |
Jian He
|
4111e6c781
|
YARN-7269. Tracking URL in the app state does not get redirected to ApplicationMaster for Running applications. Contributed by Wangda Tan
|
2017-10-03 09:54:38 -07:00 |
Sidharta S
|
7eb8499996
|
YARN-7226. Whitelisted variables do not support delayed variable expansion. Contributed by Jason Lowe
|
2017-10-02 19:04:49 -07:00 |
|
Subru Krishnan
|
d4d2fd1acd
|
YARN-2037. Add work preserving restart support for Unmanaged AMs. (Botong Huang via Subru).
|
2017-10-02 18:14:44 -07:00 |
|
Wangda Tan
|
280080fad0
|
YARN-7259. Add size-based rolling policy to LogAggregationIndexedFileController. (xgong via wangda)
Change-Id: Ifaf82c0aee6b73b9b6ebf103aa72e131e3942f31
|
2017-10-02 15:30:22 -07:00 |
|
Carlo Curino
|
ceca9694f9
|
YARN-3661. Basic Federation UI. (Contributed by Inigo Goiri via curino)
|
2017-10-02 13:03:32 -07:00 |
|
Yufei Gu
|
66c417167a
|
YARN-6333. Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThreshold. (Contributed by Chetna Chaudhari via Yufei Gu)
|
2017-09-29 18:07:33 -07:00 |
|
Wangda Tan
|
ec2ae3060a
|
YARN-6509. Add a size threshold beyond which yarn logs will require a force option. (Xuan Gong via wangda)
Change-Id: I755fe903337d4ff9ec35dae5b9cce638794e1d0f
|
2017-09-29 16:42:56 -07:00 |
|
Wangda Tan
|
febeead5f9
|
YARN-6550. Capture launch_container.sh logs to a separate log file. (Suma Shivaprasad via wangda)
Change-Id: I0ee0b1bb459437432a22cf68861a6354f0decabb
|
2017-09-29 16:39:46 -07:00 |
Eric Payne
|
7f6118f918
|
YARN-7084. TestSchedulingMonitor#testRMStarts fails sporadically. Contributed by Jason Lowe.
|
2017-09-29 10:33:57 -05:00 |
|
Wangda Tan
|
d3b1c63195
|
YARN-6623. Add support to turn off launching privileged containers in the container-executor. (Varun Vasudev via wangda)
Change-Id: I76aec68cbfb42d239279d7245a03290d691e87a4
|
2017-09-28 16:41:09 -07:00 |
|
Chris Trezzo
|
c114da5e64
|
YARN-7250. Update Shared cache client api to use URLs.
|
2017-09-28 15:28:06 -07:00 |
|
Subru Krishnan
|
ca669f9f8b
|
YARN-6962. Add support for updateContainers when allocating using FederationInterceptor. (Botong Huang via Subru).
|
2017-09-28 13:04:03 -07:00 |
|
Jason Lowe
|
85d81ae58e
|
YARN-7248. NM returns new SCHEDULED container status to older clients. Contributed by Arun Suresh
|
2017-09-28 14:10:15 -05:00 |
|
Xuan
|
28c4957fcc
|
YARN-7257. AggregatedLogsBlock reports a bad 'end' value as a bad
'start' value. Contributed by Jason Lowe
|
2017-09-27 15:46:18 -07:00 |
|
Chris Trezzo
|
c87db8d154
|
YARN-7253. Shared Cache Manager daemon command listed as admin subcmd in yarn script.
|
2017-09-27 11:32:09 -07:00 |
|
Sunil G
|
8facf1f976
|
YARN-6871. Add additional deSelects params in RMWebServices#getAppReport. Contributed by Tanuj Nayak.
|
2017-09-27 14:37:32 +05:30 |
|
Jason Lowe
|
14fec04ed3
|
Revert "YARN-6570. No logs were found for running application, running"
This reverts commit 7c732924a8.
|
2017-09-26 10:38:03 -05:00 |
|
Rohith Sharma K S
|
06e5a7b5cf
|
YARN-65. Reduce RM app memory footprint once app has completed. Contributed by Manikandan R.
|
2017-09-26 14:34:09 +05:30 |
|
Arun Suresh
|
df800f6cf3
|
YARN-7240. Add more states and transitions to stabilize the NM Container state machine. (Kartheek Muthyala via asuresh)
|
2017-09-25 16:02:55 -07:00 |
|
Akira Ajisaka
|
e928ee583c
|
YARN-7153. Remove duplicated code in AMRMClientAsyncImpl.java. Contributed by Sen Zhao.
|
2017-09-26 02:03:30 +09:00 |
|
Daniel Templeton
|
164a063e74
|
YARN-6878. TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order
(Contributed by Sen Zhao via Daniel Templeton)
|
2017-09-22 23:53:32 +02:00 |
|
Junping Du
|
4002bf0a9e
|
YARN-7118. AHS REST API can return NullPointerException. Contributed by Billie Rinaldi.
|
2017-09-22 13:58:09 -07:00 |
|
Jason Lowe
|
bfd1a72ba8
|
YARN-4266. Allow users to enter containers as UID:GID pair instead of by username. Contributed by luhuichun, Zhankun Tang, and Eric Badger.
|
2017-09-21 17:41:34 -05:00 |
|
Junping Du
|
e5e1851d80
|
YARN-7034. DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor. Contributed by Miklos Szegedi.
|
2017-09-21 14:01:16 -07:00 |
|
Yufei Gu
|
a92ef030a2
|
YARN-7045. Remove FSLeafQueue#addAppSchedulable. (Contributed by Sen Zhao via Yufei Gu)
|
2017-09-21 12:31:07 -07:00 |
|
Wangda Tan
|
263e2c692a
|
YARN-6991. "Kill application" button does not show error if other user tries to kill the application for secure cluster. (Suma Shivaprasad via wangda)
Change-Id: I7e7894b24609709f89064ee5882f055dbb09080b
|
2017-09-21 12:00:53 -07:00 |
|
Jason Lowe
|
10d7493587
|
YARN-6968. Hardcoded absolute pathname in DockerLinuxContainerRuntime. Contributed by Eric Badger
|
2017-09-21 08:38:08 -05:00 |
Sangjin Lee
|
8b336632ac
|
YARN-6771. Use classloader inside configuration class to make new
classes. Contributed by Jongyoul Lee.
|
2017-09-20 22:22:43 -07:00 |
|
Yufei Gu
|
a9019e1fb7
|
YARN-6499. Remove the doc about Schedulable#redistributeShare(). (Contributed by Chetna Chaudhari via Yufei Gu)
|
2017-09-19 18:28:31 -07:00 |
|
Junping Du
|
647b7527a9
|
YARN-7186. Fix finicky TestContainerManager tests. Contributed by Arun Suresh.
|
2017-09-19 18:31:15 -07:00 |
|
Arun Suresh
|
56ef5279c1
|
YARN-7203. Add container ExecutionType into ContainerReport. (Botong Huang via asuresh)
|
2017-09-18 15:49:31 -07:00 |
Andrew Wang
|
3cf3540f19
|
HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory.
|
2017-09-18 15:13:42 -07:00 |
|
Xuan
|
7c732924a8
|
YARN-6570. No logs were found for running application, running
container. Contributed by Junping Du
|
2017-09-18 14:04:05 -07:00 |
|
Arun Suresh
|
29dd55153e
|
YARN-7199. Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests. (Botong Huang via asuresh)
|
2017-09-18 11:26:44 -07:00 |
|
Jason Lowe
|
a4f9c7c924
|
YARN-7192. Add a pluggable StateMachine Listener that is notified of NM Container State changes. Contributed by Arun Suresh
|
2017-09-18 10:16:09 -05:00 |
|
Wangda Tan
|
e81596d06d
|
YARN-7172. ResourceCalculator.fitsIn() should not take a cluster resource parameter. (Sen Zhao via wangda)
Change-Id: Icc3670c9381ce7591ca69ec12da5aa52d3612d34
|
2017-09-17 21:20:43 -07:00 |
|
Wangda Tan
|
38c14ef8d8
|
YARN-7149. Cross-queue preemption sometimes starves an underserved queue. (Eric Payne via wangda)
Change-Id: Ib269991dbebce160378e8372ee6d24849c4a5ed6
(cherry picked from commit 3dfa937a1fadfc62947755872515f549b3b15e6a)
|
2017-09-15 21:29:39 -07:00 |
|
Wangda Tan
|
958e8c0e25
|
YARN-6977. Node information is not provided for non am containers in RM logs. (Suma Shivaprasad via wangda)
Change-Id: I0c44d09a560446dee2ba68c2b9ae69fce0ec1d3e
(cherry picked from commit 8a42e922fad613f3cf1cc6cb0f3fa72546a9cc56)
|
2017-09-15 21:29:31 -07:00 |
|
Junping Du
|
1a84c24b0c
|
YARN-7174. Add retry logic in LogsCLI when fetch running application logs. Contributed by Xuan Gong.
|
2017-09-15 15:33:24 -07:00 |
|
Yufei Gu
|
09b476e6da
|
YARN-6612. Update fair scheduler policies to be aware of resource types. (Contributed by Daniel Templeton via Yufei Gu)
|
2017-09-14 11:23:37 -07:00 |
|
Arun Suresh
|
66ca0a6540
|
YARN-6059. Update paused container state in the NM state store. (Hitesh Sharma via asuresh)
|
2017-09-14 08:51:26 -07:00 |
|
Arun Suresh
|
4f8194430f
|
YARN-5216. Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM. (Hitesh Sharma via asuresh)
|
2017-09-14 08:51:26 -07:00 |
|
Arun Suresh
|
864fbacd45
|
YARN-5292. NM Container lifecycle and state transitions to support for PAUSED container state. (Hitesh Sharma via asuresh)
|
2017-09-14 08:48:39 -07:00 |
|
Junping Du
|
c92c1d521e
|
YARN-7194. Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat. Contributed by Xuan Gong.
|
2017-09-13 22:16:06 -07:00 |
|
Robert Kanter
|
bb34ae9554
|
YARN-7146. Many RM unit tests failing with FairScheduler (rkanter)
|
2017-09-13 15:44:54 -07:00 |
|
Eric Payne
|
3860be7961
|
YARN-4727. Unable to override the $HADOOP_CONF_DIR env variable for container. Contributed by Jason Lowe.
|
2017-09-13 14:41:55 -05:00 |
|
Eric Payne
|
a3c44195be
|
Revert 'YARN-4727. Unable to override the $HADOOP_CONF_DIR env variable for container. Contributed by Jason Lowe.'
This reverts commit 729d05f529.
|
2017-09-13 14:38:58 -05:00 |
|
Eric Payne
|
729d05f529
|
YARN-4727. Unable to override the /home/ericp/run/conf/ env variable for container. Contributed by Jason Lowe.
|
2017-09-13 14:29:08 -05:00 |
|
Rohith Sharma K S
|
5324388cf2
|
YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G.
|
2017-09-13 23:36:47 +05:30 |
|
Arun Suresh
|
a1c398e0dc
|
YARN-7185. [Addendum patch] Minor javadoc and checkstyle fix.
|
2017-09-12 17:03:32 -07:00 |
|
Yufei Gu
|
82c5dd1d50
|
YARN-7057. FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption. (Contributed by Karthik via Yufei Gu)
|
2017-09-12 16:13:39 -07:00 |
|
Arun Suresh
|
2ae72692fc
|
YARN-7185. ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled. (Wangda Tan via asuresh)
|
2017-09-12 16:10:08 -07:00 |
|
Sunil G
|
da0b6a354b
|
YARN-7137. [YARN-3926] Move newly added APIs to unstable in YARN-3926 branch. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
|
Daniel Templeton
|
bf2b687412
|
YARN-7136. Additional Performance Improvement for Resource Profile Feature
(Contributed by Wangda Tan via Daniel Templeton)
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
6b88cd1901
|
YARN-7056. Document Resource Profiles feature. (Sunil G via wangda)
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
805095496d
|
YARN-6933. [YARN-3926] ResourceUtils.DISALLOWED_NAMES check is duplicated. Contributed by Manikandan R.
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
53df3eac50
|
YARN-7093. Improve log message in ResourceUtils. (Sunil G via wangda)
Change-Id: I88928a747ee3eec17bc76fb71e9aaa632d091f0f
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
e490602e9b
|
YARN-7039. Fix javac and javadoc errors in YARN-3926 branch. (Sunil G via wangda)
Change-Id: I442bf6d838b3aba83f1f6779cf9dcf8596a2102d
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
a333ba54e3
|
YARN-7067. [YARN-3926] Optimize ResourceType information display in UI. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
39240b61a1
|
YARN-7043. Cleanup ResourceProfileManager. (wangda)
Change-Id: I463356f37bf1f6a3f1fc3c594c79916e8c0ab913
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
758b771943
|
YARN-6781. [YARN-3926] ResourceUtils#initializeResourcesMap takes an unnecessary Map parameter. Contributed by Yu-Tang Lin.
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
df3855541a
|
YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
|
2017-09-12 09:19:12 -07:00 |
|
Wangda Tan
|
b1fe3a222e
|
YARN-7042. Clean up unit tests after YARN-6610. (Daniel Templeton via wangda)
Change-Id: I8e40f704b6fcdd5b14faa9548a27986501044fa1
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
a6989af1d9
|
YARN-7030. [YARN-3926] Performance optimizations in Resource and ResourceUtils class. Contributed by Wangda Tan.
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
a0030c8c6f
|
YARN-6610. [YARN-3926] DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources. Contributed by Daniel Templeton.
|
2017-09-12 09:19:12 -07:00 |
|
Daniel Templeton
|
6746f8cadb
|
YARN-6908. ResourceProfilesManagerImpl is missing @Overrides on methods
(Contributed by Sunil G. via Daniel Templeton)
|
2017-09-12 09:19:12 -07:00 |
|
Sunil G
|
2b51b262ab
|
YARN-6892. [YARN-3926] Improve API implementation in Resources and DominantResourceCalculator class. Contributed by Sunil G.
|
2017-09-12 09:19:12 -07:00 |
|
Yufei Gu
|
d5e9939ebb
|
YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu)
|
2017-09-12 09:19:11 -07:00 |
|
Daniel Templeton
|
5c4ab4c291
|
YARN-6935. [YARN-3926] ResourceProfilesManagerImpl.parseResource() has no need of the key parameter
(Contributed by Manikandan R via Daniel Templeton)
|
2017-09-12 09:19:11 -07:00 |
|
Daniel Templeton
|
3aeaafecb8
|
YARN-6788. [YARN-3926] Improve performance of resource profile branch
(Contributed by Sunil Govindan via Daniel Templeton)
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
4e5632d28e
|
YARN-6786. [YARN-3926] ResourcePBImpl imports cleanup. Contributed by Yeliang Cang.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
ca2808d8bb
|
YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
58da54640e
|
YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
dae65f3bef
|
YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
7805deed48
|
YARN-5588. [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Arun Suresh
|
6708ac3301
|
YARN-5587. Add support for resource profiles. (vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
Varun Vasudev
|
c2032e251e
|
YARN-5708. Implement APIs to get resource profiles from the RM. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
a9b4426302
|
YARN-5707. Add manager class for resource profiles. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Rohith Sharma K S
|
239c1824a0
|
YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Rohith Sharma K S
|
9e4ba6aff5
|
YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
759114b006
|
YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Arun Suresh
|
7ba698997b
|
YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
ceb12c59a3
|
YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Wangda Tan
|
32c91223f1
|
YARN-4172. Extend DominantResourceCalculator to account for all resources. (Varun Vasudev via wangda)
|
2017-09-12 09:19:09 -07:00 |
|
Wangda Tan
|
1bbab7c157
|
YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda)
|
2017-09-12 09:19:09 -07:00 |
|
Wangda Tan
|
e74d1be04b
|
YARN-7173. Container update RM-NM communication fix for backward compatibility. (Arun Suresh via wangda)
Change-Id: I1c39ed5c59dee739ba5044b61b3ef5ed203b79c1
|
2017-09-11 20:52:08 -07:00 |
|
Haibo Chen
|
fa531788fd
|
YARN-7132. FairScheduler.initScheduler() contains a surprising unary plus. (Yeliang Cang via Haibo Chen)
|
2017-09-11 20:42:49 -07:00 |
|
Haibo Chen
|
661f5eb0c6
|
YARN-7128. The error message in TimelineSchemaCreator is not enough to find out the error. (Jinjiang Ling via Haibo Chen)
|
2017-09-11 16:20:20 -07:00 |
|
Daniel Templeton
|
6651cbcc72
|
YARN-6622. Document Docker work as experimental (Contributed by Varun Vasudev)
|
2017-09-11 16:14:31 -07:00 |
|
Daniel Templeton
|
07951b586e
|
Revert "YARN-6022. Document Docker work as experimental (Contributed by Varun Vasudev)"
This reverts commit 66be6c848b.
|
2017-09-11 16:14:18 -07:00 |
|
Daniel Templeton
|
66be6c848b
|
YARN-6022. Document Docker work as experimental (Contributed by Varun Vasudev)
|
2017-09-11 15:46:23 -07:00 |
|
Yufei Gu
|
5ab21dfe9c
|
YARN-6799. Remove the duplicated code in CGroupsHandlerImp.java. (Contributed by Weiyuan via Yufei Gu)
|
2017-09-10 23:17:59 -07:00 |
|
Sunil G
|
722ee84194
|
YARN-7163. RMContext need not to be injected to webapp and other Always Running services. Contributed by Rohith Sharma K S.
|
2017-09-11 10:28:10 +05:30 |
|
Junping Du
|
3fddabc2fe
|
YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
|
2017-09-08 15:16:19 -07:00 |
|
Haibo Chen
|
8edc60531f
|
HADOOP-14847. Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc. (Bharat Viswanadham via Haibo Chen)
|
2017-09-08 14:33:11 -07:00 |
|
Arun Suresh
|
1f53ae7972
|
YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-09-08 09:24:05 -07:00 |
|
Rohith Sharma K S
|
4a83170be4
|
YARN-7140. CollectorInfo should have Public visibility. Contributed by Varun Saxena.
|
2017-09-08 20:23:16 +05:30 |
|
Rohith Sharma K S
|
0bfb3a2566
|
YARN-7130. ATSv2 documentation changes post merge. Contributed by Varun Saxena.
|
2017-09-08 20:21:50 +05:30 |
|
Sunil G
|
ab8368d2e0
|
YARN-7104. Improve Nodes Heatmap in new YARN UI with better color coding. Contributed by Da Ding.
|
2017-09-08 16:16:01 +05:30 |
|
Subru Krishnan
|
fa6137501c
|
YARN-5330. SharingPolicy enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru).
|
2017-09-07 19:07:17 -07:00 |
|
Sunil G
|
56d93d2e39
|
YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
|
2017-09-08 07:15:17 +05:30 |
|
Jason Lowe
|
b0b535d9d5
|
YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf
|
2017-09-07 16:17:03 -05:00 |
|
Wangda Tan
|
f155ab7cfa
|
YARN-7033. Add support for NM Recovery of assigned resources (e.g. GPU's, NUMA, FPGA's) to container. (Devaraj K and Wangda Tan)
Change-Id: Iffd18bb95debe1c8cc55e30abc1d8f663e9d0e30
|
2017-09-07 14:13:37 -07:00 |
|
Arun Suresh
|
c41118a7f8
|
YARN-6978. Add updateContainer API to NMClient. (Kartheek Muthyala via asuresh)
|
2017-09-07 10:23:12 -07:00 |
|
Sunil G
|
6f101e7df1
|
YARN-6992. Kill application button is visible even if the application is FINISHED in RM UI. Contributed by Suma Shivaprasad.
|
2017-09-07 13:16:20 +05:30 |
|
Subru Krishnan
|
b6e7d13696
|
YARN-5328. Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-06 16:46:01 -07:00 |
|
Subru Krishnan
|
e3345e985b
|
Revert "Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem."
This reverts commit 7996eca7dc.
|
2017-09-06 16:39:23 -07:00 |
|
Junping Du
|
22de9449f8
|
YARN-7144. Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. Contributed by Xuan Gong.
|
2017-09-06 14:53:31 -07:00 |
|
Jason Lowe
|
704267cb49
|
YARN-7164. TestAMRMClientOnRMRestart fails sporadically with bind address in use. Contributed by Jason Lowe
|
2017-09-06 15:23:49 -05:00 |
|
Junping Du
|
63231a2a30
|
YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc error. Contributed by Xuan Gong.
|
2017-09-06 13:19:34 -07:00 |
|
Sunil G
|
ed162b7aa0
|
YARN-7022. Improve click interaction in queue topology in new YARN UI. Contributed by Abdullah Yousufi.
|
2017-09-05 08:06:43 +05:30 |
Varun Saxena
|
ef87d34a0e
|
YARN-7152. [ATSv2] Registering timeline client before AMRMClient service init throw exception (Rohith Sharma K S via Varun Saxena)
|
2017-09-04 20:11:02 +05:30 |
|
Sunil G
|
275980bb1e
|
YARN-7075. Better styling for donut charts in new YARN UI. Contributed by Da Ding.
|
2017-09-02 08:08:59 +05:30 |
|
Subru Krishnan
|
7996eca7dc
|
Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-01 15:16:40 -07:00 |
Oleg Danilov
|
c5281a85e1
|
YARN-7023. Incorrect ReservationId.compareTo() implementation.
This closes #262
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2017-09-01 21:33:31 +02:00 |
|
Andrew Wang
|
0d419c984f
|
Preparing for 3.1.0 development
|
2017-09-01 11:53:48 -07:00 |
|
Jason Lowe
|
99a7f5d451
|
YARN-7120. CapacitySchedulerPage NPE in "Aggregate scheduler counts" section. Contributed by Eric Payne
|
2017-09-01 11:09:14 -05:00 |
|
Sunil G
|
a756704f5a
|
YARN-7071. Add vcores and number of containers in new YARN UI node heat map. Contributed by Abdullah Yousufi.
|
2017-09-01 20:46:39 +05:30 |
bibinchundatt
|
dcd0bedcc8
|
YARN-7141. Move logging APIs to slf4j in timelineservice after ATSv2 merge. Contributed by Varun Saxena
|
2017-09-01 11:29:16 +05:30 |
|
Allen Wittenauer
|
0adc3a0533
|
YARN-6721. container-executor should have stack checking
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-31 19:39:31 -07:00 |
|
Allen Wittenauer
|
190410085b
|
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
Signed-off-by: Andrew Wang <wang@apache.org>
|
2017-08-31 19:06:49 -07:00 |
|
Junping Du
|
91cc070d67
|
YARN-6877. Create an abstract log reader for extendability. Contributed by Xuan Gong.
|
2017-08-31 16:41:43 -07:00 |
Subru Krishnan
|
bac4e8cca8
|
YARN-7095. Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
|
2017-08-31 15:05:41 -07:00 |
|
Daniel Templeton
|
d4417dae4f
|
YARN-6780. ResourceWeights.toString() cleanup (Contributed by weiyuan via Daniel Templeton)
|
2017-08-31 09:35:01 -07:00 |
|
Sunil G
|
f9e0cc8cdc
|
YARN-7116. CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage. Contributed by Wangda Tan.
|
2017-08-31 18:42:01 +05:30 |
|
Allen Wittenauer
|
71bbb86d69
|
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-30 21:47:24 -07:00 |
|
Robert Kanter
|
ce79f7be29
|
YARN-7094. Document the current known issue with server-side NM graceful decom (rkanter)
|
2017-08-30 18:04:55 -07:00 |
|
Daniel Templeton
|
cc23514aba
|
YARN-7115. Move BoundedAppender to org.hadoop.yarn.util pacakge
(Contributed by Jian He via Daniel Templeton)
|
2017-08-30 17:26:13 -07:00 |
|
Haibo Chen
|
a20e7105ea
|
YARN-6868. Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml. (Ray Chiang via Haibo Chen)
|
2017-08-30 09:14:59 -07:00 |
|
Varun Saxena
|
3d00c8f394
|
Made fixes for whitespace errors and checstyle warnings before merge.
|
2017-08-30 11:29:54 +05:30 |
|
Varun Saxena
|
512068a01f
|
YARN-6905. Addendum to fix TestTimelineReaderWebServicesHBaseStorage due to missing FastNumberFormat
|
2017-08-30 11:29:54 +05:30 |
|
Varun Saxena
|
16ba4f544f
|
MAPREDUCE-6838. Addendum to fix code comment
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
08f40bcc7f
|
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
|
2017-08-30 11:29:54 +05:30 |
Vrushali C
|
bea3e4df76
|
YARN-6047 Documentation updates for TimelineService v2 (Contributed by Rohith Sharma)
|
2017-08-30 11:29:54 +05:30 |
|
Haibo Chen
|
9b08f365d7
|
YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen)
|
2017-08-30 11:29:54 +05:30 |
|
Varun Saxena
|
b2efebdd07
|
YARN-6861. Reader API for sub application entities (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
7fd6ae2479
|
YARN-6134. [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active. Contributed by Varun Saxena
|
2017-08-30 11:29:54 +05:30 |
|
Rohith Sharma K S
|
e276c75ec1
|
YARN-7041. Nodemanager NPE running jobs with security off. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|
Rohith Sharma K S
|
32188d3295
|
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
b664569586
|
YARN-7006. [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol. Contributed by Varun Saxena
|
2017-08-30 11:29:53 +05:30 |
Jason Lowe
|
d5ff965fee
|
YARN-6820. Restrict read access to timelineservice v2 data. Contributed by Vrushali C
|
2017-08-30 11:29:53 +05:30 |
|
Varun Saxena
|
60765aff9b
|
YARN-6874. Supplement timestamp for min start/max end time columns in flow run table to avoid overwrite (Vrushali C via Varun Saxena)
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
354be99dbf
|
YARN-6133. [ATSv2 Security] Renew delegation token for app automatically if an app collector is active. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
7594d1de7b
|
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Varun Saxena
|
9f6540535d
|
YARN-6734. Ensure sub-application user is extracted & sent to timeline service (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
3fb71b1393
|
YARN-6888. Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created. Contributed by Vrushali C.
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
a990ff70c2
|
YARN-6733. Add table for storing sub-application entities. Contributed by Vrushali C.
|
2017-08-30 11:29:53 +05:30 |
|
Vrushali C
|
61136d03f2
|
YARN-6850 Ensure that supplemented timestamp is stored only for flow run metrics (Contributed by Varun Saxena via Vrushali C)
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
70078e91e3
|
YARN-4455. Support fetching metrics by time range. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |