Karthik Kambatla
|
74dd142250
|
YARN-5798. Set UncaughtExceptionHandler for all FairScheduler threads. (Yufei Gu via kasha)
|
2017-02-16 00:03:09 -08:00 |
|
Karthik Kambatla
|
11be3f70e0
|
YARN-4212. FairScheduler: Can't create a DRF queue under a FAIR policy queue. (Yufei Gu via kasha)
|
2017-02-15 23:51:22 -08:00 |
|
Karthik Kambatla
|
6c25dbcdc0
|
YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha)
|
2017-02-15 23:16:12 -08:00 |
Junping Du
|
0fc6f38379
|
Addendum patch for YARN-6174 - remove deleted file.
|
2017-02-15 09:07:49 -08:00 |
|
Junping Du
|
ce2d5bfa5f
|
YARN-6174. Log files pattern should be same for both running and finished container. Contributed by Xuan Gong.
|
2017-02-15 09:05:14 -08:00 |
Sunil G
|
ff75132355
|
YARN-6183. Few missing informations in Application and Application Attempt pages for new YARN UI. Contributed by Akhil PB.
|
2017-02-15 15:52:57 +05:30 |
Varun Saxena
|
b7613e0f40
|
YARN-6156. AM blacklisting to consider node label partition (Bibin A Chundatt via Varun Saxena)
|
2017-02-15 14:48:17 +05:30 |
Masatake Iwasaki
|
fbc0c2bd76
|
YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation. (iwasakims)
|
2017-02-15 13:09:10 +09:00 |
|
Karthik Kambatla
|
353a9b2d91
|
YARN-6061. Addendum. Remove extraneous change.
|
2017-02-14 15:19:52 -08:00 |
|
Karthik Kambatla
|
652679aa8a
|
YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. (Yufei Gu via kasha)
|
2017-02-14 13:39:41 -08:00 |
|
Sunil G
|
1fa084c425
|
YARN-5912. Fix breadcrumb issues for various pages in new YARN UI. Contributed by Akhil P B.
|
2017-02-14 22:29:21 +05:30 |
Arun Suresh
|
aaf106fde3
|
YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh)
|
2017-02-14 06:09:10 -08:00 |
|
Karthik Kambatla
|
646c6d6509
|
YARN-3933. FairScheduler: Multiple calls to completedContainer are not safe. (Shiwei Guo and Miklos Szegedi via kasha)
|
2017-02-13 11:26:30 -08:00 |
|
Junping Du
|
464ff479ce
|
YARN-6113. Re-direct NM Web Service to get container logs for finished applications. Contributed by Xuan Gong.
|
2017-02-13 06:12:54 -08:00 |
|
Varun Saxena
|
649deb72fb
|
YARN-6170. TimelineReaderServer should wait to join with HttpServer2 (Sangjin Lee via Varun Saxena)
|
2017-02-11 19:21:45 +05:30 |
Daniel Templeton
|
1238fa71f8
|
YARN-6166. Unnecessary INFO logs in AMRMClientAsyncImpl$CallbackHandlerThread.run (Contributed by Grant Whiteheart via Daniel Templeton)
|
2017-02-10 09:46:11 -08:00 |
|
Sunil G
|
3a0a0a485a
|
YARN-6118. Add javadoc for Resources.isNone. Contributed by Andres Perez.
|
2017-02-10 15:48:46 +05:30 |
|
Karthik Kambatla
|
08f93978f3
|
YARN-6144. FairScheduler: preempted resources can become negative. (Miklos Szegedi via kasha)
|
2017-02-09 14:45:04 -08:00 |
|
Karthik Kambatla
|
9b85053583
|
YARN-6112. UpdateCallDuration is calculated only when debug logging is enabled. (Yufei Gu via kasha)
|
2017-02-09 13:09:32 -08:00 |
Wangda Tan
|
5fb723bb77
|
YARN-5889. Improve and refactor user-limit calculation in Capacity Scheduler. (Sunil G via wangda)
|
2017-02-09 10:23:50 -08:00 |
Jason Lowe
|
37b4acf7ce
|
YARN-6137. Yarn client implicitly invoke ATS client which accesses HDFS. Contributed by Li Lu
|
2017-02-08 14:59:09 -06:00 |
|
Junping Du
|
eec52e158b
|
YARN-6145. Improve log message on fail over. Contributed by Jian He.
|
2017-02-08 02:11:19 -08:00 |
|
Daniel Templeton
|
a87e3850b9
|
YARN-6135. Node manager REST API documentation is not up to date (Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-02-07 16:41:02 -08:00 |
Sidharta S
|
307ec58ffb
|
YARN-5258. Document Use of Docker with LinuxContainerExecutor (Contributed by Daniel Templeton)
|
2017-02-07 16:29:21 -08:00 |
|
Sunil G
|
7a8f3f237e
|
YARN-5917. Make navigation link active when selecting sub tabs in 'Applications' and 'Nodes' page for new UI. Contributed by Kai Sasaki.
|
2017-02-07 21:45:40 +05:30 |
|
Junping Du
|
9dbfab1284
|
YARN-6108. Improve AHS webservice to accept NM address as a parameter to get container logs. Contributed by Xuan Gong.
|
2017-02-07 02:13:14 -08:00 |
|
Junping Du
|
cce35c3815
|
HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
|
2017-02-05 19:42:11 -08:00 |
|
Junping Du
|
327c9980aa
|
YARN-6100. Improve YARN webservice to output aggregated container logs. Contributed by Xuan Gong.
|
2017-02-02 00:41:18 -08:00 |
|
Daniel Templeton
|
3e06475307
|
YARN-4658. Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment (Contributed by Udai Potluri via Daniel Templeton)
|
2017-01-31 16:25:33 -08:00 |
|
Sunil G
|
4c6bae5a22
|
YARN-5866. Fix few issues reported by jshint in new YARN UI. Contributed by Akhil P B.
|
2017-01-31 14:18:31 +05:30 |
|
Daniel Templeton
|
87852b6ef4
|
YARN-6103. Log updates for ZKRMStateStore (Contributed by Daniel Sturman via Daniel Templeton)
|
2017-01-30 21:44:48 -08:00 |
|
Karthik Kambatla
|
11e44bdda7
|
YARN-6131. FairScheduler: Lower update interval for faster tests. (kasha)
|
2017-01-30 13:35:23 -08:00 |
|
Junping Du
|
1a16431bd0
|
YARN-6126. Obtaining app logs for Running application fails with json parse error. Contributed by Xuan Gong.
|
2017-01-27 06:31:10 -08:00 |
|
Sunil G
|
165f07f51a
|
YARN-6123. [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed. Contributed by Wangda Tan.
|
2017-01-27 18:37:51 +05:30 |
|
Daniel Templeton
|
f85b74ccf9
|
YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues
(Contributed by Yufei Gu via Daniel Templeton)
|
2017-01-26 10:31:09 -08:00 |
Sangjin Lee
|
425a7e5028
|
YARN-3637. Handle localization sym-linking correctly at the YARN level. Contributed by Chris Trezzo.
|
2017-01-25 15:51:36 -08:00 |
Jason Lowe
|
9e19f758c1
|
YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger
|
2017-01-25 21:41:43 +00:00 |
Karthik Kambatla
|
abedb8a9d8
|
YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha)
|
2017-01-25 12:17:28 -08:00 |
|
Junping Du
|
8528d85a68
|
YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong.
|
2017-01-24 15:26:53 -08:00 |
|
Jason Lowe
|
a33ce45e35
|
YARN-5547. NMLeveldbStateStore should be more tolerant of unknown keys. Contributed by Ajith S
|
2017-01-24 16:17:36 +00:00 |
Rohith Sharma K S
|
0101267d9d
|
YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G.
|
2017-01-24 10:59:55 +05:30 |
|
Sangjin Lee
|
dc6ec97048
|
YARN-6117. SharedCacheManager does not start up. Contributed by Chris Trezzo.
|
2017-01-23 21:07:25 -08:00 |
|
Daniel Templeton
|
a2c50127d1
|
YARN-6012. Remove node label (removeFromClusterNodeLabels) document is missing (Contributed by Ying Zhang via Daniel Templeton)
|
2017-01-23 17:42:54 -08:00 |
|
Wangda Tan
|
ce832059db
|
YARN-5864. Capacity Scheduler - Queue Priorities. (wangda)
|
2017-01-23 10:52:14 -08:00 |
|
Jason Lowe
|
69fa81679f
|
YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He
|
2017-01-23 17:12:51 +00:00 |
|
Sunil G
|
3fa0d540df
|
YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang.
|
2017-01-23 12:19:35 +05:30 |
Ray Chiang
|
9bab85cadf
|
YARN-6106. Document FairScheduler 'allowPreemptionFrom' queue property. (Yufei Gu via rchiang)
|
2017-01-20 14:08:25 -08:00 |
|
Sangjin Lee
|
b01514f65b
|
YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
|
2017-01-19 20:52:55 -08:00 |
Andrew Wang
|
5d8b80ea9b
|
Preparing for 3.0.0-alpha3 development
|
2017-01-19 15:50:07 -08:00 |
Jian He
|
efc8faa1ba
|
YARN-6104. RegistrySecurity overrides zookeeper sasl system properties. Contributed by Billie Rinaldi
|
2017-01-19 10:18:59 -08:00 |
|
Arun Suresh
|
7e8d32147c
|
YARN-6110. Fix opportunistic containers documentation. (Akira Ajisaka via asuresh)
|
2017-01-19 06:14:28 -08:00 |
Allen Wittenauer
|
0eb4b513b7
|
HADOOP-13673. Update scripts to be smarter when running with privilege
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
|
2017-01-18 14:39:05 -08:00 |
|
Wangda Tan
|
72054a817d
|
YARN-5556. CapacityScheduler: Support deleting queues without requiring a RM restart. (Naganarasimha G R via wangda)
|
2017-01-18 13:31:33 -08:00 |
|
Karthik Kambatla
|
e224c96234
|
YARN-5831. FairScheduler: Propagate allowPreemptionFrom flag all the way down to the app. (Yufei Gu via kasha)
|
2017-01-17 17:01:31 -08:00 |
Subru Krishnan
|
4d1f3d9020
|
YARN-6016. Fix minor bugs in handling of local AMRMToken in AMRMProxy. (Botong Huang via Subru).
|
2017-01-17 14:48:03 -08:00 |
|
Daniel Templeton
|
695f110f93
|
YARN-6071. Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)
(Contributed by Wangda Tan via Daniel Templeton)
|
2017-01-17 12:55:47 -08:00 |
bibinchundatt
|
a9d946d4df
|
YARN-6057. yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds. Contributed by Julia Sommer.
|
2017-01-17 14:16:00 +05:30 |
Akira Ajisaka
|
e407449ddb
|
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
|
2017-01-17 10:10:23 +09:00 |
|
Junping Du
|
cf695577aa
|
YARN-6011. Add a new web service to list the files on a container in AHSWebService. Contributed by Xuan Gong.
|
2017-01-16 16:20:24 -08:00 |
|
Sunil G
|
d3170f9eba
|
YARN-6081. LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container. Contributed by Wangda Tan.
|
2017-01-13 18:22:29 +05:30 |
Naganarasimha
|
a6b06f7179
|
YARN-6072. RM unable to start in secure mode. Contributed by Ajith S.
|
2017-01-12 06:40:41 +05:30 |
|
Daniel Templeton
|
e6f13fe5d1
|
YARN-5849. Automatically create YARN control group for pre-mounted cgroups (Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-01-11 16:00:01 -08:00 |
|
Daniel Templeton
|
7979939428
|
YARN-5554. MoveApplicationAcrossQueues does not check user permission on the target queue
(Contributed by Wilfred Spiegelenburg via Daniel Templeton)
|
2017-01-11 14:34:10 -08:00 |
|
Jason Lowe
|
357eab9566
|
YARN-5416. TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped. Contributed by Junping Du
|
2017-01-11 17:13:37 +00:00 |
|
Junping Du
|
4db119b7b5
|
YARN-6079. Fix simple spelling errors in yarn test code. Contributed by vijay.
|
2017-01-10 18:20:27 -08:00 |
|
Naganarasimha
|
4c431a6940
|
YARN-6054. TimelineServer fails to start when some LevelDb state files are missing. Contributed by Ravi Prakash.
|
2017-01-10 15:54:16 +05:30 |
|
Naganarasimha
|
41db07d532
|
YARN-5937. stop-yarn.sh is not able to gracefully stop node managers. Contributed by Weiwei Yang.
|
2017-01-10 15:35:01 +05:30 |
|
Sunil G
|
9594c35dcb
|
YARN-5899. Debug log in AbstractCSQueue#canAssignToThisQueue needs improvement. Contributed by Ying Zhang.
|
2017-01-10 14:08:01 +05:30 |
|
Daniel Templeton
|
6332a318bc
|
YARN-6073. Misuse of format specifier in Preconditions.checkArgument (Contributed by Yuanbo Liu via Daniel Templeton)
|
2017-01-09 22:12:58 -08:00 |
|
Junping Du
|
945db55f2e
|
YARN-4148. When killing app, RM releases app's resource before they are released by NM. Contributed by Jason Lowe.
|
2017-01-09 18:14:46 -08:00 |
|
Wangda Tan
|
287d3d6804
|
YARN-3955. Support for application priority ACLs in queues of CapacityScheduler. (Sunil G via wangda)
|
2017-01-09 08:40:39 -08:00 |
|
Varun Saxena
|
db490eccce
|
YARN-6074. FlowRunEntity does not deserialize long values correctly (Rohith Sharma K S via Varun Saxena)
|
2017-01-09 18:54:22 +05:30 |
|
Varun Saxena
|
f59e36b4ce
|
YARN-6068. Log aggregation get failed when NM restart even with recovery (Junping Du via Varun Saxena)
|
2017-01-09 11:17:19 +05:30 |
|
Arun Suresh
|
85826f6ca5
|
YARN-6066. Opportunistic containers Minor fixes : API annotations, parameter name changes, checkstyles. (asuresh)
(cherry picked from commit 4985217de4)
|
2017-01-08 09:04:20 -08:00 |
|
Daniel Templeton
|
ac16400e1f
|
YARN-6022. Revert changes of AbstractResourceRequest (Contributed by Wangda Tan via Daniel Templeton)
|
2017-01-07 08:24:30 -08:00 |
|
Naganarasimha
|
a59df15757
|
YARN-6015. AsyncDispatcher thread name can be set to improved debugging. Contributed by Ajith S.
|
2017-01-07 08:11:58 +05:30 |
|
Jian He
|
020316458d
|
YARN-6009. Skip validating app timeout value on recovery. Contributed by Rohith Sharma K S
|
2017-01-06 18:19:09 -08:00 |
|
Daniel Templeton
|
71a4acf74b
|
YARN-5991. Yarn Distributed Shell does not print throwable t to App Master When failed to start container
(Contributed by Jim Frankola via Daniel Templeton)
|
2017-01-06 14:26:08 -08:00 |
|
Arun Suresh
|
2977bc6a14
|
YARN-6040. Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes. (Wangda Tan via asuresh)
|
2017-01-06 09:59:57 -08:00 |
|
Wangda Tan
|
0a55bd841e
|
YARN-5959. RM changes to support change of container ExecutionType. (Arun Suresh via wangda)
|
2017-01-05 10:31:05 -08:00 |
|
Rohith Sharma K S
|
e49e0a6e37
|
YARN-5988. RM unable to start in secure setup. Contributed by Ajith S.
|
2017-01-04 12:09:29 +05:30 |
Junping Du
|
8fadd69047
|
YARN-5923. Unable to access logs for a running application if YARN_ACL_ENABLE is enabled. Contributed by Xuan Gong.
|
2017-01-03 15:03:38 -08:00 |
|
Wangda Tan
|
f69a107aec
|
YARN-6025. Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
(cherry picked from commit e0f2379312)
|
2017-01-03 14:53:36 -08:00 |
|
Wangda Tan
|
ab1faa4ba8
|
Revert "Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)" to add correct JIRA number
This reverts commit e0f2379312.
|
2017-01-03 14:53:13 -08:00 |
|
Wangda Tan
|
e0f2379312
|
Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)
|
2017-01-03 14:46:41 -08:00 |
|
Daniel Templeton
|
165d01a73e
|
YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)
|
2016-12-30 08:41:52 -08:00 |
Robert Kanter
|
f216276d21
|
YARN-4882. Change the log level to DEBUG for recovering completed applications (templedf via rkanter)
|
2016-12-28 15:21:52 -08:00 |
|
Sunil G
|
9ca54f4810
|
YARN-5906. Update AppSchedulingInfo to use SchedulingPlacementSet. Contributed by Wangda Tan.
|
2016-12-28 22:48:19 +05:30 |
Varun Vasudev
|
972da46cb4
|
YARN-5719. Enforce a C standard for native container-executor. Contributed by Chris Douglas.
|
2016-12-28 14:59:57 +05:30 |
|
Sunil G
|
f6715b26b6
|
YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan.
|
2016-12-28 12:33:02 +05:30 |
|
Rohith Sharma K S
|
e297be74ed
|
YARN-6001. Improve moveApplicationQueues command line. Contributed by Sunil G.
|
2016-12-28 12:16:11 +05:30 |
|
Wangda Tan
|
0840b4329b
|
YARN-5756. Add state-machine implementation for scheduler queues. (Xuan Gong via wangda)
|
2016-12-27 21:18:33 -08:00 |
|
Robert Kanter
|
9262797e86
|
YARN-5257. Fix unreleased resources and null dereferences (yufeigu via rkanter)
|
2016-12-27 14:14:08 -08:00 |
|
Robert Kanter
|
1bbd023275
|
YARN-5962. Spelling errors in logging and exceptions for resource manager code (gsohn via rkanter)
|
2016-12-27 13:35:34 -08:00 |
|
Daniel Templeton
|
e216e8e233
|
HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton)
|
2016-12-27 13:03:16 -08:00 |
|
Arun Suresh
|
ac1e5d4f77
|
YARN-5938. Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes (asuresh)
|
2016-12-27 12:40:44 -08:00 |
|
Karthik Kambatla
|
c3973e7080
|
YARN-5969. FairShareComparator: Cache value of getResourceUsage for better performance. (zhangshilong via kasha)
|
2016-12-27 12:30:35 -08:00 |
|
Daniel Templeton
|
ded2d08f33
|
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
|
2016-12-27 07:18:08 -08:00 |
|
Naganarasimha
|
c721f78a3c
|
YARN-6026. A couple of spelling errors in the docs. Contributed by Grant Sohn.
|
2016-12-24 05:38:09 +05:30 |
|
Karthik Kambatla
|
4d3f73acc0
|
YARN-6000. Make AllocationFileLoaderService.Listener public. (Tao Jie via kasha)
|
2016-12-23 11:40:56 -08:00 |