Jason Lowe
|
32e490b6c0
|
YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt
|
2015-07-31 17:37:24 +00:00 |
Zhihai Xu
|
ab80e27703
|
YARN-433. When RM is catching up with node updates then it should not expire acquired containers. Contributed by Xuan Gong
|
2015-07-30 21:57:11 -07:00 |
Wangda Tan
|
91b42e7d6e
|
YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (Bibin A Chundatt via wangda)
|
2015-07-30 10:00:31 -07:00 |
Karthik Kambatla
|
5205a330b3
|
YARN-2768. Avoid cloning Resource in FSAppAttempt#updateDemand. (Hong Zhiguo via kasha)
|
2015-07-29 09:42:32 -07:00 |
Xuan
|
f170934215
|
YARN-3982. container-executor parsing of container-executor.cfg broken
in trunk and branch-2. Contributed by Varun Vasudev
|
2015-07-27 23:45:58 -07:00 |
Jian He
|
3572ebd738
|
YARN-3846. RM Web UI queue filter is not working for sub queue. Contributed by Mohammad Shahid Khan
|
2015-07-27 17:12:05 -07:00 |
Varun Vasudev
|
3e6fce91a4
|
YARN-3853. Add docker container runtime support to LinuxContainterExecutor. Contributed by Sidharta Seethana.
|
2015-07-27 11:57:40 -07:00 |
|
Varun Vasudev
|
f36835ff9b
|
YARN-3852. Add docker container support to container-executor. Contributed by Abin Shahab.
|
2015-07-27 10:14:51 -07:00 |
ccurino
|
156f24ead0
|
YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)
|
2015-07-25 07:39:47 -07:00 |
|
Wangda Tan
|
a3bd7b4a59
|
YARN-3973. Recent changes to application priority management break reservation system from YARN-1051 (Carlo Curino via wangda)
|
2015-07-24 16:44:18 -07:00 |
|
Jason Lowe
|
ff9c13e0a7
|
YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu
|
2015-07-24 22:14:39 +00:00 |
|
Jian He
|
83fe34ac08
|
YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan
|
2015-07-24 14:00:25 -07:00 |
|
Karthik Kambatla
|
d19d187753
|
YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha)
|
2015-07-24 11:44:37 -07:00 |
|
Xuan
|
fbd6063269
|
YARN-3967. Fetch the application report from the AHS if the RM does not
know about it. Contributed by Mit Desai
|
2015-07-24 10:15:54 -07:00 |
carlo curino
|
0fcb4a8cf2
|
YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)
|
2015-07-23 19:33:59 -07:00 |
Rohith Sharma K S
|
e202efaf93
|
YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan)
|
2015-07-24 12:43:06 +05:30 |
Robert Kanter
|
1d3026e7b3
|
YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)
|
2015-07-23 14:46:54 -07:00 |
|
Wangda Tan
|
3bba180051
|
YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda)
|
2015-07-23 10:07:57 -07:00 |
Junping Du
|
ee98d6354b
|
YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.
|
2015-07-22 17:52:35 -07:00 |
|
Wangda Tan
|
06e5dd2c84
|
YARN-3956. Fix TestNodeManagerHardwareUtils fails on Mac (Varun Vasudev via wangda)
|
2015-07-22 12:01:41 -07:00 |
|
Wangda Tan
|
76ec26de80
|
YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda)
|
2015-07-22 11:54:02 -07:00 |
|
Wangda Tan
|
c39ca541f4
|
YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda)
|
2015-07-21 09:57:23 -07:00 |
Colin Patrick Mccabe
|
419c51d233
|
YARN-3844. Make hadoop-yarn-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe)
|
2015-07-17 11:38:59 -07:00 |
Jonathan Eagles
|
7faae0e6fe
|
YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles)
|
2015-07-17 11:02:11 -05:00 |
Arun Suresh
|
9b272ccae7
|
YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)
|
2015-07-17 04:31:34 -07:00 |
|
Wangda Tan
|
3540d5fe4b
|
YARN-3885. ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level. (Ajith S via wangda)
|
2015-07-16 16:13:32 -07:00 |
|
Arun Suresh
|
ac94ba3e18
|
YARN-3453. Ensure preemption logic in FairScheduler uses DominantResourceCalculator in DRF queues to prevent unnecessary thrashing. (asuresh)
|
2015-07-14 00:23:55 -07:00 |
Akira Ajisaka
|
19295b36d9
|
YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.
|
2015-07-13 17:52:13 +09:00 |
|
Wangda Tan
|
5ed1fead6b
|
YARN-3894. RM startup should fail for wrong CS xml NodeLabel capacity configuration. (Bibin A Chundatt via wangda)
|
2015-07-12 21:52:11 -07:00 |
|
Wangda Tan
|
1df39c1efc
|
YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda)
|
2015-07-11 10:26:46 -07:00 |
Zhijie Shen
|
1ea36299a4
|
YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola.
|
2015-07-10 18:58:10 -07:00 |
Ming Ma
|
08244264c0
|
YARN-3445. Cache runningApps in RMNode for getting running apps on given NodeId. (Junping Du via mingma)
|
2015-07-10 08:30:10 -07:00 |
|
Xuan
|
5214876792
|
YARN-3888. ApplicationMaster link is broken in RM WebUI when appstate is
NEW. Contributed by Bibin A Chundatt
|
2015-07-09 21:37:33 -07:00 |
|
carlo curino
|
0e602fa3a1
|
YARN-3800. Reduce storage footprint for ReservationAllocation. Contributed by Anubhav Dhoot.
|
2015-07-09 16:51:59 -07:00 |
|
Karthik Kambatla
|
527c40e4d6
|
YARN-1012. Report NM aggregated container resource utilization in heartbeat. (Inigo Goiri via kasha)
|
2015-07-09 09:35:14 -07:00 |
|
Varun Vasudev
|
63d0365088
|
YARN-2194. Addendum patch to fix failing unit test in TestPrivilegedOperationExecutor. Contributed by Sidharta Seethana.
|
2015-07-09 11:51:59 +05:30 |
|
Jian He
|
c9dd2cada0
|
YARN-3892. Fixed NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails. Contributed by Bibin A Chundatt
|
2015-07-07 14:16:21 -07:00 |
|
Varun Vasudev
|
c40bdb56a7
|
YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan.
|
2015-07-07 16:59:29 +05:30 |
Devaraj K
|
af63427c6d
|
YARN-3837. javadocs of TimelineAuthenticationFilterInitializer give wrong
prefix for auth options. Contributed by Bibin A Chundatt.
|
2015-07-07 12:06:30 +05:30 |
|
Devaraj K
|
37d7395773
|
YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id
properly in log. Contributed by Bibin A Chundatt.
|
2015-07-02 10:20:31 +05:30 |
|
Wangda Tan
|
0e4b06690f
|
YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda)
|
2015-07-01 17:32:22 -07:00 |
|
Jason Lowe
|
b5cdf78e8e
|
YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena
|
2015-07-01 21:13:32 +00:00 |
|
Devaraj K
|
80a68d6056
|
YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a
null attempt. Contributed by nijel.
|
2015-07-01 19:03:44 +05:30 |
|
Colin Patrick Mccabe
|
d0cc0380b5
|
YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe)
|
2015-06-30 16:24:19 -07:00 |
|
Jian He
|
62e583c7dc
|
YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti
|
2015-06-29 13:37:32 -07:00 |
|
Devaraj K
|
b543d1a390
|
YARN-3859. LeafQueue doesn't print user properly for application add.
Contributed by Varun Saxena.
|
2015-06-28 10:04:50 +05:30 |
|
Xuan
|
fe6c1bd73a
|
YARN-2871. TestRMRestart#testRMRestartGetApplicationList sometime fails
in trunk. Contributed by zhihai xu
|
2015-06-26 19:43:59 -07:00 |
|
Jason Lowe
|
40b256949a
|
YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena
|
2015-06-26 15:47:07 +00:00 |
|
Devaraj K
|
57f1a01eda
|
YARN-3826. Race condition in ResourceTrackerService leads to wrong
diagnostics messages. Contributed by Chengbing Liu.
|
2015-06-25 16:13:59 +05:30 |
|
Jonathan Eagles
|
4c659ddbf7
|
YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles)
|
2015-06-24 16:16:52 -05:00 |
|
rohithsharmaks
|
dd4b387d96
|
YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks)
|
2015-06-24 23:00:14 +05:30 |
|
Jason Lowe
|
8d58512d6e
|
YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula
|
2015-06-24 16:37:39 +00:00 |
|
Jason Lowe
|
2a20dd9b61
|
YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong
|
2015-06-24 16:23:48 +00:00 |
|
Robert Kanter
|
99271b7621
|
YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter)
|
2015-06-22 18:02:27 -07:00 |
|
Karthik Kambatla
|
5ebf2817e5
|
YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)
|
2015-06-22 17:47:47 -07:00 |
|
Xuan
|
6c7a9d502a
|
YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth
|
2015-06-21 17:13:44 -07:00 |
|
Xuan
|
5b5bb8dcdc
|
YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes
after NM is reconnected. Contributed by zhihai xu
|
2015-06-18 14:37:49 -07:00 |
|
Xuan
|
a826d432f9
|
YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena
|
2015-06-17 16:23:27 -07:00 |
|
Devaraj K
|
ebb9a82519
|
YARN-3148. Allow CORS related headers to passthrough in
WebAppProxyServlet. Contributed by Varun Saxena.
|
2015-06-17 15:56:18 +05:30 |
|
Xuan
|
e27d5a13b0
|
YARN-3714. AM proxy filter can not get RM webapp address from
yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki
|
2015-06-16 14:06:16 -07:00 |
|
Devaraj K
|
b039e69bb0
|
YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed
by Bibin A Chundatt.
|
2015-06-16 14:03:22 +05:30 |
|
Devaraj K
|
d8dcfa98e3
|
YARN-3794. TestRMEmbeddedElector fails because of ambiguous LOG reference.
Contributed by Chengbing Liu.
|
2015-06-12 13:42:49 +05:30 |
|
Xuan
|
5583f88bf7
|
YARN-3785. Support for Resource as an argument during submitApp call in
MockRM test class. Contributed by Sunil G
|
2015-06-10 21:40:48 -07:00 |
|
Zhijie Shen
|
8d0ef31632
|
YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong.
|
2015-06-08 23:14:58 -07:00 |
|
Xuan
|
2b2465dfac
|
YARN-3778. Fix Yarn resourcemanger CLI usage. Contributed by Brahma Reddy Battula
|
2015-06-08 15:43:03 -07:00 |
|
Jian He
|
960b8f19ca
|
YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla
|
2015-06-08 14:50:58 -07:00 |
|
Devaraj K
|
126321eded
|
YARN-3747. TestLocalDirsHandlerService should delete the created test
directory logDir2. Contributed by David Moore.
|
2015-06-08 15:32:13 +05:30 |
|
Devaraj K
|
c7ee6c151c
|
YARN-3780. Should use equals when compare Resource in
RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.
|
2015-06-08 11:54:55 +05:30 |
|
Karthik Kambatla
|
bd69ea408f
|
YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha)
|
2015-06-07 11:37:52 -07:00 |
|
Xuan
|
3e000a919f
|
YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong
|
2015-06-05 12:48:52 -07:00 |
|
Karthik Kambatla
|
75885852cc
|
YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha)
|
2015-06-05 09:39:41 -07:00 |
|
Zhijie Shen
|
18dd01d6bf
|
YARN-3766. Fixed the apps table column error of generic history web UI. Contributed by Xuan Gong.
|
2015-06-04 14:47:08 -07:00 |
|
Jian He
|
1970ca7cbc
|
YARN-2392. Add more diags about app retry limits on AM failures. Contributed by Steve Loughran
|
2015-06-04 11:14:09 -07:00 |
|
Jian He
|
6ad4e59cfc
|
YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan
|
2015-06-04 10:52:59 -07:00 |
|
Wangda Tan
|
ebd797c48f
|
YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)
|
2015-06-04 10:22:57 -07:00 |
|
Junping Du
|
d7e7f6aa03
|
YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K.
|
2015-06-04 04:59:27 -07:00 |
|
Xuan
|
5766a04428
|
YARN-3749. We should make a copy of configuration when init
MiniYARNCluster with multiple RMs. Contributed by Chun Chen
|
2015-06-03 17:20:15 -07:00 |
|
Zhijie Shen
|
bc85959edd
|
Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong."
This reverts commit 4a9ec1a824.
|
2015-06-03 14:15:56 -07:00 |
|
Karthik Kambatla
|
edb9cd0f7a
|
YARN-3762. FairScheduler: CME on FSParentQueue#getQueueUserAclInfo. (kasha)
|
2015-06-03 13:47:24 -07:00 |
|
Jason Lowe
|
e13b671aa5
|
YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. Contributed by Rohith Sharmaks
|
2015-06-03 19:44:07 +00:00 |
|
Zhijie Shen
|
dbc4f64937
|
YARN-3751. Fixed AppInfo to check if used resources are null. Contributed by Sunil G.
|
2015-06-03 11:51:41 -07:00 |
|
Wangda Tan
|
5cc3fced95
|
YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)
|
2015-05-31 16:31:09 -07:00 |
|
Xuan
|
9686261ecb
|
YARN-2900. Application (Attempt and Container) Not Found in AHS results
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
|
2015-05-31 15:37:05 -07:00 |
|
Xuan
|
da05361c3b
|
Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results"
This reverts commit 06f8e9caba.
|
2015-05-31 00:26:04 -07:00 |
|
Xuan
|
06f8e9caba
|
YARN-2900. Application (Attempt and Container) Not Found in AHS results
in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai
|
2015-05-30 21:56:19 -07:00 |
|
Zhijie Shen
|
4a9ec1a824
|
YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
|
2015-05-30 21:05:36 -07:00 |
|
Karthik Kambatla
|
a8acdd65b3
|
YARN-3467. Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI. (Anubhav Dhoot via kasha)
|
2015-05-30 13:36:24 -07:00 |
|
Zhijie Shen
|
eb6bf91eea
|
YARN-3740. Fixed the typo in the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong.
|
2015-05-29 18:17:48 -07:00 |
|
Robert Kanter
|
6aec13cb33
|
YARN-3713. Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition (zxu via rkanter)
|
2015-05-29 15:34:37 -07:00 |
|
Karthik Kambatla
|
3ae2a62501
|
YARN-3547. FairScheduler: Apps that have no resource demand should not participate scheduling. (Xianyin Xin via kasha)
|
2015-05-29 15:17:22 -07:00 |
Andrew Wang
|
7673d4f205
|
HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang)
|
2015-05-29 14:54:18 -07:00 |
Vinod Kumar Vavilapalli
|
9acd24fec4
|
Fixed more FilesSystemRMStateStore issues. Contributed by Vinod Kumar Vavilapalli.
|
2015-05-28 15:25:56 -07:00 |
|
Zhijie Shen
|
54504133f4
|
YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
|
2015-05-27 16:52:22 -07:00 |
Allen Wittenauer
|
d6e3164d4a
|
YARN-2355. MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container (Darrell Taylor via aw)
|
2015-05-27 16:40:56 -07:00 |
cnauroth
|
4102e5882e
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.
|
2015-05-27 14:31:49 -07:00 |
|
Wangda Tan
|
ec0a852a37
|
YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)
|
2015-05-27 12:51:20 -07:00 |
|
Wangda Tan
|
cdbd66be11
|
YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
|
2015-05-26 15:58:47 -07:00 |
|
Jian He
|
10732d515f
|
YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch
|
2015-05-26 12:00:51 -07:00 |
|
Vinod Kumar Vavilapalli
|
500a1d9c76
|
YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
|
2015-05-26 11:38:35 -07:00 |
Tsuyoshi Ozawa
|
9a3d617b63
|
YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka.
|
2015-05-26 19:07:40 +09:00 |