Jason Lowe
|
b379972ab3
|
YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena
|
2015-02-11 16:33:43 +00:00 |
Junping Du
|
c541a374d8
|
YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu)
|
2015-02-11 03:44:31 -08:00 |
Zhijie Shen
|
d5855c0e46
|
YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K.
|
2015-02-10 15:24:01 -08:00 |
|
Jason Lowe
|
3f5431a22f
|
YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts
|
2015-02-10 17:27:21 +00:00 |
|
Jason Lowe
|
4eb5f7fa32
|
YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena
|
2015-02-10 16:54:21 +00:00 |
|
Zhijie Shen
|
23bf6c7207
|
YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.
|
2015-02-09 20:34:56 -08:00 |
Jian He
|
0af6a99a3f
|
YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong
|
2015-02-09 13:47:08 -08:00 |
Karthik Kambatla
|
7e42088abf
|
YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha)
|
2015-02-08 22:48:10 -08:00 |
|
Jason Lowe
|
da2fb2bc46
|
YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe
|
2015-02-06 21:47:32 +00:00 |
|
Jason Lowe
|
4c484320b4
|
YARN-3089. LinuxContainerExecutor does not handle file arguments to deleteAsUser. Contributed by Eric Payne
|
2015-02-06 20:39:01 +00:00 |
|
Jian He
|
c1957fef29
|
YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan
|
2015-02-06 11:34:20 -08:00 |
Arun C. Murthy
|
02f154a001
|
YARN-1537. Fix race condition in TestLocalResourcesTrackerImpl.testLocalResourceCache. Contributed by Xuan Gong.
|
2015-02-05 23:58:52 -08:00 |
|
Arun C. Murthy
|
18b2507eda
|
YARN-1904. Ensure exceptions thrown in ClientRMService & ApplicationHistoryClientService are uniform when application-attempt is not found. Contributed by Zhijie Shen.
|
2015-02-05 23:48:55 -08:00 |
|
Jian He
|
4641196fe0
|
YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo. Contributed by Tsuyoshi OZAWA
|
2015-02-05 16:12:53 -08:00 |
|
Jason Lowe
|
69c8a7f45b
|
YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per queue. Contributed by Thomas Graves
|
2015-02-05 19:28:49 +00:00 |
Sandy Ryza
|
b6466deac6
|
YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding max share (Anubhav Dhoot via Sandy Ryza)
|
2015-02-05 09:39:28 -08:00 |
Tsuyoshi Ozawa
|
26dee1486b
|
YARN-3058. Fix error message of tokens' activation delay configuration. Contributed by Yi Liu.
|
2015-02-04 11:41:14 +09:00 |
|
Zhijie Shen
|
e5b56e2af6
|
YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R.
|
2015-02-03 17:34:22 -08:00 |
Xuan
|
b73e776abc
|
YARN-3056. Add verification for containerLaunchDuration in
TestNodeManagerMetrics. Contributed by zhihai Xu
|
2015-02-03 15:12:54 -08:00 |
Wangda Tan
|
5bd984691b
|
YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda)
|
2015-02-03 12:52:42 -08:00 |
|
Jian He
|
21d80b3dd9
|
YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan
|
2015-02-03 11:43:12 -08:00 |
Robert Kanter
|
f7a77819a1
|
YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter)
|
2015-02-03 10:39:41 -08:00 |
|
Jason Lowe
|
a761bf8726
|
YARN-3085. Application summary should include the application type. Contributed by Rohith
|
2015-02-03 14:56:34 +00:00 |
|
Jian He
|
054a947989
|
YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen
|
2015-01-30 17:34:49 -08:00 |
|
Jian He
|
86358221fc
|
YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan
|
2015-01-30 15:15:20 -08:00 |
Jonathan Eagles
|
30a8778c63
|
YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li via jeagles)
|
2015-01-29 16:51:38 -06:00 |
Akira Ajisaka
|
342efa110a
|
HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
|
2015-01-30 02:49:10 +09:00 |
Allen Wittenauer
|
9dd0b7a2ab
|
YARN-2428. LCE default banned user list should have yarn (Varun Saxena via aw)
|
2015-01-29 09:30:26 -08:00 |
|
Wangda Tan
|
7882bc0f14
|
YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda)
|
2015-01-28 21:54:38 -08:00 |
|
Wangda Tan
|
18741adf97
|
YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda)
|
2015-01-27 15:36:09 -08:00 |
|
Jonathan Eagles
|
a8ad1e8089
|
YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via jeagles)
|
2015-01-27 16:06:39 -06:00 |
|
Jian He
|
4e15fc0841
|
YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena
|
2015-01-27 13:31:22 -08:00 |
|
Tsuyoshi Ozawa
|
f56da3ce04
|
YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger.
|
2015-01-28 00:15:34 +09:00 |
|
Jian He
|
6f9fe76918
|
YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan
|
2015-01-26 15:38:00 -08:00 |
|
Jason Lowe
|
902c6ea7e4
|
YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne
|
2015-01-26 15:40:21 +00:00 |
|
Xuan
|
0d6bd62102
|
YARN-3024. LocalizerRunner should give DIE action when all resources are
localized. Contributed by Chengbing Liu
|
2015-01-25 19:37:57 -08:00 |
|
Tsuyoshi Ozawa
|
24aa462673
|
YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.
|
2015-01-23 20:37:05 +09:00 |
|
Tsuyoshi Ozawa
|
3aab354e66
|
YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot.
|
2015-01-23 16:04:18 +09:00 |
|
Wangda Tan
|
0a2d3e717d
|
YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal
|
2015-01-19 16:48:50 -08:00 |
|
Zhijie Shen
|
43302f6f44
|
YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu.
|
2015-01-16 16:37:42 -08:00 |
|
Karthik Kambatla
|
84198564ba
|
YARN-2984. Metrics for container's actual memory usage. (kasha)
|
2015-01-17 05:44:04 +05:30 |
|
Junping Du
|
5d1cca34fa
|
YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He)
|
2015-01-16 00:08:36 -08:00 |
|
Jian He
|
9e33116d1d
|
YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen
|
2015-01-15 11:07:43 -08:00 |
|
Jian He
|
c53420f583
|
YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch
|
2015-01-13 17:32:07 -08:00 |
|
Robert Kanter
|
51881535e6
|
YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter)
|
2015-01-12 17:51:00 -08:00 |
|
Robert Kanter
|
ae7bf31fe1
|
YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter)
|
2015-01-12 10:47:52 -08:00 |
|
Jian He
|
a260406268
|
YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan
|
2015-01-09 17:49:53 -08:00 |
|
Jian He
|
cc2a745f7e
|
YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu
|
2015-01-08 11:12:54 -08:00 |
|
Zhijie Shen
|
dc2eaa26b2
|
YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu.
|
2015-01-08 09:47:02 -08:00 |
|
Jian He
|
e13a484a2b
|
YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu
|
2015-01-07 14:12:20 -08:00 |
|
Zhijie Shen
|
60103fca04
|
YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev.
|
2015-01-06 14:37:44 -08:00 |
|
Jian He
|
dd57c2047b
|
YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena
|
2015-01-06 14:15:57 -08:00 |
|
Karthik Kambatla
|
0c4b112677
|
YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler. (Anubhav Dhoot via kasha)
|
2015-01-06 04:42:10 +05:30 |
|
Zhijie Shen
|
562a701945
|
YARN-2958. Made RMStateStore not update the last sequence number when updating the delegation token. Contributed by Varun Saxena.
|
2015-01-05 13:33:07 -08:00 |
|
Tsuyoshi Ozawa
|
ddc5be48fc
|
YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed by Rohith Sharmaks.
|
2015-01-05 00:08:31 +09:00 |
|
Karthik Kambatla
|
e7257acd8a
|
YARN-2998. Abstract out scheduler independent PlanFollower components. (Anubhav Dhoot via kasha)
|
2014-12-30 19:55:24 -08:00 |
|
Jian He
|
e2351c7ae2
|
YARN-2987. Fixed ClientRMService#getQueueInfo to check against queue and app ACLs. Contributed by Varun Saxena
|
2014-12-30 17:15:37 -08:00 |
|
Jian He
|
b7442bf92e
|
YARN-2493. Added node-labels page on RM web UI. Contributed by Wangda Tan
|
2014-12-30 16:49:01 -08:00 |
|
Jian He
|
746ad6e989
|
Revert "YARN-2492(wrong jira number). Added node-labels page on RM web UI. Contributed by Wangda Tan"
This reverts commit 5f57b904f5.
|
2014-12-30 16:48:49 -08:00 |
|
Jian He
|
5f57b904f5
|
YARN-2492. Added node-labels page on RM web UI. Contributed by Wangda Tan
|
2014-12-30 15:38:28 -08:00 |
|
Zhijie Shen
|
241d3b3a50
|
YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice. Contributed by Varun Saxena.
|
2014-12-29 09:59:35 -08:00 |
|
Jian He
|
1454efe5d4
|
YARN-2992. ZKRMStateStore crashes due to session expiry. Contributed by Karthik Kambatla
|
2014-12-26 17:59:58 -08:00 |
|
Junping Du
|
40ee4bff65
|
YARN-2993. Several fixes (missing acl check, error log msg ...) and some refinement in AdminService. (Contributed by Yi Liu)
|
2014-12-26 06:59:25 -08:00 |
|
Jian He
|
4f18018b7a
|
YARN-2946. Fixed potential deadlock in RMStateStore. Contributed by Rohith Sharmaks
|
2014-12-23 22:14:29 -08:00 |
|
Zhijie Shen
|
41a548a916
|
YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena.
|
2014-12-23 20:32:36 -08:00 |
|
Junping Du
|
d468c9aaf1
|
YARN-2940. Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu)
|
2014-12-23 20:04:33 -08:00 |
|
Junping Du
|
856b46cf47
|
Revert ca3381de61 and 20674255ad as missing JIRA number in commit message
|
2014-12-23 20:02:33 -08:00 |
|
Junping Du
|
ca3381de61
|
Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu)
|
2014-12-23 18:57:16 -08:00 |
|
Jian He
|
149512a837
|
YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen
|
2014-12-23 18:25:37 -08:00 |
|
Jian He
|
0d89859b51
|
YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharmaks
|
2014-12-22 21:53:22 -08:00 |
|
Jian He
|
fdf042dfff
|
YARN-2920. Changed CapacityScheduler to kill containers on nodes where node labels are changed. Contributed by Wangda Tan
|
2014-12-22 16:51:15 -08:00 |
|
Junping Du
|
a696fbb001
|
YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)
|
2014-12-22 03:06:37 -08:00 |
|
Karthik Kambatla
|
24ee9e3431
|
YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha)
|
2014-12-20 12:17:50 -08:00 |
|
Jian He
|
808cba3821
|
YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks
|
2014-12-19 16:56:30 -08:00 |
|
Karthik Kambatla
|
954fb8581e
|
YARN-2675. containersKilled metrics is not updated when the container is killed during localization. (Zhihai Xu via kasha)
|
2014-12-19 16:02:20 -08:00 |
|
Karthik Kambatla
|
a22ffc3188
|
YARN-2738. [YARN-2574] Add FairReservationSystem for FairScheduler. (Anubhav Dhoot via kasha)
|
2014-12-19 15:37:12 -08:00 |
|
Jason Lowe
|
0402bada19
|
YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by Jian He
|
2014-12-18 23:28:18 +00:00 |
|
Junping Du
|
2b4b0e8847
|
YARN-2972. DelegationTokenRenewer thread pool never expands. Contributed by Jason Lowe
|
2014-12-17 17:40:00 -08:00 |
|
Karthik Kambatla
|
b7f64823e1
|
YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)
|
2014-12-17 16:32:21 -08:00 |
|
Karthik Kambatla
|
a1bd140964
|
YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance. (Chris Trezzo via kasha)
|
2014-12-17 16:23:52 -08:00 |
|
Karthik Kambatla
|
f2d150ea12
|
YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read locks. (Tsuyoshi Ozawa via kasha)
|
2014-12-17 12:03:16 -08:00 |
cnauroth
|
e996a1bfd4
|
HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth.
|
2014-12-16 15:29:22 -08:00 |
|
Karthik Kambatla
|
e597249d36
|
YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha)
|
2014-12-15 12:00:12 -08:00 |
|
Jian He
|
a4f2995b9e
|
Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai."
This reverts commit 51af8d367d.
Conflicts:
hadoop-yarn-project/CHANGES.txt
|
2014-12-15 11:04:09 -08:00 |
Steve Loughran
|
3681de2039
|
YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel)
|
2014-12-12 17:11:07 +00:00 |
Devaraj K
|
bda748ac3a
|
YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in
SchedulerApplicationAttempt ctor. Contributed by Devaraj K.
|
2014-12-12 12:34:43 +05:30 |
|
Jian He
|
2ed90a57fd
|
YARN-2930. Fixed TestRMRestart#testRMRestartRecoveringNodeLabelManager intermittent failure. Contributed by Wangda Tan
|
2014-12-09 16:48:04 -08:00 |
|
Karthik Kambatla
|
a2e07a5456
|
YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg via kasha)
|
2014-12-09 14:00:31 -08:00 |
|
Karthik Kambatla
|
db73cc9124
|
YARN-2931. PublicLocalizer may fail until directory is initialized by LocalizeRunner. (Anubhav Dhoot via kasha)
|
2014-12-08 22:26:18 -08:00 |
|
Jian He
|
e69af836f3
|
YARN-2869. CapacityScheduler should trim sub queue names when parse configuration. Contributed by Wangda Tan
|
2014-12-05 17:33:39 -08:00 |
|
Jason Lowe
|
4b13082199
|
YARN-2056. Disable preemption at Queue level. Contributed by Eric Payne
|
2014-12-05 21:06:48 +00:00 |
|
Karthik Kambatla
|
78968155d7
|
YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)
|
2014-12-04 17:36:32 -08:00 |
|
Jian He
|
258623ff8b
|
YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R
|
2014-12-04 12:53:18 -08:00 |
|
Jian He
|
73fbb3c66b
|
YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks
|
2014-12-03 17:14:52 -08:00 |
Harsh J
|
a31e016491
|
YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)
|
2014-12-04 03:17:15 +05:30 |
|
Karthik Kambatla
|
799353e2c7
|
YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha)
|
2014-12-03 13:44:41 -08:00 |
|
Jason Lowe
|
03ab24aa01
|
MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
|
2014-12-03 17:02:14 +00:00 |
|
Junping Du
|
e65b7c5ff6
|
YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)
|
2014-12-03 04:11:18 -08:00 |
|
Jian He
|
392c3aaea8
|
YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks
|
2014-12-02 17:16:35 -08:00 |
|
Jian He
|
52bcefca8b
|
YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena
|
2014-12-02 10:54:48 -08:00 |
|
Zhijie Shen
|
51af8d367d
|
YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.
|
2014-12-01 19:04:04 -08:00 |
|
Jian He
|
a7fba0bc28
|
YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe
|
2014-12-01 16:38:25 -08:00 |
|
Junping Du
|
c732ed760e
|
YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith)
|
2014-12-01 05:38:22 -08:00 |
|
Zhijie Shen
|
8f1454cc6d
|
YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ.
|
2014-11-26 12:09:34 -08:00 |
|
Karthik Kambatla
|
fe1f2db5ee
|
YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
|
2014-11-25 16:21:46 -08:00 |
|
Jian He
|
8a7ca13b13
|
YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe
|
2014-11-25 16:16:56 -08:00 |
|
Jian He
|
5805a81efb
|
YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA
|
2014-11-25 12:48:22 -08:00 |
|
Zhijie Shen
|
e37a4ff0c1
|
YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang.
|
2014-11-24 14:58:59 -08:00 |
|
Jason Lowe
|
1ce4d33c2d
|
YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena
|
2014-11-24 22:36:59 +00:00 |
|
Sandy Ryza
|
a128cca305
|
YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza)
|
2014-11-21 16:06:41 -08:00 |
|
Karthik Kambatla
|
233b61e495
|
YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha)
|
2014-11-21 14:22:21 -08:00 |
|
Karthik Kambatla
|
3114d4731d
|
YARN-2604. Scheduler should consider max-allocation-* in conjunction with the largest node. (Robert Kanter via kasha)
|
2014-11-21 10:32:28 -08:00 |
|
Karthik Kambatla
|
a9a0cc3679
|
YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha)
|
2014-11-19 20:15:40 -08:00 |
|
Karthik Kambatla
|
c90fb84aaa
|
YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha)
|
2014-11-19 19:50:12 -08:00 |
|
Jian He
|
9cb8b75ba5
|
YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks
|
2014-11-19 19:48:52 -08:00 |
|
Karthik Kambatla
|
2fce6d6141
|
YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha)
|
2014-11-17 16:45:57 -08:00 |
|
Jason Lowe
|
81c9d17af8
|
YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan
|
2014-11-17 21:15:48 +00:00 |
Vinod Kumar Vavilapalli
|
198fb58776
|
YARN-1703. Fixed ResourceManager web-proxy to close connections correctly. Contributed by Rohith Sharma.
|
2014-11-15 12:05:25 -08:00 |
|
Jian He
|
9b860661a5
|
YARN-2432. RMStateStore should process the pending events before close. Contributed by Varun Saxena
|
2014-11-14 17:24:09 -08:00 |
|
Sandy Ryza
|
1a47f890ba
|
YARN-2811. In Fair Scheduler, reservation fulfillments shouldn't ignore max share (Siqi Li via Sandy Ryza)
|
2014-11-14 15:18:56 -08:00 |
|
Jason Lowe
|
49c38898b0
|
YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu
|
2014-11-14 21:25:59 +00:00 |
|
Jian He
|
d005404ef7
|
YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks
|
2014-11-13 15:34:26 -08:00 |
|
Zhijie Shen
|
3648cb57c9
|
YARN-2766. Made ApplicationHistoryManager return a sorted list of apps, attempts and containers. Contributed by Robert Kanter.
|
2014-11-13 13:47:42 -08:00 |
|
Vinod Kumar Vavilapalli
|
3651fe1b08
|
YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He.
|
2014-11-13 08:13:03 -08:00 |
|
Jason Lowe
|
33ea5ae92b
|
YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du
|
2014-11-13 16:11:04 +00:00 |
|
Zhijie Shen
|
be7bf956e9
|
YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He.
|
2014-11-12 11:07:57 -08:00 |
|
Karthik Kambatla
|
a04143039e
|
YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha)
|
2014-11-12 09:31:05 -08:00 |
|
Jason Lowe
|
f8aefa5e9c
|
YARN-2780. Log aggregated resource allocation in rm-appsummary.log. Contributed by Eric Payne
|
2014-11-12 17:01:15 +00:00 |
Ravi Prakash
|
53f64ee516
|
YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN
|
2014-11-11 21:28:11 -08:00 |
|
Karthik Kambatla
|
061bc293c8
|
YARN-2735. diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection. (Zhihai Xu via kasha)
|
2014-11-11 10:31:39 -08:00 |
|
Xuan
|
5c9a51f140
|
YARN-2841. RMProxy should retry EOFException. Contributed by Jian He
|
2014-11-10 18:25:01 -08:00 |
|
Vinod Kumar Vavilapalli
|
e76faebc95
|
YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery consistent with the (somewhat incorrect) behaviour in the non-recovery case. Contributed by Jian He.
|
2014-11-09 18:56:58 -08:00 |
|
Arun C. Murthy
|
43cd07b408
|
YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.
|
2014-11-09 14:57:37 -08:00 |
|
Zhijie Shen
|
9a4e0d343e
|
YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch.
|
2014-11-07 20:35:46 -08:00 |
|
Vinod Kumar Vavilapalli
|
df36edf751
|
YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826. Contributed by Wangda Tan.
|
2014-11-07 19:43:55 -08:00 |
|
Xuan
|
4a114dd67a
|
YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6. Contributed by Zhijie Shen
|
2014-11-07 16:11:30 -08:00 |
|
Jason Lowe
|
c3d475070a
|
YARN-2825. Container leak on NM. Contributed by Jian He
|
2014-11-07 23:16:37 +00:00 |
|
Vinod Kumar Vavilapalli
|
4cfd5bc7c1
|
YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu.
|
2014-11-07 14:15:53 -08:00 |
|
cnauroth
|
06b797947c
|
YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch.
|
2014-11-07 12:29:39 -08:00 |
|
Vinod Kumar Vavilapalli
|
2ac1be7dec
|
YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are not mapped to queues by making default capacities per label to be zero. Contributed by Wangda Tan.
|
2014-11-07 10:39:37 -08:00 |
|
Xuan
|
1e97f2f094
|
YARN-2810. TestRMProxyUsersConf fails on Windows VMs. Contributed by Varun Vasudev
|
2014-11-07 09:44:43 -08:00 |
|
Vinod Kumar Vavilapalli
|
a5657182a7
|
YARN-2823. Fixed ResourceManager app-attempt state machine to inform schedulers about previous finished attempts of a running appliation to avoid expectation mismatch w.r.t transferred containers. Contributed by Jian He.
|
2014-11-07 09:28:36 -08:00 |
|
Vinod Kumar Vavilapalli
|
a3839a9fbf
|
YARN-2744. Fixed CapacityScheduler to validate node-labels correctly against queues. Contributed by Wangda Tan.
|
2014-11-06 17:28:12 -08:00 |
|
Vinod Kumar Vavilapalli
|
f5b19bed7d
|
YARN-2818. Removed the now unnecessary user entity injection from Timeline service given we now have domains. Contributed by Zhijie Shen.
|
2014-11-06 11:48:40 -08:00 |
|
Xuan
|
b0b52c4e11
|
YARN-2812. TestApplicationHistoryServer is likely to fail on less powerful machine. Contributed by Zhijie Shen
|
2014-11-05 20:42:38 -08:00 |
|
Xuan
|
e4b4901d36
|
YARN-2813. Fixed NPE from MemoryTimelineStore.getDomains. Contributed by Zhijie Shen
|
2014-11-05 18:24:41 -08:00 |
|
Jian He
|
395275af86
|
YARN-2579. Fixed a deadlock issue when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time. Contributed by Rohith Sharmaks
|
2014-11-05 16:59:54 -08:00 |
|
Vinod Kumar Vavilapalli
|
834e931d8e
|
YARN-2805. Fixed ResourceManager to load HA configs correctly before kerberos login. Contributed by Wangda Tan.
|
2014-11-05 15:30:33 -08:00 |
|
Zhijie Shen
|
b4c951ab83
|
YARN-2767. Added a test case to verify that http static user cannot kill or submit apps in the secure mode. Contributed by Varun Vasudev.
|
2014-11-05 10:57:38 -08:00 |
|
Vinod Kumar Vavilapalli
|
b76179895d
|
YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings exceptions. Contributed by Zhijie Shen.
|
2014-11-04 18:00:06 -08:00 |
Haohui Mai
|
d794f785de
|
HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN. Contributed by Robert Kanter.
|
2014-11-04 17:52:03 -08:00 |
|
Karthik Kambatla
|
b2cd269802
|
YARN-2010. Handle app-recovery failures gracefully. (Jian He and Karthik Kambatla via kasha)
|
2014-11-04 17:45:24 -08:00 |
|
Vinod Kumar Vavilapalli
|
c5a46d4c8c
|
YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence of races between the launch and the stop-container call and when root processes crash. Contributed by Billie Rinaldi.
|
2014-11-03 16:38:55 -08:00 |
|
Vinod Kumar Vavilapalli
|
ec6cbece8e
|
YARN-2795. Fixed ResourceManager to not crash loading node-label data from HDFS in secure mode. Contributed by Wangda Tan.
|
2014-11-03 13:44:06 -08:00 |
|
Vinod Kumar Vavilapalli
|
58e9f24e0f
|
YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong.
|
2014-11-03 13:16:29 -08:00 |
|
Jason Lowe
|
6157ace547
|
YARN-2730. DefaultContainerExecutor runs only one localizer at a time. Contributed by Siqi Li
|
2014-11-03 20:37:47 +00:00 |
|
Zhijie Shen
|
27715ec63b
|
YARN-2785. Fixed intermittent TestContainerResourceUsage failure. Contributed by Varun Vasudev.
|
2014-11-02 15:20:40 -08:00 |
|
Vinod Kumar Vavilapalli
|
5c0381c96a
|
YARN-2790. Fixed a NodeManager bug that was causing log-aggregation to fail beyond HFDS delegation-token expiry even when RM is a proxy-user (YARN-2704). Contributed by Jian He.
|
2014-11-01 16:32:35 -07:00 |
|
Zhijie Shen
|
1cd088fd9d
|
YARN-2711. Fixed TestDefaultContainerExecutor#testContainerLaunchError failure on Windows. Contributed by Varun Vasudev.
|
2014-10-31 17:43:30 -07:00 |
|
Vinod Kumar Vavilapalli
|
6ce32f593b
|
YARN-2789. Re-instated the NodeReport.newInstance private unstable API modified in YARN-2698 so that tests in YARN frameworks don't break. Contributed by Wangda Tan.
|
2014-10-31 15:32:21 -07:00 |
|
Xuan
|
86ff28dea0
|
YARN-2701. Addendum patch. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong
|
2014-10-31 14:36:25 -07:00 |
|
Jian He
|
1b4be91866
|
YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen
|
2014-10-31 13:16:45 -07:00 |
|
Karthik Kambatla
|
256697acd5
|
YARN-2186. [YARN-1492] Node Manager uploader service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
|
2014-10-31 13:00:42 -07:00 |
|
Vinod Kumar Vavilapalli
|
d1828d9443
|
YARN-2779. Fixed ResourceManager to not require delegation tokens for communicating with Timeline Service. Contributed by Zhijie Shen.
|
2014-10-30 23:16:19 -07:00 |
|
Vinod Kumar Vavilapalli
|
e0233c16eb
|
YARN-2698. Moved some node label APIs to be correctly placed in client protocol. Contributed by Wangda Tan.
|
2014-10-30 22:59:31 -07:00 |
|
Jason Lowe
|
73e626ad91
|
YARN-2755. NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661. Contributed by Siqi Li
|
2014-10-30 15:10:27 +00:00 |
|
Karthik Kambatla
|
179cab81e0
|
YARN-2712. TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks. (Tsuyoshi Ozawa via kasha)
|
2014-10-30 00:29:07 -07:00 |
|
Karthik Kambatla
|
782971ae7a
|
YARN-2742. FairSchedulerConfiguration should allow extra spaces between value and unit. (Wei Yan via kasha)
|
2014-10-29 10:24:57 -07:00 |
|
Jian He
|
d5e0a09721
|
YARN-2503. Added node lablels in web UI. Contributed by Wangda Tan
|
2014-10-28 17:57:54 -07:00 |
|
Zhijie Shen
|
8984e9b177
|
YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch.
|
2014-10-28 14:11:19 -07:00 |
|
Xuan
|
69f79bee8b
|
YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen
|
2014-10-28 13:28:42 -07:00 |
|
Xuan
|
0d3e7e2bd6
|
RN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen
|
2014-10-28 11:16:49 -07:00 |
|
Vinod Kumar Vavilapalli
|
a16d022ca4
|
YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.
|
2014-10-27 15:49:47 -07:00 |
|
Jian He
|
c05b581a55
|
YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen
|
2014-10-27 10:45:53 -07:00 |
|
Xuan
|
ce1a4419a6
|
YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan
|
2014-10-27 10:26:21 -07:00 |
|
Vinod Kumar Vavilapalli
|
0186645505
|
YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He.
|
2014-10-26 11:14:34 -07:00 |
|
Karthik Kambatla
|
c51e53d7aa
|
YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
|
2014-10-25 10:31:06 -07:00 |
|
Jian He
|
5864dd99a4
|
YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe
|
2014-10-24 22:47:56 -07:00 |
|
Zhijie Shen
|
f81dc3f995
|
YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong.
|
2014-10-24 14:10:46 -07:00 |
|
Zhijie Shen
|
0f3b6900be
|
YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.
|
2014-10-23 21:56:03 -07:00 |
|
Jian He
|
3b12fd6cfb
|
YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu
|
2014-10-22 15:57:46 -07:00 |
|
Zhijie Shen
|
7e3b5e6f5c
|
YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it retries creating znode. Contributed by Jian He.
|
2014-10-21 21:49:17 -07:00 |
|
Vinod Kumar Vavilapalli
|
c0e034336c
|
YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen.
|
2014-10-21 20:09:40 -07:00 |
|
cnauroth
|
6637e3cf95
|
YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch.
|
2014-10-21 12:33:21 -07:00 |
|
Jason Lowe
|
6f2028bd15
|
YARN-90. NodeManager should identify failed disks becoming good again. Contributed by Varun Vasudev
|
2014-10-21 17:31:13 +00:00 |
|
Jian He
|
4fa1fb3193
|
Missing file for YARN-2701
|
2014-10-20 19:57:45 -07:00 |
|
Jian He
|
2839365f23
|
YARN-2701. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong
|
2014-10-20 18:45:47 -07:00 |
|
Vinod Kumar Vavilapalli
|
8256766498
|
YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan.
|
2014-10-18 12:07:40 -07:00 |
|
Vinod Kumar Vavilapalli
|
39063cd36f
|
YARN-2676. Enhanced Timeline auth-filter to support proxy users. Contributed by Zhijie Shen.
|
2014-10-17 22:02:50 -07:00 |
|
Vinod Kumar Vavilapalli
|
e9c66e8fd2
|
YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan.
|
2014-10-17 18:26:12 -07:00 |
|
Jian He
|
c3de2412eb
|
YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA
|
2014-10-17 16:35:27 -07:00 |
|
Jian He
|
a6aa6e42ca
|
YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks
|
2014-10-17 10:54:24 -07:00 |
|
Vinod Kumar Vavilapalli
|
abae63caf9
|
YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.
|
2014-10-17 08:58:08 -07:00 |
|
Jian He
|
0fd0ebae64
|
YARN-2682. Updated WindowsSecureContainerExecutor to not use DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir() instead. Contributed by Zhihai Xu
|
2014-10-16 18:14:34 -07:00 |
|
Jian He
|
233d446be1
|
YARN-2621. Simplify the output when the user doesn't have the access for getDomain(s). Contributed by Zhijie Shen
|
2014-10-16 16:37:21 -07:00 |
|
Vinod Kumar Vavilapalli
|
b3056c266a
|
YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.
|
2014-10-15 18:47:26 -07:00 |
|
Vinod Kumar Vavilapalli
|
f2ea555ac6
|
YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan.
YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.
|
2014-10-15 18:33:06 -07:00 |
|
Jian He
|
0af1a2b5bc
|
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
|
2014-10-15 15:22:07 -07:00 |
|
Zhijie Shen
|
1220bb72d4
|
YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen.
|
2014-10-14 21:50:46 -07:00 |
|
Zhijie Shen
|
cdce88376a
|
HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.
|
2014-10-14 11:35:38 -07:00 |