Jason Lowe
|
711d77cc54
|
YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du
|
2015-05-13 21:06:47 +00:00 |
Xuan
|
0f95921447
|
YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch
|
2015-05-13 13:10:53 -07:00 |
Devaraj K
|
5c2f05cd9b
|
YARN-3629. NodeID is always printed as "null" in node manager
initialization log. Contributed by nijel.
|
2015-05-12 22:20:25 +05:30 |
|
Devaraj K
|
8badd82ce2
|
YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug
log for overall resource usage by all containers. Contributed by
Naganarasimha G R.
|
2015-05-12 16:54:38 +05:30 |
Karthik Kambatla
|
70fb37cd79
|
YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
|
2015-05-09 14:34:54 -07:00 |
|
Xuan
|
6471d18bc7
|
YARN-1912. ResourceLocalizer started without any jvm memory control.
Contributed by Masatake Iwasaki
|
2015-05-08 20:01:21 -07:00 |
|
Xuan
|
333f9a896d
|
YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu
|
2015-05-08 17:52:54 -07:00 |
|
Jason Lowe
|
25e2b02122
|
YARN-3476. Nodemanager can fail to delete local logs if log aggregation fails. Contributed by Rohith
|
2015-05-08 22:45:52 +00:00 |
|
Xuan
|
088156de43
|
YARN-2331. Distinguish shutdown during supervision vs. shutdown for
rolling upgrade. Contributed by Jason Lowe
|
2015-05-08 15:10:43 -07:00 |
Robert (Bobby) Evans
|
bcf2890502
|
YARN-644: Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer
|
2015-05-08 11:11:01 -05:00 |
|
Devaraj K
|
241a72af0d
|
YARN-2784. Make POM project names consistent. Contributed by Rohith.
|
2015-05-08 19:23:53 +05:30 |
Akira Ajisaka
|
b167fe7605
|
YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo.
|
2015-05-08 11:14:45 +09:00 |
|
Akira Ajisaka
|
918af8efff
|
YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
|
2015-05-07 13:33:03 +09:00 |
Robert Kanter
|
b72507810a
|
YARN-3491. PublicLocalizer#addResource is too slow. (zxu via rkanter)
|
2015-05-06 14:19:06 -07:00 |
Junping Du
|
3810242062
|
YARN-3396. Handle URISyntaxException in ResourceLocalizationService. (Contributed by Brahma Reddy Battula)
|
2015-05-05 10:18:23 -07:00 |
Wangda Tan
|
71f4de220c
|
YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda)
|
2015-05-04 15:49:19 -07:00 |
|
Jason Lowe
|
8f65c793f2
|
YARN-3097. Logging of resource recovery on NM restart has redundancies. Contributed by Eric Payne
|
2015-05-04 15:31:15 +00:00 |
|
Robert Kanter
|
ac7d152901
|
YARN-3363. add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. (zxu via rkanter)
|
2015-05-01 16:39:21 -07:00 |
Vinod Kumar Vavilapalli
|
1b3b9e5c31
|
YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan.
|
2015-04-30 21:41:07 -07:00 |
|
Karthik Kambatla
|
47279c3228
|
YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha)
|
2015-04-26 09:13:46 -07:00 |
|
Jason Lowe
|
5e093f0d40
|
YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula
|
2015-04-24 22:02:53 +00:00 |
|
Xuan
|
0b3f8957a8
|
YARN-3516. killing ContainerLocalizer action doesn't take effect when
private localizer receives FETCH_FAILURE status. Contributed by zhihai
xu
|
2015-04-23 16:40:40 -07:00 |
|
Vinod Kumar Vavilapalli
|
a100be685c
|
YARN-3366. Enhanced NodeManager to support classifying/shaping outgoing network bandwidth traffic originating from YARN containers Contributed by Sidharta Seethana.
|
2015-04-22 17:26:13 -07:00 |
Jian He
|
674c7ef649
|
YARN-3503. Expose disk utilization percentage and bad local and log dir counts in NM metrics. Contributed by Varun Vasudev
|
2015-04-21 20:57:02 -07:00 |
|
Junping Du
|
1db355a875
|
YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.
|
2015-04-17 13:18:59 -07:00 |
|
Jian He
|
1b89a3e173
|
YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan
|
2015-04-15 13:57:06 -07:00 |
|
Junping Du
|
838b06ac87
|
YARN-3443. Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM. Contributed by Sidharta Seethana.
|
2015-04-13 18:35:56 -07:00 |
|
Junping Du
|
92431c9617
|
YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong.
|
2015-04-10 08:56:18 -07:00 |
|
Karthik Kambatla
|
6495940eae
|
YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha)
|
2015-04-09 00:07:49 -07:00 |
Tsuyoshi Ozawa
|
dd852f5b8c
|
YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt.
|
2015-04-08 15:56:18 +09:00 |
|
Wangda Tan
|
bad070fe15
|
YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
|
2015-04-02 17:23:20 -07:00 |
|
Vinod Kumar Vavilapalli
|
b21c72777a
|
YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana.
|
2015-04-02 16:53:59 -07:00 |
|
Tsuyoshi Ozawa
|
c69ba81497
|
YARN-3424. Change logs for ContainerMonitorImpl's resourse monitoring from info to debug. Contributed by Anubhav Dhoot.
|
2015-04-01 17:44:25 +09:00 |
|
Karthik Kambatla
|
2daa478a64
|
YARN-3428. Debug log resources to be localized for a container. (kasha)
|
2015-03-31 17:34:47 -07:00 |
|
Wangda Tan
|
2a945d24f7
|
YARN-2495. Allow admin specify labels from each NM (Distributed configuration for node label). (Naganarasimha G R via wangda)
|
2015-03-30 12:05:21 -07:00 |
|
Vinod Kumar Vavilapalli
|
c358368f51
|
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
|
2015-03-30 10:09:40 -07:00 |
Ravi Prakash
|
e0ccea33c9
|
YARN-3288. Document and fix indentation in the DockerContainerExecutor code
|
2015-03-28 08:00:41 -07:00 |
|
Tsuyoshi Ozawa
|
82eda771e0
|
YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R.
|
2015-03-24 00:25:30 +09:00 |
|
Junping Du
|
d81109e588
|
YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong
|
2015-03-20 13:41:22 -07:00 |
|
Karthik Kambatla
|
20b49224eb
|
YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
|
2015-03-18 16:30:33 -07:00 |
|
Ravi Prakash
|
56085203c4
|
YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak)
|
2015-03-16 16:17:58 -07:00 |
|
Tsuyoshi Ozawa
|
3da9a97cfb
|
YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
|
2015-03-16 23:19:05 +09:00 |
|
Vinod Kumar Vavilapalli
|
863079bb87
|
YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
|
2015-03-12 13:32:29 -07:00 |
|
Jian He
|
21101c01f2
|
YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
|
2015-03-06 14:18:11 -08:00 |
|
Karthik Kambatla
|
53947f37c7
|
YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha)
|
2015-03-04 17:33:30 -08:00 |
Konstantin V Shvachko
|
8ca0d957c4
|
YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko.
|
2015-02-26 17:12:19 -08:00 |
Allen Wittenauer
|
d4ac6822e1
|
YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw)
|
2015-02-24 11:25:26 -08:00 |
|
Xuan
|
f56c65bb3e
|
YARN-3237. AppLogAggregatorImpl fails to log error cause. Contributed by
Rushabh S Shah
|
2015-02-20 14:02:40 -08:00 |
|
Junping Du
|
c33ae271c2
|
YARN-2799. Cleanup TestLogAggregationService based on the change in YARN-90. Contributed by Zhihai Xu
|
2015-02-20 09:43:39 -08:00 |
|
Tsuyoshi Ozawa
|
447bd7b5a6
|
YARN-3203. Correct a log message in AuxServices. Contributed by Brahma Reddy Battula.
|
2015-02-16 23:55:58 +09:00 |
|
Junping Du
|
ab0b958a52
|
YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk. (Contributed by Xuan Gong)
|
2015-02-15 06:46:32 -08:00 |
cnauroth
|
6804d68901
|
YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only. Contributed by Ming Ma.
|
2015-02-13 21:58:54 -08:00 |
|
Jason Lowe
|
1a0f508b63
|
YARN-2847. Linux native container executor segfaults if default banned user detected. Contributed by Olaf Flebbe
|
2015-02-13 20:20:55 +00:00 |
|
Akira Ajisaka
|
6a49e58cb8
|
YARN-3191. Log object should be initialized with its own class. Contributed by Rohith.
|
2015-02-12 17:58:54 -08:00 |
|
Junping Du
|
04f5ef18f7
|
YARN-2079. Recover NonAggregatingLogHandler state upon nodemanager restart. (Contributed by Jason Lowe)
|
2015-02-12 11:46:47 -08:00 |
|
Jason Lowe
|
b379972ab3
|
YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena
|
2015-02-11 16:33:43 +00:00 |
|
Jason Lowe
|
3f5431a22f
|
YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts
|
2015-02-10 17:27:21 +00:00 |
|
Jason Lowe
|
4eb5f7fa32
|
YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena
|
2015-02-10 16:54:21 +00:00 |
|
Jason Lowe
|
4c484320b4
|
YARN-3089. LinuxContainerExecutor does not handle file arguments to deleteAsUser. Contributed by Eric Payne
|
2015-02-06 20:39:01 +00:00 |
Arun C. Murthy
|
02f154a001
|
YARN-1537. Fix race condition in TestLocalResourcesTrackerImpl.testLocalResourceCache. Contributed by Xuan Gong.
|
2015-02-05 23:58:52 -08:00 |
|
Xuan
|
b73e776abc
|
YARN-3056. Add verification for containerLaunchDuration in
TestNodeManagerMetrics. Contributed by zhihai Xu
|
2015-02-03 15:12:54 -08:00 |
|
Robert Kanter
|
f7a77819a1
|
YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter)
|
2015-02-03 10:39:41 -08:00 |
|
Akira Ajisaka
|
342efa110a
|
HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
|
2015-01-30 02:49:10 +09:00 |
|
Allen Wittenauer
|
9dd0b7a2ab
|
YARN-2428. LCE default banned user list should have yarn (Varun Saxena via aw)
|
2015-01-29 09:30:26 -08:00 |
|
Jian He
|
4e15fc0841
|
YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena
|
2015-01-27 13:31:22 -08:00 |
|
Jason Lowe
|
902c6ea7e4
|
YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne
|
2015-01-26 15:40:21 +00:00 |
|
Xuan
|
0d6bd62102
|
YARN-3024. LocalizerRunner should give DIE action when all resources are
localized. Contributed by Chengbing Liu
|
2015-01-25 19:37:57 -08:00 |
|
Tsuyoshi Ozawa
|
3aab354e66
|
YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot.
|
2015-01-23 16:04:18 +09:00 |
|
Karthik Kambatla
|
84198564ba
|
YARN-2984. Metrics for container's actual memory usage. (kasha)
|
2015-01-17 05:44:04 +05:30 |
|
Junping Du
|
5d1cca34fa
|
YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He)
|
2015-01-16 00:08:36 -08:00 |
|
Jian He
|
cc2a745f7e
|
YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu
|
2015-01-08 11:12:54 -08:00 |
Zhijie Shen
|
41a548a916
|
YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena.
|
2014-12-23 20:32:36 -08:00 |
|
Jian He
|
808cba3821
|
YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks
|
2014-12-19 16:56:30 -08:00 |
|
Karthik Kambatla
|
954fb8581e
|
YARN-2675. containersKilled metrics is not updated when the container is killed during localization. (Zhihai Xu via kasha)
|
2014-12-19 16:02:20 -08:00 |
|
cnauroth
|
e996a1bfd4
|
HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth.
|
2014-12-16 15:29:22 -08:00 |
Steve Loughran
|
3681de2039
|
YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel)
|
2014-12-12 17:11:07 +00:00 |
|
Karthik Kambatla
|
db73cc9124
|
YARN-2931. PublicLocalizer may fail until directory is initialized by LocalizeRunner. (Anubhav Dhoot via kasha)
|
2014-12-08 22:26:18 -08:00 |
Harsh J
|
a31e016491
|
YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)
|
2014-12-04 03:17:15 +05:30 |
|
Jason Lowe
|
03ab24aa01
|
MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
|
2014-12-03 17:02:14 +00:00 |
|
Junping Du
|
e65b7c5ff6
|
YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)
|
2014-12-03 04:11:18 -08:00 |
|
Karthik Kambatla
|
233b61e495
|
YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha)
|
2014-11-21 14:22:21 -08:00 |
|
Jason Lowe
|
49c38898b0
|
YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu
|
2014-11-14 21:25:59 +00:00 |
|
Jason Lowe
|
33ea5ae92b
|
YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du
|
2014-11-13 16:11:04 +00:00 |
|
Zhijie Shen
|
be7bf956e9
|
YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He.
|
2014-11-12 11:07:57 -08:00 |
|
Karthik Kambatla
|
a04143039e
|
YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha)
|
2014-11-12 09:31:05 -08:00 |
Ravi Prakash
|
53f64ee516
|
YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN
|
2014-11-11 21:28:11 -08:00 |
|
Karthik Kambatla
|
061bc293c8
|
YARN-2735. diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection. (Zhihai Xu via kasha)
|
2014-11-11 10:31:39 -08:00 |
|
Xuan
|
5c9a51f140
|
YARN-2841. RMProxy should retry EOFException. Contributed by Jian He
|
2014-11-10 18:25:01 -08:00 |
|
Arun C. Murthy
|
43cd07b408
|
YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.
|
2014-11-09 14:57:37 -08:00 |
|
Jason Lowe
|
c3d475070a
|
YARN-2825. Container leak on NM. Contributed by Jian He
|
2014-11-07 23:16:37 +00:00 |
|
cnauroth
|
06b797947c
|
YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch.
|
2014-11-07 12:29:39 -08:00 |
|
Vinod Kumar Vavilapalli
|
c5a46d4c8c
|
YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence of races between the launch and the stop-container call and when root processes crash. Contributed by Billie Rinaldi.
|
2014-11-03 16:38:55 -08:00 |
|
Vinod Kumar Vavilapalli
|
58e9f24e0f
|
YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong.
|
2014-11-03 13:16:29 -08:00 |
|
Jason Lowe
|
6157ace547
|
YARN-2730. DefaultContainerExecutor runs only one localizer at a time. Contributed by Siqi Li
|
2014-11-03 20:37:47 +00:00 |
|
Vinod Kumar Vavilapalli
|
5c0381c96a
|
YARN-2790. Fixed a NodeManager bug that was causing log-aggregation to fail beyond HFDS delegation-token expiry even when RM is a proxy-user (YARN-2704). Contributed by Jian He.
|
2014-11-01 16:32:35 -07:00 |
|
Zhijie Shen
|
1cd088fd9d
|
YARN-2711. Fixed TestDefaultContainerExecutor#testContainerLaunchError failure on Windows. Contributed by Varun Vasudev.
|
2014-10-31 17:43:30 -07:00 |
|
Xuan
|
86ff28dea0
|
YARN-2701. Addendum patch. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong
|
2014-10-31 14:36:25 -07:00 |
|
Jason Lowe
|
73e626ad91
|
YARN-2755. NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661. Contributed by Siqi Li
|
2014-10-30 15:10:27 +00:00 |
|
Zhijie Shen
|
8984e9b177
|
YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch.
|
2014-10-28 14:11:19 -07:00 |
|
Vinod Kumar Vavilapalli
|
a16d022ca4
|
YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.
|
2014-10-27 15:49:47 -07:00 |