Karthik Kambatla
3e4b280de7
YARN-2010. Handle app-recovery failures gracefully. (Jian He and Karthik Kambatla via kasha)
...
(cherry picked from commit b2cd269802
)
2014-11-04 17:48:49 -08:00
Zhijie Shen
e06c23a6c9
YARN-2752. Made ContainerExecutor append "nice -n" arg only when priority adjustment flag is set. Contributed by Xuan Gong.
2014-11-04 15:50:10 -08:00
Haohui Mai
aa09c4c342
HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai.
2014-11-04 14:52:51 -08:00
Vinod Kumar Vavilapalli
9c76dcadaf
YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence of races between the launch and the stop-container call and when root processes crash. Contributed by Billie Rinaldi.
...
(cherry picked from commit c5a46d4c8c
)
2014-11-03 16:40:37 -08:00
Vinod Kumar Vavilapalli
277141b82d
YARN-2795. Fixed ResourceManager to not crash loading node-label data from HDFS in secure mode. Contributed by Wangda Tan.
...
(cherry picked from commit ec6cbece8e
)
2014-11-03 13:45:31 -08:00
Vinod Kumar Vavilapalli
715c81ef6d
YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong.
...
(cherry picked from commit 58e9f24e0f
)
2014-11-03 13:19:34 -08:00
Jason Lowe
8091ea54d5
YARN-2730. DefaultContainerExecutor runs only one localizer at a time. Contributed by Siqi Li
...
(cherry picked from commit 6157ace547
)
2014-11-03 20:39:14 +00:00
Zhijie Shen
caae0a0a08
YARN-2785. Fixed intermittent TestContainerResourceUsage failure. Contributed by Varun Vasudev.
...
(cherry picked from commit 27715ec63b
)
2014-11-02 15:22:54 -08:00
Vinod Kumar Vavilapalli
6627f67bf5
YARN-2790. Fixed a NodeManager bug that was causing log-aggregation to fail beyond HFDS delegation-token expiry even when RM is a proxy-user (YARN-2704). Contributed by Jian He.
...
(cherry picked from commit 5c0381c96a
)
2014-11-01 16:33:35 -07:00
Zhijie Shen
d9ac25454c
YARN-2711. Fixed TestDefaultContainerExecutor#testContainerLaunchError failure on Windows. Contributed by Varun Vasudev.
...
(cherry picked from commit 1cd088fd9d
)
2014-10-31 17:45:05 -07:00
Vinod Kumar Vavilapalli
6d4a04a033
YARN-2789. Re-instated the NodeReport.newInstance private unstable API modified in YARN-2698 so that tests in YARN frameworks don't break. Contributed by Wangda Tan.
...
(cherry picked from commit 6ce32f593b
)
2014-10-31 15:33:41 -07:00
Xuan
902566741e
YARN-2701. Addendum patch. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong
2014-10-31 14:39:06 -07:00
Jian He
a87f827ae4
YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen
...
(cherry picked from commit 1b4be91866
)
2014-10-31 13:17:19 -07:00
Karthik Kambatla
268af259b5
YARN-2186. [YARN-1492] Node Manager uploader service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
...
(cherry picked from commit 256697acd5
)
2014-10-31 13:01:25 -07:00
Vinod Kumar Vavilapalli
97694e78ad
YARN-2779. Fixed ResourceManager to not require delegation tokens for communicating with Timeline Service. Contributed by Zhijie Shen.
...
(cherry picked from commit d1828d9443
)
2014-10-30 23:17:16 -07:00
Vinod Kumar Vavilapalli
0ba8d8c19c
YARN-2698. Moved some node label APIs to be correctly placed in client protocol. Contributed by Wangda Tan.
...
(cherry picked from commit e0233c16eb
)
2014-10-30 23:02:06 -07:00
Jason Lowe
3e8544c5f2
YARN-2755. NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661. Contributed by Siqi Li
...
(cherry picked from commit 73e626ad91
)
2014-10-30 15:11:57 +00:00
Karthik Kambatla
d2ba115f06
YARN-2712. TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks. (Tsuyoshi Ozawa via kasha)
...
(cherry picked from commit 179cab81e0
)
2014-10-30 00:39:34 -07:00
Karthik Kambatla
e88832dfb3
YARN-2742. FairSchedulerConfiguration should allow extra spaces between value and unit. (Wei Yan via kasha)
...
(cherry picked from commit 782971ae7a
)
2014-10-29 10:25:29 -07:00
Jian He
720de7eb4c
YARN-2503. Added node lablels in web UI. Contributed by Wangda Tan
...
(cherry picked from commit d5e0a09721
)
2014-10-28 18:00:59 -07:00
Zhijie Shen
f40389ae08
YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch.
...
(cherry picked from commit 8984e9b177
)
2014-10-28 14:12:09 -07:00
Xuan
43b1878f86
YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen
2014-10-28 13:30:55 -07:00
Xuan
43a53f2b65
YARN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen
2014-10-28 11:18:35 -07:00
Vinod Kumar Vavilapalli
0ad33e1483
YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.
...
(cherry picked from commit a16d022ca4
)
2014-10-27 15:50:51 -07:00
Jian He
2d3c64943d
YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen
...
(cherry picked from commit c05b581a55
)
2014-10-27 10:46:37 -07:00
Xuan
3a77838535
YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan
2014-10-27 10:28:45 -07:00
Vinod Kumar Vavilapalli
36d3f1fcca
YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He.
...
(cherry picked from commit 0186645505
)
2014-10-26 11:15:45 -07:00
Karthik Kambatla
acc6f622e0
YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
...
(cherry picked from commit c51e53d7aa
)
2014-10-25 11:50:06 -07:00
Jian He
96a6e02d16
YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe
...
(cherry picked from commit 5864dd99a4
)
2014-10-24 22:48:48 -07:00
Zhijie Shen
1b81105143
YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong.
...
(cherry picked from commit f81dc3f995
)
2014-10-24 14:12:17 -07:00
Zhijie Shen
3b03ea6b50
YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.
...
(cherry picked from commit 0f3b6900be
)
2014-10-23 22:03:30 -07:00
Jian He
1c235a4448
YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu
...
(cherry picked from commit 3b12fd6cfb
)
2014-10-22 15:58:26 -07:00
Zhijie Shen
4b9de2cdfe
YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it retries creating znode. Contributed by Jian He.
...
(cherry picked from commit 7e3b5e6f5c
)
2014-10-21 21:52:01 -07:00
Vinod Kumar Vavilapalli
77dc9afe86
YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen.
...
(cherry picked from commit c0e034336c
)
2014-10-21 20:10:45 -07:00
cnauroth
a066134277
YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch.
...
(cherry picked from commit 6637e3cf95
)
2014-10-21 12:34:58 -07:00
Jason Lowe
3820bf055e
YARN-90. NodeManager should identify failed disks becoming good again. Contributed by Varun Vasudev
...
(cherry picked from commit 6f2028bd15
)
2014-10-21 17:33:34 +00:00
Jian He
e9564e729f
Missing file for YARN-2701
...
(cherry picked from commit 4fa1fb3193
)
2014-10-20 19:58:21 -07:00
Jian He
3c8ae89050
YARN-2701. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong
...
(cherry picked from commit 2839365f23
)
2014-10-20 19:54:10 -07:00
Vinod Kumar Vavilapalli
9915d52185
YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan.
...
(cherry picked from commit 8256766498
)
2014-10-18 12:08:28 -07:00
Vinod Kumar Vavilapalli
ea841eb25d
YARN-2676. Enhanced Timeline auth-filter to support proxy users. Contributed by Zhijie Shen.
...
(cherry picked from commit 39063cd36f
)
2014-10-17 22:03:43 -07:00
Vinod Kumar Vavilapalli
1c52b6551b
YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan.
...
(cherry picked from commit e9c66e8fd2
)
2014-10-17 18:27:04 -07:00
Jian He
78a57087bf
YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA
...
(cherry picked from commit c3de2412eb
)
2014-10-17 16:36:15 -07:00
Jian He
79428e021f
YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks
...
(cherry picked from commit a6aa6e42ca
)
2014-10-17 10:55:04 -07:00
Vinod Kumar Vavilapalli
99ce4277a8
YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.
...
(cherry picked from commit abae63caf9
)
2014-10-17 08:59:22 -07:00
Jian He
a78f1f8da8
YARN-2682. Updated WindowsSecureContainerExecutor to not use DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir() instead. Contributed by Zhihai Xu
...
(cherry picked from commit 0fd0ebae64
)
2014-10-16 18:15:43 -07:00
Jian He
caba212f12
YARN-2621. Simplify the output when the user doesn't have the access for getDomain(s). Contributed by Zhijie Shen
...
(cherry picked from commit 233d446be1
)
2014-10-16 16:38:00 -07:00
Vinod Kumar Vavilapalli
76cf2250de
YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.
...
(cherry picked from commit b3056c266a
)
2014-10-15 18:48:36 -07:00
Vinod Kumar Vavilapalli
e8e3a36213
YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan.
...
YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.
(cherry picked from commit f2ea555ac6
)
2014-10-15 18:34:19 -07:00
Jian He
f93d2ea27e
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
2014-10-15 15:28:26 -07:00
Zhijie Shen
bec165e163
YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen.
...
(cherry picked from commit 1220bb72d4
)
2014-10-14 21:56:44 -07:00