Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,623 Commits 326 Branches 371 Tags
Commit Graph

1440 Commits

Author SHA1 Message Date
Jason Lowe
3e8544c5f2 YARN-2755. NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661. Contributed by Siqi Li 
(cherry picked from commit 73e626ad91cd5c06a005068d8432fd16e06fe6a0)
 2014-10-30 15:11:57 +00:00
Karthik Kambatla
d2ba115f06 YARN-2712. TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks. (Tsuyoshi Ozawa via kasha) 
(cherry picked from commit 179cab81e0bde1af0cba6131ccccf16ff127358a)
 2014-10-30 00:39:34 -07:00
Zhijie Shen
d2a5c386c1 YARN-2769. Fixed the problem that timeline domain is not set in distributed shell AM when using shell_command on Windows. Contributed by Varun Vasudev. 
(cherry picked from commit 72496311def320987c31822776e8fbb73dfcc726)
 2014-10-29 12:14:48 -07:00
Karthik Kambatla
e88832dfb3 YARN-2742. FairSchedulerConfiguration should allow extra spaces between value and unit. (Wei Yan via kasha) 
(cherry picked from commit 782971ae7a0247bcf5920e10b434b7e0954dd868)
 2014-10-29 10:25:29 -07:00
Zhijie Shen
734cbe7de2 YARN-2747. Fixed the test failure of TestAggregatedLogFormat when native I/O is enabled. Contributed by Xuan Gong. 
(cherry picked from commit ec63a3ffbd9413e7434594682fdbbd36eef7413c)
 2014-10-28 22:45:20 -07:00
Jian He
720de7eb4c YARN-2503. Added node lablels in web UI. Contributed by Wangda Tan 
(cherry picked from commit d5e0a09721a5156fa2ee51ac1c32fbfd9905b8fb)
 2014-10-28 18:00:59 -07:00
Zhijie Shen
f40389ae08 YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch. 
(cherry picked from commit 8984e9b1774033e379b57da1bd30a5c81888c7a3)
 2014-10-28 14:12:09 -07:00
Xuan
43b1878f86 YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen 2014-10-28 13:30:55 -07:00
Xuan
43a53f2b65 YARN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen 2014-10-28 11:18:35 -07:00
Karthik Kambatla
3f7edeb055 YARN-2760. Remove 'experimental' from FairScheduler docs. (Harsh J via kasha) 
(cherry picked from commit ade3727ecb092935dcc0f1291c1e6cf43d764a03)
 2014-10-28 08:49:34 -07:00
Jian He
a1c7a707ca YARN-2502. Changed DistributedShell to support node labels. Contributed by Wangda Tan 
(cherry picked from commit f6b963fdfc517429149165e4bb6fb947be6e3c99)
 2014-10-27 20:13:53 -07:00
Vinod Kumar Vavilapalli
0ad33e1483 YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He. 
(cherry picked from commit a16d022ca4313a41425c8e97841c841a2d6f2f54)
 2014-10-27 15:50:51 -07:00
Jian He
2d3c64943d YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen 
(cherry picked from commit c05b581a5522eed499d3ba16af9fa6dc694563f6)
 2014-10-27 10:46:37 -07:00
Xuan
3a77838535 YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan 2014-10-27 10:28:45 -07:00
Zhijie Shen
cb3974524c YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by Xuan Gong. 
(cherry picked from commit caecd9fffe7c6216be31f3ab65349182045451fa)
 2014-10-26 12:59:29 -07:00
Vinod Kumar Vavilapalli
36d3f1fcca YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He. 
(cherry picked from commit 018664550507981297fd9f91e29408e6b7801ea9)
 2014-10-26 11:15:45 -07:00
Xuan
f862999a7e YARN-2723. Fix rmadmin -replaceLabelsOnNode does not correctly parse 
port. Contributed by Naganarasimha G R
 2014-10-25 12:47:09 -07:00
Karthik Kambatla
acc6f622e0 YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha) 
(cherry picked from commit c51e53d7aad46059f52d4046a5fedfdfd3c37955)
 2014-10-25 11:50:06 -07:00
Jian He
9bd149978d YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe 
(cherry picked from commit f44cf99599119b5e989be724eeab447b2dc4fe53)
 2014-10-24 23:06:00 -07:00
Jian He
96a6e02d16 YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe 
(cherry picked from commit 5864dd99a419b8a0fb973a4984c0f1d1e02ccf16)
 2014-10-24 22:48:48 -07:00
Karthik Kambatla
9af3cfc7eb YARN-2713. "RM Home" link in NM should point to one of the RMs in an HA setup. (kasha) 
(cherry picked from commit 683897fd028dcc2185383f73b52d15245a69e0cb)
 2014-10-24 15:00:37 -07:00
Zhijie Shen
1b81105143 YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong. 
(cherry picked from commit f81dc3f995579c1b94b11d60e9fc6da56c8a9496)
 2014-10-24 14:12:17 -07:00
Zhijie Shen
13c60bac57 YARN-2724. Skipped uploading a local log file to HDFS if exception is raised when opening it. Contributed by Xuan Gong. 
(cherry picked from commit e31f0a6558b106662c83e1f797216e412b6689a9)
 2014-10-24 11:15:19 -07:00
Jian He
d57f2b9dea Updated CHANGES.txt to move YARN-2682 to branch-2.6 
(cherry picked from commit 071c925c7dffbb825884a5df5a0104e7793b30fc)
 2014-10-23 22:28:23 -07:00
Zhijie Shen
3b03ea6b50 YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He. 
(cherry picked from commit 0f3b6900be1a3b2e4624f31f84656f4a32dadce9)
 2014-10-23 22:03:30 -07:00
Zhijie Shen
36515435ff YARN-2732. Fixed syntax error in SecureContainer.apt.vm. Contributed by Jian He. 
(cherry picked from commit b94b8b30f282563ee2ecdd25761b2345aaf06c9b)
 2014-10-22 18:41:05 -07:00
Jian He
1c235a4448 YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu 
(cherry picked from commit 3b12fd6cfbf4cc91ef8e8616c7aafa9de006cde5)
 2014-10-22 15:58:26 -07:00
Steve Loughran
5e6494ea95 YARN-2700 TestSecureRMRegistryOperations failing on windows: auth problems 2014-10-22 21:13:32 +01:00
Steve Loughran
a64ac5501c YARN-2692 ktutil test hanging on some machines/ktutil versions (stevel) 2014-10-22 14:35:13 +01:00
Zhijie Shen
4b9de2cdfe YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it retries creating znode. Contributed by Jian He. 
(cherry picked from commit 7e3b5e6f5cb4945b4fab27e8a83d04280df50e17)
 2014-10-21 21:52:01 -07:00
Vinod Kumar Vavilapalli
77dc9afe86 YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen. 
(cherry picked from commit c0e034336c85296be6f549d88d137fb2b2b79a15)
 2014-10-21 20:10:45 -07:00
Zhijie Shen
296bbd8971 YARN-2709. Made timeline client getDelegationToken API retry if ConnectException happens. Contributed by Li Lu. 
(cherry picked from commit b2942762d7f76d510ece5621c71116346a6b12f6)
 2014-10-21 16:08:18 -07:00
cnauroth
a066134277 YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch. 
(cherry picked from commit 6637e3cf95b3a9be8d6b9cd66bc849a0607e8ed5)
 2014-10-21 12:34:58 -07:00
Jason Lowe
3820bf055e YARN-90. NodeManager should identify failed disks becoming good again. Contributed by Varun Vasudev 
(cherry picked from commit 6f2028bd1514d90b831f889fd0ee7f2ba5c15000)
 2014-10-21 17:33:34 +00:00
Zhijie Shen
fd7ba56f6a YARN-2717. Avoided duplicate logging when container logs are not found. Contributed by Xuan Gong. 
(cherry picked from commit 171f2376d23d51b61b9c9b3804ee86dbd4de033a)
 2014-10-20 22:23:12 -07:00
Jian He
b52928a6ea Missing file for YARN-1879 
(cherry picked from commit 4a78a752286effbf1a0d8695325f9d7464a09fb4)
 2014-10-20 21:14:57 -07:00
Jian He
e9564e729f Missing file for YARN-2701 
(cherry picked from commit 4fa1fb3193bf39fcb1bd7f8f8391a78f69c3c302)
 2014-10-20 19:58:21 -07:00
Jian He
3c8ae89050 YARN-2701. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong 
(cherry picked from commit 2839365f230165222f63129979ea82ada79ec56e)
 2014-10-20 19:54:10 -07:00
Zhijie Shen
f75570734b YARN-2582. Fixed Log CLI and Web UI for showing aggregated logs of LRS. Contributed Xuan Gong. 
(cherry picked from commit e90718fa5a0e7c18592af61534668acebb9db51b)
 2014-10-20 13:42:22 -07:00
Zhijie Shen
42ceed8f20 YARN-2673. Made timeline client put APIs retry if ConnectException happens. Contributed by Li Lu. 
(cherry picked from commit 89427419a3c5eaab0f73bae98d675979b9efab5f)
 2014-10-20 12:23:10 -07:00
Vinod Kumar Vavilapalli
9915d52185 YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan. 
(cherry picked from commit 82567664988b673f1b819a42a4baf31cb0dcb331)
 2014-10-18 12:08:28 -07:00
Vinod Kumar Vavilapalli
ea841eb25d YARN-2676. Enhanced Timeline auth-filter to support proxy users. Contributed by Zhijie Shen. 
(cherry picked from commit 39063cd36f96e351e4a6bf0bc2b6185711d4b059)
 2014-10-17 22:03:43 -07:00
Vinod Kumar Vavilapalli
1c52b6551b YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan. 
(cherry picked from commit e9c66e8fd2ccb658db2848e1ab911f1502de4de5)
 2014-10-17 18:27:04 -07:00
Jian He
78a57087bf YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit c3de2412eb7633ff16c67e71e73bbe27a982d984)
 2014-10-17 16:36:15 -07:00
Jian He
79428e021f YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks 
(cherry picked from commit a6aa6e42cacdbfcc1c2b7c19e7239204fe9ff654)
 2014-10-17 10:55:04 -07:00
Vinod Kumar Vavilapalli
99ce4277a8 YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan. 
(cherry picked from commit abae63caf9c53b404f2f2db7d482555484eaeaf8)
 2014-10-17 08:59:22 -07:00
Jian He
10110b6eae Moved YARN-2682 from 2.6 to 2.7 in CHANGES.txt 
(cherry picked from commit 72093fd8cb9865a27a96163f31d03d6813ce267f)
 2014-10-16 19:03:29 -07:00
Jian He
a78f1f8da8 YARN-2682. Updated WindowsSecureContainerExecutor to not use DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir() instead. Contributed by Zhihai Xu 
(cherry picked from commit 0fd0ebae645e671699f6a6a56a012ebe6dfb5b2a)
 2014-10-16 18:15:43 -07:00
Jian He
caba212f12 YARN-2621. Simplify the output when the user doesn't have the access for getDomain(s). Contributed by Zhijie Shen 
(cherry picked from commit 233d446be1bc1bc77c7c1c45386086a732897afd)
 2014-10-16 16:38:00 -07:00
Steve Loughran
fddbf52caa YARN-2689 TestSecureRMRegistryOperations failing on windows: secure ZK won't start 2014-10-16 14:21:49 -07:00