495 Commits

Author SHA1 Message Date
Wangda Tan
97244b143c YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda)
(cherry picked from commit 7af086a515d573dc90ea4deec7f4e3f23622e0e8)
2015-04-08 10:58:38 -07:00
Xuan
0522d6970d YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev

(cherry picked from commit d27e9241e8676a0edb2d35453cac5f9495fcd605)
2015-04-07 09:54:29 -07:00
Wangda Tan
405aead879 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
(cherry picked from commit bad070fe15a642cc6f3a165612fbd272187e03cb)
2015-04-02 17:23:44 -07:00
Wangda Tan
865be70b02 YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wangda)
(cherry picked from commit 492239424a3ace9868b6154f44a0f18fa5318235)
2015-04-01 10:15:47 -07:00
Vinod Kumar Vavilapalli
c980e34bc5 YARN-3304. Addendum patch. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. (Junping Du and Karthik Kambatla via vinodkv)
(cherry picked from commit 7610925e90155dfe5edce05da31574e4fb81b948)
2015-03-31 17:28:48 -07:00
Vinod Kumar Vavilapalli
c5bc48946d YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
(cherry picked from commit c358368f511963ad8e35f030b9babee541e1bd01)
2015-03-30 10:11:12 -07:00
Robert Kanter
6f0e864d61 YARN-3400. [JDK 8] Build Failure due to unreported exceptions in RPCUtil (rkanter)
(cherry picked from commit 87130bf6b22f538c5c26ad5cef984558a8117798)
2015-03-26 11:00:37 -07:00
Jian He
9c494cedaf YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
(cherry picked from commit e1feb4ea1a532d680d6ca69b55ffcae1552d64f0)
2015-03-20 19:05:14 -07:00
Junping Du
9aedb3d688 YARN-3350. YARN RackResolver spams logs with messages at info level. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 7f1e2f996995e1883d9336f720c27621cf1b73b6)
2015-03-20 18:22:23 -07:00
Junping Du
f40f17489c YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong
(cherry picked from commit d81109e588493cef31e68508a3d671203bd23e12)
2015-03-20 13:42:31 -07:00
Xuan
7990e1d80d YARN-2777. Mark the end of individual log in aggregated log. Contributed
by Varun Saxena

(cherry picked from commit 1a4b52869191b7e39c0101d3585efc12d6362c1c)
2015-03-20 10:25:26 -07:00
Karthik Kambatla
05627dd96d YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
(cherry picked from commit 20b49224eb90c796f042ac4251508f3979fd4787)
2015-03-18 16:33:57 -07:00
Tsuyoshi Ozawa
d6e3ef2506 YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
(cherry picked from commit 3da9a97cfbcc3a1c50aaf85b1a129d4d269cd5fd)
2015-03-16 23:20:17 +09:00
Vinod Kumar Vavilapalli
53aa3a4d1f YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
(cherry picked from commit 863079bb874ba77918ca1c0741eae10e245995c8)
2015-03-12 13:33:42 -07:00
Zhijie Shen
426535007b YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
(cherry picked from commit 85f6d67fa78511f255fcfa810afc9a156a7b483b)
2015-03-11 19:39:46 -07:00
Zhijie Shen
a94d23762e YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles.
(cherry picked from commit d6e05c5ee26feefc17267b7c9db1e2a3dbdef117)
2015-03-09 13:55:51 -07:00
Tsuyoshi Ozawa
b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli
d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
Junping Du
b91e1b0feb YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable resource monitoring. Contributed by Hitesh Shah
(cherry picked from commit 7ce3c7635392c32f0504191ddd8417fb20509caa)
2015-03-08 14:48:42 -07:00
Jason Lowe
ef3d9bdf6b YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne
(cherry picked from commit 27e8ea820fab8dce59f4db9814e73bd60c1d4ef1)
2015-03-06 22:45:09 +00:00
Jian He
6cef2c16de YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
(cherry picked from commit 21101c01f242439ec8ec40fb3a9ab1991ae0adc7)
2015-03-06 14:18:56 -08:00
Xuan
56c2050ab7 YARN-3227. Timeline renew delegation token fails when RM user's TGT is
expired. Contributed by Zhijie Shen

(cherry picked from commit d1abc5d4fc00bb1b226066684556ba16ace71744)
2015-03-06 13:33:18 -08:00
Jian He
a5f3fb4dc1 YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong
(cherry picked from commit 95bfd087dc89e57a93340604cc8b96042fa1a05a)
2015-03-05 21:27:03 -08:00
Karthik Kambatla
1749094fab YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha)
(cherry picked from commit 53947f37c7a84a84ef4ab1a3cab63ff27c078385)
2015-03-04 17:39:39 -08:00
Wangda Tan
0b0be0056b YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)
(cherry picked from commit edcecedc1c39d54db0f86a1325b4db26c38d2d4d)
2015-02-27 16:14:35 -08:00
Tsuyoshi Ozawa
79f73f4613 YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.
(cherry picked from commit 01a1621930df17a745dd37892996c68fca3447d1)
2015-02-28 00:57:01 +09:00
Xuan
fefeba4ac8 YARN-3238. Connection timeouts to nodemanagers are retried at multiple
levels. Contributed by Jason Lowe

(cherry picked from commit 92d67ace3248930c0c0335070cc71a480c566a36)
2015-02-21 16:07:28 -08:00
Wangda Tan
cd5eb9c1de YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)
(cherry picked from commit d49ae725d5fa3eecf879ac42c42a368dd811f854)
2015-02-19 11:01:47 -08:00
Jian He
8f06eaa251 YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan
(cherry picked from commit f5da5566d9c392a5df71a2dce4c2d0d50eea51ee)
2015-02-18 11:52:28 -08:00
Xuan
df6bee5a75 YARN-3179. Update use of Iterator to Iterable in RMAdminCLI and
CommonNodeLabelsManager. Contributed by Ray Chiang

(cherry picked from commit 2586915bb3178d26ad692f93d53aaffbb55d9ed9)
2015-02-12 17:32:58 -08:00
Tsuyoshi Ozawa
dc14f2772f YARN-3157. Refactor the exception handling in ConverterUtils#to*Id. Contributed by Bibin A Chundatt.
(cherry picked from commit 7bc492adab90c4533c20d48c004e92cb917cd199)
2015-02-12 23:49:27 +09:00
Junping Du
634cc297ba YARN-1580. Documentation error regarding container-allocation.expiry-interval-ms (Brahma Reddy Battula via junping_du)
(cherry picked from commit 46c7577b9843766b8cc3e81eae1100d4c194286a)
2015-02-12 03:40:57 -08:00
Tsuyoshi Ozawa
fd047702e4 YARN-1237. Description for yarn.nodemanager.aux-services in yarn-default.xml is misleading. Contributed by Brahma Reddy Battula.
(cherry picked from commit b3bcbaf277ec389ec048a4b5cd59b2e90781a30b)
2015-02-12 15:19:54 +09:00
Steve Loughran
a8eaec396f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:22 +00:00
Zhijie Shen
24d4d933f7 YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.
(cherry picked from commit 23bf6c72071782e3fd5a628e21495d6b974c7a9e)
2015-02-09 20:37:58 -08:00
Wangda Tan
4d4442cb39 YARN-3155. Refactor the exception handling code for TimelineClientImpl's retryOn method (Li Lu via wangda)
(cherry picked from commit 00a748d24a565bce0cc8cfa2bdcf165778cea395)
2015-02-09 17:30:59 -08:00
Jonathan Eagles
c0e14d546e YARN-2971. RM uses conf instead of token service address to renew timeline delegation tokens (jeagles)
(cherry picked from commit af0842589359ad800427337ad2c84fac09907f72)
2015-02-09 17:56:59 -06:00
Jian He
6146680955 YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong
(cherry picked from commit 0af6a99a3fcfa4b47d3bcba5e5cc5fe7b312a152)
2015-02-09 13:47:33 -08:00
Jason Lowe
9361fc8f70 YARN-3144. Configuration for making delegation token failures to timeline server not-fatal. Contributed by Jonathan Eagles
(cherry picked from commit 6f10434a5ad965d50352602ce31a9fce353cb90c)
2015-02-06 20:55:56 +00:00
Jian He
3ddafaa7c8 YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan
(cherry picked from commit c1957fef29b07fea70938e971b30532a1e131fd0)
2015-02-06 11:34:56 -08:00
Xuan
096ba583fa YARN-3149. Fix typo in message for invalid application id. Contributed
by Bibin A Chundatt.

(cherry picked from commit b77ff37686e01b7497d3869fbc62789a5b123c0a)
2015-02-05 15:15:29 -08:00
Wangda Tan
205e15c4a3 YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda)
(cherry picked from commit 5bd984691b3e3df5d8aac910295138996e7a5839)
2015-02-03 12:55:25 -08:00
Kihwal Lee
05d831c4b7 YARN-3113. Release audit warning for Sorting icons.psd. Contributed by Steve Loughran.
(cherry picked from commit f33c99ba3900f21901b479ad6e85f5cd95a9c657)
2015-02-02 12:59:45 -06:00
Tsuyoshi Ozawa
6efffc9cd8 YARN-3029. FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere. Contributed by Varun Saxena.
(cherry picked from commit 7acce7d3648d6f1e45ce280e2147e7dedf5693fc)
2015-01-30 04:42:25 +09:00
Akira Ajisaka
1081b4c4a7 HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
(cherry picked from commit 342efa110af9989829b8a8caa699658a2ba01607)
2015-01-30 02:50:46 +09:00
Wangda Tan
12060cb9a6 YARN-3028. Better syntax for replaceLabelsOnNode in RMAdmin CLI. Contributed by Rohith Sharmaks
(cherry picked from commit fd93e5387b554a78413bc0f14b729e58fea604ea)
2015-01-27 15:25:47 -08:00
Tsuyoshi Ozawa
25f2cf8a4e YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.
(cherry picked from commit 24aa462673d392fed859f8088acf9679ae62a129)
2015-01-23 20:37:26 +09:00
Tsuyoshi Ozawa
316eedb55f YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'. Contributed by Sam Liu.
(cherry picked from commit 5712c9f96a2cf4ff63d36906ab3876444c0cddec)
2015-01-22 12:25:29 +09:00
Wangda Tan
610aa71a10 YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino)
(cherry picked from commit f250ad1773b19713d6aea81ae290ebb4c90fd44b)
2015-01-20 14:49:06 -08:00
Junping Du
0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He)
(cherry picked from commit f92e5038000a012229c304bc6e5281411eff2883)
2015-01-13 18:23:32 -08:00