625 Commits

Author SHA1 Message Date
Jian He
521378ffa3 YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan
(cherry picked from commit 8966d4217969eb71767ba83a3ff2b5bb38189b19)
2015-05-20 16:30:44 -07:00
Wangda Tan
b5ba6979b7 YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
(cherry picked from commit 563eb1ad2ae848a23bbbf32ebfaf107e8fa14e87)
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
2015-05-19 17:37:24 -07:00
Wangda Tan
7b97f049ee YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda)
(cherry picked from commit b37da52a1c4fb3da2bd21bfadc5ec61c5f953a59)
2015-05-19 16:35:23 -07:00
Xuan
3ceb2ffe54 YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen
(cherry picked from commit 76afd28862c1f27011273659a82cd45903a77170)
2015-05-18 13:19:01 -07:00
Junping Du
bc13c7d84b YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong.
(cherry picked from commit 15ccd967ee3e7046a50522089f67ba01f36ec76a)
2015-05-14 10:59:48 -07:00
Wangda Tan
8555a5146d YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda)
(cherry picked from commit d4f53fc9631d682cd79ba440aefa6750dcc898be)
2015-05-13 13:33:38 -07:00
Wangda Tan
3df8880bbe YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda)
(cherry picked from commit 341a476812015d0d584b198b451ea9458645a47c)
2015-05-13 13:07:05 -07:00
Zhijie Shen
6043224458 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
(cherry picked from commit fcd0702c10ce574b887280476aba63d6682d5271)
2015-05-12 21:13:47 -07:00
Karthik Kambatla
e8dd0bc4fd YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
(cherry picked from commit 70fb37cd79a7eba6818313960624380bacfe0bb2)
2015-05-09 14:35:13 -07:00
Xuan
8d07116266 YARN-2331. Distinguish shutdown during supervision vs. shutdown for
rolling upgrade. Contributed by Jason Lowe

(cherry picked from commit 088156de43abb07bec590a3fcd1a5af2feb02cd2)
2015-05-08 15:11:55 -07:00
Thomas Graves
638feaaa35 YARN-20. More information for yarn.resourcemanager.webapp.address in yarn-default.xml (Bartosz Ługowski vai tgraves)
(cherry picked from commit f0f5e3c0751bcadcacd6d91e2c5504803ec3d0a5)
2015-05-08 17:22:33 +00:00
Devaraj K
bf8be56292 YARN-2784. Make POM project names consistent. Contributed by Rohith. 2015-05-08 19:26:11 +05:30
Jason Lowe
bcb863b156 YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R
(cherry picked from commit 9757864fd662b69445e0c600aedbe307a264982e)
2015-05-08 13:47:48 +00:00
Tsuyoshi Ozawa
b1f3590b22 YARN-3589. RM and AH web UI display DOCTYPE wrongly. Contbituted by Rohith.
(cherry picked from commit f26700f2878f4374c68e97ee00205eda5a6d022c)
2015-05-08 17:13:56 +09:00
Akira Ajisaka
67bebabb21 YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit 995f1b5831fc33042de90267a689333dc110c4c3)
2015-05-07 13:33:17 +09:00
Xuan
02cdcaec58 YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA

(cherry picked from commit b7dd3a4f04f712b7594c4e6e7ce50fd314f7c342)
2015-05-05 10:45:18 -07:00
Tsuyoshi Ozawa
f382602de1 YARN-1993. Cross-site scripting vulnerability in TextView.java. Contributed byKenji Kikushima.
(cherry picked from commit e8d0ee5fc9af612d7abc9ab2c201434e7102d092)
2015-05-03 10:51:39 +09:00
Junping Du
8068e79989 YARN-2454. Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. Contributed by Xu Yang.
(cherry picked from commit 57d9a972cbd62aae0ab010d38a0973619972edd6)
2015-05-02 10:20:30 -07:00
tgraves
2e13183f60 YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves)
(cherry picked from commit 2e215484bd05cd5e3b7a81d3558c6879a05dd2d2)
2015-04-29 21:27:16 +00:00
Wangda Tan
8ee632caa7 YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda)
(cherry picked from commit db1b674b50ddecf2774f4092d677c412722bdcb1)
2015-04-27 16:42:36 -07:00
Vinod Kumar Vavilapalli
0ec6e7e7f5 YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv)
(cherry picked from commit f5fe35e297ed4a00a1ba93d090207ef67cebcc9d)
2015-04-23 11:25:30 -07:00
Jian He
48d8d88245 YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen
(cherry picked from commit aa4a192feb8939353254d058c5f81bddbd0335c0)
2015-04-23 11:07:54 -07:00
Junping Du
8de6045842 New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K
(cherry picked from commit fad9d7e85b1ba0934ab592daa9d3c9550b2bb501)
2015-04-22 10:08:16 -07:00
Jian He
9827da95bc YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks
(cherry picked from commit 6779467ab6fcc6a02d0e8c80b138cc9df1aa831e)
2015-04-17 15:57:36 -07:00
Junping Du
b244701fad YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.
(cherry picked from commit 1db355a875c3ecc40a244045c6812e00c8d36ef1)
2015-04-17 13:20:27 -07:00
Akira Ajisaka
51c458a5c4 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
(cherry picked from commit 1fa8075794894b3e0053d251788277fb88e85533)
2015-04-16 10:06:03 -05:00
Jian He
6fed2c2a79 YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan
(cherry picked from commit 1b89a3e173f8e905074ed6714a7be5c003c0e2c4)
2015-04-15 14:03:29 -07:00
Harsh J
01af29106a YARN-3462. Patches applied for YARN-2424 are inconsistent between trunk and branch-2. Contributed by Naganarasimha G R. 2015-04-15 09:41:43 +05:30
Junping Du
a64b8915de YARN-3347. Improve YARN log command to get AMContainer logs as well as running containers logs. Contributed by Xuan Gong.
(cherry picked from commit a77d628339afaf2f5a085c73fd81a805b18348c9)
2015-04-13 17:41:02 -07:00
Jian He
d3daf9665c YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev 2015-04-10 10:40:31 -07:00
Wangda Tan
97244b143c YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda)
(cherry picked from commit 7af086a515d573dc90ea4deec7f4e3f23622e0e8)
2015-04-08 10:58:38 -07:00
Xuan
0522d6970d YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev

(cherry picked from commit d27e9241e8676a0edb2d35453cac5f9495fcd605)
2015-04-07 09:54:29 -07:00
Wangda Tan
405aead879 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
(cherry picked from commit bad070fe15a642cc6f3a165612fbd272187e03cb)
2015-04-02 17:23:44 -07:00
Wangda Tan
865be70b02 YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wangda)
(cherry picked from commit 492239424a3ace9868b6154f44a0f18fa5318235)
2015-04-01 10:15:47 -07:00
Vinod Kumar Vavilapalli
c980e34bc5 YARN-3304. Addendum patch. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. (Junping Du and Karthik Kambatla via vinodkv)
(cherry picked from commit 7610925e90155dfe5edce05da31574e4fb81b948)
2015-03-31 17:28:48 -07:00
Vinod Kumar Vavilapalli
c5bc48946d YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
(cherry picked from commit c358368f511963ad8e35f030b9babee541e1bd01)
2015-03-30 10:11:12 -07:00
Robert Kanter
6f0e864d61 YARN-3400. [JDK 8] Build Failure due to unreported exceptions in RPCUtil (rkanter)
(cherry picked from commit 87130bf6b22f538c5c26ad5cef984558a8117798)
2015-03-26 11:00:37 -07:00
Jian He
9c494cedaf YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
(cherry picked from commit e1feb4ea1a532d680d6ca69b55ffcae1552d64f0)
2015-03-20 19:05:14 -07:00
Junping Du
9aedb3d688 YARN-3350. YARN RackResolver spams logs with messages at info level. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 7f1e2f996995e1883d9336f720c27621cf1b73b6)
2015-03-20 18:22:23 -07:00
Junping Du
f40f17489c YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong
(cherry picked from commit d81109e588493cef31e68508a3d671203bd23e12)
2015-03-20 13:42:31 -07:00
Xuan
7990e1d80d YARN-2777. Mark the end of individual log in aggregated log. Contributed
by Varun Saxena

(cherry picked from commit 1a4b52869191b7e39c0101d3585efc12d6362c1c)
2015-03-20 10:25:26 -07:00
Karthik Kambatla
05627dd96d YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)
(cherry picked from commit 20b49224eb90c796f042ac4251508f3979fd4787)
2015-03-18 16:33:57 -07:00
Tsuyoshi Ozawa
d6e3ef2506 YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
(cherry picked from commit 3da9a97cfbcc3a1c50aaf85b1a129d4d269cd5fd)
2015-03-16 23:20:17 +09:00
Vinod Kumar Vavilapalli
53aa3a4d1f YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
(cherry picked from commit 863079bb874ba77918ca1c0741eae10e245995c8)
2015-03-12 13:33:42 -07:00
Zhijie Shen
426535007b YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
(cherry picked from commit 85f6d67fa78511f255fcfa810afc9a156a7b483b)
2015-03-11 19:39:46 -07:00
Zhijie Shen
a94d23762e YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles.
(cherry picked from commit d6e05c5ee26feefc17267b7c9db1e2a3dbdef117)
2015-03-09 13:55:51 -07:00
Tsuyoshi Ozawa
b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli
d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
Junping Du
b91e1b0feb YARN-3296. Mark ResourceCalculatorProcessTree class as Public for configurable resource monitoring. Contributed by Hitesh Shah
(cherry picked from commit 7ce3c7635392c32f0504191ddd8417fb20509caa)
2015-03-08 14:48:42 -07:00
Jason Lowe
ef3d9bdf6b YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne
(cherry picked from commit 27e8ea820fab8dce59f4db9814e73bd60c1d4ef1)
2015-03-06 22:45:09 +00:00