536 Commits

Author SHA1 Message Date
Wangda Tan
a3734f67d3 YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)
(cherry picked from commit 5cc3fced957a8471733e0e9490878bd68429fe24)
2015-05-31 16:33:50 -07:00
Zhijie Shen
4e2ed34d20 YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.
(cherry picked from commit a9f986bc5a41ab74171da1076d10e83c5adc284f)
2015-05-30 21:06:32 -07:00
Wangda Tan
2fb794ecaf YARN-3716. Node-label-expression should be included by ResourceRequestPBImpl.toString. (Xianyin Xin via wangda)
(cherry picked from commit 788bfa0359c1789fa48f21724a8117fe3fd9e532)
2015-05-28 16:35:17 -07:00
Devaraj K
7116141d7d YARN-3722. Merge multiple TestWebAppUtils into
o.a.h.yarn.webapp.util.TestWebAppUtils. Contributed by Masatake Iwasaki.

(cherry picked from commit 7e509f58439b1089462f51f9a0f9782faec7d198)
2015-05-28 15:36:13 +05:30
Zhijie Shen
839f81a632 YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.
(cherry picked from commit 54504133f41e36eaea6bb06c7b9ddb249468ecd7)
2015-05-27 16:53:47 -07:00
Wangda Tan
8857cba72e YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)
(cherry picked from commit ec0a852a37d5c91a62d3d0ff3ddbd9d58235b312)
2015-05-27 13:15:55 -07:00
Wangda Tan
0728a86b3a YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)
(cherry picked from commit cdbd66be111c93c85a409d47284e588c453ecae9)
2015-05-26 16:00:17 -07:00
Vinod Kumar Vavilapalli
a67cb4826b YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
(cherry picked from commit 500a1d9c76ec612b4e737888f4be79951c11591d)
2015-05-26 11:39:40 -07:00
Xuan
84245ff3b2 YARN-2238. Filtering on UI sticks even if I move away from the page.
Contributed by Jian He

(cherry picked from commit 39077dba2e877420e7470df253f6154f6ecc64ec)
2015-05-25 22:41:02 -07:00
Vinayakumar B
19895a41ad HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
(cherry picked from commit 55ed6558bad5d76ce4ebf958fc101a48032a0cd1)

Conflicts:
	hadoop-common-project/hadoop-common/pom.xml
2015-05-22 16:46:50 +05:30
Devaraj K
157ecb2241 YARN-3646. Applications are getting stuck some times in case of retry
policy forever. Contributed by Raju Bairishetti.

(cherry picked from commit 0305316d6932e6f1a05021354d77b6934e57e171)
2015-05-21 20:16:09 +05:30
Jian He
521378ffa3 YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan
(cherry picked from commit 8966d4217969eb71767ba83a3ff2b5bb38189b19)
2015-05-20 16:30:44 -07:00
Wangda Tan
b5ba6979b7 YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)
(cherry picked from commit 563eb1ad2ae848a23bbbf32ebfaf107e8fa14e87)
(cherry picked from commit b0d22b0c606fad6b4ab5443c0aed07c829b46726)
2015-05-19 17:37:24 -07:00
Wangda Tan
7b97f049ee YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda)
(cherry picked from commit b37da52a1c4fb3da2bd21bfadc5ec61c5f953a59)
2015-05-19 16:35:23 -07:00
Xuan
3ceb2ffe54 YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen
(cherry picked from commit 76afd28862c1f27011273659a82cd45903a77170)
2015-05-18 13:19:01 -07:00
Junping Du
bc13c7d84b YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong.
(cherry picked from commit 15ccd967ee3e7046a50522089f67ba01f36ec76a)
2015-05-14 10:59:48 -07:00
Wangda Tan
8555a5146d YARN-3579. CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings. (Sunil G via wangda)
(cherry picked from commit d4f53fc9631d682cd79ba440aefa6750dcc898be)
2015-05-13 13:33:38 -07:00
Wangda Tan
3df8880bbe YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda)
(cherry picked from commit 341a476812015d0d584b198b451ea9458645a47c)
2015-05-13 13:07:05 -07:00
Zhijie Shen
6043224458 YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
(cherry picked from commit fcd0702c10ce574b887280476aba63d6682d5271)
2015-05-12 21:13:47 -07:00
Karthik Kambatla
e8dd0bc4fd YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)
(cherry picked from commit 70fb37cd79a7eba6818313960624380bacfe0bb2)
2015-05-09 14:35:13 -07:00
Xuan
8d07116266 YARN-2331. Distinguish shutdown during supervision vs. shutdown for
rolling upgrade. Contributed by Jason Lowe

(cherry picked from commit 088156de43abb07bec590a3fcd1a5af2feb02cd2)
2015-05-08 15:11:55 -07:00
Thomas Graves
638feaaa35 YARN-20. More information for yarn.resourcemanager.webapp.address in yarn-default.xml (Bartosz Ługowski vai tgraves)
(cherry picked from commit f0f5e3c0751bcadcacd6d91e2c5504803ec3d0a5)
2015-05-08 17:22:33 +00:00
Devaraj K
bf8be56292 YARN-2784. Make POM project names consistent. Contributed by Rohith. 2015-05-08 19:26:11 +05:30
Jason Lowe
bcb863b156 YARN-3554. Default value for maximum nodemanager connect wait time is too high. Contributed by Naganarasimha G R
(cherry picked from commit 9757864fd662b69445e0c600aedbe307a264982e)
2015-05-08 13:47:48 +00:00
Tsuyoshi Ozawa
b1f3590b22 YARN-3589. RM and AH web UI display DOCTYPE wrongly. Contbituted by Rohith.
(cherry picked from commit f26700f2878f4374c68e97ee00205eda5a6d022c)
2015-05-08 17:13:56 +09:00
Akira Ajisaka
67bebabb21 YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
(cherry picked from commit 995f1b5831fc33042de90267a689333dc110c4c3)
2015-05-07 13:33:17 +09:00
Xuan
02cdcaec58 YARN-2123. Progress bars in Web UI always at 100% due to non-US locale.
Contributed by Akira AJISAKA

(cherry picked from commit b7dd3a4f04f712b7594c4e6e7ce50fd314f7c342)
2015-05-05 10:45:18 -07:00
Tsuyoshi Ozawa
f382602de1 YARN-1993. Cross-site scripting vulnerability in TextView.java. Contributed byKenji Kikushima.
(cherry picked from commit e8d0ee5fc9af612d7abc9ab2c201434e7102d092)
2015-05-03 10:51:39 +09:00
Junping Du
8068e79989 YARN-2454. Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. Contributed by Xu Yang.
(cherry picked from commit 57d9a972cbd62aae0ab010d38a0973619972edd6)
2015-05-02 10:20:30 -07:00
tgraves
2e13183f60 YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves)
(cherry picked from commit 2e215484bd05cd5e3b7a81d3558c6879a05dd2d2)
2015-04-29 21:27:16 +00:00
Wangda Tan
8ee632caa7 YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda)
(cherry picked from commit db1b674b50ddecf2774f4092d677c412722bdcb1)
2015-04-27 16:42:36 -07:00
Vinod Kumar Vavilapalli
0ec6e7e7f5 YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv)
(cherry picked from commit f5fe35e297ed4a00a1ba93d090207ef67cebcc9d)
2015-04-23 11:25:30 -07:00
Jian He
48d8d88245 YARN-3522. Fixed DistributedShell to instantiate TimeLineClient as the correct user. Contributed by Zhijie Shen
(cherry picked from commit aa4a192feb8939353254d058c5f81bddbd0335c0)
2015-04-23 11:07:54 -07:00
Junping Du
8de6045842 New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K
(cherry picked from commit fad9d7e85b1ba0934ab592daa9d3c9550b2bb501)
2015-04-22 10:08:16 -07:00
Jian He
9827da95bc YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks
(cherry picked from commit 6779467ab6fcc6a02d0e8c80b138cc9df1aa831e)
2015-04-17 15:57:36 -07:00
Junping Du
b244701fad YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.
(cherry picked from commit 1db355a875c3ecc40a244045c6812e00c8d36ef1)
2015-04-17 13:20:27 -07:00
Akira Ajisaka
51c458a5c4 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
(cherry picked from commit 1fa8075794894b3e0053d251788277fb88e85533)
2015-04-16 10:06:03 -05:00
Jian He
6fed2c2a79 YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan
(cherry picked from commit 1b89a3e173f8e905074ed6714a7be5c003c0e2c4)
2015-04-15 14:03:29 -07:00
Harsh J
01af29106a YARN-3462. Patches applied for YARN-2424 are inconsistent between trunk and branch-2. Contributed by Naganarasimha G R. 2015-04-15 09:41:43 +05:30
Junping Du
a64b8915de YARN-3347. Improve YARN log command to get AMContainer logs as well as running containers logs. Contributed by Xuan Gong.
(cherry picked from commit a77d628339afaf2f5a085c73fd81a805b18348c9)
2015-04-13 17:41:02 -07:00
Jian He
d3daf9665c YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev 2015-04-10 10:40:31 -07:00
Wangda Tan
97244b143c YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda)
(cherry picked from commit 7af086a515d573dc90ea4deec7f4e3f23622e0e8)
2015-04-08 10:58:38 -07:00
Xuan
0522d6970d YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev

(cherry picked from commit d27e9241e8676a0edb2d35453cac5f9495fcd605)
2015-04-07 09:54:29 -07:00
Wangda Tan
405aead879 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
(cherry picked from commit bad070fe15a642cc6f3a165612fbd272187e03cb)
2015-04-02 17:23:44 -07:00
Wangda Tan
865be70b02 YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wangda)
(cherry picked from commit 492239424a3ace9868b6154f44a0f18fa5318235)
2015-04-01 10:15:47 -07:00
Vinod Kumar Vavilapalli
c980e34bc5 YARN-3304. Addendum patch. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. (Junping Du and Karthik Kambatla via vinodkv)
(cherry picked from commit 7610925e90155dfe5edce05da31574e4fb81b948)
2015-03-31 17:28:48 -07:00
Vinod Kumar Vavilapalli
c5bc48946d YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
(cherry picked from commit c358368f511963ad8e35f030b9babee541e1bd01)
2015-03-30 10:11:12 -07:00
Robert Kanter
6f0e864d61 YARN-3400. [JDK 8] Build Failure due to unreported exceptions in RPCUtil (rkanter)
(cherry picked from commit 87130bf6b22f538c5c26ad5cef984558a8117798)
2015-03-26 11:00:37 -07:00
Jian He
9c494cedaf YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan
(cherry picked from commit e1feb4ea1a532d680d6ca69b55ffcae1552d64f0)
2015-03-20 19:05:14 -07:00
Junping Du
9aedb3d688 YARN-3350. YARN RackResolver spams logs with messages at info level. Contributed by Wilfred Spiegelenburg
(cherry picked from commit 7f1e2f996995e1883d9336f720c27621cf1b73b6)
2015-03-20 18:22:23 -07:00