810 Commits

Author SHA1 Message Date
Li Lu
51162f9629 YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
gtcarrera9)
2016-02-24 13:52:11 -08:00
Sangjin Lee
432a2367ce YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
(cherry picked from commit 553b591ba06bbf0b18dca674d25a48218fed0a26)
2016-02-24 09:30:37 -08:00
Varun Vasudev
2c218ca8a8 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
(cherry picked from commit 140cb5d74565aad848b40a251ec02b597a3a20d4)
2016-02-23 12:32:16 +05:30
Zhe Zhang
56b7f2c2c1 HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:14:39 -08:00
Arun Suresh
6a238e4a6b YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)
(cherry picked from commit 23f937e3b718f607d4fc975610ab3a03265f0f7e)
2016-02-11 10:49:11 -08:00
Varun Vasudev
3a5b39e931 YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.
(cherry picked from commit fa00d3e20560bee412b49e5792595749a247a8ab)
2016-02-11 12:09:29 +05:30
Varun Vasudev
99966b1912 YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.
(cherry picked from commit 308d63f382e1992ea2b8ccf3130edaaa751c644d)
2016-02-04 13:33:38 +05:30
Devaraj K
43131af1e2 YARN-4100. Add Documentation for Distributed and Delegated-Centralized
Node Labels feature. Contributed by Naganarasimha G R.

(cherry picked from commit db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33)
2016-02-02 12:07:49 +05:30
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda)
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
2016-02-02 10:19:19 +08:00
Xuan
2f00d8d3a7 YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by
Li Lu

(cherry picked from commit 9fab22b36673e7f1a0bb629d2c07966ac2482e99)
2016-01-28 14:36:58 -08:00
Xuan
1d19557dda YARN-4496. Improve HA ResourceManager Failover detection on the client.
Contributed by Jian He

(cherry picked from commit 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)
2016-01-22 18:21:50 -08:00
Wangda Tan
23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)
2016-01-19 21:28:51 +08:00
Karthik Kambatla
ef59521094 YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)
(cherry picked from commit d40859fab1ad977636457a6cc96b6a4f9b903afc)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapred/TestTaskAttemptListenerImpl.java
2016-01-18 10:59:34 +01:00
Junping Du
4a30a44b11 YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe
(cherry picked from commit 02f597c5db36ded385413958bdee793ad7eda40e)
2016-01-17 17:38:42 -08:00
rohithsharmaks
d3c08cde68 YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 2016-01-15 22:46:21 +05:30
Wangda Tan
c0b97865e8 YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
(cherry picked from commit c0537bcd2c2dcdb4812fcab7badf42e4f55a54d9)
2016-01-13 13:19:01 +08:00
Jason Lowe
d164cdcda1 YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
(cherry picked from commit 13de8359a1c6d9fc78cd5013c860c1086d86176f)
2016-01-12 15:57:07 +00:00
Akira Ajisaka
df95343047 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
2016-01-12 13:34:44 +09:00
Gera Shegalov
8baf9369bb YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
(cherry picked from commit 2c17b81569c05b5f375d0ddad99d43cb4e3b23b1)
2015-12-24 23:52:43 -08:00
Junping Du
dbc4c79b44 YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
(cherry picked from commit bb5df272b9c0be9830ee8480cd33e75d26deb9d1)
2015-12-23 08:55:55 -08:00
Junping Du
6e97a3c968 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
(cherry picked from commit 882f2f04644a13cadb93070d5545f7a4f8691fde)
2015-12-23 05:27:47 -08:00
cnauroth
fdfcffb3d1 YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
(cherry picked from commit 114b59095540bb80db5153c816f9d285e4029031)
2015-12-21 16:59:17 -08:00
Wangda Tan
f16daa59a4 YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)
(cherry picked from commit bc038b382cb2ce561ce718405fbcee4382f3b204)
2015-12-21 11:30:37 -08:00
Jian He
1147b086d9 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:14:31 -08:00
Wangda Tan
2f5435acbd YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
2015-12-16 13:29:02 -08:00
Wangda Tan
9f4a6ec663 YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
2015-12-16 13:28:56 -08:00
Jian He
34e86d8d47 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:04 -08:00
Wangda Tan
9f979107c2 YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
(cherry picked from commit dfcbbddb0963c89c0455d41223427165b9f9e537)
2015-12-14 11:13:51 -08:00
Xuan
455c6f39c5 YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
(cherry picked from commit 21daa6c68a0bff51a14e748bf14d56b2f5a5580f)
2015-12-10 10:57:35 -08:00
Junping Du
0b5e76e9ff YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
(cherry picked from commit f910e4f639dc311fcb257bfcb869b1aa8b2c0643)
2015-12-10 02:57:46 -08:00
rohithsharmaks
04e056f4f5 YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)
(cherry picked from commit 01a641bc447c464b2830d58addd482f47dbd92ae)
2015-12-07 15:19:59 +05:30
Jian He
8a97ca4b00 Add missing file for YARN-4419 2015-12-03 19:11:07 -08:00
Jian He
be404e1680 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
(cherry picked from commit 755dda8dd8bb23864abc752bad506f223fcac010)
2015-12-03 17:46:09 -08:00
Jian He
23fe1abc02 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
(cherry picked from commit 9f77ccad735f4843ce2c38355de9f434838d4507)
2015-12-03 12:49:22 -08:00
Jian He
48cbde9083 YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding 2015-12-02 11:08:00 -08:00
Vinod Kumar Vavilapalli
b20e77eba3 Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0 2015-11-25 17:47:22 -08:00
Jason Lowe
3a2f5d6329 YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
(cherry picked from commit f5acf94ecafb301a0cc8e8f91f19c8bcbc8da701)
2015-11-24 23:47:54 +00:00
Jason Lowe
9e54433c6c YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li
(cherry picked from commit 4ac6799d4a8b071e0d367c2d709e84d8ea06942d)
2015-11-24 22:36:19 +00:00
Akira Ajisaka
ac0ddc4fec YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
(cherry picked from commit 8c0133f3d4c85733c1e0389d1ee39f1eab58c0b9)
2015-11-24 18:40:56 +09:00
Jian He
2cf084ac76 Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
This reverts commit a4ff03b200cf02a49ab81fa3c71cb707f6d2fee1.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-11-16 20:19:31 -08:00
Akira Ajisaka
f6f128c867 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
(cherry picked from commit 23d0db551cc63def9acbab2473e58fb1c52f85e0)
2015-11-11 16:13:50 +09:00
Jian He
a4ff03b200 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
(cherry picked from commit 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
2015-11-09 11:05:12 -08:00
Jian He
7d109ef5b5 YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
(cherry picked from commit c41699965e78ce5e87669d17923ab84e494c4188)
2015-10-29 00:01:20 -07:00
Wangda Tan
9bf1e74171 YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)
(cherry picked from commit 6f606214e734d9600bc0f25a63142714f0fea633)
2015-10-26 16:38:39 -07:00
Wangda Tan
baa2998e93 YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
(cherry picked from commit 3cc73773eb26f7469c99b25a76814d6fad0be28e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-10-26 13:12:56 -07:00
Rohith Sharma K S
33455fa415 YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)
(cherry picked from commit 5acdde4744c131e05db7b4b5f7d684fed7608b99)
2015-10-26 15:45:22 +05:30
Jonathan Eagles
6db7bfbcfd YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
(cherry picked from commit f8adeb712dc834c27cec15c04a986f2f635aba83)
2015-10-23 10:43:59 -05:00
Junping Du
d5145b58f6 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.
(cherry picked from commit 0fce5f9a496925f0d53ea6c14318c9b513de9882)
2015-10-22 13:42:12 -07:00
Jonathan Eagles
cc8093e5ac YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)
(cherry picked from commit 25f8f801d15e3d9f27f4a2a198262407203e14a5)
2015-10-21 15:38:48 -05:00
Varun Vasudev
196d549e2b YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.
(cherry picked from commit e39ae0e676f77fab216e2281ae946ab8c647733f)
2015-10-19 20:21:48 +05:30