688 Commits

Author SHA1 Message Date
Chris Douglas
878924189d YARN-4976. Missing NullPointer check in ContainerLaunchContextPBImpl. Contributed by Giovanni Matteo Fumarola
(cherry picked from commit 95a50466075c28110fa7c297e9c5246892076ca8)
2016-04-21 10:46:35 -07:00
Vinod Kumar Vavilapalli
342bb438f2 Fixed TimelineClient to retry SocketTimeoutException too. Contributed by Xuan Gong.
(cherry picked from commit 477003730e6a7c7eff11892f5cedf74073ca867b)
2016-04-18 11:49:00 -07:00
Xuan
94e4d349b0 YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du
(cherry picked from commit e6c0742012ffeacad2bcaf712d86a7e5d1420b26)
2016-04-16 19:40:11 -07:00
Naganarasimha
2213a40f30 YARN-4909. Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter. Contributed by Bibin A Chundatt
(cherry picked from commit fdbafbc9e59314d9f9f75e615de9d2dfdced017b)
2016-04-15 23:40:07 +05:30
Rohith Sharma K S
d93cfefea5 YARN-4897. dataTables_wrapper change min height. Contributed by Bibin A Chundatt.
(cherry picked from commit 4ee7f0a3e7814d66d6e11aa4b559da5ac93c4b99)
2016-04-12 10:28:18 +05:30
Jason Lowe
f1a370ce8b Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla"
This reverts commit 814ceeb4893ad9ed903ebcfd30fe3158ec1c71df.
2016-04-11 15:56:29 +00:00
Akira Ajisaka
8cf6630fc6 YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 1ff27f9d12e8124c1b9a722708264c5b07fd0fde)
2016-04-11 14:55:37 +09:00
Varun Vasudev
4baee3eb67 YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.
(cherry picked from commit 07920acc165f17e8fe3ca9d21283a2123223f438)
2016-04-11 09:40:28 +05:30
Jason Lowe
814ceeb489 YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
(cherry picked from commit 1cbcd4a491e6a57d466c2897335614dc6770b475)
2016-04-05 13:41:18 +00:00
naganarasimha
3772602848 YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt
(cherry picked from commit 5092c94195a63bd2c3e36d5a74b4c061cea1b847)
2016-04-04 18:08:18 +05:30
Karthik Kambatla
ecfd25dc65 YARN-4657. Javadoc comment is broken for Resources.multiplyByAndAddTo(). (Daniel Templeton via kasha)
(cherry picked from commit 81d04cae41182808ace5d86cdac7e4d71871eb1e)
2016-04-01 16:20:18 -07:00
Arun Suresh
f56266fccc Missing file for YARN-4895.
(cherry picked from commit 5686caa9fcb59759c9286385575f31e407a97c16)
2016-04-01 15:58:38 -07:00
Varun Vasudev
10d8f8a39c Revert "YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki."
This reverts commit 0064cba169d1bb761f6e81ee86830be598d7c500.

(cherry picked from commit 3488c4f2c9767684eb1007bb00250f474c06d5d8)
2016-04-01 12:21:49 +05:30
Sangjin Lee
b91928cd26 YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)
(cherry picked from commit 6d67420dbc5c6097216fa40fcec8ed626b2bae14)
2016-03-31 10:49:45 -07:00
Varun Vasudev
dcad99892d YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki.
(cherry picked from commit 0064cba169d1bb761f6e81ee86830be598d7c500)
2016-03-31 14:06:45 +05:30
Jason Lowe
3cea00a294 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong
(cherry picked from commit e8fc81f9c812b0c167411de7f1789a9a433a0d57)
2016-03-25 20:19:15 +00:00
Junping Du
76602161c0 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.
(cherry picked from commit af1d125f9ce35ec69a610674a1c5c60cc17141a7)
2016-03-23 08:58:05 -07:00
Karthik Kambatla
95b59c17a7 YARN-4732. *ProcessTree classes have too many whitespace issues
(cherry picked from commit 7fae4c68e6d599d0c01bb2cb2c8d5e52925b3e1e)
2016-03-20 10:47:56 -07:00
Xuan
398dbde538 Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)"
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
2016-03-15 22:11:16 -07:00
Li Lu
94649b9cc0 YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9)
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
2016-03-15 11:48:37 -07:00
Li Lu
14a4110b75 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
2016-03-15 11:42:30 -07:00
Siddharth Seth
edd9abf302 YARN-4816. Fix incompatible change in SystemClock.
(cherry picked from commit eba66a64d28b50a660d6f537c767677f5fa0f7ea)
2016-03-14 20:15:41 -07:00
Junping Du
3d5ac829da YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du
(cherry picked from commit f291d82cd49c04a81380bc45c97c279d791b571c)
2016-03-14 08:30:07 -07:00
Li Lu
76ef097fd1 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)
(cherry-picked from commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec)
2016-03-10 10:56:51 -08:00
Varun Vasudev
e9a0ffc7f1 YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.
(cherry picked from commit 43416187c07afb35e3267f94d0a41d8d3cfb5735)
2016-03-07 15:23:36 +05:30
Robert Kanter
872b8d90a6 YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)
(cherry picked from commit d7fdec1e6b465395d2faca6e404e329d20f6c3d8)
2016-02-25 16:40:05 -08:00
Robert Kanter
ec48848711 YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter)
(cherry picked from commit c4d4df8de09ee0c89ea8176bd8149900becd3c0c)
2016-02-25 12:48:29 -08:00
Robert Kanter
c2098d2470 YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)
(cherry picked from commit 954dd57043d2de4f962876c1b89753bfc7e4ce55)
2016-02-24 15:00:48 -08:00
Li Lu
51162f9629 YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via
gtcarrera9)
2016-02-24 13:52:11 -08:00
Sangjin Lee
432a2367ce YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)
(cherry picked from commit 553b591ba06bbf0b18dca674d25a48218fed0a26)
2016-02-24 09:30:37 -08:00
Varun Vasudev
2c218ca8a8 YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.
(cherry picked from commit 140cb5d74565aad848b40a251ec02b597a3a20d4)
2016-02-23 12:32:16 +05:30
Zhe Zhang
56b7f2c2c1 HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:14:39 -08:00
Arun Suresh
6a238e4a6b YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)
(cherry picked from commit 23f937e3b718f607d4fc975610ab3a03265f0f7e)
2016-02-11 10:49:11 -08:00
Varun Vasudev
3a5b39e931 YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.
(cherry picked from commit fa00d3e20560bee412b49e5792595749a247a8ab)
2016-02-11 12:09:29 +05:30
Varun Vasudev
99966b1912 YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.
(cherry picked from commit 308d63f382e1992ea2b8ccf3130edaaa751c644d)
2016-02-04 13:33:38 +05:30
Devaraj K
43131af1e2 YARN-4100. Add Documentation for Distributed and Delegated-Centralized
Node Labels feature. Contributed by Naganarasimha G R.

(cherry picked from commit db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33)
2016-02-02 12:07:49 +05:30
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda)
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
2016-02-02 10:19:19 +08:00
Xuan
2f00d8d3a7 YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by
Li Lu

(cherry picked from commit 9fab22b36673e7f1a0bb629d2c07966ac2482e99)
2016-01-28 14:36:58 -08:00
Xuan
1d19557dda YARN-4496. Improve HA ResourceManager Failover detection on the client.
Contributed by Jian He

(cherry picked from commit 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)
2016-01-22 18:21:50 -08:00
Wangda Tan
23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)
2016-01-19 21:28:51 +08:00
Karthik Kambatla
ef59521094 YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)
(cherry picked from commit d40859fab1ad977636457a6cc96b6a4f9b903afc)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapred/TestTaskAttemptListenerImpl.java
2016-01-18 10:59:34 +01:00
Junping Du
4a30a44b11 YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe
(cherry picked from commit 02f597c5db36ded385413958bdee793ad7eda40e)
2016-01-17 17:38:42 -08:00
rohithsharmaks
d3c08cde68 YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks) 2016-01-15 22:46:21 +05:30
Wangda Tan
c0b97865e8 YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
(cherry picked from commit c0537bcd2c2dcdb4812fcab7badf42e4f55a54d9)
2016-01-13 13:19:01 +08:00
Jason Lowe
d164cdcda1 YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
(cherry picked from commit 13de8359a1c6d9fc78cd5013c860c1086d86176f)
2016-01-12 15:57:07 +00:00
Akira Ajisaka
df95343047 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
2016-01-12 13:34:44 +09:00
Gera Shegalov
8baf9369bb YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
(cherry picked from commit 2c17b81569c05b5f375d0ddad99d43cb4e3b23b1)
2015-12-24 23:52:43 -08:00
Junping Du
dbc4c79b44 YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
(cherry picked from commit bb5df272b9c0be9830ee8480cd33e75d26deb9d1)
2015-12-23 08:55:55 -08:00
Junping Du
6e97a3c968 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
(cherry picked from commit 882f2f04644a13cadb93070d5545f7a4f8691fde)
2015-12-23 05:27:47 -08:00
cnauroth
fdfcffb3d1 YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
(cherry picked from commit 114b59095540bb80db5153c816f9d285e4029031)
2015-12-21 16:59:17 -08:00