Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,217 Commits 326 Branches 371 Tags
Commit Graph

2271 Commits

Author SHA1 Message Date
Chris Douglas
c6b0bbabc7 HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl 
(cherry picked from commit a431ed9075cf6f467be5ff10f4ffb131cb1d3216)
 2015-07-13 15:36:25 -07:00
Jian He
27366dd7c3 Revert "YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)" 
This reverts commit aa067c6aa47b4c79577096817acc00ad6421180c.
(cherry picked from commit 2466460d4cd13ad5837c044476b26e63082c1d37)
 2015-07-13 14:31:55 -07:00
Akira Ajisaka
0ba2defb9e YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 19295b36d90e26616accee73b1f7743aab5df692)
 2015-07-13 17:53:27 +09:00
Wangda Tan
87360be089 YARN-3894. RM startup should fail for wrong CS xml NodeLabel capacity configuration. (Bibin A Chundatt via wangda) 
(cherry picked from commit 5ed1fead6b5ec24bb0ce1a3db033c2ee1ede4bb4)
 2015-07-12 21:53:08 -07:00
Akira Ajisaka
ad6787aa43 YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang. 
(cherry picked from commit d6675606dc5f141c9af4f76a37128f8de4cfedad)
 2015-07-13 12:57:29 +09:00
Gera Shegalov
896b8c6551 YARN-3917. getResourceCalculatorPlugin for the default should intercept all exceptions. (gera) 
(cherry picked from commit d7319dee37ea93f1a1ba4153ea63ea8010ba2441)
 2015-07-11 22:41:04 -07:00
Wangda Tan
c36090fd3f YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda) 
(cherry picked from commit 1df39c1efc9ed26d3f1a5887c31c38c873e0b784)
 2015-07-11 10:27:58 -07:00
Zhijie Shen
37a93c2d78 YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 1ea36299a47af302379ae0750b571ec021eb54ad)
 2015-07-10 19:02:13 -07:00
Ming Ma
b169889f01 YARN-3445. Cache runningApps in RMNode for getting running apps on given NodeId. (Junping Du via mingma) 
(cherry picked from commit 08244264c0583472b9c4e16591cfde72c6db62a2)
 2015-07-10 08:34:01 -07:00
Xuan
2a01495544 YARN-3888. ApplicationMaster link is broken in RM WebUI when appstate is 
NEW. Contributed by Bibin A Chundatt

(cherry picked from commit 52148767924baf423172d26f2c6d8a4cfc6e143f)
 2015-07-09 21:38:46 -07:00
Chris Douglas
66419d3672 HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl 
(cherry picked from commit 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)
 2015-07-09 17:48:56 -07:00
carlo curino
753d87066f YARN-3800. Reduce storage footprint for ReservationAllocation. Contributed by Anubhav Dhoot. 
(cherry picked from commit 0e602fa3a1529134214452fba10a90307d9c2072)
 2015-07-09 16:52:47 -07:00
Karthik Kambatla
fc989ebe16 HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha) 
(cherry picked from commit ac6048372a58b3a3b57cd5f2702b44a3d4667f3d)
 2015-07-09 09:59:02 -07:00
Karthik Kambatla
ccf18705f7 YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha) 
(cherry picked from commit aa067c6aa47b4c79577096817acc00ad6421180c)
 2015-07-09 09:48:46 -07:00
Karthik Kambatla
d15f69457b YARN-1012. Report NM aggregated container resource utilization in heartbeat. (Inigo Goiri via kasha) 
(cherry picked from commit 527c40e4d664c721b8f32d7cd8df21b2666fea8a)
 2015-07-09 09:35:39 -07:00
Varun Vasudev
d17a7bbf6e YARN-2194. Addendum patch to fix failing unit test in TestPrivilegedOperationExecutor. Contributed by Sidharta Seethana. 
(cherry picked from ad5b904175a1f89951c7c32f744a4e20fafb51b5)
 2015-07-09 11:52:57 +05:30
Akira Ajisaka
d260478d3a YARN-3690. [JDK8] 'mvn site' fails. Contributed by Brahma Reddy Battula. 
(cherry picked from commit d6325745e26d6acb0bbdb0972ce036297d66d5b0)
 2015-07-08 15:43:04 +09:00
Jian He
fa59b224b8 YARN-3892. Fixed NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails. Contributed by Bibin A Chundatt 
(cherry picked from commit c9dd2cada055c0beffd04bad0ded8324f66ad1b7)
 2015-07-07 14:18:16 -07:00
Varun Vasudev
16ca0fcf99 YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan. 
(cherry-picked from commit 7e3ebc0fc59dbd1d7768b5a6c05af18b8c8fea4d)
 2015-07-07 17:05:06 +05:30
Devaraj K
f558429efe YARN-3837. javadocs of TimelineAuthenticationFilterInitializer give wrong 
prefix for auth options. Contributed by Bibin A Chundatt.

(cherry picked from commit af63427c6d7d2fc251eafb1f152b7a90c5bd07e5)
 2015-07-07 12:08:03 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
a8bf34cad8 Release process for 2.7.1: Set the release date for 2.7.1. 
(cherry picked from commit bf89ddb9b8ca27a34074b415f85599dd48b8fc50)
 2015-07-06 16:41:00 -07:00
Xuan
09639ac6b4 YARN-3882. AggregatedLogFormat should close aclScanner and ownerScanner 
after create them. Contributed by zhihai xu

(cherry picked from commit 688617d6d7e6377a37682b5676b805cc6e8cf3f0)
 2015-07-04 21:54:22 -07:00
Devaraj K
e1ca886419 YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id 
properly in log. Contributed by Bibin A Chundatt.

(cherry picked from commit 37d7395773b5bb24aa522db38a2602df9a5ac184)
 2015-07-02 10:21:32 +05:30
Wangda Tan
d61dd10b50 YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda) 
(cherry picked from commit 0e4b06690ff51fbde3ab26f68fde8aeb32af69af)
 2015-07-01 17:32:57 -07:00
Jason Lowe
a721b9d812 YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena 
(cherry picked from commit b5cdf78e8e6cd6c5c1fb7286207dac72be32c0d6)
 2015-07-01 21:14:35 +00:00
Devaraj K
c343250657 YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a 
null attempt. Contributed by nijel.

(cherry picked from commit 80a68d60560e505b5f8e01969dc3c168a1e5a7f3)
 2015-07-01 19:05:27 +05:30
Devaraj K
3432017de0 YARN-3823. Fix mismatch in default values for 
yarn.scheduler.maximum-allocation-vcores property. Contributed by Ray
Chiang.

(cherry picked from commit 7405c59799ed1b8ad1a7c6f1b18fabf49d0b92b2)
 2015-07-01 11:12:43 +05:30
cnauroth
f7ba3c0045 HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu. 2015-06-30 16:55:10 -07:00
Colin Patrick Mccabe
b1da58d23d YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit d0cc0380b57db5fdeb41775bb9ca42dac65928b8)
 2015-06-30 16:24:44 -07:00
Gera Shegalov
f9b98082b8 YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera) 
(cherry picked from commit 6f2a41e37d0b36cdafcfff75125165f212c612a6)
 2015-06-30 15:05:01 -07:00
Jian He
484a6c0f01 YARN-3770. SerializedException should also handle java.lang.Error on de-serialization. Contributed by Lavkesh Lahngir 
(cherry picked from commit 4672315e2d6abe1cee0210cf7d3e8ab114ba933c)
 2015-06-29 14:32:22 -07:00
Jian He
0100995c5e YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti 
(cherry picked from commit 62e583c7dcbb30d95d8b32a4978fbdb3b98d67cc)
 2015-06-29 13:38:04 -07:00
Junping Du
dbd2b18205 YARN-3860. rmadmin -transitionToActive should check the state of non-target node. (Contributed by Masatake Iwasaki) 
(cherry picked from commit a95d39f9d08b3b215a1b33e77e9ab8a2ee59b3a9)
 2015-06-28 22:28:35 -07:00
Vinod Kumar Vavilapalli
4155bb565e Adding release 2.7.2 to CHANGES.txt. 
(cherry picked from commit aad6a7d5dba5858d6e9845f18c4baec16c91911d)
 2015-06-28 16:30:27 -07:00
Devaraj K
e163c1e0da YARN-3859. LeafQueue doesn't print user properly for application add. 
Contributed by Varun Saxena.

(cherry picked from commit b543d1a390a67e5e92fea67d3a2635058c29e9da)
 2015-06-28 10:06:08 +05:30
Xuan
1a8d162bc4 YARN-2871. TestRMRestart#testRMRestartGetApplicationList sometime fails 
in trunk. Contributed by zhihai xu

(cherry picked from commit fe6c1bd73aee188ed58df4d33bbc2d2fe0779a97)
 2015-06-26 19:45:00 -07:00
Jason Lowe
0221d19f4e YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena 
(cherry picked from commit 40b256949ad6f6e0dbdd248f2d257b05899f4332)
 2015-06-26 15:48:05 +00:00
Devaraj K
bb8a2cff2a YARN-3745. SerializedException should also try to instantiate internal 
exception with the default constructor. Contributed by Lavkesh Lahngir.

(cherry picked from commit b381f88c71d18497deb35039372b1e9715d2c038)
 2015-06-25 17:39:40 +05:30
Devaraj K
3e20f595d4 YARN-3826. Race condition in ResourceTrackerService leads to wrong 
diagnostics messages. Contributed by Chengbing Liu.

(cherry picked from commit 57f1a01eda80f44d3ffcbcb93c4ee290e274946a)
 2015-06-25 16:15:24 +05:30
Jonathan Eagles
d1f0ff165b YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles) 
(cherry picked from commit 4c659ddbf7629aae92e66a5b54893e9c1c68dfb0)
 2015-06-24 16:17:32 -05:00
rohithsharmaks
1619d8d62a Move YARN-3790 from 2.7.1 to 2.8 in CHANGES.txt 2015-06-24 23:31:09 +05:30
rohithsharmaks
1392d1ad94 YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks) 2015-06-24 23:00:25 +05:30
Jason Lowe
15b1800b12 YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula 
(cherry picked from commit 8d58512d6e6d9fe93784a9de2af0056bcc316d96)
 2015-06-24 16:38:22 +00:00
Jason Lowe
14afa5d53d YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong 
(cherry picked from commit 2a20dd9b61ba3833460cbda0e8c3e8b6366fc3ab)
 2015-06-24 16:24:43 +00:00
Robert Kanter
5c1e809af5 YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter) 
(cherry picked from commit 99271b762129d78c86f3c9733a24c77962b0b3f7)
 2015-06-22 18:03:00 -07:00
Karthik Kambatla
9656ee4ee7 YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha) 
(cherry picked from commit 5ebf2817e58e1be8214dc1916a694a912075aa0a)
 2015-06-22 17:48:07 -07:00
Xuan
c3254a63a9 YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth 
(cherry picked from commit 6c7a9d502a633b5aca75c9798f19ce4a5729014e)
 2015-06-21 17:14:59 -07:00
Gera Shegalov
34e744ce1a MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera) 
(cherry picked from commit 63d40d528654707b3f56619a4eb20e21cdeadc7e)
 2015-06-20 11:52:11 -07:00
Xuan
86b75ac544 YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes 
after NM is reconnected. Contributed by zhihai xu

(cherry picked from commit 5b5bb8dcdc888ba1ebc7e4eba0fa0e7e79edda9a)
 2015-06-18 14:38:52 -07:00
Devaraj K
3b9698ecac YARN-3824. Fix two minor nits in member variable properties of 
YarnConfiguration. Contributed by Ray Chiang.

(cherry picked from commit 2ad668748e2535e25e3b04656c29034d58074027)
 2015-06-18 16:46:33 +05:30