Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,744 Commits 326 Branches 371 Tags
Commit Graph

2422 Commits

Author SHA1 Message Date
Varun Vasudev
a4288f1262 YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt. 
(cherry picked from commit 486d5cb803efec7b4db445ee65a3df83392940a3)
 2015-09-11 14:39:01 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
cbf90f93f9 Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.

(cherry picked from commit fbbb7ff1ed111884d0375c177239073153139848)
 2015-09-10 14:01:15 -07:00
Wangda Tan
5decd8f9f7 YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) 
(cherry picked from commit 77666105b4557d5706e5844a4ca286917d966c5f)
 2015-09-10 09:30:34 -07:00
Robert Kanter
ea64a9b277 YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter) 
(cherry picked from commit 6dd6ca442aba8612c3780399a42bb473e4483021)
 2015-09-09 18:03:47 -07:00
Zhihai Xu
214338bd68 YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe. 
(cherry picked from commit 16b9037dc1300b8bdbe54ba7cd47c53fe16e93d8)
 2015-09-08 12:33:29 -07:00
Varun Vasudev
1c53cd2b0d YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki. 
(cherry picked from commit 435f935ba7d8abb1a35796b72d1de906ded80592)
 2015-09-08 12:39:39 +05:30
Jian He
f23be93dd1 YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil 
(cherry picked from commit 6f72f1e6003ab11679bebeb96f27f1f62b3b3e02)
 2015-09-08 11:24:07 +08:00
Xuan
a0b7ef15d0 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when 
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d8c117c1e909df414f20d9db56efe4b)
 2015-09-07 17:46:48 -07:00
Xuan
d983e55714 Modify the CHANGES.txt to move YARN-2019 Commit log from branch 2.8 to 
branch 2.7.2

(cherry picked from commit 6a5068970567817af78d6ec2dfe474b09533a8d2)
 2015-09-07 17:30:25 -07:00
Varun Vasudev
70575286b7 YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir. 
(cherry picked from commit 1dbd8e34a7d97c4d8586da79c980d8f2e0aad61d)
 2015-09-07 11:34:14 +05:30
Wangda Tan
9f97b86816 YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda) 
(cherry picked from commit bcc85e3bab78bcacd430eac23141774465b96ef9)
 2015-09-04 15:14:34 -07:00
Jason Lowe
6a5220cab3 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 
(cherry picked from commit 6eaca2e3634a88dc55689e8960352d6248c424d9)
 2015-09-04 15:31:37 +00:00
Varun Vasudev
64c2e8011e YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles. 
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
 2015-09-04 14:32:07 +05:30
Varun Vasudev
a53054c853 YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R. 
(cherry picked from commit 223a306da925ad031bc398f2ea5e56f0e6521edf)
 2015-09-03 16:40:42 +05:30
Jian He
cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 09c64ba1ba8be7a2ac31f4e42efb8c99b682399f)
 2015-09-02 17:46:04 -07:00
Rohith Sharma K S
6e41aa64a5 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 7d6687fe76f6152a577ff2298c358dd30fce41fb)
 2015-09-02 15:27:33 +05:30
Rohith Sharma K S
7ecdf51441 YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 095ab9ab5fa5f415fba41fee81b6008cf0455af8)
 2015-09-02 14:28:50 +05:30
Vinod Kumar Vavilapalli
acb3000187 YARN-3222. Added the missing CHANGES.txt entry. 
(cherry picked from commit 4620767156ecc43424bc6c7c4d50519e2563cc69)
 2015-09-01 13:44:10 -07:00
Andrew Wang
7d833a3058 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder. 
(cherry picked from commit 0eb9b1932590ba6c60ac996d03269dffb4e095cc)
 2015-09-01 10:59:39 -07:00
Tsuyoshi Ozawa
d3d65f62b3 YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R. 
(cherry picked from commit faa38e1aa49907254bf981662a8aeb5dc52e75e3)
 2015-09-01 17:55:53 +09:00
Varun Vasudev
855e0f8b00 YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan. 
(cherry picked from commit bf669b6d9f8ba165e30b8823218d625a49958925)
 2015-09-01 14:20:54 +05:30
Jian He
21b478e1bf Move YARN-4092 to 2.7.2 
(cherry picked from commit 4eaa7fd3eae4412ac0b964c617b1bbb17a39d8be)
 2015-08-31 17:44:04 -07:00
Jian He
48f5161cd5 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 
(cherry picked from commit a3fd2ccc869dfc1f04d1cf0a8678d4d90a43a80f)
 2015-08-31 17:34:49 -07:00
Vinod Kumar Vavilapalli
0191dae2ec YARN-2945. Fixing the CHANGES.txt to have the right JIRA number. 
(cherry picked from commit cf831565e8344523e1bd0eaf686ed56a2b48b920)
 2015-08-30 20:02:36 -07:00
Junping Du
792b9c0eaf YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang. 
(cherry picked from commit beb65c9465806114237aa271b07b31ff3c1f4404)
 2015-08-28 05:58:45 -07:00
Jian He
306c535395 YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit a9c8ea71aa427ff5f25caec98be15bc880e578a7)
 2015-08-27 13:27:34 -07:00
Andrew Wang
7a668981f5 HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin. 
(cherry picked from commit 90fe7bcc3b30f8497d7a5124c91c5aea28f2fccb)
 2015-08-27 10:17:04 -07:00
Jian He
387076894f YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit 57c7ae1affb2e1821fbdc3f47738d7e6fd83c7c1)
 2015-08-24 20:37:18 -07:00
Rohith Sharma K S
6dc732f2f7 YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks) 
(cherry picked from commit feaf0349949e831ce3f25814c1bbff52f17bfe8f)
 2015-08-24 11:30:46 +05:30
Xuan
85363ea4bd YARN-221. Addendum patch to compilation issue which is caused by missing 
AllContainerLogAggregationPolicy. Contributed by Xuan Gong

(cherry picked from commit b71c6006f579ac6f0755975a9b908b0062618b46)
 2015-08-23 16:50:02 -07:00
Xuan
205b98c059 YARN-221. NM should provide a way for AM to tell it not to aggregate 
logs. Contributed by Ming Ma

(cherry picked from commit 37e1c3d82a96d781e1c9982988b7de4aa5242d0c)
 2015-08-22 16:26:39 -07:00
Rohith Sharma K S
27ced8253b YARN-3986. getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface 
(cherry picked from commit 22de7c1dca1be63d523de833163ae51bfe638a79)
 2015-08-21 10:56:45 +05:30
Vinod Kumar Vavilapalli
9da81a3955 MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du. 2015-08-20 17:35:24 -07:00
Vinod Kumar Vavilapalli
45be1240d9 Creating 2.6.2 entries in CHANGES.txt files. 
(cherry picked from commit 33474939a048ac7bbe07df772f0000c84979722f)
 2015-08-20 17:23:54 -07:00
Wangda Tan
6452b31760 YARN-2923. Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup. (Naganarasimha G R) 
(cherry picked from commit fc07464d1a48b0413da5e921614430e41263fdb7)
 2015-08-20 16:52:57 -07:00
Karthik Kambatla
b567aa2b4f YARN-4055. Report node resource utilization in heartbeat. (Inigo Goiri via kasha) 
(cherry picked from commit 13604bd5f119fc81b9942190dfa366afad61bc92)
 2015-08-20 16:52:33 -07:00
Xuan
fc6b176e70 YARN-4028. AppBlock page key update and diagnostics value null on 
recovery. Contributed by Bibin A Chundatt

(cherry picked from commit 22dc5fc20942a8d98333ed5470b5fb8c1d257f1a)
 2015-08-18 22:54:01 -07:00
Zhihai Xu
051a622b57 YARN-4057. If ContainersMonitor is not enabled, only print related log info one time. Contributed by Jun Gong. 
(cherry picked from commit 14215c8ef83d58b8443c52a3cb93e6d44fc87065)
 2015-08-18 11:47:41 -07:00
Zhihai Xu
8f2eb99d71 YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao. 
(cherry picked from commit 3a76a010b85176f2bcb85ed6f74c25dcb8acfe4d)
 2015-08-18 10:53:16 -07:00
Karthik Kambatla
d2ff763533 YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha) 
(cherry picked from commit def12933b38efd5e47c5144b729c1a1496f09229)
 2015-08-16 06:26:21 -07:00
Jian He
b2e869f2a8 YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee 
(cherry picked from commit 0a030546e24c55662a603bb63c9029ad0ccf43fc)
 2015-08-13 16:23:30 -07:00
Jian He
703fa1b141 YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe 
(cherry picked from commit 7a445fcfabcf9c6aae219051f65d3f6cb8feb87c)
 2015-08-13 16:13:28 -07:00
Jian He
4a5fdb7c23 YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong 
(cherry picked from commit 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb)
 2015-08-13 14:46:34 -07:00
Robert Kanter
fbcfca6f91 YARN-4031. Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer (djp via rkanter) 
(cherry picked from commit dc2340c60e33f903f8fd34958ec746c989016191)
 2015-08-12 15:48:14 -07:00
Jian He
65d22b3686 YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan 
(cherry picked from commit e5003be907acef87c2770e3f2914953f62017b0e)
 2015-08-12 15:09:46 -07:00
rohithsharmaks
c5b20e0db6 YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks) 
(cherry picked from commit 1c12adb71f32f24ec525313ff8dfcd2b738fc8e2)
 2015-08-12 14:47:23 +05:30
Xuan
2ebdf5bfce YARN-3999. RM hangs on draing events. Contributed by Jian He 
(cherry picked from commit 3ae716fa696b87e849dae40225dc59fb5ed114cb)
 2015-08-11 18:26:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3dcff42437 Adding release 2.6.1 to CHANGES.txt 
(cherry picked from commit 7c796fd12ca5092d74e6cc7044f28496f9884983)
 2015-08-11 13:21:41 -07:00
Jian He
df97e3265b YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G 
(cherry picked from commit fa1d84ae2739a1e76f58b9c96d1378f9453cc0d2)
 2015-08-10 20:52:18 -07:00
Wangda Tan
380d401da5 YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda) 
(cherry picked from commit cf9d3c925608e8bc650d43975382ed3014081057)
 2015-08-10 14:58:19 -07:00