Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,774 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

1382 Commits

Author SHA1 Message Date
Wangda Tan e081593042 YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda) 
(cherry picked from commit f47a5763ac)
(cherry picked from commit 3316cd4357)
(cherry picked from commit 24d45ee9544abcfcf9e611ab835ec2f824333670)
 2015-09-02 11:28:22 -07:00
Wangda Tan 61f2ddb125 YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed. (Jian He via wangda) 
(cherry picked from commit f65eeb412d)
(cherry picked from commit e7cbecddc3)
(cherry picked from commit 9d47d5aa5bffe427c4a77260f7ccc039d446e1fd)
 2015-09-02 11:14:35 -07:00
Vinod Kumar Vavilapalli 752e3da738 YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp. 
(cherry picked from commit 9c5911294e)
(cherry picked from commit 1ff3fd33ed)
(cherry picked from commit 82c722aae86669325672dd10840447434f15e7fd)
 2015-09-01 21:31:00 -07:00
Xuan 914cc8f4a4 YARN-3393. Getting application(s) goes wrong when app finishes before 
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26)
(cherry picked from commit cbdcdfad6d)
(cherry picked from commit 61aafdcfa589cbae8363976c745ea528b03f152d)
 2015-09-01 18:14:51 -07:00
Wangda Tan 005d865494 YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda) 
(cherry picked from commit 6bc7710ec7)
(cherry picked from commit 8e142d27cb)
(cherry picked from commit 4d43be3c01b1bc0deb31a9081fca5395d0eb4e0d)
 2015-09-01 17:10:42 -07:00
Jonathan Eagles a9bb641d51 YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles) 
(cherry picked from commit 8180e676ab)
(cherry picked from commit 44aedad5dd)
(cherry picked from commit f4bbf2c8f97d3601132504453f61e472950a433e)
 2015-09-01 16:04:19 -07:00
Zhijie Shen 9005b141a5 YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles. 
(cherry picked from commit d6e05c5ee2)
(cherry picked from commit a94d23762e)
(cherry picked from commit 68e07eb50b872ec8a78923df8f5f640f08a72aa2)
 2015-09-01 15:24:36 -07:00
Xuan a57ada6c1f YARN-3227. Timeline renew delegation token fails when RM user's TGT is 
expired. Contributed by Zhijie Shen

(cherry picked from commit d1abc5d4fc)
(cherry picked from commit 56c2050ab7)
(cherry picked from commit 780a9b1a98827a692e0ea9fbc92f9d1ab979e3e0)
 2015-09-01 15:21:46 -07:00
Jian He 7ffdf7d105 YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong 
(cherry picked from commit 95bfd087dc)

(cherry picked from commit a5f3fb4dc1)
(cherry picked from commit 27a2f0acb84202cc082090eef7eea57f6e42f9bb)
 2015-09-01 15:12:53 -07:00
Tsuyoshi Ozawa 81417f7572 YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi. 
(cherry picked from commit 1b67209612)
(cherry picked from commit 6660c2f83b)
(cherry picked from commit 6ea859e435e7cd6bc342f67e1551ccb86fbd976f)
 2015-09-01 14:37:21 -07:00
Wangda Tan 8b5bdac98e YARN-3230. Clarify application states on the web UI. (Jian He via wangda) 
(cherry picked from commit ce5bf927c3)
(cherry picked from commit a1963968d2)
(cherry picked from commit 591e261ccf1fb5dd25e87665c8d5c0341ff6fb24)
 2015-09-01 14:34:07 -07:00
Karthik Kambatla 5a6755cc0f YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha) 
(cherry picked from commit 8d88691d16)
(cherry picked from commit 0d62e94887)
(cherry picked from commit 4a5b0e708d42fbff571229a43d1762d1767e2db5)
 2015-09-01 14:06:34 -07:00
Karthik Kambatla dbc5bab9fd YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha) 
(cherry picked from commit 22426a1c9f)
(cherry picked from commit 721d7b5741)
(cherry picked from commit 5dfa25f22a989222e8b3d1013117b3350a48b2c5)
 2015-09-01 13:54:04 -07:00
Vinod Kumar Vavilapalli 2692401dfb YARN-3222. Added the missing CHANGES.txt entry. 
(cherry picked from commit 4620767156)
(cherry picked from commit 015696fb81)
 2015-09-01 13:49:04 -07:00
Jason Lowe a4b8897b30 YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params. Contributed by Jian He 
(cherry picked from commit 1a68fc4346)

(cherry picked from commit 257087417e)
(cherry picked from commit 49468108c203bf093acdc93c1798d90c480c3a17)
 2015-09-01 13:32:21 -07:00
Xuan 4fcf71c1e7 YARN-3238. Connection timeouts to nodemanagers are retried at multiple 
levels. Contributed by Jason Lowe

(cherry picked from commit 92d67ace32)
(cherry picked from commit fefeba4ac8)
(cherry picked from commit d8f02e1c5c3bcc230d942554b2f4cfbc3ed21526)
 2015-09-01 11:19:37 -07:00
Xuan 95edb6e64f YARN-3207. Secondary filter matches entites which do not have the key 
being filtered for. Contributed by Zhijie Shen

(cherry picked from commit 57db50cbe3)
(cherry picked from commit ba18adbb27)
(cherry picked from commit 9fd18e94849600ec66832df5ae424eeb0116330c)
 2015-08-31 17:44:42 -07:00
Zhijie Shen 28160a0bd6 YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K. 
(cherry picked from commit d5855c0e46)
(cherry picked from commit fd75b8c9ca)
(cherry picked from commit a62891971380e5f8e4a645ed36bd88aa6fe0e47a)
 2015-08-31 17:38:51 -07:00
Jian He a703952d39 YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong 
(cherry picked from commit 0af6a99a3f)

(cherry picked from commit 6146680955)
(cherry picked from commit ab654746fbad2da12b24b13425dc9bf17c46b50c)
 2015-08-31 17:17:47 -07:00
Jian He 8658945b3a YARN-3103. AMRMClientImpl does not update AMRM token properly. Contributed by Jason Lowe 
(cherry picked from commit 6d2bdbd7da)

(cherry picked from commit 12522fd9cb)
(cherry picked from commit f50f5ad49d3b70448647384fc5f020214cb58f10)
 2015-08-31 15:42:03 -07:00
Jian He 994c3d049a YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena 
(cherry picked from commit 4e15fc0841)

(cherry picked from commit 8100c8a68c)
(cherry picked from commit 10a6c4f349e6f32ed2a520bf669a0cbfff31c824)
 2015-08-31 15:38:45 -07:00
Jian He 3f8da2a9eb YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu 
(cherry picked from commit cc2a745f7e)

(cherry picked from commit e7e6173049)
(cherry picked from commit 3c4ed2497b14140f09b3cae4959be6474c4cdc99)
 2015-08-30 20:45:45 -07:00
Tsuyoshi Ozawa 03f9ac2de7 YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed by Rohith Sharmaks. 
(cherry picked from commit ddc5be48fc)
(cherry picked from commit c116743bdd)
(cherry picked from commit 3c9d26ae14625de3e9437c07eceda0d05f1985b2)
 2015-08-30 20:43:14 -07:00
Jian He e7fc071906 YARN-2992. ZKRMStateStore crashes due to session expiry. Contributed by Karthik Kambatla 
(cherry picked from commit 1454efe5d4)

(cherry picked from commit ca0349b87a)
(cherry picked from commit 2f6be218fa41fd0f39633ec5ed0df6e0fa0f54b6)
 2015-08-30 20:42:06 -07:00
Jian He 8cdcb792a1 YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharmaks 
(cherry picked from commit 0d89859b51)

(cherry picked from commit 8b398a66ca)
(cherry picked from commit 37f1789f419fa741c2fbae9855549d405e856bff)
 2015-08-30 20:40:09 -07:00
Jian He 6dfdcf094d YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks 
(cherry picked from commit 808cba3821)

(cherry picked from commit 9180d11b3b)
 2015-08-30 20:34:14 -07:00
Jason Lowe 17a23b8191 YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena 
(cherry picked from commit 1ce4d33c2d)

(cherry picked from commit 89ef49fb08)
 2015-08-30 20:25:39 -07:00
Jason Lowe 570d52e53c YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by Jian He 
(cherry picked from commit 0402bada19)

(cherry picked from commit 173664d70f)
(cherry picked from commit 04e71db1ce9572ae0641234a02b7db5d174668fd)
 2015-08-30 20:06:07 -07:00
Jian He 3d5627b563 YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contributed by Rohith Sharmaks 
(cherry picked from commit 614b6afea4)

(cherry picked from commit 41f0d20fcb)
(cherry picked from commit aa4f8184ee7aa1817a9b23b3b4e7e78da95dc031)
 2015-08-30 13:49:25 -07:00
Karthik Kambatla 6e954bc25c YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg via kasha) 
(cherry picked from commit a2e07a5456)
(cherry picked from commit 1986ea8dd2)
(cherry picked from commit 2b827a18d7b4eb41dc0095ea7277239273e7e396)
 2015-08-30 13:44:52 -07:00
Karthik Kambatla 7d686eccc3 YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha) 
(cherry picked from commit 799353e2c7)

(cherry picked from commit 25be97808b)
(cherry picked from commit d82bf536d44c6e7ba06a01105545b3979b731d80)
 2015-08-30 13:25:37 -07:00
Jian He 3600f30c35 YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks 
(cherry picked from commit 392c3aaea8)

(cherry picked from commit d6f3d4893d)
(cherry picked from commit 61efbc1cba0c4a81b8aafb1d45c2f7b3cf7857d8)
 2015-08-30 13:08:42 -07:00
Zhijie Shen 8a47d1aa55 YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai. 
(cherry picked from commit 51af8d367d)
(cherry picked from commit d21ef79707)
(cherry picked from commit db325c053c6ef3ee8731d7273d1d92da7e5deee7)
 2015-08-27 19:47:43 -07:00
Jason Lowe 2f0a34b5ba YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena 
(cherry picked from commit 0f9528b99a)

(cherry picked from commit 38ea1419f6)
(cherry picked from commit 3877166754956bf66a8b1c81440dba2d279a1e03)
 2015-08-27 19:27:24 -07:00
Jian He 888ab4a6e7 YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe 
(cherry picked from commit 8a7ca13b13)

(cherry picked from commit ae35b0e14d)
(cherry picked from commit 65acee3e19a147e5c5a8688319ab75357bdf51b5)
 2015-08-27 19:10:43 -07:00
Jian He 7f97189bcf YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks 
(cherry picked from commit 9cb8b75ba5)

(cherry picked from commit db31ef7e7f)
(cherry picked from commit e669974ae94c03914c9181a4481b4879fd4acc0d)
 2015-08-27 18:56:22 -07:00
Jason Lowe f307b426f3 YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan 
(cherry picked from commit 81c9d17af8)

(cherry picked from commit 242fd0e39a)
(cherry picked from commit a9d5acd898b34e1050a78f2d70ed62fdb82948a6)
 2015-08-27 18:36:50 -07:00
Jason Lowe f83d898944 YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu 
(cherry picked from commit 49c38898b0)

(cherry picked from commit ad140d1fc8)
(cherry picked from commit 85b23c323c80c5303bd0b7bdb066258792ca67d8)
 2015-08-27 18:32:59 -07:00
Jian He 81ba30211e YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks 
(cherry picked from commit d005404ef7)

(cherry picked from commit beb184ac58)
(cherry picked from commit 325bb33988743d60cb333002f9da60314241632e)
 2015-08-27 18:29:39 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 4239513ec0 Adding release 2.6.1 to CHANGES.txt 
(cherry picked from commit 7c796fd12c)
 2015-08-11 13:23:27 -07:00
Wangda Tan 881084fe5c YARN-3251. Fixed a deadlock in CapacityScheduler when computing absoluteMaxAvailableCapacity in LeafQueue (Craig Welch via wangda) 2015-02-26 17:05:25 -08:00
Tsuyoshi Ozawa 07b3329e3f Revert "CHANGES.txt: add YARN-2977" 
This reverts commit 3419091631.
 2014-12-21 12:47:30 +09:00
Tsuyoshi Ozawa 3419091631 CHANGES.txt: add YARN-2977 
(cherry picked from commit 76b0370a27)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-12-20 23:11:04 +09:00
Karthik Kambatla 5913c5143b Update release date for 2.5.2 
(cherry picked from commit 1e9a3f42ff)
 2014-11-21 14:35:06 -08:00
Jonathan Eagles a9b76813a2 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles) 
(cherry picked from commit c298a9a845)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-20 23:54:59 -06:00
Arun C. Murthy 98a4538cf4 Preparing to release hadoop-2.6.0-rc1. 
(cherry picked from commit 9ff7315cbe)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
 2014-11-13 13:05:50 -08:00
Arun C. Murthy 4e9b46da11 YARN-1964. Adding changelog back in. 2014-11-13 11:39:35 -08:00
Arun C. Murthy 32032ace21 YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1. 
(cherry picked from commit d648e60eba)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-13 10:40:33 -08:00
Arun C. Murthy f8892660a8 YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1. 
(cherry picked from commit 81dc0ac6dc)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-11-13 10:36:58 -08:00
Karthik Kambatla b579c3d405 YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha) 
(cherry picked from commit 80d11eb68e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestClientToAMTokens.java
 2014-11-13 10:36:13 -08:00