Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,468 Commits 326 Branches 371 Tags
Commit Graph

1608 Commits

Author SHA1 Message Date
Karthik Kambatla
d0d42c4e32 YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha) 
(cherry picked from commit b7f64823e11f745783607ae5f3f97b5e8e64c389)
 2014-12-17 16:34:33 -08:00
Karthik Kambatla
375a1e5971 YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance. (Chris Trezzo via kasha) 
(cherry picked from commit a1bd1409649da96c9fde4a9f9398d7711bc6c281)
 2014-12-17 16:25:02 -08:00
Karthik Kambatla
2d832ad2eb YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read locks. (Tsuyoshi Ozawa via kasha) 
(cherry picked from commit f2d150ea1205b77a75c347ace667b4cd060aaf40)
 2014-12-17 16:24:17 -08:00
Karthik Kambatla
300a665307 YARN-2189. Admin service for cache manager. Addendum to fix merge conflicts 2014-12-17 11:47:24 -08:00
cnauroth
36068768d8 HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth. 
(cherry picked from commit e996a1bfd4f3ada6cbd9633fe68fda1e0c910bdf)
 2014-12-16 15:32:23 -08:00
Jian He
878350a0e8 YARN-2762. Fixed RMAdminCLI to trim and check node-label related arguments before sending to RM. Contributed by Rohith Sharmaks 
(cherry picked from commit c65f1b382ec5ec93dccf459dbf8b2c93c3e150ab)
 2014-12-16 11:01:24 -08:00
Karthik Kambatla
b1ccf68db3 YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha) 
(cherry picked from commit e597249d361bbe8383fb9b564eacda7c990b781d)
 2014-12-15 12:00:46 -08:00
Jian He
d2356a552a Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai." 
This reverts commit 51af8d367de94689770f57c64bea3b244d7755f6.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit a4f2995b9ec8347612b7aeeb5a3a8b7191278790)
 2014-12-15 11:08:44 -08:00
Devaraj K
4c6760bc6b YARN-2356. yarn status command for non-existent application/application 
attempt/container is too verbose. Contributed by Sunil G.

(cherry picked from commit fae3e8614f4f9a42904e39c51ca68b0d1e67469f)
 2014-12-15 14:46:27 +05:30
Harsh J
da36252077 YARN-2950. Change message to mandate, not suggest JS requirement on UI. Contributed by Dustin Cote. 
(cherry picked from commit 0e37bbc8e3f8e96acd96522face2f4bb01584cb4)
 2014-12-13 07:27:37 +05:30
Steve Loughran
a858d726c8 YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel) 2014-12-12 17:10:54 +00:00
Devaraj K
10ff600b35 YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in 
SchedulerApplicationAttempt ctor. Contributed by Devaraj K.

(cherry picked from commit bda748ac3abf30f6cd4c0e22c80c73396abc59fb)
 2014-12-12 12:37:13 +05:30
Jian He
41f0d20fcb YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contributed by Rohith Sharmaks 
(cherry picked from commit 614b6afea450ebb897fbb2519c6f02e13b9bd12d)
 2014-12-11 11:18:45 -08:00
Jian He
b31dfb17d8 YARN-2924. Fixed RMAdminCLI to not convert node labels to lower case. Contributed by Wangda Tan 
(cherry picked from commit 437322afcaa4b1b260501af160283c97eb589419)
 2014-12-09 17:56:41 -08:00
Jian He
0f47e4e745 YARN-2930. Fixed TestRMRestart#testRMRestartRecoveringNodeLabelManager intermittent failure. Contributed by Wangda Tan 
(cherry picked from commit 2ed90a57fdd31d194b4a690df68b158ed9743dba)
 2014-12-09 16:48:46 -08:00
Karthik Kambatla
1986ea8dd2 YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg via kasha) 
(cherry picked from commit a2e07a54561a57a83b943628ebbc53ed5ba52718)
 2014-12-09 14:00:52 -08:00
Karthik Kambatla
9d72b0282f YARN-2931. PublicLocalizer may fail until directory is initialized by LocalizeRunner. (Anubhav Dhoot via kasha) 
(cherry picked from commit db73cc9124bb8511c1626ba40d3fad81e980e44f)
 2014-12-08 22:26:44 -08:00
Karthik Kambatla
d02cb9c512 YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha) 
(cherry picked from commit 120e1decd7f6861e753269690d454cb14c240857)
 2014-12-07 22:28:57 -08:00
Jian He
4cc0abe4fe YARN-2869. CapacityScheduler should trim sub queue names when parse configuration. Contributed by Wangda Tan 
(cherry picked from commit e69af836f34f16fba565ab112c9bf0d367675b16)
 2014-12-05 17:34:15 -08:00
Jason Lowe
b72fb6c774 YARN-2056. Disable preemption at Queue level. Contributed by Eric Payne 
(cherry picked from commit 4b130821995a3cfe20c71e38e0f63294085c0491)
 2014-12-05 21:08:14 +00:00
Robert Kanter
2ebd1bc654 YARN-2461. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration. (rchiang via rkanter) 
(cherry picked from commit 3c72f54ef581b4f3e2eb84e1e24e459c38d3f769)
 2014-12-05 12:10:20 -08:00
Karthik Kambatla
aadd0c392b YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha) 
(cherry picked from commit 78968155d7f87f2147faf96c5eef9c23dba38db8)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/bin/yarn
 2014-12-04 19:48:18 -08:00
Jian He
1d1e7682c9 YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R 
(cherry picked from commit 258623ff8bb1a1057ae3501d4f20982d5a59ea34)
 2014-12-04 12:53:52 -08:00
Jian He
58c971164c YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks 
(cherry picked from commit 73fbb3c66b0d90abee49c766ee9d2f05517cb9de)
 2014-12-03 17:17:40 -08:00
Harsh J
ee25c0d890 YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh) 
(cherry picked from commit 4b13318dea7a1cbbbfc1f84207af829cbe2f720e)
 2014-12-04 03:19:01 +05:30
Karthik Kambatla
25be97808b YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha) 
(cherry picked from commit 799353e2c7db5af6e40e3521439b5c8a3c5c6a51)
 2014-12-03 13:45:03 -08:00
Jason Lowe
db723a8499 MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov 
(cherry picked from commit 03ab24aa01ffea1cacf1fa9cbbf73c3f2904d981)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2014-12-03 17:12:47 +00:00
Junping Du
86535ff65f YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA) 
(cherry picked from commit e65b7c5ff6b0c013e510e750fe5cf59acfefea5f)
 2014-12-03 04:12:35 -08:00
Jian He
d6f3d4893d YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks 
(cherry picked from commit 392c3aaea8e8f156b76e418157fa347256283c56)
 2014-12-02 17:17:16 -08:00
Jian He
5067ac098b YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena 
(cherry picked from commit 52bcefca8bb13d3757009f1f08203e7dca3b1e16)
 2014-12-02 11:02:00 -08:00
Zhijie Shen
d21ef79707 YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai. 
(cherry picked from commit 51af8d367de94689770f57c64bea3b244d7755f6)
 2014-12-01 19:08:31 -08:00
Jian He
d208c90148 YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe 
(cherry picked from commit a7fba0bc28764e0fb36c335ea60cc58079fe007f)
 2014-12-01 16:45:17 -08:00
Jason Lowe
38ea1419f6 YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena 
(cherry picked from commit 0f9528b99addbb0fd9a19d84db22a8c8e934b05f)
 2014-12-01 22:30:20 +00:00
Junping Du
c7bd22974a YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith) 
(cherry picked from commit c732ed760e115192652280cd4b5799d49e62db7e)
 2014-12-01 05:41:56 -08:00
Zhijie Shen
a9adc1295c YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ. 
(cherry picked from commit 8f1454cc6d46afa057770a39aecc151c5f048b57)
 2014-11-26 12:12:42 -08:00
Karthik Kambatla
3d4536af82 YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha) 
(cherry picked from commit 834b3b98e7ecc4bfe93c7dd1a9e928e9653cf138)
 2014-11-25 16:22:14 -08:00
Jian He
ae35b0e14d YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe 
(cherry picked from commit 8a7ca13b13c0c3f008a6490cc96d4d48a051d1f7)
 2014-11-25 16:18:02 -08:00
Jian He
2863056530 YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 5805a81efbc024024d8172489dfdc6cf77879416)
 2014-11-25 12:51:03 -08:00
Zhijie Shen
57d62d4ded YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang. 
(cherry picked from commit e37a4ff0c1712a1cb80e0412ec53a5d10b8d30f9)
 2014-11-24 15:06:44 -08:00
Jason Lowe
89ef49fb08 YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena 
(cherry picked from commit 1ce4d33c2dc86d711b227a04d2f9a2ab696a24a1)
 2014-11-24 22:38:09 +00:00
Sandy Ryza
3e2e8eac22 YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) 2014-11-21 16:08:22 -08:00
Karthik Kambatla
af0b54a4ee YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha) 
(cherry picked from commit 233b61e495e136a843dabb7315bbb9ea37e7adce)
 2014-11-21 14:22:53 -08:00
Karthik Kambatla
e9db0aa35c YARN-2604. Scheduler should consider max-allocation-* in conjunction with the largest node. (Robert Kanter via kasha) 
(cherry picked from commit 3114d4731dcca7cb6c16aaa7c7a6550b7dd7dccb)
 2014-11-21 10:42:47 -08:00
Jonathan Eagles
6570f7fd72 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles) 
(cherry picked from commit c298a9a845f89317eb9efad332e6657c56736a4d)
 2014-11-20 23:40:26 -06:00
Karthik Kambatla
7ba5bb0c5b YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha) 
(cherry picked from commit a9a0cc3679432774154a07d3157ffa0a43e0bf01)
 2014-11-19 20:19:54 -08:00
Karthik Kambatla
564deb75a8 YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha) 
(cherry picked from commit f9f8e750edbe6db453f0a845e2ed49ede66e0e8a)
 2014-11-19 19:50:35 -08:00
Jian He
db31ef7e7f YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks 
(cherry picked from commit 9cb8b75ba57f18639492bfa3b7e7c11c00bb3d3b)
 2014-11-19 19:49:44 -08:00
Jian He
c359e2a6a4 YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. Contributed by Abin Shahab 
(cherry picked from commit bc4ee5e06f89b2037e0967f8ba91089ced4b7f0e)
 2014-11-19 14:45:01 -08:00
Zhijie Shen
610e123772 YARN-2870. Updated the command to run the timeline server it the document. Contributed by Masatake Iwasaki. 
(cherry picked from commit ef38fb9758f230c3021e70b749d7a11f8bac03f5)
 2014-11-18 16:17:07 -08:00
Karthik Kambatla
8df4c04c3a YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha) 
(cherry picked from commit 2fce6d61412843f0447f60cfe02326f769edae25)
 2014-11-17 16:46:18 -08:00