Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,676 Commits 326 Branches 371 Tags
Commit Graph

1715 Commits

Author SHA1 Message Date
Karthik Kambatla
a1ff0b4145 YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha) 
(cherry picked from commit 321072ba8114ed5ad2e9c5c2cfd7e1a54def6ebe)
 2016-01-13 12:09:58 -08:00
Wangda Tan
c0b97865e8 YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda) 
(cherry picked from commit c0537bcd2c2dcdb4812fcab7badf42e4f55a54d9)
 2016-01-13 13:19:01 +08:00
Jason Lowe
d164cdcda1 YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li 
(cherry picked from commit 13de8359a1c6d9fc78cd5013c860c1086d86176f)
 2016-01-12 15:57:07 +00:00
Akira Ajisaka
93b7ef8aec YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67. 
(cherry picked from commit da1e3e3c571e7cc76adff198bf433e3f23e8b683)
 2016-01-12 15:13:38 +09:00
Wangda Tan
15e174fe79 YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda) 
(cherry picked from commit 9e792da01419998c2ebfafd7161070150d85d3ac)
 2016-01-12 12:54:09 +08:00
Jian He
c4aed35200 Missing file for YARN-4580 2016-01-11 17:05:11 -08:00
Jian He
591e7fb221 YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S 
(cherry picked from commit b8942be888e1f6f7049398f3d0322602a58ee312)
 2016-01-11 16:45:14 -08:00
Jian He
d4ff8fd5d8 YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S 
(cherry picked from commit 109e528ef5d8df07443373751266b4417acc981a)
 2016-01-08 15:51:33 -08:00
Xuan
2cbbf76c3d YARN-4438. Implement RM leader election with curator. Contributed by Jian He 
(cherry picked from commit 89022f8d4bac0e9d0b848fd91e9c4d700fe1cdbe)
 2016-01-07 14:34:14 -08:00
Akira Ajisaka
3905435d3d YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi. 
(cherry picked from commit 52b77577c44538c26fb9d0144f0b280be3593a38)
 2016-01-08 01:13:30 +09:00
Steve Loughran
d9459ffa00 YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel) 2016-01-07 14:30:07 +00:00
rohithsharmaks
4865642e7c YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks) 
(cherry picked from commit 791c1639ae0b351e0bf0b2ecec854dc72ab07935)
 2016-01-07 09:39:37 +05:30
Junping Du
1cc001db4c YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe. 
(cherry picked from commit c1462a67ff7bb632df50e1c52de971cced56c6a3)
 2016-01-06 05:51:28 -08:00
rohithsharmaks
0492552f30 YARN-4535. Fix checkstyle error in CapacityScheduler.java (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 6da6d87872de518bb2583f65c9595f2090c855d7)
 2016-01-05 12:11:48 +05:30
Rohith Sharma K S
ae25e283cf YARN-4530. LocalizedResource trigger a NPE Cause the NodeManager exit. (tangshangwen via rohithsharmaks) 
(cherry picked from commit f9e36dea96f592d09f159e521379e426e7f07ec9)
 2016-01-04 10:04:27 +05:30
Wangda Tan
05fa852d75 YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda) 2015-12-30 15:36:55 -08:00
Wangda Tan
9a7d5f69ec YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda) 
(cherry picked from commit 8310b2e9ff3d6804bad703c4c15458b0dfeeb4af)
 2015-12-30 15:31:11 -08:00
Junping Du
401d1e6e8a YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S. 
(cherry picked from commit 223ce323bb81463ec5c5ac7316738370d4a47366)
 2015-12-30 07:53:08 -08:00
Jian He
3661d4907a YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong 
(cherry picked from commit 52734134116eb4b18686e308d00e71e7e903383e)
 2015-12-29 15:59:42 -08:00
Wangda Tan
3efbde5378 YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda) 
(cherry picked from commit 561abb9fee5f57f74c2b5868a065b818678622fa)
 2015-12-29 13:29:19 -08:00
Jian He
c7cc9d6bac YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan 
(cherry picked from commit d0a22bae9bd2c701c9d80896934fe07388cf5ae0)
 2015-12-28 15:54:14 -08:00
Gera Shegalov
8baf9369bb YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera) 
(cherry picked from commit 2c17b81569c05b5f375d0ddad99d43cb4e3b23b1)
 2015-12-24 23:52:43 -08:00
Karthik Kambatla
2f67645475 YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha) 
(cherry picked from commit 0af492b4bdb0356ea04e13690b78a236b82bd40c)
 2015-12-23 17:52:54 -08:00
Junping Du
6e97a3c968 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong. 
(cherry picked from commit 882f2f04644a13cadb93070d5545f7a4f8691fde)
 2015-12-23 05:27:47 -08:00
rohithsharmaks
08ddb536eb YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit 8c180a13c82ab9d60f595e6942e35d51024dab53)
 2015-12-23 09:16:58 +05:30
Arun Suresh
31893468b1 YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh) 
(cherry picked from commit e88422df45550f788ae8dd73aec84bde28012aeb)
 2015-12-21 22:41:49 -08:00
Wangda Tan
f16daa59a4 YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda) 
(cherry picked from commit bc038b382cb2ce561ce718405fbcee4382f3b204)
 2015-12-21 11:30:37 -08:00
Uma Mahesh
fc9e130825 YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh) 
(cherry picked from commit 0f82b5d878a76b1626c9e07b2fbb55ce2a79232a)
 2015-12-19 23:17:33 -08:00
Jian He
1147b086d9 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:14:31 -08:00
Junping Du
6d2914a697 YARN-3226. UI changes for decommissioning node. Contributed by Sunil G. 
(cherry picked from commit 1de56b0448d332717c8316c621b4f6af542a85cc)
 2015-12-17 15:21:42 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
d9b9a75928 YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev. 
(cherry picked from commit 4e7d32c0db69882cde854ef581056142a997c005)
 2015-12-17 12:13:56 -08:00
Jason Lowe
fad2c5b862 YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne 
(cherry picked from commit 91828fef6b9314f72d1f973f00e81404dc6bba91)
 2015-12-16 23:23:19 +00:00
Wangda Tan
5060fd1840 YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda) 
(cherry picked from commit 9b856d9787be5ec88ef34574b9b98755d7b669ea)
 2015-12-16 13:29:08 -08:00
Wangda Tan
2f5435acbd YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda) 
(cherry picked from commit 7faa406f27f687844c941346f59a27a375af3233)
 2015-12-16 13:29:02 -08:00
Wangda Tan
9f4a6ec663 YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda) 
(cherry picked from commit 79c41b1d83e981ae74cb8b58ffcf7907b7612ad4)
 2015-12-16 13:28:56 -08:00
Junping Du
1a2ef845b5 YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R. 
(cherry picked from commit 50bd067e1d63d4c80dc1e7bf4024bfaf42cf4416)
 2015-12-16 10:58:40 -08:00
Zhihai Xu
be50df687b YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun 
(cherry picked from commit 2aaed1032719e978660d1f14a8ed299e83b5f65e)
 2015-12-15 00:21:13 -08:00
Xuan
992f65dd8b YARN-4439. Clarify NMContainerStatus#toString method. Contributed by 
Jian He

(cherry picked from commit d8a45425eba372cdebef3be50436b6ddf1c4e192)
 2015-12-14 15:42:07 -08:00
Jian He
72544db3cd YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula 2015-12-14 14:59:18 -08:00
Jian He
34e86d8d47 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:04 -08:00
Wangda Tan
c915a658c8 YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda) 
(cherry picked from commit 07b0fb996a32020678bd2ce482b672f0434651f0)
 2015-12-14 11:25:00 -08:00
Wangda Tan
9f979107c2 YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda) 
(cherry picked from commit dfcbbddb0963c89c0455d41223427165b9f9e537)
 2015-12-14 11:13:51 -08:00
Wangda Tan
a1a723fdff YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda) 
(cherry picked from commit 6cb0af3c39a5d49cb2f7911ee21363a9542ca2d7)
 2015-12-14 10:54:20 -08:00
Arun Suresh
0bf328984a YARN-4358 addendum patch to fix javadoc error 
(cherry picked from commit 7fb212e5e672b3f285493f6c7b2598ef7e61406b)
 2015-12-12 22:25:59 -08:00
rohithsharmaks
81f8a2b008 YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks) 
(cherry picked from commit a5e2e1ecb06a3942903cb79f61f0f4bb02480f19)
 2015-12-09 11:33:49 +05:30
rohithsharmaks
f626d18cc3 YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks) 
(cherry picked from commit 15c3e7ffe3d1c57ad36afd993f09fc47889c93bd)
 2015-12-09 10:51:57 +05:30
Wangda Tan
7013f9d6cd YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda) 
(cherry picked from commit 7e4715186d31ac889fba26d453feedcebb11fc70)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-08 14:30:01 -08:00
Chris Douglas
bfe4796802 YARN-4248. Followup patch adding asf-licence exclusions for json test files 
(cherry picked from commit 9f50e13d5dc329c3a6df7f9bcaf2f29b35adc52b)
 2015-12-08 12:08:35 -08:00
=
4ac1564418 YARN-4248. REST API for submit/update/delete Reservations. (curino) 
(cherry picked from commit c25a6354598ec855bec7f695a7c3eed8794cd381)
 2015-12-07 13:38:38 -08:00
Jonathan Eagles
7c604c3d06 YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles) 
(cherry picked from commit 4ff973f96ae7f77cda3b52b38427e2991819ad31)
 2015-12-07 15:05:15 -06:00