Devaraj K
123269c07f
YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws
...
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.
(cherry picked from commit a277bdc9ed
)
2016-01-29 13:52:47 +05:30
Rohith Sharma K S
b8d5df06f2
YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks)
...
(cherry picked from commit ac68666803
)
2016-01-29 12:30:53 +05:30
Rohith Sharma K S
0466743afb
YARN-4219. addendum patch to fix javadoc errors
...
(cherry picked from commit 09d831c95b
)
2016-01-29 11:53:06 +05:30
Jian He
36f0e73882
YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding
2016-01-28 14:52:00 -08:00
Xuan
2f00d8d3a7
YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by
...
Li Lu
(cherry picked from commit 9fab22b366
)
2016-01-28 14:36:58 -08:00
Jason Lowe
29195c7668
YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana
...
(cherry picked from commit 61382ff8fa
)
2016-01-28 19:00:51 +00:00
Rohith Sharma K S
6947a5d4be
YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks)
...
(cherry picked from commit ef343be82b
)
2016-01-28 21:55:12 +05:30
Karthik Kambatla
c25154576b
YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha)
...
(cherry picked from commit fb238d7e5d
)
2016-01-27 12:29:25 -08:00
Rohith Sharma K S
0b8767e01a
YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)
...
(cherry picked from commit c01bee0108
)
2016-01-27 08:24:37 +05:30
Xuan
69f3fa71a2
YARN-4612. Fix rumen and scheduler load simulator handle killed tasks
...
properly. Contributed by Ming Ma.
(cherry picked from commit 4efdf3a979
)
2016-01-26 18:18:03 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
47b20d0c74
YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev.
...
(cherry picked from commit 2085e60a96
)
2016-01-25 16:22:47 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
97f6cfa94b
Release process for 2.7.2: Set the release date for 2.7.2
...
(cherry picked from commit ec4d2d9f40
)
2016-01-25 15:47:02 -08:00
Jian He
2d236c9de2
YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee
2016-01-25 15:36:40 -08:00
Akira Ajisaka
02d4a1fce3
YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li.
...
(cherry picked from commit 56a0c17508
)
2016-01-25 15:20:45 +09:00
rohithsharmaks
7e66b2f22c
YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks)
...
(cherry picked from commit 10dc2c0493
)
2016-01-24 23:37:11 +05:30
rohithsharmaks
280c9b8401
YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks)
...
(cherry picked from commit 99829eb221
)
2016-01-23 07:58:16 +05:30
Xuan
1d19557dda
YARN-4496. Improve HA ResourceManager Failover detection on the client.
...
Contributed by Jian He
(cherry picked from commit 618bfd6ac2
)
2016-01-22 18:21:50 -08:00
Jason Lowe
635849fa45
YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen
...
(cherry picked from commit 46e5ea81e0
)
2016-01-22 21:55:59 +00:00
Jason Lowe
ad84f90e88
YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G
...
(cherry picked from commit e91e8b711c
)
2016-01-22 21:37:08 +00:00
rohithsharmaks
1cec12d95a
YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks)
...
(cherry picked from commit 34a3900773
)
2016-01-22 21:18:42 +05:30
rohithsharmaks
493275b27b
YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks)
...
(cherry picked from commit d6258b33a7
)
2016-01-22 20:29:10 +05:30
Akira Ajisaka
ddc22bbcb1
YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.
...
(cherry picked from commit 8f58f742ae
)
2016-01-22 19:43:37 +09:00
Varun Vasudev
85561207f9
YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana.
...
(cherry picked from commit b41a7e89d1
)
2016-01-22 14:44:22 +05:30
Rohith Sharma K S
844a8e3771
YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks)
...
(cherry picked from commit e30668106d
)
2016-01-22 10:20:09 +05:30
Jason Lowe
d051200a62
YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe
...
(cherry picked from commit 468a53b22f
)
2016-01-21 18:32:47 +00:00
Akira Ajisaka
bf4901c609
YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki.
...
(cherry picked from commit d3224e2d6274daf73a103c0dbe21ba69add7ca26)
2016-01-22 02:14:53 +09:00
Karthik Kambatla
5c2f495fcc
YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha)
...
(cherry picked from commit 4992398aee
)
2016-01-21 17:43:49 +01:00
Jason Lowe
4e6fc3ca18
YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R
...
(cherry picked from commit f858ac2426
)
2016-01-21 15:39:51 +00:00
Wangda Tan
9512866740
YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda)
...
(cherry picked from commit c9fe0371a8ab40c0d3437fadd32788b320788a7a)
2016-01-21 11:16:58 +08:00
Xuan
66b030f608
YARN-4611. Fix scheduler load simulator to support multi-layer network
...
location. Contributed by Ming Ma.
(cherry picked from commit 1708a4cd23
)
2016-01-20 15:43:02 -08:00
Xuan
be3322792f
YARN-4559. Make leader elector and zk store share the same curator
...
client. Contributed by Jian He
(cherry picked from commit 890a2ebd1a
)
2016-01-20 14:49:04 -08:00
Wangda Tan
23deeb4230
HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
...
(cherry picked from commit 89d1fd5dac
)
2016-01-19 21:28:51 +08:00
Jian He
bb2a9a78c0
YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan
2016-01-18 21:05:03 -08:00
Wangda Tan
704b37d0e1
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
...
(cherry picked from commit a44ce3f14f
)
2016-01-19 09:31:13 +08:00
Wangda Tan
1625281ccb
Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
...
This reverts commit 3fe5728563
.
Conflicts:
hadoop-yarn-project/CHANGES.txt
(cherry picked from commit 150f5ae034
)
2016-01-19 09:31:07 +08:00
Jian He
6db022fc48
YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu
2016-01-18 16:59:04 -08:00
rohithsharmaks
da887e4252
YARN-4265 Addendum patch to fix compilation issue caused by project version number
2016-01-18 16:38:41 +05:30
Karthik Kambatla
ef59521094
YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)
...
(cherry picked from commit d40859fab1
)
Conflicts:
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapred/TestTaskAttemptListenerImpl.java
2016-01-18 10:59:34 +01:00
Wangda Tan
c56d46307a
Move YARN-4524 from 2.9 to 2.8
2016-01-18 17:04:41 +08:00
Wangda Tan
552f15739c
YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda)
...
(cherry picked from commit b08ecf5c75
)
2016-01-18 11:16:04 +08:00
Wangda Tan
6dab78c71a
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
...
(cherry picked from commit 805a9ed85e
)
2016-01-18 11:15:59 +08:00
Wangda Tan
c1193b46d4
YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda)
...
(cherry picked from commit 9523648d57
)
2016-01-18 11:15:53 +08:00
Junping Du
4a30a44b11
YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe
...
(cherry picked from commit 02f597c5db
)
2016-01-17 17:38:42 -08:00
Colin Patrick Mccabe
48b8c99479
HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
...
(cherry picked from commit b2c155f810
)
2016-01-15 13:22:14 -08:00
rohithsharmaks
d3c08cde68
YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)
2016-01-15 22:46:21 +05:30
Junping Du
e09222306f
YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee.
...
(cherry picked from commit fc6d3a3b23
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2016-01-15 08:43:30 -08:00
Colin Patrick Mccabe
cea1c71087
HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)
...
(cherry picked from commit b1ed28fa77
)
Conflicts:
hadoop-common-project/hadoop-common/pom.xml
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml
2016-01-14 11:13:13 -08:00
Karthik Kambatla
f0923819c3
YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha)
...
(cherry picked from commit 9d04f26d4c
)
2016-01-14 08:33:52 -08:00
Varun Vasudev
6220a024b1
YARN-4553. Add cgroups support for docker containers. Contributed by Sidharta Seethana.
...
(cherry picked from commit 3ddb92bd30
)
2016-01-14 14:30:19 +05:30
Akira Ajisaka
ffca0ebfff
YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.
...
(cherry picked from commit 62b0d61513
)
2016-01-14 13:59:58 +09:00
Karthik Kambatla
a1ff0b4145
YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha)
...
(cherry picked from commit 321072ba81
)
2016-01-13 12:09:58 -08:00
Wangda Tan
c0b97865e8
YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)
...
(cherry picked from commit c0537bcd2c
)
2016-01-13 13:19:01 +08:00
Jason Lowe
d164cdcda1
YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li
...
(cherry picked from commit 13de8359a1
)
2016-01-12 15:57:07 +00:00
Jason Lowe
8d34d899e4
Update CHANGES.txt for recent commits to 2.7 and 2.6
...
(cherry picked from commit c77c35f83c
)
2016-01-12 15:45:21 +00:00
Akira Ajisaka
93b7ef8aec
YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67 .
...
(cherry picked from commit da1e3e3c57
)
2016-01-12 15:13:38 +09:00
Wangda Tan
15e174fe79
YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)
...
(cherry picked from commit 9e792da014
)
2016-01-12 12:54:09 +08:00
Akira Ajisaka
df95343047
HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
...
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
2016-01-12 13:34:44 +09:00
Jian He
c4aed35200
Missing file for YARN-4580
2016-01-11 17:05:11 -08:00
Jian He
591e7fb221
YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S
...
(cherry picked from commit b8942be888
)
2016-01-11 16:45:14 -08:00
Rohith Sharma K S
da42b01645
Add YARN-3849 to Release 2.6.4 entry in CHANGES.txt
...
(cherry picked from commit 76e7270851
)
2016-01-11 12:18:12 +05:30
Jian He
d4ff8fd5d8
YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S
...
(cherry picked from commit 109e528ef5
)
2016-01-08 15:51:33 -08:00
Xuan
2cbbf76c3d
YARN-4438. Implement RM leader election with curator. Contributed by Jian He
...
(cherry picked from commit 89022f8d4b
)
2016-01-07 14:34:14 -08:00
Akira Ajisaka
3905435d3d
YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 52b77577c4
)
2016-01-08 01:13:30 +09:00
Steve Loughran
d9459ffa00
YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel)
2016-01-07 14:30:07 +00:00
rohithsharmaks
4865642e7c
YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)
...
(cherry picked from commit 791c1639ae
)
2016-01-07 09:39:37 +05:30
Junping Du
818cd0e90d
Add YARN-2975, YARN-3893, YARN-2902 and YARN-4354 to Release 2.6.4 entry in CHANGES.txt
...
(cherry picked from commit b6c9d3fab9
)
2016-01-06 14:28:43 -08:00
Junping Du
1cc001db4c
YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe.
...
(cherry picked from commit c1462a67ff
)
2016-01-06 05:51:28 -08:00
Zhihai Xu
f41db81d5f
update CHANGES.txt to add YARN-3697 to 2.6.4 release
...
(cherry picked from commit 96d8f1d6f3
)
2016-01-05 00:42:35 -08:00
rohithsharmaks
0492552f30
YARN-4535. Fix checkstyle error in CapacityScheduler.java (Naganarasimha G R via rohithsharmaks)
...
(cherry picked from commit 6da6d87872
)
2016-01-05 12:11:48 +05:30
Akira Ajisaka
247ab92464
Set release date for 2.6.3
...
(cherry picked from commit db99e30f67
)
2016-01-04 16:12:52 +09:00
Rohith Sharma K S
ae25e283cf
YARN-4530. LocalizedResource trigger a NPE Cause the NodeManager exit. (tangshangwen via rohithsharmaks)
...
(cherry picked from commit f9e36dea96
)
2016-01-04 10:04:27 +05:30
Wangda Tan
05fa852d75
YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda)
2015-12-30 15:36:55 -08:00
Wangda Tan
6eefae1b33
YARN-4510. Fix SLS startup failure caused by NPE. (Bibin A Chundatt via wangda)
2015-12-30 15:34:39 -08:00
Wangda Tan
9a7d5f69ec
YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
...
(cherry picked from commit 8310b2e9ff
)
2015-12-30 15:31:11 -08:00
Junping Du
401d1e6e8a
YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S.
...
(cherry picked from commit 223ce323bb
)
2015-12-30 07:53:08 -08:00
Jian He
970bb2da15
YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S
2015-12-29 16:52:14 -08:00
Jian He
3661d4907a
YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong
...
(cherry picked from commit 5273413411
)
2015-12-29 15:59:42 -08:00
Wangda Tan
3efbde5378
YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda)
...
(cherry picked from commit 561abb9fee
)
2015-12-29 13:29:19 -08:00
Jian He
c7cc9d6bac
YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan
...
(cherry picked from commit d0a22bae9b
)
2015-12-28 15:54:14 -08:00
Gera Shegalov
8baf9369bb
YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
...
(cherry picked from commit 2c17b81569
)
2015-12-24 23:52:43 -08:00
Karthik Kambatla
2f67645475
YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha)
...
(cherry picked from commit 0af492b4bd
)
2015-12-23 17:52:54 -08:00
Junping Du
dbc4c79b44
YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
...
(cherry picked from commit bb5df272b9
)
2015-12-23 08:55:55 -08:00
Junping Du
6e97a3c968
YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
...
(cherry picked from commit 882f2f0464
)
2015-12-23 05:27:47 -08:00
rohithsharmaks
08ddb536eb
YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)
...
(cherry picked from commit 8c180a13c8
)
2015-12-23 09:16:58 +05:30
Arun Suresh
31893468b1
YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh)
...
(cherry picked from commit e88422df45
)
2015-12-21 22:41:49 -08:00
cnauroth
fdfcffb3d1
YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
...
(cherry picked from commit 114b590955
)
2015-12-21 16:59:17 -08:00
Wangda Tan
daf5fae369
YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)
...
(cherry picked from commit a0de702851
)
2015-12-21 11:36:49 -08:00
Wangda Tan
f16daa59a4
YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)
...
(cherry picked from commit bc038b382c
)
2015-12-21 11:30:37 -08:00
Uma Mahesh
fc9e130825
YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)
...
(cherry picked from commit 0f82b5d878
)
2015-12-19 23:17:33 -08:00
Jian He
1147b086d9
YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S
2015-12-18 14:14:31 -08:00
Junping Du
6d2914a697
YARN-3226. UI changes for decommissioning node. Contributed by Sunil G.
...
(cherry picked from commit 1de56b0448
)
2015-12-17 15:21:42 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
d9b9a75928
YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev.
...
(cherry picked from commit 4e7d32c0db
)
2015-12-17 12:13:56 -08:00
Jason Lowe
fad2c5b862
YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne
...
(cherry picked from commit 91828fef6b
)
2015-12-16 23:23:19 +00:00
Wangda Tan
5060fd1840
YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda)
...
(cherry picked from commit 9b856d9787
)
2015-12-16 13:29:08 -08:00
Wangda Tan
2f5435acbd
YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)
...
(cherry picked from commit 7faa406f27
)
2015-12-16 13:29:02 -08:00
Wangda Tan
9f4a6ec663
YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
...
(cherry picked from commit 79c41b1d83
)
2015-12-16 13:28:56 -08:00
Siddharth Seth
433212ef87
YARN-4207. Add a non-judgemental YARN app completion status. Contributed by Rich Haase.
...
(cherry picked from commit 0f708d465f
)
2015-12-16 11:35:38 -08:00
Junping Du
1a2ef845b5
YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.
...
(cherry picked from commit 50bd067e1d
)
2015-12-16 10:58:40 -08:00
Zhihai Xu
65cbac9de4
Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE
...
(cherry picked from commit 7092d47fc0
)
2015-12-15 21:49:22 -08:00
Zhihai Xu
83c72ce9f6
Update CHANGES.txt to add YARN-3857 and YARN-3535 to branch-2.6
...
(cherry picked from commit 0c3a53e5a9
)
2015-12-15 01:51:48 -08:00
Zhihai Xu
da7bde60c0
MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki
...
(cherry picked from commit 5b7078d069
)
2015-12-15 01:03:10 -08:00
Zhihai Xu
be50df687b
YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun
...
(cherry picked from commit 2aaed10327
)
2015-12-15 00:21:13 -08:00
Xuan
992f65dd8b
YARN-4439. Clarify NMContainerStatus#toString method. Contributed by
...
Jian He
(cherry picked from commit d8a45425eb
)
2015-12-14 15:42:07 -08:00
Jian He
72544db3cd
YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula
2015-12-14 14:59:18 -08:00
Jian He
34e86d8d47
YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du
2015-12-14 13:52:04 -08:00
Wangda Tan
c915a658c8
YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)
...
(cherry picked from commit 07b0fb996a
)
2015-12-14 11:25:00 -08:00
Wangda Tan
9f979107c2
YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)
...
(cherry picked from commit dfcbbddb09
)
2015-12-14 11:13:51 -08:00
Wangda Tan
a1a723fdff
YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)
...
(cherry picked from commit 6cb0af3c39
)
2015-12-14 10:54:20 -08:00
Arun Suresh
0bf328984a
YARN-4358 addendum patch to fix javadoc error
...
(cherry picked from commit 7fb212e5e6
)
2015-12-12 22:25:59 -08:00
Sangjin Lee
605914caac
YARN-4341 addendum. Moved the changelog entry from 2.8.0 to 2.9.0.
...
(cherry picked from commit b7b292367f
)
2015-12-11 09:53:40 -08:00
Sangjin Lee
8be667208f
YARN-4341. add doc about timeline performance tool usage (Chang Li via sjlee)
...
(cherry picked from commit e8964589de
)
2015-12-11 09:53:17 -08:00
Xuan
455c6f39c5
YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml
...
(cherry picked from commit 21daa6c68a
)
2015-12-10 10:57:35 -08:00
Junping Du
0b5e76e9ff
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
...
(cherry picked from commit f910e4f639
)
2015-12-10 02:57:46 -08:00
Akira Ajisaka
6451313560
YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang.
...
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
2015-12-09 16:32:52 +09:00
rohithsharmaks
81f8a2b008
YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)
...
(cherry picked from commit a5e2e1ecb0
)
2015-12-09 11:33:49 +05:30
rohithsharmaks
f626d18cc3
YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)
...
(cherry picked from commit 15c3e7ffe3
)
2015-12-09 10:51:57 +05:30
Wangda Tan
7013f9d6cd
YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)
...
(cherry picked from commit 7e4715186d
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-12-08 14:30:01 -08:00
Chris Douglas
bfe4796802
YARN-4248. Followup patch adding asf-licence exclusions for json test files
...
(cherry picked from commit 9f50e13d5d
)
2015-12-08 12:08:35 -08:00
=
4ac1564418
YARN-4248. REST API for submit/update/delete Reservations. (curino)
...
(cherry picked from commit c25a635459
)
2015-12-07 13:38:38 -08:00
Jonathan Eagles
7c604c3d06
YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)
...
(cherry picked from commit 4ff973f96a
)
2015-12-07 15:05:15 -06:00
Xuan
7decba83ef
YARN-4392. ApplicationCreatedEvent event time resets after RM
...
restart/failover. Contributed by Naganarasimha G R and Xuan Gong
(cherry picked from commit 4546c7582b
)
2015-12-07 12:26:09 -08:00
rohithsharmaks
04e056f4f5
YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)
...
(cherry picked from commit 01a641bc44
)
2015-12-07 15:19:59 +05:30
Steve Loughran
af14458de7
HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]
2015-12-06 17:42:56 +00:00
Arun Suresh
78a07e99dd
YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)
...
(cherry picked from commit 742632e346
)
2015-12-05 21:30:48 -08:00
Jian He
8a97ca4b00
Add missing file for YARN-4419
2015-12-03 19:11:07 -08:00
Jian He
be404e1680
YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
...
(cherry picked from commit 755dda8dd8
)
2015-12-03 17:46:09 -08:00
Wangda Tan
51e448d295
YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda)
...
(cherry picked from commit a2c3bfc8c1
)
2015-12-03 14:30:25 -08:00
Jian He
23fe1abc02
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena
...
(cherry picked from commit 9f77ccad73
)
2015-12-03 12:49:22 -08:00
Junping Du
e76ba91fa5
YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter.
...
(cherry picked from commit 62e9348bc1
)
2015-12-03 06:37:31 -08:00
Jian He
48cbde9083
YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding
2015-12-02 11:08:00 -08:00
Allen Wittenauer
45bb467918
HADOOP-12366. expose calculated paths (aw)
2015-12-01 08:16:20 -08:00
Junping Du
092c469059
Creating 2.6.4 entries in CHANGES.txt files.
...
(cherry picked from commit 028894281b
)
2015-12-01 08:18:57 -08:00
Vinod Kumar Vavilapalli
b20e77eba3
Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0
2015-11-25 17:47:22 -08:00
Vinod Kumar Vavilapalli
767815f317
Adding release 2.8.0 to CHANGES.txt
...
(cherry picked from commit d57fd181c7
)
2015-11-25 17:37:47 -08:00
Tsuyoshi Ozawa
d76b523b02
YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.
...
(cherry picked from commit 0656d2dc83
)
2015-11-26 01:10:41 +09:00
Wangda Tan
7b9f7eaf5c
YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda)
...
(cherry picked from commit 23c625ec57
)
2015-11-24 16:36:30 -08:00
Jason Lowe
3a2f5d6329
YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla
...
(cherry picked from commit f5acf94eca
)
2015-11-24 23:47:54 +00:00
Jason Lowe
9e54433c6c
YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li
...
(cherry picked from commit 4ac6799d4a
)
2015-11-24 22:36:19 +00:00
Tsuyoshi Ozawa
9e458c3e9e
YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang.
...
(cherry picked from commit 28dfe721b8
)
2015-11-24 22:10:31 +09:00
Akira Ajisaka
ac0ddc4fec
YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.
...
(cherry picked from commit 8c0133f3d4
)
2015-11-24 18:40:56 +09:00
Karthik Kambatla
49ed955c91
YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)
...
(cherry picked from commit 52948bb20b
)
2015-11-24 13:52:29 +05:30
Jian He
b339a4b8d6
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
...
(cherry picked from commit 8676a118a1
)
2015-11-23 17:20:24 -08:00
Jason Lowe
d13b646c61
Update CHANGES.txt for recent commits to branch-2.6.
...
(cherry picked from commit aa2009c37b
)
2015-11-23 21:58:57 +00:00
Jason Lowe
9d303edbfb
YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev
...
(cherry picked from commit d36b6e045f
)
2015-11-23 20:31:50 +00:00
Arun Suresh
cbbdbe3cdd
YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)
...
(cherry picked from commit da1016365a
)
2015-11-21 10:01:10 -08:00
Wangda Tan
08727287de
move YARN-4326/YARN-3849 from 2.8.0 to 2.7.3
2015-11-20 16:42:11 -08:00
Wangda Tan
cdca460ad4
YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)
...
(cherry picked from commit 2346fa3141
)
2015-11-20 15:56:17 -08:00
Jason Lowe
f3bca8bc1a
YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li
...
(cherry picked from commit 060cdcbe5d
)
2015-11-20 23:13:27 +00:00
Xuan
8347b1048d
YARN-2859 addendum: move the entry from 2.6.2 to 2.6.3 in hadoop-yarn/CHANGES.txt.
...
(cherry picked from commit 866dce4e8e
)
2015-11-19 10:17:20 -08:00
Xuan
be65d319fa
YARN-2859.addendum: fix the remaining issue from the previous patch
...
(cherry picked from commit f114e728da
)
2015-11-19 10:09:48 -08:00
Wangda Tan
3504d0e795
move fix version of YARN-4287 from 2.8.0 to 2.7.3
2015-11-18 14:01:02 -08:00
Karthik Kambatla
d3f9508096
YARN-4367. SLS webapp doesn't load. (kasha)
2015-11-18 13:45:00 -08:00
Steve Loughran
a0b3e43a6d
YARN-4279. Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable. (stevel)
2015-11-18 21:41:24 +00:00
Arun Suresh
d8e60080e9
YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)
...
(cherry picked from commit 6a61928fb7
)
2015-11-17 15:51:59 -08:00
Jian He
2cf084ac76
Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan"
...
This reverts commit a4ff03b200
.
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-11-16 20:19:31 -08:00
Junping Du
1d107d8058
YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.
...
(cherry picked from commit 855d52927b
)
2015-11-15 04:44:59 -08:00
Wangda Tan
875aec3177
YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)
...
(cherry picked from commit 7ff280fca9
)
2015-11-12 11:50:41 -08:00
Wangda Tan
13f8c7093b
YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)
...
(cherry picked from commit 7f55a18071
)
2015-11-12 11:24:04 -08:00
Wangda Tan
0c1fb15b29
YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)
...
(cherry picked from commit 796638d9bc
)
2015-11-12 11:12:11 -08:00
Jason Lowe
9050078005
YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du
...
(cherry picked from commit 06a70311b9
)
2015-11-12 14:49:55 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
bb5dd7f772
YARN-4183. Reverting the patch to fix behaviour change.
...
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"
This reverts commit 42bc525acb
.
2015-11-11 10:42:52 -08:00
Akira Ajisaka
f6f128c867
YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.
...
(cherry picked from commit 23d0db551c
)
2015-11-11 16:13:50 +09:00
Wangda Tan
8a8ac50a5b
YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)
...
(cherry picked from commit c99925d6dd
)
2015-11-10 13:17:23 -08:00
Vinod Kumar Vavilapalli
b742ea7fe6
HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in
...
the first patch committed. (Karthik Kambatla via vinodkv)
2015-11-10 12:16:52 -08:00
Jian He
a4ff03b200
YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan
...
(cherry picked from commit 8fbea531d7
)
2015-11-09 11:05:12 -08:00
Jason Lowe
8334d86472
Add 2.7.3 release to CHANGES.txt
...
(cherry picked from commit 0383a3973b
)
2015-11-04 16:27:28 +00:00
Wangda Tan
3190446df9
YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda)
...
(cherry picked from commit 0783184f4b
)
2015-11-03 11:36:11 -08:00
Sangjin Lee
b2d6ea5e18
Updated the 2.6.2 final release date.
...
(cherry picked from commit a4a6b5b4b4
)
2015-10-30 18:49:21 -07:00
Jason Lowe
8dce482f61
Creating 2.6.3 entries in CHANGES.txt files.
...
(cherry picked from commit eadf7b3096
)
2015-10-30 14:52:06 +00:00
Tsuyoshi Ozawa
1c80473a41
YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.
...
(cherry picked from commit ce31b22739
)
2015-10-30 18:00:35 +09:00
Tsuyoshi Ozawa
dd144035a0
Add an entry of YARN-4312 to CHANGES.txt
...
(cherry picked from commit d21214ce33
)
2015-10-30 17:57:29 +09:00
Tsuyoshi Ozawa
c522a9ffc2
Move YARN-3580 in CHANGES.txt from 2.8 to 2.7.2.
...
(cherry picked from commit d2e01f4ed8
)
2015-10-30 15:51:04 +09:00
Xuan
b505bf9e58
YARN-4313. Race condition in MiniMRYarnCluster when getting history
...
server address. Contributed by Jian He
(cherry picked from commit 7412ff48ee
)
2015-10-29 17:37:24 -07:00
Jian He
2b197bbffd
YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena
...
(cherry picked from commit e5b1733e04
)
2015-10-29 15:43:26 -07:00
Jonathan Eagles
42bc525acb
YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)
...
(cherry picked from commit c293c58954
)
2015-10-29 16:42:49 -05:00
Arun Suresh
8943abfb08
YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)
...
(cherry picked from commit 58d1df585c
)
2015-10-29 13:43:43 -07:00
Jason Lowe
c75d8b164f
YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena
...
(cherry picked from commit e2267de207
)
2015-10-29 16:39:55 +00:00
Jian He
7d109ef5b5
YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
...
(cherry picked from commit c41699965e
)
2015-10-29 00:01:20 -07:00
Rohith Sharma K S
e3fcb711d6
YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)
...
(cherry picked from commit 656c8f9527
)
2015-10-29 12:25:08 +05:30
Sangjin Lee
16db203a83
Set the release date for 2.6.2
2015-10-28 20:48:49 -07:00
Xuan
9ce5069d16
YARN-2859. ApplicationHistoryServer binds to default port 8188 in
...
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli
(cherry picked from commit 27414dac66
)
2015-10-28 10:33:56 -07:00
Tsuyoshi Ozawa
d29bff86c4
YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 9f4dfdf4eb
)
2015-10-28 17:39:26 +09:00
Varun Vasudev
c5bf1cb7af
YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt.
...
(cherry picked from commit c28e16b40c
)
2015-10-27 20:56:45 +05:30
Tsuyoshi Ozawa
3138b43f16
YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 96677bef00
)
2015-10-27 12:35:20 +09:00
Akira Ajisaka
d9156c1245
YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka)
...
(cherry picked from commit 8a68630dd1
)
2015-10-27 10:28:30 +09:00
Wangda Tan
1499af38eb
YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda)
...
(cherry picked from commit 56e4f6237a
)
2015-10-26 16:45:20 -07:00
Wangda Tan
9bf1e74171
YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)
...
(cherry picked from commit 6f606214e7
)
2015-10-26 16:38:39 -07:00
Wangda Tan
baa2998e93
YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)
...
(cherry picked from commit 3cc73773eb
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-10-26 13:12:56 -07:00
Jason Lowe
7d66e2e666
YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee
...
(cherry picked from commit 33a03af3c3
)
2015-10-26 19:54:16 +00:00
Rohith Sharma K S
33455fa415
YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)
...
(cherry picked from commit 5acdde4744
)
2015-10-26 15:45:22 +05:30
Rohith Sharma K S
06ecc37e82
YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager project. (varun saxena via rohithsharmaks)
...
(cherry picked from commit 092883b34a
)
2015-10-26 15:26:08 +05:30
Tsuyoshi Ozawa
e85ebf0825
YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.
...
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
2015-10-26 17:06:46 +09:00
Rohith Sharma K S
e75799d5fd
YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks)
...
(cherry picked from commit b57f08c0d2
)
2015-10-26 12:07:48 +05:30
Allen Wittenauer
599653ad92
YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw)
2015-10-25 21:43:51 -07:00
Arun Suresh
f0580dcac0
YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh)
...
(cherry picked from commit ab8eb8770c
)
2015-10-24 22:54:45 -07:00
Steve Loughran
fc5a433adb
YARN-4296. DistributedShell Log.info is not friendly. (Xiaowei Wang via stevel)
2015-10-24 12:54:48 +01:00
Steve Loughran
65b928d8c7
YARN-4289. TestDistributedShell failing with bind exception. (Brahma Reddy Battula via stevel)
2015-10-24 12:48:03 +01:00
Akira Ajisaka
356e922632
YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka)
...
(cherry picked from commit 7781fe1b9e
)
2015-10-24 11:56:37 +09:00
Jason Lowe
235e84bf3d
YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G
...
(cherry picked from commit d3a34a4f38
)
2015-10-23 20:57:53 +00:00
Jonathan Eagles
6db7bfbcfd
YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
...
(cherry picked from commit f8adeb712d
)
2015-10-23 10:43:59 -05:00