Wangda Tan
|
945c0958bb
|
YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda)
Change-Id: I84ccd54200ccbaae23018ef320028e42b4c3509a
|
2017-07-13 10:30:15 -07:00 |
Sunil G
|
cf0d0844d6
|
YARN-5731. Preemption calculation is not accurate when reserved containers are present in queue. Contributed by Wangda Tan.
|
2017-07-13 16:48:29 +05:30 |
Xuan
|
9845bea59c
|
YARN-6689. PlacementRule should be configurable. (Jonathan Hung via xgong)
|
2017-07-12 15:40:45 -07:00 |
Jason Lowe
|
655110393b
|
YARN-6797. TimelineWriter does not fully consume the POST response. Contributed by Jason Lowe
|
2017-07-12 15:52:56 -05:00 |
Akira Ajisaka
|
b628d0da51
|
YARN-6809. Fix typo in ResourceManagerHA.md. Contributed by Yeliang Cang.
|
2017-07-12 19:38:32 +09:00 |
|
Sunil G
|
34f113df5c
|
YARN-6714. IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by Tao Yang.
|
2017-07-11 14:52:44 +05:30 |
Arun Suresh
|
5496a34c0c
|
YARN-6776. Refactor ApplicaitonMasterService to move actual processing logic to a separate class. (asuresh)
|
2017-07-10 14:34:58 -07:00 |
Steve Loughran
|
09653ea098
|
HADOOP-14634. Remove jline from main Hadoop pom.xml.
Contributed by Ray Chiang.
|
2017-07-10 11:53:13 +01:00 |
Yufei Gu
|
3de47ab5ea
|
YARN-6764. Simplify the logic in FairScheduler#attemptScheduling. Contributed by Yufei Gu.
|
2017-07-09 16:09:12 -07:00 |
Naganarasimha
|
ba5b056e8a
|
YARN-6770. A small mistake in the example of TimelineClient. Contributed by Jinjiang Ling.
|
2017-07-09 21:28:24 +05:30 |
|
Naganarasimha
|
626d730bfc
|
YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt.
|
2017-07-09 17:26:09 +05:30 |
Daniel Templeton
|
9d27880442
|
YARN-6410. FSContext.scheduler should be final (Contributed by Yeliang Cang via Daniel Templeton)
|
2017-07-09 19:34:35 +09:00 |
|
Daniel Templeton
|
c5a0c38d8e
|
YARN-6746. SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code
(Contributed by Deepti Sawhney via Daniel Templeton)
|
2017-07-09 19:27:32 +09:00 |
Daniel Templeton
|
0615985886
|
YARN-6752. Display reserved resources in web UI per application
(Contributed by Abdullah Yousufi via Daniel Templeton)
|
2017-07-09 19:02:31 +09:00 |
|
Jason Lowe
|
7576a688ea
|
YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt
|
2017-07-06 09:40:09 -05:00 |
|
Naganarasimha
|
fa1aaee87b
|
YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp.
|
2017-07-01 12:29:39 +05:30 |
|
Xuan
|
3be2659f83
|
YARN-6694. Add certain envs to the default yarn.nodemanager.env-whitelist. Contributed by Jian He
|
2017-06-29 20:10:35 -07:00 |
Andrew Wang
|
af2773f609
|
Updating version for 3.0.0-beta1 development
|
2017-06-29 17:57:40 -07:00 |
|
Daniel Templeton
|
ec97519779
|
YARN-6751. Display reserved resources in web UI per queue
(Contributed by Abdullah Yousufi via Daniel Templeton)
|
2017-06-29 16:53:50 -07:00 |
|
Sunil G
|
c1edca101c
|
YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin.
|
2017-06-28 15:40:58 -07:00 |
Junping Du
|
4e3eebc943
|
YARN-5311. Document graceful decommission CLI and usage. Contributed by Elek, Marton.
|
2017-06-28 15:32:04 -07:00 |
|
Daniel Templeton
|
25d891a784
|
YARN-6743. yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml
(Contributed by Lori Loberg via Daniel Templeton)
|
2017-06-28 13:17:58 -07:00 |
|
Jason Lowe
|
63ce1593c5
|
YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich
|
2017-06-27 17:12:42 -05:00 |
|
Yufei Gu
|
0b77262890
|
YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu)
|
2017-06-23 13:26:03 -07:00 |
|
Sunil G
|
ca13b224b2
|
YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne.
|
2017-06-22 23:50:57 -07:00 |
|
Naganarasimha
|
740204b292
|
YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.
|
2017-06-23 07:52:41 +05:30 |
|
Arun Suresh
|
49aa60e50d
|
YARN-6127. Add support for work preserving NM restart when AMRMProxy is enabled. (Botong Huang via asuresh).
|
2017-06-22 11:27:13 -07:00 |
|
Akira Ajisaka
|
099dfe92a9
|
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang.
|
2017-06-20 17:20:27 +09:00 |
|
Naganarasimha
|
ee89ac84e6
|
YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp
|
2017-06-19 22:42:45 +05:30 |
|
Naganarasimha
|
e9c2aa1bc3
|
YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R.
|
2017-06-19 21:31:40 +05:30 |
|
Naganarasimha
|
7582dedad1
|
YARN-6517. Fix warnings from Spotbugs in hadoop-yarn-common(addendum). Contributed by Weiwei Yang.
|
2017-06-18 19:53:42 +05:30 |
|
Daniel Templeton
|
036a24bab3
|
MAPREDUCE-6896. Document wrong spelling in usage of MapredTestDriver tools.
(Contributed by LiXin Ge via Daniel Templeton)
|
2017-06-13 13:21:23 -07:00 |
bibinchundatt
|
d64c842743
|
YARN-6703. RM startup failure with old state store due to version mismatch. Contributed by Varun Saxena
|
2017-06-12 18:07:43 +05:30 |
Eric Payne
|
5578af8603
|
YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.
|
2017-06-09 16:16:34 -05:00 |
|
Naganarasimha
|
99634d10ed
|
YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp.
|
2017-06-09 11:10:13 +05:30 |
|
Daniel Templeton
|
a062374c39
|
YARN-6679. Reduce Resource instance overhead via non-PBImpl
(Contributed by Daryn Sharp via Daniel Templeton)
|
2017-06-08 10:08:08 -07:00 |
Carlo Curino
|
547cb53e8a
|
YARN-6634. [API] Refactor ResourceManager WebServices to make API explicit. (Giovanni Matteo Fumarola via curino)
|
2017-06-07 13:41:06 -07:00 |
Varun Saxena
|
0b7bff706e
|
YARN-6604. Allow metric TTL for Application table to be specified through cmd (Haibo Chen via Varun Saxena)
|
2017-06-07 21:51:07 +05:30 |
Brahma Reddy Battula
|
19ef3a81f8
|
HADOOP-14485. Redundant 'final' modifier in try-with-resources statement. Contributed by wenxin he.
|
2017-06-06 23:11:47 +08:00 |
Jian He
|
7311015ace
|
YARN-6683. Invalid event: COLLECTOR_UPDATE at KILLED. Contributed by Rohith Sharma K S
|
2017-06-05 13:16:57 -07:00 |
|
Sunil G
|
46f7e91980
|
YARN-6458. Use yarn package manager to lock down dependency versions for new web UI. Contributed by Sreenath Somarajapuram.
|
2017-06-04 22:05:14 +05:30 |
|
Daniel Templeton
|
73ecb19312
|
YARN-6208. Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application
(Contributed by Akira Ajisaka via Daniel Templeton)
|
2017-06-02 08:50:19 -07:00 |
vrushali
|
d95c82cb79
|
YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C)
|
2017-06-01 18:30:23 -07:00 |
|
Daniel Templeton
|
d5b71e4175
|
YARN-6246. Identifying starved apps does not need the scheduler writelock
(Contributed by Karthik Kambatla via Daniel Templeton)
|
2017-05-31 15:48:04 -07:00 |
Nathan Roberts
|
4369690ce6
|
YARN-6649. RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception. Contributed by Jon Eagles.
|
2017-05-31 11:32:32 -05:00 |
Jonathan Eagles
|
cbfed0e82f
|
YARN-6497. Method length of ResourceManager#serviceInit() is too long (Gergely Novák via jeagles)
|
2017-05-31 10:18:42 -05:00 |
Varun Vasudev
|
547f18cb96
|
YARN-6366. Refactor the NodeManager DeletionService to support additional DeletionTask types. Contributed by Shane Kumpf.
|
2017-05-31 16:15:35 +05:30 |
Haibo Chen
|
4b4a6524f2
|
YARN-6477. Dispatcher no longer needs the raw types suppression. (Maya Wexler via Haibo Chen)
|
2017-05-30 16:58:15 -07:00 |
|
Sunil G
|
af03c33346
|
YARN-6635. Refactor yarn-app pages in new YARN UI. Contributed by Akhil PB.
|
2017-05-30 13:52:40 +05:30 |
|
Andrew Wang
|
16ad896d5c
|
Update maven version for 3.0.0-alpha4 development
|
2017-05-26 14:09:44 -07:00 |
|
Daniel Templeton
|
d81372dfad
|
YARN-6646. Modifier 'static' is redundant for inner enums
(Contributed by ZhangBing Lin via Daniel Templeton)
|
2017-05-26 12:05:48 -07:00 |
|
Jason Lowe
|
aea42930bb
|
YARN-6641. Non-public resource localization on a bad disk causes subsequent containers failure. Contributed by Kuhu Shukla
|
2017-05-26 09:37:56 -05:00 |
|
Haibo Chen
|
47474fffac
|
YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
|
2017-05-25 21:15:27 -07:00 |
|
Yufei Gu
|
87590090c8
|
YARN-6582. FSAppAttempt demand can be updated atomically in updateDemand(). (Karthik Kambatla via Yufei Gu)
|
2017-05-25 14:22:13 -07:00 |
|
Jason Lowe
|
3fd6a2da4e
|
YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter
|
2017-05-25 16:07:52 -05:00 |
|
Varun Vasudev
|
1a56a3db59
|
Addendum patch to fix Docker sanitization.
|
2017-05-25 14:53:57 +05:30 |
|
Akira Ajisaka
|
bc28da65fb
|
YARN-6141. ppc64le on Linux doesn't trigger __linux get_executable codepath. Contributed by Sonia Garudi and Ayappan.
|
2017-05-25 17:06:26 +09:00 |
|
Jason Lowe
|
8bf1949c0e
|
YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg
|
2017-05-24 11:22:42 -05:00 |
|
Wangda Tan
|
8e0f83e49a
|
YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda)
Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d
|
2017-05-22 14:28:55 -07:00 |
|
Wangda Tan
|
c583ab02c7
|
YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda)
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
|
2017-05-22 14:26:13 -07:00 |
|
Sunil G
|
b6f66b0da1
|
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
|
2017-05-22 14:10:06 +05:30 |
|
Sunil G
|
46d9c4ca7a
|
YARN-5705. Show timeline data from ATS v2 in new web UI. Contributed by Akhil PB.
|
2017-05-21 18:09:13 +05:30 |
|
Jian He
|
e135c0b207
|
YARN-6627. Use deployed webapp folder to launch new YARN UI. Contributed by Sunil G
|
2017-05-19 20:14:03 -07:00 |
Robert Kanter
|
9855225a79
|
YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter)
|
2017-05-19 15:43:22 -07:00 |
Yufei Gu
|
66bba8c024
|
YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu)
|
2017-05-19 14:53:27 -07:00 |
|
Yufei Gu
|
e82da2b4f4
|
YARN-6540. Resource Manager is spelled "Resource Manger" in ResourceManagerRestart.md and ResourceManagerHA.md. (Grant Sohn via Yufei Gu)
|
2017-05-19 14:16:00 -07:00 |
|
Eric Payne
|
19482e0d09
|
YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe.
|
2017-05-19 11:24:54 -05:00 |
|
Varun Vasudev
|
b46cd315f7
|
Sanitize arguments before launching Docker containers.
|
2017-05-18 10:37:16 +05:30 |
|
Varun Vasudev
|
e120ee865a
|
Validate docker image name before launching container.
|
2017-05-18 10:29:34 +05:30 |
Chris Douglas
|
b23fcc86c6
|
YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin
|
2017-05-17 20:40:06 -07:00 |
Rohith Sharma K S
|
d87a63a901
|
HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.
|
2017-05-17 08:27:45 +05:30 |
|
Robert Kanter
|
18c494a00c
|
YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter)
|
2017-05-16 18:02:39 -07:00 |
|
Jian He
|
8236130b2c
|
YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh
|
2017-05-16 10:48:46 -07:00 |
|
Jason Lowe
|
489f85933c
|
YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe
|
2017-05-16 09:26:44 -05:00 |
|
Jonathan Eagles
|
c48f2976a3
|
YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles)
|
2017-05-15 10:32:01 -05:00 |
|
Carlo Curino
|
6600abbb5c
|
YARN-6587. Refactor of ResourceManager#startWebApp in a Util class. (Giovanni Matteo Fumarola via curino).
|
2017-05-12 17:48:55 -07:00 |
Haibo Chen
|
6c35001b9f
|
YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen)
|
2017-05-12 13:05:40 -07:00 |
|
Daniel Templeton
|
90cb5b4635
|
YARN-6380. FSAppAttempt keeps redundant copy of the queue
|
2017-05-11 13:47:02 -07:00 |
Min Shen
|
2ada100da7
|
YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.
|
2017-05-11 13:25:31 -07:00 |
|
Brahma Reddy Battula
|
4aae2d40a3
|
HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
|
2017-05-11 23:33:45 +05:30 |
|
Carlo Curino
|
5cb6e3e082
|
YARN-6473. Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations.
|
2017-05-10 14:49:25 -07:00 |
|
Daniel Templeton
|
e7654c4a1f
|
YARN-6571. Fix JavaDoc issues in SchedulingPolicy
(Contributed by Weiwei Yang via Daniel Templeton)
|
2017-05-10 14:34:13 -07:00 |
|
Daniel Templeton
|
74a61438ca
|
YARN-6475. Fix some long function checkstyle issues
(Contributed by Soumabrata Chakraborty via Daniel Templeton)
|
2017-05-10 10:46:50 -07:00 |
|
Jason Lowe
|
6099deebcb
|
YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
|
2017-05-10 08:47:48 -05:00 |
|
Haibo Chen
|
ab2bb93a2a
|
YARN-6561. Update exception message during timeline collector aux service initialization. (Vrushali C via Haibo Chen)
|
2017-05-09 21:37:30 -07:00 |
|
Haibo Chen
|
461ee44d28
|
YARN-6435. [ATSv2] Can't retrieve more than 1000 versions of metrics in time series. (Rohith Sharma K S via Haibo Chen)
|
2017-05-09 21:12:57 -07:00 |
Karthik Kambatla
|
166be0ee95
|
YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha)
|
2017-05-09 14:44:16 -07:00 |
|
Daniel Templeton
|
a2f680493f
|
YARN-5301. NM mount cpu cgroups failed on some systems
(Contributed by Miklos Szegedi via Daniel Templeton)
|
2017-05-09 12:05:46 -07:00 |
|
Vrushali Channapattan
|
7dd258d8f4
|
YARN-6563 ConcurrentModificationException in TimelineCollectorManager while stopping RM (Contributed by Haibo Chen via Vrushali C)
|
2017-05-09 11:18:12 -07:00 |
|
Andrew Wang
|
543aac9f28
|
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
|
2017-05-09 09:22:53 -07:00 |
Subru Krishnan
|
749e5c09b9
|
YARN-6281. Cleanup when AMRMProxy fails to initialize a new interceptor chain. (Botong Huang via Subru)
(cherry picked from commit 57a9afbd45b7ef8e6021cc58f96bd0074bf1389d)
|
2017-05-08 16:55:47 -07:00 |
|
Subru Krishnan
|
cd9ff27ffc
|
YARN-6234. Support multiple attempts on the node when AMRMProxy is enabled. (Giovanni Matteo Fumarola via Subru).
|
2017-05-08 16:41:30 -07:00 |
|
Haibo Chen
|
1769b12a77
|
YARN-6457. Allow custom SSL configuration to be supplied in WebApps. (Sanjay M Pujare via Haibo Chen)
|
2017-05-08 15:46:12 -07:00 |
|
Jason Lowe
|
424887ecb7
|
YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R
|
2017-05-08 17:14:37 -05:00 |
|
Subru Krishnan
|
d6eed5acca
|
YARN-6565. Fix memory leak and finish app trigger in AMRMProxy. (Botong Huang via Subru).
|
2017-05-05 16:27:49 -07:00 |
|
Chris Douglas
|
e4f34ecb04
|
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
|
2017-05-05 12:10:50 -07:00 |
|
Vrushali Channapattan
|
54e2b9e876
|
YARN-6375 App level aggregation should not consider metric values reported in the previous aggregation cycle (Varun Saxena via Vrushali C)
|
2017-05-04 15:25:56 -07:00 |
Sidharta S
|
fd5cb2c946
|
YARN-6374. Improve test coverage and add utility classes for common Docker operations. Contributed by Shane Kumpf
|
2017-05-03 14:49:30 -07:00 |
|
Daniel Templeton
|
9f0aea0ee2
|
YARN-6481. Yarn top shows negative container number in FS
(Contributed by Tao Jie via Daniel Templeton)
|
2017-05-02 13:06:47 -07:00 |
|
Subru Krishnan
|
6bf42e48ef
|
YARN-5331. Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
|
2017-05-01 18:48:36 -07:00 |