Tsuyoshi Ozawa
|
14f0e2787c
|
Moved CHANGES.txt entries to 2.6.2
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798
|
2015-10-21 23:23:07 +09:00 |
Arun Suresh
|
506d1b1dbc
|
YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh)
|
2015-10-20 16:46:14 -07:00 |
|
Arun Suresh
|
7e2837f830
|
YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh)
|
2015-10-19 20:00:38 -07:00 |
Varun Vasudev
|
151eab2a12
|
YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana.
|
2015-10-19 20:56:01 +05:30 |
|
Varun Vasudev
|
e39ae0e676
|
YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.
|
2015-10-19 20:19:22 +05:30 |
Steve Loughran
|
e2d59e2c7b
|
YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel)
|
2015-10-18 12:03:57 +01:00 |
Sangjin Lee
|
58590fef49
|
YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee)
|
2015-10-16 16:53:20 -07:00 |
Jian He
|
f9da5cdb2b
|
YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G
|
2015-10-16 15:26:27 -07:00 |
Wangda Tan
|
4337b263aa
|
YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda)
|
2015-10-16 15:06:28 -07:00 |
|
Jian He
|
cf23f2c2b5
|
YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena
|
2015-10-15 17:12:46 -07:00 |
|
Varun Vasudev
|
63020c54c1
|
YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.
|
2015-10-15 13:41:20 +05:30 |
|
Steve Loughran
|
dfa7848463
|
HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)
|
2015-10-14 20:25:47 +01:00 |
rohithsharmaks
|
d6c8bad869
|
YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks)
|
2015-10-14 16:11:34 +05:30 |
|
Varun Vasudev
|
da1ee078f9
|
YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana.
|
2015-10-14 15:25:21 +05:30 |
|
Varun Vasudev
|
fb9c1519b3
|
YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana.
|
2015-10-14 15:18:08 +05:30 |
|
Varun Vasudev
|
8d59293089
|
YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana.
|
2015-10-14 14:58:10 +05:30 |
|
Steve Loughran
|
c59af2fdf8
|
HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)
|
2015-10-13 21:49:28 +01:00 |
|
Varun Vasudev
|
5b6bae0094
|
YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana
|
2015-10-13 12:48:30 +05:30 |
|
Jian He
|
9849c8b386
|
YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding
|
2015-10-12 11:51:33 -07:00 |
Zhihai Xu
|
049c6e8dc0
|
YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong.
|
2015-10-12 00:14:25 -07:00 |
Devaraj K
|
db93047881
|
YARN-3964. Support NodeLabelsProvider at Resource Manager side.
Contributed by Dian Fu.
|
2015-10-11 11:21:29 +05:30 |
|
Wangda Tan
|
def374e666
|
YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda)
|
2015-10-09 16:38:59 -07:00 |
Karthik Kambatla
|
4aa9b3e75c
|
MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
|
2015-10-09 07:37:39 -07:00 |
Jason Lowe
|
a0bca2b5ad
|
YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S
|
2015-10-09 14:17:38 +00:00 |
|
Rohith Sharma K S
|
8f195387a4
|
YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks)
|
2015-10-09 10:09:26 +05:30 |
|
Jason Lowe
|
8d226225d0
|
YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu
|
2015-10-08 22:25:34 +00:00 |
|
Jason Lowe
|
0841940a21
|
Fixup CHANGES.txt to reflect recent commits to 2.7.2 and 2.6.2
|
2015-10-08 16:45:29 +00:00 |
|
Rohith Sharma K S
|
3793cbe4c3
|
YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks)
|
2015-10-07 10:12:14 +05:30 |
|
Rohith Sharma K S
|
9156fc60c6
|
YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks)
|
2015-10-07 09:34:59 +05:30 |
|
Wangda Tan
|
29a582ada0
|
YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda)
|
2015-10-06 11:56:04 -07:00 |
|
Wangda Tan
|
30ac69c6bd
|
YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda)
|
2015-10-05 15:47:21 -07:00 |
Vinod Kumar Vavilapalli
|
f1c19b9365
|
HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan.
|
2015-10-05 10:56:55 -07:00 |
Harsh J
|
c918f7be5e
|
HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.
|
2015-10-03 18:37:58 +05:30 |
Xuan
|
8f08532bde
|
YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma
|
2015-10-02 18:50:47 -07:00 |
|
Jason Lowe
|
fdf02d1f26
|
YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu
|
2015-10-02 20:20:31 +00:00 |
|
Jason Lowe
|
854d25b0c3
|
YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu
|
2015-09-30 14:59:44 +00:00 |
|
Karthik Kambatla
|
a0b5a0a419
|
YARN-4066. Large number of queues choke fair scheduler. (Johan Gustavsson via kasha)
|
2015-09-29 07:55:34 -07:00 |
Anubhav Dhoot
|
9735afe967
|
YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot)
|
2015-09-28 16:13:41 -07:00 |
|
Jason Lowe
|
9f53a95ff6
|
YARN-4141. Runtime Application Priority change should not throw exception for applications at finishing states. Contributed by Sunil G
|
2015-09-28 22:55:20 +00:00 |
|
Anubhav Dhoot
|
fb2e525c07
|
YARN-4204. ConcurrentModificationException in FairSchedulerQueueInfo. (adhoot)
|
2015-09-28 09:05:45 -07:00 |
|
Xuan
|
d1b9b85244
|
YARN-3624. ApplicationHistoryServer should not reverse the order of the
filters it gets. Contributed by Mit Desai
|
2015-09-24 15:01:17 -07:00 |
|
Rohith Sharma K S
|
a9aafad12b
|
YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks)
|
2015-09-24 12:13:22 +05:30 |
|
Rohith Sharma K S
|
8ed0d4b744
|
YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks)
|
2015-09-24 11:24:14 +05:30 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
1f707ecffd
|
Release process for 2.6.1: Set the release date for 2.6.1
|
2015-09-23 15:10:50 -07:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
df52ff92ae
|
YARN-3248. Moving it to improvements section in CHANGES.txt.
|
2015-09-23 15:01:29 -07:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
f3e5bc6766
|
CHANGES.txt: Moving YARN-1884, YARN-3171, YARN-3740, YARN-3248, YARN-3544 to 2.6.1 given the backport.
|
2015-09-23 13:40:37 -07:00 |
|
Jian He
|
b3f6b641dc
|
YARN-4171. Fix findbugs warnings in YARN-1197 branch. Contributed by Wangda Tan
|
2015-09-23 13:29:38 -07:00 |
|
Jian He
|
89cab1ba5f
|
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
|
2015-09-23 13:29:38 -07:00 |
|
Jian He
|
c57eac5dfe
|
YARN-3868. Recovery support for container resizing. Contributed by Meng Ding
|
2015-09-23 13:29:38 -07:00 |
|
Jian He
|
c3dc1af072
|
YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding
|
2015-09-23 13:29:37 -07:00 |
|
Jian He
|
c59ae4eeb1
|
YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan
|
2015-09-23 13:29:37 -07:00 |
|
Jian He
|
5f5a968d65
|
YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding
|
2015-09-23 13:29:37 -07:00 |
|
Jian He
|
ffd820c27a
|
YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan
|
2015-09-23 13:29:37 -07:00 |
|
Jian He
|
83a18add10
|
YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)
|
2015-09-23 13:29:36 -07:00 |
|
Jian He
|
dfe2cb849f
|
YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding
|
2015-09-23 13:29:36 -07:00 |
|
Jason Lowe
|
692d51c09d
|
YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai
|
2015-09-23 16:38:55 +00:00 |
|
Jason Lowe
|
c890c51a91
|
YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu
|
2015-09-23 15:42:01 +00:00 |
|
Tsuyoshi Ozawa
|
dfd807afab
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
|
2015-09-22 12:54:29 +09:00 |
Chris Douglas
|
8e01b0d97a
|
YARN-4188. Make MoveApplicationAcrossQueues abstract, newInstance static
Contributed by Giovanni Matteo Fumarola
|
2015-09-21 17:51:48 -07:00 |
|
Wangda Tan
|
b00392dd9c
|
YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda)
|
2015-09-21 11:04:03 -07:00 |
|
Rohith Sharma K S
|
c9cb6a5960
|
YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks)
|
2015-09-21 09:59:30 +05:30 |
|
Arun Suresh
|
94dec5a916
|
YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh)
|
2015-09-18 14:02:55 -07:00 |
|
Wangda Tan
|
372ad270a0
|
MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda)
|
2015-09-18 10:10:32 -07:00 |
|
Wangda Tan
|
9bc913a35c
|
YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda)
|
2015-09-18 10:04:17 -07:00 |
|
Steve Loughran
|
a7201d635f
|
YARN-2597 MiniYARNCluster should propagate reason for AHS not starting
|
2015-09-18 09:45:35 +01:00 |
|
Rohith Sharma K S
|
723c31d45b
|
YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks)
|
2015-09-18 08:44:10 +05:30 |
|
Jian He
|
6c6e734f0b
|
YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S
|
2015-09-17 14:55:50 +08:00 |
|
Steve Loughran
|
bf2f2b4fc4
|
YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula)
|
2015-09-16 10:31:02 +01:00 |
|
Jian He
|
452079af8b
|
YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R
|
2015-09-16 14:59:20 +08:00 |
|
Xuan
|
34ef1a092b
|
YARN-4149. yarn logs -am should provide an option to fetch all the log
files. Contributed by Varun Vasudev
|
2015-09-15 14:36:30 -07:00 |
|
Jason Lowe
|
8c1cdb17a0
|
YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu
|
2015-09-15 20:21:33 +00:00 |
|
Wangda Tan
|
ae5308fe1d
|
YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)
|
2015-09-15 11:40:50 -07:00 |
Junping Du
|
73e3a49eb0
|
YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)
|
2015-09-15 07:56:47 -07:00 |
|
Jian He
|
5468baa80a
|
YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan
|
2015-09-15 15:39:20 +08:00 |
|
Wangda Tan
|
e2a0270217
|
YARN-4151. Fix findbugs errors in hadoop-yarn-server-common module. (Meng Ding via wangda)
|
2015-09-14 16:00:43 -07:00 |
|
Jian He
|
e1b1d7e4ae
|
YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt
|
2015-09-14 14:09:19 +08:00 |
|
Karthik Kambatla
|
332b520a48
|
YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
|
2015-09-13 18:07:43 -07:00 |
|
Karthik Kambatla
|
81df7b586a
|
YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)
|
2015-09-13 17:03:15 -07:00 |
|
Steve Loughran
|
7269906254
|
HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).
|
2015-09-13 14:25:26 +01:00 |
Robert Kanter
|
ea4bb2749f
|
YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)
|
2015-09-11 11:46:10 -07:00 |
|
Robert Kanter
|
b84fb41bb6
|
YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter)
|
2015-09-11 11:46:10 -07:00 |
|
Varun Vasudev
|
486d5cb803
|
YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt.
|
2015-09-11 14:37:48 +05:30 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
fbbb7ff1ed
|
Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1.
|
2015-09-10 13:45:57 -07:00 |
|
Wangda Tan
|
77666105b4
|
YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda)
|
2015-09-10 09:30:09 -07:00 |
|
Robert Kanter
|
6dd6ca442a
|
YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter)
|
2015-09-09 18:03:04 -07:00 |
|
Zhihai Xu
|
16b9037dc1
|
YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.
|
2015-09-08 12:29:54 -07:00 |
|
Varun Vasudev
|
435f935ba7
|
YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki.
|
2015-09-08 12:33:43 +05:30 |
|
Jian He
|
6f72f1e600
|
YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil
|
2015-09-08 09:35:46 +08:00 |
|
Xuan
|
9b78e6e33d
|
YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
state-store error occurs. Contributed by Jian He
|
2015-09-07 17:45:47 -07:00 |
|
Xuan
|
6a50689705
|
Modify the CHANGES.txt to move YARN-2019 Commit log from branch 2.8 to
branch 2.7.2
|
2015-09-07 17:27:53 -07:00 |
|
Varun Vasudev
|
1dbd8e34a7
|
YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir.
|
2015-09-07 11:32:12 +05:30 |
|
Wangda Tan
|
bcc85e3bab
|
YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)
|
2015-09-04 15:13:53 -07:00 |
|
Jason Lowe
|
6eaca2e363
|
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
|
2015-09-04 15:30:53 +00:00 |
|
Varun Vasudev
|
40d222e862
|
YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.
|
2015-09-04 14:31:51 +05:30 |
|
Varun Vasudev
|
b469ac531a
|
YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R.
|
2015-09-03 16:40:10 +05:30 |
|
Jian He
|
09c64ba1ba
|
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
|
2015-09-02 17:45:23 -07:00 |
|
Rohith Sharma K S
|
7d6687fe76
|
YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)
|
2015-09-02 15:22:48 +05:30 |
|
Rohith Sharma K S
|
095ab9ab5f
|
YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks)
|
2015-09-02 14:13:33 +05:30 |
|
Vinod Kumar Vavilapalli
|
4620767156
|
YARN-3222. Added the missing CHANGES.txt entry.
|
2015-09-01 13:43:10 -07:00 |
Andrew Wang
|
0eb9b19325
|
HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder.
|
2015-09-01 10:57:32 -07:00 |