76cf2250de
YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.
...
(cherry picked from commit b3056c266a
2014-10-15 18:48:36 -07:00
e8e3a36213
YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan.
...
YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.
(cherry picked from commit f2ea555ac6
2014-10-15 18:34:19 -07:00
08eeb3e5b6
HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak)
...
(cherry picked from commit 466f08792f
2014-10-15 15:52:46 -07:00
f93d2ea27e
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
2014-10-15 15:28:26 -07:00
025b6c13e9
MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov
...
(cherry picked from commit f19771a24c
2014-10-15 17:51:53 +00:00
e68fef4d81
HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao.
2014-10-15 10:28:02 -07:00
1179a0cb07
MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li
...
(cherry picked from commit b9edad6403
2014-10-15 15:54:57 +00:00
3ee0a5892b
HDFS-7190. Bad use of Preconditions in startFileInternal(). Contributed by Dawson Choong.
2014-10-14 23:42:36 -07:00
bec165e163
YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen.
...
(cherry picked from commit 1220bb72d4
2014-10-14 21:56:44 -07:00
174138ec26
HDFS-7201. Fix typos in hdfs-default.xml. Contributed by Dawson Choong.
2014-10-14 17:36:23 -07:00
8aeda20b25
HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.
...
(cherry picked from commit cdce88376a
2014-10-14 11:37:28 -07:00
6c3ac6a485
HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao.
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlockStoragePolicy.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestStorageMover.java
2014-10-14 10:33:51 -07:00
262fef119e
HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu.
2014-10-13 20:43:17 -07:00
dd0857fd70
HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException.
2014-10-13 18:30:21 -07:00
f3132eee10
HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh.
...
(cherry picked from commit 0e57aa3bf6
2014-10-13 18:10:23 -07:00
88455173e8
YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)
...
(cherry picked from commit cc93e7e683
2014-10-13 16:32:42 -07:00
a1116b56a4
YARN-2641. Decommission nodes on -refreshNodes instead of next NM-RM heartbeat. (Zhihai Xu via kasha)
...
(cherry picked from commit da709a2eac
2014-10-13 16:24:00 -07:00
31a4bf7321
Missing Changes.txt for YARN-2308
...
(cherry picked from commit 178bc505da
2014-10-13 14:20:18 -07:00
536254f5e7
YARN-2308. Changed CapacityScheduler to explicitly throw exception if the queue
...
to which the apps were submitted is changed across RM restart. Contributed by Craig Welch & Chang Li
(cherry picked from commit f9680d9a16
2014-10-13 14:16:12 -07:00
6b5741d423
YARN-2377. Localization exception stack traces are not passed as diagnostic info. Contributed by Gera Shegalov
...
(cherry picked from commit a56ea01002
2014-10-13 18:32:38 +00:00
e51ae64761
YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong.
...
(cherry picked from commit 4aed2d8e91
2014-10-13 10:55:09 -07:00
c3dfc71193
HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M.
2014-10-13 10:33:31 -07:00
715f222a80
HDFS-7236. Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots. Contributed by Yongjun Zhang.
2014-10-13 10:28:12 -07:00
942fb67a04
MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk. Contributed by Binglin Chang
...
(cherry picked from commit 793dbf2465
2014-10-13 16:05:29 +00:00
9ed9ea8c52
YARN-2667. Fix the release audit warning caused by hadoop-yarn-registry. Contributed by Yi Liu
...
(cherry picked from commit 344a10ad5e
2014-10-13 15:40:16 +00:00
e17e3bdbc4
MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai
...
(cherry picked from commit bbe80cdc7b
2014-10-13 15:09:26 +00:00
7bfd9e068d
MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)
...
(cherry picked from commit ed0e0ef9748ce5b231de677ab41c3035137bbde4)
2014-10-11 22:49:46 -07:00
38dedc2f07
YARN-2668 yarn-registry JAR won't link against ZK 3.4.5. (stevel)
2014-10-11 18:33:29 -07:00
16710758f1
HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao.
2014-10-10 23:02:41 -07:00
fff6a1f77e
YARN-2501. Enhanced AMRMClient library to support requests against node labels. Contributed by Wangda Tan.
...
(cherry picked from commit a5ec3d0809
2014-10-10 19:58:42 -07:00
059f774f90
HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B.
2014-10-10 17:27:30 -07:00
f11c8eb096
HDFS-6252. Phase out the old web UI in HDFS. Contributed by Haohui Mai.
2014-10-10 17:10:54 -07:00
217c0405d9
HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang)
...
(cherry picked from commit d3d3d47202
2014-10-10 13:40:53 -07:00
4c0bc45978
HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe)
...
(cherry picked from commit 1ceb326933
2014-10-10 13:04:16 -07:00
8ef83a9480
YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.
...
(cherry picked from commit db7f165319
2014-10-10 11:45:15 -07:00
1e6d81a886
YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.
...
(cherry picked from commit cb81bac002
2014-10-10 00:16:34 -07:00
b81641a310
YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth.
...
(cherry picked from commit d3afd730ac
2014-10-09 22:47:04 -07:00
f6278cbac5
MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth.
...
(cherry picked from commit 777877d079
2014-10-09 22:38:25 -07:00
61be28f501
MAPREDUCE-6122. Fix CHANGES.txt.
...
(cherry picked from commit 2f0166db56
2014-10-09 22:32:38 -07:00
85a2b90740
MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth.
...
(cherry picked from commit 684170d5ef
2014-10-09 22:27:40 -07:00
79204dced9
YARN-2671. Fix the Jira number in the change log.
...
(cherry picked from commit 5b12df6587
2014-10-09 20:59:37 -07:00
8cbacb37e9
HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang.
...
(cherry picked from commit cbd21fd13b
2014-10-09 18:53:03 -07:00
ad47a27dbf
YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan.
...
(cherry picked from commit e532ed8faa
2014-10-09 18:00:01 -07:00
7e20187f91
YARN-2180. [YARN-1492] In-memory backing store for cache manager. (Chris Trezzo via kasha)
...
(cherry picked from commit 4f426fe223
2014-10-09 17:16:45 -07:00
8addbe2b8e
HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe)
...
(cherry picked from commit d8d628d1e0
2014-10-09 17:12:24 -07:00
d3125f3de5
YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan.
...
(cherry picked from commit 596702a025
2014-10-09 15:47:20 -07:00
c1a86d105e
YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank)
2014-10-09 13:43:36 -07:00
6cc8ec980c
HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang)
...
(cherry picked from commit 8d94114495
2014-10-09 13:21:32 -07:00
4d170d3db6
YARN-2629. Made the distributed shell use the domain-based timeline ACLs. Contributed by Zhijie Shen.
...
(cherry picked from commit 1d4612f5ad
2014-10-09 13:01:44 -07:00
971eb31d28
HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang)
...
(cherry picked from commit d7b647f0ee
2014-10-09 11:58:51 -07:00
Vinod Kumar Vavilapalli
Ravi Prakash
Jian He
Jason Lowe
Jing Zhao
Haohui Mai
Zhijie Shen
Tsz-Wo Nicholas Sze
Aaron T. Myers
Karthik Kambatla
Steve Loughran
Andrew Wang
Colin Patrick Mccabe
cnauroth
Mayank Bansal