arp
754ba3a42d
HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2014-10-17 16:00:50 -07:00
arp
d973656e5d
HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
2014-10-17 16:00:50 -07:00
arp
2079d4b72e
HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
2014-10-17 16:00:49 -07:00
arp
15372df48d
HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
2014-10-17 16:00:49 -07:00
arp
c2721edc50
HDFS-6927. Initial unit tests for Lazy Persist files. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
2014-10-17 16:00:49 -07:00
arp
8e01a89b61
HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2014-10-17 16:00:49 -07:00
arp
34d0088bf9
HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/FsVolumeSpi.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java
2014-10-17 16:00:49 -07:00
arp
8c3c0ec977
HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/Receiver.java
2014-10-17 16:00:49 -07:00
arp
1d9d29ad40
HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormat.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageFormatPBINode.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSImageSerialization.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFile.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/INodeFileAttributes.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeLayoutVersion.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/FSImageFormatPBSnapshot.java
hadoop-hdfs-project/hadoop-hdfs/src/main/proto/fsimage.proto
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/CreateEditsLog.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLog.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSPermissionChecker.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java
2014-10-17 16:00:48 -07:00
arp
d09f316520
HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/StorageType.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
hadoop-hdfs-project/hadoop-hdfs/src/main/proto/hdfs.proto
2014-10-17 16:00:34 -07:00
Vinod Kumar Vavilapalli
db2bfed839
HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen.
...
(cherry picked from commit 1137557816
)
2014-10-17 15:57:39 -07:00
Jason Lowe
8217665297
MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE in client. Contributed by Rohith
...
(cherry picked from commit 209b1699fc
)
2014-10-17 19:53:35 +00:00
Jian He
b7504f0394
YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks
...
(cherry picked from commit a6aa6e42ca
)
2014-10-17 10:55:29 -07:00
Vinod Kumar Vavilapalli
778fbcd5d3
YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.
...
(cherry picked from commit abae63caf9
)
2014-10-17 08:59:49 -07:00
Ravi Prakash
d4606bff3c
HADOOP-11182. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) Fix CHANGES.txt
2014-10-16 16:54:21 -07:00
Jian He
6be8330606
YARN-2621. Simplify the output when the user doesn't have the access for getDomain(s). Contributed by Zhijie Shen
...
(cherry picked from commit 233d446be1
)
2014-10-16 16:38:27 -07:00
Steve Loughran
b0a72f354b
YARN-2689 TestSecureRMRegistryOperations failing on windows: secure ZK won't start
2014-10-16 14:21:38 -07:00
Tsz-Wo Nicholas Sze
fd036896a8
HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION.
2014-10-15 20:59:38 -07:00
Tsz-Wo Nicholas Sze
253e3eb31c
HDFS-7208. NN doesn't schedule replication when a DN storage fails. Contributed by Ming Ma
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeDescriptor.java
2014-10-15 20:49:18 -07:00
Vinod Kumar Vavilapalli
8a09fdccb3
YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.
...
(cherry picked from commit b3056c266a
)
2014-10-15 18:49:06 -07:00
Vinod Kumar Vavilapalli
fe80fd5e88
YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan.
...
YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.
(cherry picked from commit f2ea555ac6
)
2014-10-15 18:35:34 -07:00
Ravi Prakash
7b53ab7b14
HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak)
...
(cherry picked from commit 466f08792f
)
2014-10-15 15:53:47 -07:00
Jian He
bd45dba807
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
...
(cherry picked from commit f93d2ea27e
)
2014-10-15 15:31:57 -07:00
Jason Lowe
ec38eec165
MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov
...
(cherry picked from commit f19771a24c
)
2014-10-15 17:52:12 +00:00
Jing Zhao
439560dcf2
HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao.
2014-10-15 10:28:40 -07:00
Jason Lowe
9203ea7ea9
MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li
...
(cherry picked from commit b9edad6403
)
2014-10-15 15:59:56 +00:00
Zhijie Shen
eb055eadd7
YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen.
...
(cherry picked from commit 1220bb72d4
)
2014-10-14 21:58:12 -07:00
Zhijie Shen
e71fa82ee5
HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.
...
(cherry picked from commit cdce88376a
)
2014-10-14 11:39:06 -07:00
Jing Zhao
3d2d501abb
HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao.
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlockStoragePolicy.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestStorageMover.java
2014-10-14 10:43:12 -07:00
Haohui Mai
21fa0f6c43
HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu.
2014-10-13 20:44:23 -07:00
Tsz-Wo Nicholas Sze
20fc34edac
HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException.
2014-10-13 18:37:34 -07:00
Aaron T. Myers
834533fdfc
HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh.
...
(cherry picked from commit 0e57aa3bf6
)
(cherry picked from commit f3132eee10
)
2014-10-13 18:10:40 -07:00
Karthik Kambatla
e6102b1828
YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)
...
(cherry picked from commit cc93e7e683
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
2014-10-13 16:42:47 -07:00
Jian He
da3e84beb9
Missing Changes.txt for YARN-2308
...
(cherry picked from commit 178bc505da
)
2014-10-13 14:21:01 -07:00
Jian He
29496c9be2
YARN-2308. Changed CapacityScheduler to explicitly throw exception if the queue
...
to which the apps were submitted is changed across RM restart. Contributed by Craig Welch & Chang Li
(cherry picked from commit f9680d9a16
)
2014-10-13 14:16:57 -07:00
Jason Lowe
9d73c1b15f
YARN-2377. Localization exception stack traces are not passed as diagnostic info. Contributed by Gera Shegalov
...
(cherry picked from commit a56ea01002
)
2014-10-13 18:34:28 +00:00
Zhijie Shen
6da637ec12
YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong.
...
(cherry picked from commit 4aed2d8e91
)
2014-10-13 10:56:22 -07:00
Haohui Mai
4fb157655a
HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M.
2014-10-13 10:35:48 -07:00
Jing Zhao
369ef7c4b7
HDFS-7236. Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots. Contributed by Yongjun Zhang.
2014-10-13 10:30:44 -07:00
Jason Lowe
034fcaa540
MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk. Contributed by Binglin Chang
...
(cherry picked from commit 793dbf2465
)
2014-10-13 16:06:28 +00:00
Jason Lowe
eb5faa161a
YARN-2667. Fix the release audit warning caused by hadoop-yarn-registry. Contributed by Yi Liu
...
(cherry picked from commit 344a10ad5e
)
2014-10-13 15:46:14 +00:00
Jason Lowe
5dbbabe85f
MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai
...
(cherry picked from commit bbe80cdc7b
)
2014-10-13 15:12:05 +00:00
Steve Loughran
752f724d52
YARN-2668 yarn-registry JAR won't link against ZK 3.4.5. (stevel)
2014-10-11 18:32:47 -07:00
Haohui Mai
edf2497df7
HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao.
2014-10-10 23:04:19 -07:00
Uma Maheswara Rao G
157f86fca5
HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh)
...
(cherry picked from commit 8d7c54967d
)
2014-10-10 23:04:12 -07:00
Vinod Kumar Vavilapalli
8dacf89b3e
YARN-2501. Enhanced AMRMClient library to support requests against node labels. Contributed by Wangda Tan.
...
(cherry picked from commit a5ec3d0809
)
2014-10-10 19:59:30 -07:00
Vinod Kumar Vavilapalli
bb6c79f76c
YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.
...
(cherry picked from commit db7f165319
)
2014-10-10 11:46:10 -07:00
Zhijie Shen
16d7144337
YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.
...
(cherry picked from commit cb81bac002
)
2014-10-10 00:18:24 -07:00
cnauroth
281041a57e
YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth.
...
(cherry picked from commit d3afd730ac
)
(cherry picked from commit b81641a310
)
2014-10-09 22:49:00 -07:00
cnauroth
308e336853
MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth.
...
(cherry picked from commit 777877d079
)
(cherry picked from commit f6278cbac5
)
2014-10-09 22:40:34 -07:00