0ceb1b70f3
HDFS-14260. Replace synchronized method in BlockReceiver with atomic value. Contributed by BELUGA BEHR.
2019-02-11 10:09:44 -08:00
177131793a
HDFS-14172. Avoid NPE when SectionName#fromString returns null. Contributed by Xiang Li.
2019-02-08 20:51:30 +08:00
4be87353e3
HDFS-14140. JournalNodeSyncer authentication is failing in secure cluster. Contributed by Surendra Singh Lilhore.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-02-07 16:51:59 -08:00
668817a6ce
Revert "HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth."
...
(accidentally mixed in two patches)
This reverts commit fa8cd1bf28
2019-02-07 21:57:22 +00:00
6aa63452b3
HDFS-14242. OIV WebImageViewer: NPE when param op is not specified. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-02-06 12:19:21 -08:00
d3de8e162b
HDFS-14250. [SBN read]. msync should always direct to active NameNode to get latest stateID. Contributed by Chao Sun.
2019-02-06 09:54:47 -08:00
49ddd8a6ed
HDFS-14231. DataXceiver#run() should not log exceptions caused by InvalidToken exception as an error. Contributed by Kitti Nanasi.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-02-05 15:14:19 -08:00
308f3168fa
Make upstream aware of 3.1.2 release
...
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
2019-02-05 14:03:18 -08:00
fa8cd1bf28
HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth.
...
Contributed by Da Zhou and Junhua Gu.
2019-02-05 19:23:15 +00:00
f365957c63
HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile();
...
S3A to implement S3 Select through this API.
The new openFile() API is asynchronous, and implemented across FileSystem and FileContext.
The MapReduce V2 inputs are moved to this API, and you can actually set must/may
options to pass in.
This is more useful for setting things like s3a seek policy than for S3 select,
as the existing input format/record readers can't handle S3 select output where
the stream is shorter than the file length, and splitting plain text is suboptimal.
Future work is needed there.
In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific
configuration parameters which can be set in jobs and used to set filesystem input stream
options (seek policy, retry, encryption secrets, etc).
Contributed by Steve Loughran
2019-02-05 11:51:02 +00:00
5f15a60e32
HDFS-14125. Use parameterized log format in ECTopologyVerifier. Contributed by Kitti Nanasi.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-02-04 14:52:07 -08:00
0e79a86582
HDFS-14202. dfs.disk.balancer.max.disk.throughputInMBperSec property is not working as per set value. Contributed by Ranith Sardar.
2019-02-04 11:59:48 -08:00
9aa3dc872c
HDFS-14158. Checkpointer ignores configured time period > 5 minutes
...
This closes #449
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-02-04 13:51:07 +09:00
1129288cf5
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.
2019-01-29 18:29:56 -08:00
d1714c20e9
Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
...
This reverts commit 1d523279da
2019-01-29 15:43:09 -08:00
dc5af4c6b7
HDFS-12729. Document special paths in HDFS. Contributed by Masatake Iwasaki.
2019-01-26 05:34:32 +09:00
1d523279da
HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-01-25 09:02:57 -08:00
45caeee6cf
HDFS-14228. Incorrect getSnapshottableDirListing() javadoc. Contributed by Dinesh Chitlangia.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-01-25 07:37:01 -08:00
f3e642d92b
HDFS-14185. Cleanup method calls to static Assert methods in TestAddStripedBlocks
...
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I0d533f575a405ed3affd05994a4208bde7d9cbe9
2019-01-23 15:57:39 -08:00
951cdd7e4c
HDFS-14061. Check if the cluster topology supports the EC policy before setting, enabling or adding it. Contributed by Kitti Nanasi.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-01-23 14:40:57 -08:00
221e308cb5
HDFS-14153. [SPS] : Add Support for Storage Policy Satisfier in WEBHDFS. Contributed by Ayush Saxena.
2019-01-23 17:00:37 +05:30
7d6792e5d2
HDFS-14218. EC: Ls -e throw NPE when directory ec policy is disabled. Contributed by Ayush Saxena.
2019-01-23 10:03:06 +09:00
6f0756fc0e
HDFS-14222. Make ThrottledAsyncChecker constructor public. Contributed by Arpit Agarwal.
2019-01-21 20:45:09 -08:00
1ff658b2ef
HDFS-14221. Replace Guava Optional with Java Optional. Contributed by Arpit Agarwal.
2019-01-21 20:44:37 -08:00
de34fc148c
HDFS-14207. ZKFC should catch exception when ha configuration missing. Contributed by Fei Hui.
2019-01-22 12:01:08 +08:00
e9962240f0
Make 3.2.0 aware to other branches - jdiff
2019-01-21 22:41:26 +05:30
f048512bb8
HDFS-14192. Track missing DFS operations in Statistics and StorageStatistics. Contributed by Ayush Saxena.
2019-01-16 10:14:22 -08:00
fb8932a727
HADOOP-16029. Consecutive StringBuilder.append can be reused. Contributed by Ayush Saxena.
2019-01-11 10:54:49 -08:00
9aeaaa0479
HDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contributed by Ayush Saxena.
2019-01-11 14:36:55 +05:30
4ab5260b7e
HDFS-14132. Add BlockLocation.isStriped() to determine if block is replicated or Striped
...
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I0ed8996a0bae2ad2c7d3513143195533f7191af8
2019-01-08 17:04:57 -08:00
1a08302897
HDFS-14189. Fix intermittent failure of TestNameNodeMetrics. Contributed by Ayush Saxena.
2019-01-08 10:38:06 -08:00
f660e5eaa3
HDFS-14163. Debug Admin Command Should Support Generic Options. Contributed by Ayush Saxena.
2019-01-03 18:58:03 +05:30
21fe77e3ab
HDFS-14184. [SPS] Add support for URI based path in satisfystoragepolicy command. Contributed by Ayush Saxena.
2019-01-03 18:36:53 +05:30
f30473f2ef
HDFS-14183. [SPS] Remove the -w parameter from the -satisfystoragepolicy usage. Contributed by Ayush Saxena.
2018-12-31 03:16:26 +09:00
e9a005dfcf
HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
2018-12-28 10:34:18 -08:00
c546b12e45
HDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
c9d7737431
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement RpcInvocationHandler. Contributed by Konstantin V Shvachko.
2018-12-24 09:34:01 -08:00
fa8550337d
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
c3efc299fe
HDFS-14116. [SBN read] Fix class cast error in NNThroughputBenchmark with ObserverReadProxyProvider. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
ef3e1929dd
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from blocking within internalQueueCall. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
b73fb70f97
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko.
2018-12-24 09:34:01 -08:00
2904aa3808
HDFS-14131. [SBN read] Create user guide for Consistent Reads from Observer feature. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
cbc2f932eb
HDFS-14067. [SBN read] Allow manual failover between standby and observer. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
652b257478
HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang.
2018-12-24 09:34:01 -08:00
8c49135078
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
b6f20c36c2
HDFS-13925. Unit Test for transitioning between different states. Contributed by Sherwood Zheng.
2018-12-24 09:34:00 -08:00
1c4265d7bc
HDFS-13523. Support observer nodes in MiniDFSCluster. Contributed by Konstantin Shvachko.
2018-12-24 09:34:00 -08:00
b5b9b77707
HDFS-13961. [SBN read] TestObserverNode refactoring. Contributed by Konstantin Shvachko.
2018-12-24 09:34:00 -08:00
a65bb97f5d
HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen.
2018-12-24 09:34:00 -08:00
b74a7dbf88
HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode. Contributed by Chao Sun.
2018-12-24 09:34:00 -08:00
25b63e8da8
HDFS-13749. [SBN read] Use getServiceStatus to discover observer namenodes. Contributed by Chao Sun.
2018-12-24 09:34:00 -08:00
28820fb6b1
HDFS-13778. [SBN read] TestStateAlignmentContextWithHA should use real ObserverReadProxyProvider instead of AlignmentContextProxyProvider. Contributed by Konstantin Shvachko and Plamen Jeliazkov.
2018-12-24 09:34:00 -08:00
d2e85b0b6d
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.
2018-12-24 09:34:00 -08:00
aa42fb0db7
HDFS-13779. [SBN read] Implement proper failover and observer failure handling logic for for ObserverReadProxyProvider. Contributed by Erik Krogen.
2018-12-24 09:34:00 -08:00
25d8e39b5c
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider. Contributed by Konstantin Shvachko.
2018-12-24 09:34:00 -08:00
66ec3a67e8
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
2018-12-24 09:34:00 -08:00
4c9baba066
HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
2018-12-24 09:34:00 -08:00
eae0a5d54a
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
2018-12-24 09:34:00 -08:00
1e22f2bfbb
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen.
2018-12-24 09:34:00 -08:00
64b7cf59bd
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
2018-12-24 09:33:59 -08:00
0105d7f597
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko.
2018-12-24 09:33:59 -08:00
00e99c6594
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen.
2018-12-24 09:33:59 -08:00
151c8ddbe4
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
2018-12-24 09:33:59 -08:00
c81ac2ff02
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen.
2018-12-24 09:33:59 -08:00
e880660a20
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
2018-12-24 09:33:59 -08:00
091ad974cd
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
2018-12-24 09:33:59 -08:00
9bf0696c73
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
2018-12-24 09:33:59 -08:00
c9d73437e8
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
2018-12-24 09:33:59 -08:00
3a78e5ffd8
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby. Contributed by Chao Sun.
2018-12-24 09:33:59 -08:00
686fcd4db3
HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar.
2018-12-24 11:02:36 +05:30
d944d5ec46
HDFS-14165. In NameNode UI under DataNode tab ,the Capacity column is Non-Aligned. Contributed by Shubham Dewan.
2018-12-23 15:06:12 +05:30
feb2664ac4
HDFS-13946. Log longest FSN write/read lock held stack trace.
2018-12-22 23:09:59 +08:00
00d5e631b5
HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota.
2018-12-14 11:10:54 -08:00
cb3382f667
HDFS-14145. TestBlockStorageMovementAttemptedItems#testNoBlockMovementAttemptFinishedReportAdded fails sporadically in Trunk. Contributed by Ayush Saxena.
2018-12-14 10:59:02 -08:00
ca379e1c43
HDFS-13970. Use MultiMap for CacheManager Directives to simplify the code. Contributed by BELUGA BEHR.
2018-12-14 14:36:26 +09:00
561b61cfb1
HDFS-14144. TestPred fails in Trunk. Contributed by Ayush Saxena.
2018-12-12 11:16:16 -08:00
60af851e59
HDFS-14137. TestMaintenanceState fails with ArrayIndexOutOfBound Exception. Contributed by Ayush Saxena.
2018-12-11 11:22:32 -08:00
39dc7345b8
HDFS-14124. EC : Support EC Commands (set/get/unset EcPolicy) via WebHdfs. Contributed by Ayush Saxena.
2018-12-11 17:59:04 +05:30
80e59e7876
HDFS-14101. Fixing underflow error in test. Contributed by Zsolt Venczel.
2018-12-10 14:03:08 -07:00
8fc0d04517
HDFS-14001. [PROVIDED Storage] bootstrapStandby should manage the InMemoryAliasMap. Contributed by Virajith Jalaparti.
2018-12-07 18:30:36 -08:00
c03024a530
HDFS-14113. EC : Add Configuration to restrict UserDefined Policies. Contributed by Ayush Saxena.
2018-12-06 18:20:28 +05:30
69489ff2d1
HDFS-14119. Improve GreedyPlanner Parameter Logging. Contributed by Beluga Behr.
2018-12-03 12:55:52 -08:00
fb10803dfa
HDFS-13818. Extend OIV to detect FSImage corruption. Contributed by Adam Antal.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-12-03 10:34:39 -08:00
dd5e7c6b72
HDFS-12946. Add a tool to check rack configuration against EC policies. Contributed by Kitti Nanasi.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-12-03 10:01:09 -08:00
042c8ef593
HDFS-14075. Terminate the namenode when failed to start log segment. Contributed by Ayush Saxena.
2018-12-02 12:31:08 +05:30
99e201dfe2
HDFS-14105. Replace TreeSet in NamenodeFsck with HashSet. Contributed by Beluga Behr.
2018-11-30 11:07:11 -08:00
b09cfad432
HDFS-14106. Refactor NamenodeFsck#copyBlock. Contributed by Beluga Behr.
2018-11-30 10:47:59 -08:00
0e36e935d9
HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
2018-11-30 11:31:34 +08:00
0081b02e35
HDFS-14112. Avoid recursive call to external authorizer for getContentSummary.
2018-11-29 13:55:21 -08:00
f534736867
HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena.
2018-11-30 00:18:27 +05:30
c1d24f8483
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
...
Contributed by Ewan Higgs and Steve Loughran.
2018-11-29 15:12:17 +00:00
300f560fcc
HDFS-14102. Performance improvement in BlockPlacementPolicyDefault. Contributed by Beluga Behr.
2018-11-28 11:33:22 -08:00
4ca3a6b21a
HDFS-14108. Performance improvement in BlockManager Data Structures. Contributed by Beluga Behr.
2018-11-28 11:25:47 -08:00
b098281454
HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B.
2018-11-26 18:22:32 +05:30
892b33e054
HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena.
2018-11-22 00:13:56 +05:30
1a00b4e325
Add 2.9.2 release notes and changes documents.
2018-11-20 14:25:18 +09:00
68d5dfdc78
HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena.
2018-11-16 18:05:10 +05:30
8571507efa
HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
2018-11-16 17:26:36 +05:30
1e15c7e855
HADOOP-15936. [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier. Contributed by Zsolt Venczel.
2018-11-15 12:42:31 -08:00
460a94a10f
HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang.
2018-11-15 10:58:57 -08:00
993c2140cc
HDFS-14054. TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky. Contributed by Zsolt Venczel.
2018-11-15 09:29:14 -08:00
9da6054ca4
Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel."
...
This reverts commit 7dc79a8b5b
2018-11-13 12:44:25 -08:00
e7b63baca1
HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota
2018-11-13 12:45:44 +05:30
b6d4e19f34
HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena.
2018-11-12 15:31:42 -08:00
8d99648c20
HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-11-08 10:01:19 -08:00
887244de4a
HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen.
2018-11-06 11:18:15 -08:00
f0ce072934
HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota.
2018-11-06 10:05:58 -08:00
6430c9890a
HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in hadoop-hdfs.
2018-11-06 18:42:38 +09:00
ffc9c50e07
HDFS-14053. Provide ability for NN to re-replicate based on topology changes. Contributed by Hrishikesh Gadre.
2018-11-05 21:38:39 -08:00
f3296501e0
HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak.
2018-11-05 16:48:37 -08:00
f3f5e7ad00
HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti.
2018-11-05 11:02:31 -08:00
8fe85af63b
HDFS-13996. Make HttpFS' ACLs RegEx configurable. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-11-01 17:36:50 -07:00
d98b881e9a
HDFS-14008. NN should log snapshotdiff report. Contributed by Pranay Singh.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-11-01 17:26:00 -07:00
fac9f91b29
HDFS-13942. [JDK10] Fix javadoc errors in hadoop-hdfs module. Contributed by Dinesh Chitlangia.
2018-10-31 14:43:58 +09:00
db7e636824
HDFS-14027. DFSStripedOutputStream should implement both hsync methods.
2018-10-29 19:06:15 -07:00
63e7134df6
Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
...
This reverts commit fb2b72e6fc
2018-10-28 17:04:59 -07:00
4f10d7e23f
HDFS-14028. HDFS OIV temporary dir deletes folder.
...
Contributed by Adam Antal.
2018-10-26 16:41:23 -07:00
1851d06eb3
HDFS-13959. TestUpgradeDomainBlockPlacementPolicy is flaky. Contributed by Ayush Saxena.
2018-10-26 09:29:12 -07:00
9b899f1ebd
HDFS-14029. Sleep in TestLazyPersistFiles should be put into a loop. Contributed by Adam Antal.
2018-10-25 15:14:13 -07:00
fb2b72e6fc
HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
2018-10-25 09:33:31 -07:00
97bd49fc36
HDFS-14026. Overload BlockPoolTokenSecretManager.checkAccess to make storageId and storageType optional. Contributed by Arpit Agarwal.
2018-10-24 21:55:42 -07:00
936fc3f3c2
HDFS-14025. TestPendingReconstruction.testPendingAndInvalidate fails. Contributed by Ayush Saxena.
2018-10-24 16:18:43 -07:00
c1874046e2
HDFS-14021. TestReconstructStripedBlocksWithRackAwareness#testReconstructForNotEnoughRacks fails intermittently. Contributed by Xiao Chen.
2018-10-24 09:20:38 -07:00
635786a511
HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang.
2018-10-23 14:53:45 -07:00
efdfe679d6
HDFS-14004. TestLeaseRecovery2#testCloseWhileRecoverLease fails intermittently in trunk. Contributed by Ayush Saxena.
2018-10-23 14:28:37 -07:00
c58811c77d
HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Ajay Kumar.
2018-10-22 14:44:28 -07:00
f069d38c8d
HDFS-13983. TestOfflineImageViewer crashes in windows. Contributed by Vinayakumar B.
2018-10-19 17:16:04 -07:00
88cce32551
HDFS-9872. HDFS bytes-default configurations should accept multiple size units. Contributed by Yiqun Lin.
2018-10-19 10:38:04 -07:00
8b64fbab1a
HDFS-13994. Improve DataNode BlockSender waitForMinLength. Contributed by BELUGA BEHR.
2018-10-19 10:36:03 -07:00
be1cffb085
HDFS-14002. TestLayoutVersion#testNameNodeFeatureMinimumCompatibleLayoutVersions fails. Contributed by Takanobu Asanuma.
2018-10-18 15:25:53 -07:00
0e56c883cd
HDFS-14003. Fix findbugs warning in trunk for FSImageFormatPBINode. Contributed by Yiqun Lin.
2018-10-18 10:53:30 -07:00
533138718c
HDFS-13662. TestBlockReaderLocal#testStatisticsForErasureCodingRead is flaky
2018-10-16 19:33:55 -07:00
f90c64e624
HDFS-13993. TestDataNodeVolumeFailure#testTolerateVolumeFailuresAfterAddingMoreVolumes is flaky. Contributed by Ayush Saxena.
2018-10-16 11:22:57 -07:00
b6fc72a025
HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
2018-10-15 10:51:55 -07:00
b60ca37914
Fix potential FSImage corruption. Contributed by Daryn Sharp.
2018-10-15 15:48:26 +05:30
6e0e6daaf3
HDFS-13945. TestDataNodeVolumeFailure is Flaky. Contributed by Ayush Saxena.
2018-10-12 17:34:10 +05:30
de44e1064f
HDFS-13156. HDFS Block Placement Policy - Client Local Rack. Contributed by Ayush Saxena.
2018-10-12 17:27:23 +05:30
c0118105b7
HDFS-13973. getErasureCodingPolicy should log path in audit event. Contributed by Shweta.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-10-11 20:39:41 -07:00
3532aa3886
HDFS-13968. BlockReceiver Array-Based Queue. Contributed by BELUGA BEHR.
2018-10-11 13:49:39 -07:00
2addebb94f
HDFS-13951. HDFS DelegationTokenFetcher can't print non-HDFS tokens in a tokenfile.
...
Contributed by Steve Loughran.
2018-10-11 20:03:56 +01:00
bf3d591f0c
HDFS-13956. iNotify should include information to identify a file as either replicated or erasure coded. Contributed by Hrishikesh Gadre.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-10-10 10:23:07 -07:00
3ead525c71
HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-10-10 10:11:10 -07:00
10185d9a77
HDFS-13882. Set a maximum delay for retrying locateFollowingBlock. Contributed by Kitti Nanasi.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-10-10 08:55:32 -07:00
b39b802422
HDFS-13949. Correct the description of dfs.datanode.disk.check.timeout in hdfs-default.xml. Contributed by Toshihiro Suzuki.
2018-10-10 12:29:07 +05:30
6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.
2018-10-10 10:16:57 +09:00
605622c87b
HDFS-11396. TestNameNodeMetadataConsistency#testGenerationStampInFuture timed out. Contributed by Ayush Saxena.
2018-10-09 17:03:21 -07:00
08bb6c49a5
HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads.
...
Contributed by Xiao Chen, Hrishikesh Gadre.
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-10-08 20:31:57 -07:00
1043795f7f
HDFS-13962. Add null check for add-replica pool to avoid lock acquiring. Contributed by Surendra Singh Lilhore.
2018-10-09 10:33:13 +08:00
73c660b43f
HDFS-13958. Miscellaneous Improvements for FsVolumeSpi. Contributed by BELUGA BEHR.
2018-10-05 09:32:19 -07:00
619e490333
HDFS-13957. Fix incorrect option used in description of InMemoryAliasMap.
2018-10-05 09:55:08 +08:00
cc2babc1f7
HDFS-13950. ACL documentation update to indicate that ACL entries are capped by 32. Contributed by Adam Antal.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-10-04 15:22:44 -07:00
1dc0adfac0
HDFS-13947. Review of DirectoryScanner Class. Contributed by BELUGA BEHR.
2018-10-03 11:19:57 -07:00
58fa96b697
Changed version in trunk to 3.3.0-SNAPSHOT.
2018-10-02 22:41:41 +05:30
5689355783
HDFS-13768. Adding replicas to volume map makes DataNode start slowly. Contributed by Surendra Singh Lilhore.
2018-10-02 09:43:14 +08:00
e2113500df
HDFS-8196. Post enabled Erasure Coding Policies on NameNode UI. Contributed by Kitti Nanasi and Kai Sasaki.
2018-09-29 00:53:35 +09:00
f9c0221623
HDFS-13932. [JDK 11] Casts to BlockStoragePolicy[] in unit tests raise ClassCastExceptions. Contributed by Andrew Purtell.
2018-09-27 11:44:42 +09:00
e0ff8e2c10
HDFS-13840. RBW Blocks which are having less GS should be added to Corrupt. Contributed by Brahma Reddy Battula
2018-09-26 23:44:16 +05:30
6275b42870
HDFS-13927. Addendum: Improve TestDataNodeMultipleRegistrations#testDNWithInvalidStorageWithHA wait. Contributed by Ayush Saxena.
2018-09-26 09:50:09 -07:00
4758b4b6da
HDFS-13927. Improve TestDataNodeMultipleRegistrations#testDNWithInvalidStorageWithHA wait. Contributed by Ayush Saxena.
2018-09-21 15:32:28 -07:00
6fc293fece
HDFS-13892. Disk Balancer: Make execute command documentation better.
...
Contributed by Ranith Sardar.
2018-09-19 20:48:41 -07:00
2eb597b151
HADOOP-15772. Remove the 'Path ... should be specified as a URI' warnings on startup. Contributed by Ayush Saxena.
2018-09-19 13:48:27 -07:00
a30b4f9e71
HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen.
2018-09-19 13:22:37 -07:00
090272d7de
HADOOP-15684. triggerActiveLogRoll stuck on dead name node, when ConnectTimeoutException happens. Contributed by Rong Tang.
2018-09-19 13:00:30 -07:00
56e0d635e0
HDFS-13908. TestDataNodeMultipleRegistrations is flaky. Contributed by Ayush Saxena.
2018-09-19 09:30:25 -07:00
28ceb34a72
HDFS-13868. WebHDFS: GETSNAPSHOTDIFF API NPE when param "snapshotname" is given but "oldsnapshotname" is not. Contributed by Pranay Singh.
2018-09-19 03:12:20 -07:00
27978bcb66
HDFS-13833. Improve BlockPlacementPolicyDefault's consider load logic. Contributed by Shweta.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-09-18 20:23:50 -07:00
6ff509c32a
HDFS-11719. Arrays.fill() wrong index in BlockSender.readChecksum() exception handling. Contributed by Tao Zhang
2018-09-18 10:25:28 -07:00
d1541932db
HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js. Contributed by yanghuafeng.
2018-09-17 14:42:03 -07:00
fdf5a3fd63
HDFS-13919. Documentation: Improper formatting in Disk Balancer for Settings.
...
Contributed by Ayush Saxena.
2018-09-17 10:08:23 -07:00
a1de8cbac5
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
2018-09-14 05:22:56 +08:00
e1b242a984
HDFS-13914. Fix DN UI logs link broken when https is enabled after HDFS-13902. Contributed by Jianfei Jiang.
2018-09-13 09:16:58 -07:00
78bd3b1db9
HDFS-13846. Safe blocks counter is not decremented correctly if the block is striped
...
(Contributed by Kitti Nanasi via Daniel Templeton)
Change-Id: Id41747a67dc946fdf0dbde90643bb1ea7e9e0f70
2018-09-12 11:18:55 -07:00
b2432d254c
HDFS-13902. Add JMX, conf and stacks menus to the datanode page. Contributed by fengchuang.
2018-09-12 06:30:57 +05:30
8e54da1511
HDFS-13051. Fix dead lock during async editlog rolling if edit queue is full. Contributed by Daryn Sharp.
2018-09-10 22:34:23 -07:00
0da49642fc
HDFS-13884. Improve the description of the setting dfs.image.compress. Contributed by Ryan Wu.
2018-09-10 13:57:36 +08:00
eef3bafae8
HDFS-13895. EC: Fix Intermittent Failure in TestDFSStripedOutputStreamWithFailureWithRandomECPolicy. Contributed by Ayush Saxena.
2018-09-10 09:22:59 +05:30
30eceec342
HDFS-13806. EC: No error message for unsetting EC policy of the directory inherits the erasure coding policy from an ancestor directory. Contributed by Ayush Saxena.
2018-09-10 09:10:51 +05:30
335a8139f5
HDFS-13820. Add an ability to disable CacheReplicationMonitor. Contributed by Hrishikesh Gadre.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-09-07 14:59:06 -07:00
410dd3faa5
HDFS-13744. OIV tool should better handle control characters present in file or directory names. Contributed by Zsolt Venczel.
2018-09-07 12:39:33 -06:00
eca1a4bfe9
HDFS-13695. Move logging to slf4j in HDFS package. Contributed by Ian Pickering.
2018-09-06 14:48:00 -07:00
9af96d4ed4
HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak.
2018-09-05 10:50:25 -07:00
6ccb809c2d
HDFS-13812. Fix the inconsistent default refresh interval on Caching documentation. Contributed by Hrishikesh Gadre.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-09-04 21:53:42 -07:00
3801436e49
HDFS-13774. EC: 'hdfs ec -getPolicy' is not retrieving policy details when the special REPLICATION policy set on the directory. Contributed by Ayush Saxena.
2018-09-03 14:37:57 +05:30
8aa6c4f079
Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng."
...
This reverts commit 26c2a97c56
2018-08-30 11:44:20 -07:00
c36d69a7b3
HDFS-13027. Handle possible NPEs due to deleted blocks in race condition. Contributed by Vinayakumar B.
...
(cherry picked from commit 65977e5d81
2018-08-30 22:15:51 +05:30
582cb10ec7
HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui.
2018-08-30 11:21:13 +08:00
3e18b957eb
HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel.
2018-08-28 15:13:43 -07:00
33f42efc94
HDFS-13837. Enable debug log for LeaseRenewer in TestDistributedFileSystem. Contributed by Shweta.
2018-08-28 13:56:32 -07:00
26c2a97c56
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
2018-08-27 16:02:35 -07:00
b9b964d253
HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu.
2018-08-27 14:55:46 +08:00
96c4575d73
HDFS-13805. Journal Nodes should allow to format non-empty directories with -force option. Contributed by Surendra Singh Lilhore.
2018-08-24 08:14:57 +05:30
770d9d9bb6
HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled. Contributed by Ayush Saxena
2018-08-21 09:33:19 +05:30
79c97f6a0b
HADOOP-14624. Add GenericTestUtils.DelayAnswer that accept slf4j logger API. Contributed by Ian Pickering and Wenxin He.
2018-08-17 14:40:00 -07:00
77b015000a
HADOOP-8807. Update README and website to reflect HADOOP-8662. Contributed by Andras Bokor.
2018-08-17 11:10:29 +02:00
c67b0650ea
HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi.
2018-08-16 23:14:21 -07:00
1290e3c647
HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang.
2018-08-16 16:29:38 -07:00
8512e1a91b
HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh
...
(Contributed by Siyao Meng via Daniel Templeton)
Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
2018-08-16 15:00:45 -07:00
6df606f1b4
HDFS-13829. Remove redundant condition judgement in DirectoryScanner#scan. Contributed by liaoyuxiangqin.
2018-08-16 18:44:18 +08:00
7dc79a8b5b
HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel.
2018-08-15 13:53:47 -07:00
ef02f9b233
HDFS-13217. Audit log all EC policy names during addErasureCodingPolicies. Contributed by liaoyuxiangqin.
2018-08-15 09:23:05 -07:00
3e3963b035
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.
2018-08-16 00:31:59 +09:00
4a5006b1d0
HDFS-13819. TestDirectoryScanner#testDirectoryScannerInFederatedCluster is flaky
...
Change-Id: I1cea6e67fcec72702ad202775dee3373261ac5cd
2018-08-14 17:22:15 -07:00
363bd16e31
HADOOP-14212. Expose SecurityEnabled boolean field in JMX for other services besides NameNode. Contributed by Adam Antal.
2018-08-14 17:19:00 -07:00
cede33997f
HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi.
2018-08-14 11:57:22 -07:00
61a9b4f58b
HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan.
2018-08-14 11:51:27 -07:00
4023eeba05
HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh.
2018-08-13 17:36:13 -07:00
23854443ef
HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng.
2018-08-13 16:12:37 -07:00
f760a544a7
HDFS-13823. NameNode UI : "Utilities -> Browse the file system -> open a file -> Head the file" is not working. Contributed by Nanda kumar.
2018-08-13 11:35:19 -07:00
475bff6e8e
HDFS-13668. FSPermissionChecker may throws AIOOE when check inode permission. Contributed by He Xiaoqiao.
2018-08-13 17:32:56 +08:00
3ac07b720b
HDFS-13808: [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite() and #getFileInfo() function. Contributed by Rakesh R.
2018-08-12 03:06:07 -07:00
39ed3a66db
HDFS-13076: [SPS]: Cleanup work for HDFS-10285 merge. Contributed by Rakesh R.
2018-08-12 03:06:06 -07:00
dfcb331ba3
HDFS-13076: [SPS]: Addendum. Resolve conflicts after rebasing branch to trunk. Contributed by Rakesh R.
2018-08-12 03:06:06 -07:00
db3f227d8a
HDFS-13076: [SPS]: Resolve conflicts after rebasing HDFS-10285 branch to trunk. Contributed by Rakesh R.
2018-08-12 03:06:06 -07:00
66e8f9b315
HDFS-13381 : [SPS]: Use DFSUtilClient#makePathFromFileId() to prepare satisfier file path. Contributed by Rakesh R.
2018-08-12 03:06:06 -07:00
2acc50b826
HDFS-13165: [SPS]: Collects successfully moved block details via IBR. Contributed by Rakesh R.
2018-08-12 03:06:05 -07:00
75ccc1396b
HDFS-13166: [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls. Contributed by Rakesh R.
2018-08-12 03:06:05 -07:00
8467ec24fb
HDFS-13110: [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier. Contributed by Rakesh R.
2018-08-12 03:06:05 -07:00
4402f3f855
HDFS-13097: [SPS]: Fix the branch review comments(Part1). Contributed by Surendra Singh.
2018-08-12 03:06:04 -07:00
d3de4fb2a0
HDFS-13077. [SPS]: Fix review comments of external storage policy satisfier. Contributed by Rakesh R.
2018-08-12 03:06:04 -07:00
5845c36c16
HDFS-13050: [SPS]: Create start/stop script to start external SPS process. Contributed by Surendra Singh Lilhore.
2018-08-12 03:06:04 -07:00
99594b48b8
HDFS-13075. [SPS]: Provide External Context implementation. Contributed by Uma Maheswara Rao G.
2018-08-12 03:06:04 -07:00
3b83110d5e
HDFS-13057: [SPS]: Revisit configurations to make SPS service modes internal/external/none. Contributed by Rakesh R.
2018-08-12 03:06:04 -07:00
b0cb8d9bb4
HDFS-13033: [SPS]: Implement a mechanism to do file block movements for external SPS. Contributed by Rakesh R.
2018-08-12 03:06:03 -07:00
3159b39cf8
HDFS-13025. [SPS]: Implement a mechanism to scan the files for external SPS. Contributed by Uma Maheswara Rao G.
2018-08-12 03:06:03 -07:00
8d4f74e733
HDFS-12911. [SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations. Contributed by Uma Maheswara Rao G
2018-08-12 03:06:03 -07:00
05d4daf6ba
HDFS-12982 : [SPS]: Reduce the locking and cleanup the Namesystem access. Contributed by Rakesh R.
2018-08-12 03:06:02 -07:00
78420719eb
HDFS-12955: [SPS]: Move SPS classes to a separate package. Contributed by Rakesh R.
2018-08-12 03:06:02 -07:00
c561cb316e
HDFS-12106: [SPS]: Improve storage policy satisfier configurations. Contributed by Surendra Singh Lilhore.
2018-08-12 03:06:02 -07:00
9b83f94f35
HDFS-12790: [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits. Contributed by Rakesh R.
2018-08-12 03:06:02 -07:00
68017e3349
HDFS-12310: [SPS]: Provide an option to track the status of in progress requests. Contributed by Surendra Singh Lilhore.
2018-08-12 03:06:02 -07:00
5780f0624d
HDFS-12556: [SPS] : Block movement analysis should be done in read lock.
2018-08-12 03:06:01 -07:00
00eceed233
HDFS-12570: [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements. Contributed by Rakesh R.
2018-08-12 03:06:01 -07:00
bfd3f8bd8a
HDFS-12291: [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir. Contributed by Surendra Singh Lilhore.
2018-08-12 03:06:01 -07:00
7ea24fc06c
HDFS-12225: [SPS]: Optimize extended attributes for tracking SPS movements. Contributed by Surendra Singh Lilhore.
2018-08-12 03:06:01 -07:00
0e820f16af
HDFS-12214: [SPS]: Fix review comments of StoragePolicySatisfier feature. Contributed by Rakesh R.
2018-08-12 03:06:01 -07:00
3b601f2c0e
HDFS-12152: [SPS]: Re-arrange StoragePolicySatisfyWorker stopping sequence to improve thread cleanup time. Contributed by Rakesh R.
2018-08-12 03:06:00 -07:00
4bcf61c696
HDFS-12141: [SPS]: Fix checkstyle warnings. Contributed by Rakesh R.
2018-08-12 03:06:00 -07:00
9e82e5a86e
HDFS-12146. [SPS]: Fix TestStoragePolicySatisfierWithStripedFile#testSPSWhenFileHasLowRedundancyBlocks. Contributed by Surendra Singh Lilhore.
2018-08-12 03:06:00 -07:00
68af4e199a
HDFS-11874. [SPS]: Document the SPS feature. Contributed by Uma Maheswara Rao G
2018-08-12 03:06:00 -07:00
5eb24ef7e7
HDFS-11264: [SPS]: Double checks to ensure that SPS/Mover are not running together. Contributed by Rakesh R.
2018-08-12 03:06:00 -07:00
0b360b16ab
HDFS-11965: [SPS]: Should give chance to satisfy the low redundant blocks before removing the xattr. Contributed by Surendra Singh Lilhore.
2018-08-12 03:06:00 -07:00
00cf207192
HDFS-11670: [SPS]: Add CLI command for satisfy storage policy operations. Contributed by Surendra Singh Lilhore.
2018-08-12 03:05:59 -07:00
46f7523eb8
HDFS-11966. [SPS] Correct the log in BlockStorageMovementAttemptedItems#blockStorageMovementResultCheck. Contributed by Surendra Singh Lilhore.
2018-08-12 03:05:59 -07:00
20f9c62336
HDFS-11726. [SPS]: StoragePolicySatisfier should not select same storage type as source and destination in same datanode. Surendra Singh Lilhore.
2018-08-12 03:05:59 -07:00
d638a7dc03
HDFS-11762. [SPS]: Empty files should be ignored in StoragePolicySatisfier. Surendra Singh Lilhore.
2018-08-12 03:05:59 -07:00
e53f89ccc3
HDFS-11883: [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called. Contributed by Surendra Singh Lilhore.
2018-08-12 03:05:59 -07:00
5ce332dc9a
HDFS-11695: [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log. Contributed by Surendra Singh Lilhore.
2018-08-12 03:05:59 -07:00
6fe6c549e8
HDFS-11572. [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file. Contributed by Uma Maheswara Rao G
2018-08-12 03:05:58 -07:00
695a402fca
HDFS-11334: [SPS]: NN switch and rescheduling movements can lead to have more than one coordinator for same file blocks. Contributed by Rakesh R.
2018-08-12 03:05:58 -07:00
11a08a7e8f
HDFS-11338: [SPS]: Fix timeout issue in unit tests caused by longger NN down time. Contributed by Wei Zhou and Rakesh R
2018-08-12 03:05:58 -07:00
c00be44463
HDFS-11336: [SPS]: Remove xAttrs when movements done or SPS disabled. Contributed by Yuanbo Liu.
2018-08-12 03:05:58 -07:00
9b15f5418d
HDFS-11239: [SPS]: Check Mover file ID lease also to determine whether Mover is running. Contributed by Wei Zhou
2018-08-12 03:05:57 -07:00
e34331c31d
HDFS-11243. [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues. Contributed by Uma Maheswara Rao G
2018-08-12 03:05:57 -07:00
f8fc96a66e
HDFS-11309. [SPS]: chooseTargetTypeInSameNode should pass accurate block size to chooseStorage4Block while choosing target. Contributed by Uma Maheswara Rao G
2018-08-12 03:05:57 -07:00
681d2804c9
HDFS-11186. [SPS]: Daemon thread of SPS should start only in Active NN. Contributed by Wei Zhou
2018-08-12 03:05:57 -07:00
6215e35bb6
HDFS-11150: [SPS]: Provide persistence when satisfying storage policy. Contributed by Yuanbo Liu
2018-08-12 03:05:57 -07:00
df2b551e79
HDFS-11293: [SPS]: Local DN should be given preference as source node, when target available in same node. Contributed by Yuanbo Liu and Uma Maheswara Rao G
2018-08-12 03:05:56 -07:00
422f870607
HDFS-11289. [SPS]: Make SPS movement monitor timeouts configurable. Contributed by Uma Maheswara Rao G
2018-08-12 03:05:56 -07:00
81ed364b63
HDFS-11193 : [SPS]: Erasure coded files should be considered for satisfying storage policy. Contributed by Rakesh R
2018-08-12 03:05:56 -07:00
b7bed9f00a
HDFS-11248: [SPS]: Handle partial block location movements. Contributed by Rakesh R
2018-08-12 03:05:55 -07:00
d81611fe55
HDFS-11032: [SPS]: Handling of block movement failure at the coordinator datanode. Contributed by Rakesh R
2018-08-12 03:05:55 -07:00
5179d99b7e
HDFS-11123. [SPS] Make storage policy satisfier daemon work on/off dynamically. Contributed by Uma Maheswara Rao G
2018-08-12 03:05:55 -07:00
cd5262aba0
HDFS-10885. [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on. Contributed by Wei Zhou
2018-08-12 03:05:55 -07:00
b07291e176
HDFS-11151. [SPS]: StoragePolicySatisfier should gracefully handle when there is no target node with the required storage type. Contributed by Rakesh R
2018-08-12 03:05:54 -07:00
b67ae6d9d7
HDFS-10802. [SPS]: Add satisfyStoragePolicy API in HdfsAdmin. Contributed by Yuanbo Liu
2018-08-12 03:05:54 -07:00
19b5aee3e4
HDFS-11068: [SPS]: Provide unique trackID to track the block movement sends to coordinator. Contributed by Rakesh R
2018-08-12 03:05:54 -07:00
047526b4c2
HDFS-11029. [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs. Contributed by Uma Maheswara Rao G
2018-08-12 03:05:53 -07:00
0f2d1ddc2c
HDFS-10954. [SPS]: Provide mechanism to send blocks movement result back to NN from coordinator DN. Contributed by Rakesh R
2018-08-12 03:05:53 -07:00
24add8c2f8
HDFS-10884: [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN. Contributed by Rakesh R
2018-08-12 03:05:53 -07:00
e2a15d18bb
HDFS-10801. [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN. Contributed by Rakesh R
2018-08-12 03:05:53 -07:00
1438da4944
HDFS-10800: [SPS]: Daemon thread in Namenode to find blocks placed in other storage than what the policy specifies. Contributed by Uma Maheswara Rao G
2018-08-12 03:05:53 -07:00
5692887395
HDFS-10794. [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work. Contributed by Rakesh R
2018-08-12 03:05:52 -07:00
a2a8c48699
Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun.
2018-08-10 15:59:39 -07:00
15241c6349
HDFS-13795. Fix potential NPE in InMemoryLevelDBAliasMapServer.
2018-08-10 09:38:40 -07:00
5326a7906d
HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun.
2018-08-09 10:11:47 -07:00
49c687608b
Make 3.1.1 awared by other branches
2018-08-08 13:02:12 -07:00
9499df7b81
HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi.
2018-08-08 10:40:20 -07:00
36c0d742d4
HDFS-13447. Fix Typos - Node Not Chosen. Contributed by Beluga Behr.
2018-08-08 17:31:55 +02:00
2ec97abb2e
HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.
2018-08-08 13:50:23 +02:00
4203bc738c
HDFS-13785. EC: 'removePolicy' is not working for built-in/system Erasure Code policies. Contributed by Ayush Saxena
2018-08-08 12:42:20 +05:30
6677717c68
HDFS-13728. Disk Balancer should not fail if volume usage is greater than capacity. Contributed by Stephen O'Donnell.
2018-08-07 22:05:17 -07:00
2b0f977241
HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena.
2018-08-08 07:53:17 +05:30
0f8cb127cd
HDFS-13799. TestEditLogTailer#testTriggersLogRollsForAllStandbyNN fails due to missing synchronization
...
between rollEditsRpcExecutor and tailerThread shutdown. Contributed by Hrishikesh Gadre.
2018-08-07 16:13:41 -07:00
b1a59b1644
HDFS-13796. Allow verbosity of InMemoryLevelDBAliasMapServer to be configurable.
2018-08-07 10:15:28 -07:00
2b18bb4f37
HDFS-11610. sun.net.spi.nameservice.NameService has moved to a new location. Contributed by Akira Ajisaka.
2018-08-03 23:38:05 +09:00
3108d27edd
HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to support minimum number of volumes to be available. Contributed by Ranith Sardar and usharani
2018-07-30 15:50:04 +05:30
1c40bc2836
HDFS-13765. Fix javadoc for FSDirMkdirOp#createParentDirectories. Contributed by Lokesh Jain.
2018-07-27 10:14:01 -07:00
64e739e344
HDFS-13727. Log full stack trace if DiskBalancer exits with an unhandled exception.
...
Contributed by Gabor Bota.
2018-07-27 06:11:56 -07:00
be150a17b1
HDFS-13622. mkdir should print the parent directory in the error message when parent directories do not exist. Contributed by Shweta.
2018-07-26 10:24:32 -07:00
e95c5e9f62
HDFS-11060. make DEFAULT_MAX_CORRUPT_FILEBLOCKS_RETURNED configurable. Contributed by Lantao Jin.
2018-07-25 11:04:18 -07:00
26864471c2
HDFS-13761. Add toString Method to AclFeature Class. Contributed by Shweta.
2018-07-24 21:42:47 -07:00
849c45db18
HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
...
(Contributed by BELUGA BEHR via Daniel Templeton)
Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
2018-07-24 16:05:27 -07:00
0a1e922f3d
Fix potential FSImage corruption. Contributed by Ekanth Sethuramalingam & Arpit Agarwal.
2018-07-16 18:24:18 -07:00
88b2794244
HDFS-13524. Occasional "All datanodes are bad" error in TestLargeBlock#testLargeBlockSize. Contributed by Siyao Meng.
2018-07-16 10:51:23 -07:00
88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.
2018-07-13 11:42:12 -04:00
87eeb26e72
HDFS-13663. Should throw exception when incorrect block size is set. Contributed by Shweta.
2018-07-12 20:24:11 -07:00
b37074be5a
HDFS-12837. Intermittent failure in TestReencryptionWithKMS.
2018-07-11 21:03:19 -07:00
418cc7f3ae
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota.
2018-07-11 14:46:43 -04:00
162228e8db
HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.
2018-07-11 10:02:08 -07:00
c275a9a6a0
Merge trunk into HDDS-48
2018-07-09 12:13:03 -07:00
eecb5baaaa
HDFS-13719. Docs around dfs.image.transfer.timeout are misleading. Contributed by Kitti Nansi.
2018-07-09 15:17:21 +02:00
936e0df0d3
HDFS-13721. NPE in DataNode due to uninitialized DiskBalancer.
2018-07-06 21:00:32 -07:00
0247cb6318
HDFS-13121. NPE when request file descriptors when SC read. Contributed by Zsolt Venczel.
2018-07-06 14:59:49 -07:00
59a3038bc3
HDFS-13715:diskbalancer does not work if one of the blockpools are empty on a Federated cluster. Contributed by Bharat Viswanadham
2018-07-02 21:43:18 -07:00
7296b644f7
HDFS-13714. Fix TestNameNodePrunesMissingStorages test failures on Windows. Contributed by Lukas Majercak.
2018-07-02 16:36:25 -07:00
1804a31515
HDFS-13536. [PROVIDED Storage] HA for InMemoryAliasMap. Contributed by Virajith Jalaparti.
2018-07-02 10:48:20 -07:00
5d748bd056
HDFS-13702. Remove HTrace hooks from DFSClient to reduce CPU usage. Contributed by Todd Lipcon.
2018-07-02 12:11:06 +02:00
6ba9974108
HDFS-13703. Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit. Contributed by Todd Lipcon.
2018-07-02 12:02:19 +02:00
73746c5da7
HDFS-13707. [PROVIDED Storage] Fix failing integration tests in ITestProvidedImplementation. Contributed by Virajith Jalaparti.
2018-06-29 09:56:13 -07:00
c104525168
Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48
2018-06-28 14:28:23 -07:00
2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
2018-06-28 14:37:22 +09:00
30728aced4
HDFS-13692. StorageInfoDefragmenter floods log when compacting StorageInfo TreeSet. Contributed by Bharat Viswanadham.
2018-06-22 10:50:54 +08:00
32f867a6a9
HDFS-13682. Cannot create encryption zone after KMS auth token expires.
2018-06-20 15:58:26 -07:00
fba9d7cd74
HDFS-13621. Upgrade commons-lang version to 3.7 in hadoop-hdfs-project. Contributed by Takanobu Asanuma.
2018-06-18 10:17:07 -07:00
980031bb04
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
2018-06-17 11:54:26 -07:00
8762e9cf10
HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows. Contributed by Xiao Liang.
2018-06-15 16:49:06 -07:00
d31a3ce767
HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by Lukas Majercak.
2018-06-15 15:59:19 -07:00
c966a3837a
HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by Istvan Fajth.
2018-06-15 13:36:46 -07:00
eebeb6033f
HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming Zhang.
2018-06-15 13:07:54 -07:00
43d994e4a6
HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming Zhang.
2018-06-15 10:33:28 -07:00
3e37a9a70b
HDFS-13679. Fix Typo in javadoc for ScanInfoPerBlockPool#addAll. Contributed by Shashikant Banerjee.
2018-06-15 14:58:20 +05:30
5d7449d2b8
HDFS-13675. Speed up TestDFSAdminWithHA. Contributed by Lukas Majercak.
2018-06-14 13:43:14 -07:00
8d4926f38b
HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by Lukas Majercak.
2018-06-14 09:58:50 -07:00
418cff4820
Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48
2018-06-14 09:38:20 -07:00
8e7548d33b
HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
2018-06-13 20:05:55 +08:00
f4c7c91123
HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan.
2018-06-13 00:36:02 -07:00
7c3dc39083
Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
...
(cherry picked from commit 5a82f10e32
2018-06-11 15:13:18 -07:00
2e5cfe6df3
HDFS-13653. Make dfs.client.failover.random.order a per nameservice configuration. Contributed by Ekanth Sethuramalingam.
2018-06-11 11:20:29 -07:00
ccfb816d39
HDFS-13667:Typo: Marking all datandoes as stale. Contributed by Nanda Kumar
2018-06-09 16:43:03 -07:00
000a678396
HDFS-12670. can't renew HDFS tokens with only the hdfs client jar. Contributed by Arpit Agarwal.
2018-06-08 17:57:12 -07:00
cf4108313d
HDFS-13642. Creating a file with block size smaller than EC policy's cell size should fail.
2018-06-08 15:14:11 -07:00
e39b113db0
HDFS-13659. Add more test coverage for contentSummary for snapshottable path. Contributed by Wei-Chiu Chuang.
2018-06-07 08:30:06 -07:00
9654dd1f47
HDFS-12950. [oiv] ls will fail in secure cluster. Contributed by Wei-Chiu Chuang.
2018-06-07 10:16:02 +05:30
772c95395b
HDDS-140. Add DU usage to VolumeInfo.
2018-06-06 16:21:21 -07:00
0e3c31579d
HDFS-13545. "guarded" is misspelled as "gaurded" in FSPermissionChecker.java. Contributed by Jianchao Jia.
2018-06-05 17:53:24 +09:00
8d31ddcfeb
HDFS-13650. Randomize baseDir for MiniDFSCluster in TestDFSStripedInputStream and TestDFSStripedInputStreamWithRandomECPolicy. Contributed by Anbang Hu.
2018-06-04 18:28:11 -07:00
16316b6011
HDFS-13649. Randomize baseDir for MiniDFSCluster in TestReconstructStripedFile and TestReconstructStripedFileWithRandomECPolicy. Contributed by Anbang Hu.
2018-06-04 18:21:38 -07:00
a28848104f
HDFS-13652. Randomize baseDir for MiniDFSCluster in TestBlockScanner. Contributed by Anbang Hu.
2018-06-04 18:12:43 -07:00
e2289c8d14
HDFS-13281 Namenode#createFile should be /.reserved/raw/ aware.. Contributed by Rushabh S Shah
2018-06-04 09:19:03 -05:00
bccdfeee0a
HDFS-13155. BlockPlacementPolicyDefault.chooseTargetInOrder Not Checking Return Value for NULL. Contributed by Zsolt Venczel.
2018-06-04 07:03:05 -07:00
9efb4b7db0
HDFS-13339. Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume. Contributed by liaoyuxiangqin and Zsolt Venczel.
2018-06-03 22:33:34 -07:00
8f83b9abf9
HDFS-13648. Fix TestGetConf#testGetJournalNodes on Windows due to a mismatch line separator. Contributed by Giovanni Matteo Fumarola.
2018-06-02 20:19:59 -07:00
e308ac88d3
HDFS-13651. TestReencryptionHandler fails on Windows. Contributed by Anbang Hu.
2018-06-02 20:12:35 -07:00
ff013d2c95
HDFS-13602. Add checkOperation(WRITE) checks in FSNamesystem. Contributed by Chao Sun.
2018-05-31 17:37:44 -07:00
3f4a29813b
HDFS-13646. DFSAdmin doesn't display specialized help for triggerBlockReport. Contributed by Takanobu Asanuma.
2018-05-31 15:26:08 -07:00
ebe5853a45
HDFS-12978. Fine-grained locking while consuming journal stream. Contributed by Konstantin Shvachko.
2018-05-31 14:56:32 -07:00
1f324e9661
HDFS-13631. TestDFSAdmin#testCheckNumOfBlocksInReportCommand should use a separate MiniDFSCluster path. Contributed by Anbang Hu.
2018-05-31 10:12:38 -07:00
1361030e59
HDFS-13582. Improve backward compatibility for HDFS-13176 (WebHdfs file path gets truncated when having semicolon (;) inside). Contributed by Zsolt Venczel.
2018-05-31 07:59:21 -06:00
47c31ff16b
HDFS-13629. Some tests in TestDiskBalancerCommand fail on Windows due to MiniDFSCluster path conflict and improper path usage. Contributed by Anbang Hu.
2018-05-30 10:22:04 -07:00
8197b9b560
HDFS-13632. Randomize baseDir for MiniJournalCluster in MiniQJMHACluster for TestDFSAdminWithHA. Contributed by Anbang Hu.
2018-05-30 10:13:52 -07:00
b24098bc8f
HDFS-13626. Fix incorrect username when deny the setOwner operation. Contributed by Zsolt Venczel.
2018-05-30 16:52:21 +08:00
9dbf4f0166
HDFS-13591. TestDFSShell#testSetrepLow fails on Windows. Contributed by Anbang Hu.
2018-05-28 16:34:02 -07:00
91d7c74e6a
HDFS-13627. TestErasureCodingExerciseAPIs fails on Windows. Contributed by Anbang Hu.
2018-05-28 10:26:47 -07:00
04757e5864
HDFS-13628. Update Archival Storage doc for Provided Storage
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-28 19:06:34 +09:00
8605a38514
HDFS-13620. Randomize the test directory path for TestHDFSFileSystemContract. Contributed by Anbang Hu.
2018-05-25 19:43:33 -07:00
13d2528907
HDFS-13619. TestAuditLoggerWithCommands fails on Windows. Contributed by Anbang Hu.
2018-05-25 13:32:34 -07:00
1e0d4b1c28
HDFS-13618. Fix TestDataNodeFaultInjector test failures on Windows. Contributed by Xiao Liang.
2018-05-25 09:14:28 -07:00
7a87add4ea
HDFS-13598. Reduce unnecessary byte-to-string transform operation in INodesInPath#toString. Contributed by Gabor Bota.
2018-05-24 10:57:35 +08:00
cddbbe5f69
HDFS-13493. Reduce the HttpServer2 thread count on DataNodes. Contributed by Erik Krogen.
2018-05-23 12:12:08 -07:00
c13dea87d9
HDFS-13587. TestQuorumJournalManager fails on Windows. Contributed by Anbang Hu.
2018-05-23 11:36:03 -07:00
bc6d9d4c79
HDFS-13589: Add dfsAdmin command to query if upgrade is finalized. Contributed by Hanisha Koneru
2018-05-23 10:15:40 -07:00
c0c9b7a8ef
HDFS-13588. Fix TestFsDatasetImpl test failures on Windows. Contributed by Xiao Liang.
2018-05-23 09:46:35 -07:00
34e8b9f9a8
HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.
2018-05-23 19:10:09 +08:00
1d2640b613
HDFS-13601. Optimize ByteString conversions in PBHelper.
2018-05-22 23:55:20 -07:00
9775ecb235
HDFS-13593. TestBlockReaderLocalLegacy#testBlockReaderLocalLegacyWithAppend fails on Windows. Contributed by Anbang Hu.
2018-05-18 09:46:02 -07:00
57b893de3d
HDFS-13592. TestNameNodePrunesMissingStorages#testNameNodePrunesUnreportedStorages does not shut down cluster properly. Contributed by Anbang Hu.
2018-05-18 09:36:58 -07:00
f749517cc7
HDFS-13573. Javadoc for BlockPlacementPolicyDefault is inaccurate. Contributed by Zsolt Venczel.
2018-05-18 10:43:53 +08:00
53b807a6a8
HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
2018-05-17 17:03:23 -07:00
a97a2042f2
HDFS-13556. TestNestedEncryptionZones does not shut down cluster. Contributed by Anbang Hu.
2018-05-17 16:53:23 -07:00
65476458fa
HDFS-13554. TestDatanodeRegistration#testForcedRegistration does not shut down cluster. Contributed by Anbang Hu.
2018-05-17 14:48:04 -07:00
26f1e22fc9
HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. Contributed by Anbang Hu.
2018-05-17 13:35:09 -07:00
c0ec061e28
HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows. Contributed by Anbang Hu.
2018-05-17 09:21:57 -07:00
0ce6290de6
HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee.
2018-05-17 09:23:24 -05:00
454de3b543
HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu.
2018-05-16 19:23:02 -07:00
0fc988e6a3
HDFS-13512. WebHdfs getFileStatus doesn't return ecPolicy. Contributed by Ajay Kumar.
2018-05-16 11:28:39 -07:00
55d5549087
HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu.
2018-05-16 10:08:49 -07:00
6b67161ca3
HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu.
2018-05-16 09:31:46 -07:00
63480976a0
HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu.
2018-05-15 15:34:54 -07:00
2d6195c0af
HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu.
2018-05-15 11:20:32 -07:00
eaca7980ad
HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu.
2018-05-15 10:27:36 -07:00
92ebd466c7
HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu.
2018-05-15 10:21:42 -07:00
6beb25ab7e
HDFS-13544. Improve logging for JournalNode in federated cluster.
2018-05-14 10:12:08 -07:00
960940e0e0
HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure.
2018-05-14 09:28:39 -07:00
f3f544b004
Add 2.9.1 release notes and changes documents
2018-05-14 15:14:02 +08:00
66c9905b57
Revert "Add 2.9.1 release notes and changes documents"
...
This reverts commit e4dc346d65
2018-05-14 14:38:40 +08:00
e4dc346d65
Add 2.9.1 release notes and changes documents
2018-05-14 14:24:01 +08:00
4b4f24ad5f
HDDS-40. Separating packaging of Ozone/HDDS from the main Hadoop.
...
Contributed by Elek, Marton.
2018-05-11 14:24:36 -07:00
d50c4d71dc
HDFS-13542. TestBlockManager#testNeededReplicationWhileAppending fails due to improper cluster shutdown in TestBlockManager#testBlockManagerMachinesArray on Windows. Contributed by Anbang Hu.
2018-05-11 09:47:57 -07:00
696a4be0da
HDFS-12981. renameSnapshot a Non-Existent snapshot to itself should throw error. Contributed by Kitti Nanasi.
2018-05-07 15:36:29 -07:00
118bd75805
Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445."
...
This reverts commit 6503593711
2018-05-07 13:32:27 -07:00
a732acd873
HDFS-5926 Documentation should clarify dfs.datanode.du.reserved impact from reserved disk capacity (Gabor Bota)
2018-05-04 16:38:30 -07:00
9e2cfb2d3f
HDFS-13503. Fix TestFsck test failures on Windows. Contributed by Xiao Liang.
2018-05-01 08:12:46 -07:00
fc074a359c
HDFS-13283. Percentage based Reserved Space Calculation for DataNode. Contributed by Lukas Majercak.
2018-04-30 13:28:33 -07:00
eb7fe1d588
HDFS-13509. Bug fix for breakHardlinks() of ReplicaInfo/LocalReplica, and fix TestFileAppend failures on Windows. Contributed by Xiao Liang.
2018-04-28 09:05:30 -07:00
84ecfe3ceb
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-27 19:21:37 +09:00
09c9cf1d43
HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li.
2018-04-26 13:54:40 -07:00
a8e428b2dc
HDFS-13468. Add erasure coding metrics into ReadStatistics. (Contributed by Lei (Eddy) Xu)
2018-04-26 13:54:40 -07:00
48269c370c
HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri.
2018-04-26 13:54:40 -07:00
2adda92de1
HDFS-7240 git commit fixup
...
Signed-off-by: Owen O'Malley <omalley@apache.org>
2018-04-26 13:52:17 -07:00
3d18ca4926
HDFS-13459. Ozone: Clean-up of ozone related change from MiniDFSCluste. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
979bbb4019
HDFS-13423. Ozone: Clean-up of ozone related change from hadoop-hdfs-project. Contributed by Nanda Kumar.
2018-04-26 05:36:04 -07:00
25f2398bbd
HDFS-13395. Ozone: Plugins support in HDSL Datanode Service. Contributed by Nanda Kumar.
2018-04-26 05:36:04 -07:00
4e61bc431e
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
...
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
2018-04-26 05:36:04 -07:00
5e7164c614
HDFS-13137. Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key.
...
Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
61651dcf5c
HDFS-13108. Ozone: OzoneFileSystem: Simplified url schema for Ozone File System. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
9a914126a7
HDFS-13008. Ozone: Add DN container open/close state to container report. Contributed by Xiaoyu Yao.
2018-04-26 05:36:04 -07:00
f4466402ae
HDFS-12965. Ozone: Documentation : Add ksm -createObjectStore command documentation. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
1094af072c
HDFS-11699. Ozone:SCM: Add support for close containers in SCM. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
b4a3cf1476
HDFS-13070. Ozone: SCM: Support for container replica reconciliation - 1. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
4c10a849e8
HDFS-13078. Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT.
...
To fix large chunk reads (>4M) from Datanodes. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
136b419594
HDFS-13149. Ozone: Rename Corona to Freon. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
9272e1021d
HDFS-12636. Ozone: OzoneFileSystem: Implement seek functionality for rpc client. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
377b31ffa1
HDFS-13022. Block Storage: Kubernetes dynamic persistent volume provisioner. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
ee5495456e
HDFS-13116. Ozone: Refactor Pipeline to have transport and container specific information. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
3cf07b43bc
HDFS-13127. Fix TestContainerStateManager and TestOzoneConfigurationFields. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
443425a5d9
HDFS-12522. Ozone: Remove the Priority Queues used in the Container State Manager. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
32245c78e2
HDFS-13080. Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
150c4e1d0b
HDFS-12879. Ozone : add scm init command to document. Contributed by Rahul Pathak.
2018-04-26 05:36:04 -07:00
7b3179f551
HDFS-13072. Ozone: DatanodeStateMachine: Handling Uncaught Exception in command handler thread. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
6b03fca37d
HDFS-12868. Ozone: Service Discovery API. Contributed by Nanda Kumar.
2018-04-26 05:36:04 -07:00
fb09d75379
HDFS-13018. Block Storage: make the iscsi target addres configurable for discovery. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
4bb9ad8e8f
HDFS-13017. Block Storage: implement simple iscsi discovery in jscsi server. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
ba4d5a52a8
HDFS-12986. Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-0f7169d-SNAPSHOT). Contributed by Lokesh Jain
2018-04-26 05:36:04 -07:00
94c0346f35
HDFS-13024. Ozone: ContainerStateMachine should synchronize operations between createContainer and writeChunk. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
4a051ba494
HDFS-12940. Ozone: KSM: TestKeySpaceManager#testExpiredOpenKey fails occasionally. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
1fb1ce107f
HDFS-13012. TestOzoneConfigurationFields fails due to missing configs in ozone-default.xml. Contributed by Xiaoyu Yao.
2018-04-26 05:36:04 -07:00
916f31f7d1
HDFS-13026. Ozone: TestContainerPersistence is failing becaue of container data mismatch. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
28b87af51b
HDFS-13013. Fix closeContainer API with the right container state change. Contributed by Xiaoyu Yao.
2018-04-26 05:36:04 -07:00
c4b88454a7
HDFS-12843. Ozone: Client: TestOzoneRpcClient#testPutKeyRatisThreeNodes is failing. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
98d62e55c4
Revert "HDFS-12794. Ozone: Parallelize ChunkOutputSream Writes to container. Contributed by Shashikant Banerjee."
...
This reverts commit 6ce5ec6761
2018-04-26 05:36:04 -07:00
98eeabbdb3
HDFS-12794. Ozone: Parallelize ChunkOutputSream Writes to container. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
0c48cb2cf2
HFDS-13007. Ozone: Fix TestKeySpaceManager#testKSMInitializationFailure. Contributed by Xiaoyu Yao.
2018-04-26 05:36:04 -07:00
98973cd0c4
HDFS-12966. Ozone: owner name should be set properly when the container allocation happens. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
5e31b920f0
HDFS-12871. Ozone: Service Discovery: Adding REST server details in ServiceList. Contributed by Nanda Kumar.
2018-04-26 05:36:04 -07:00
3965f1ec99
HDFS-12853. Ozone: Optimize chunk writes for Ratis by avoiding double writes. Contributed by Mukul Kumar Singh
2018-04-26 05:36:04 -07:00
5cc5149bd8
HDFS-12961. Ozone: Use relative resource urls in KSM/SCM web ui. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
5766792cad
HDFS-12870. Ozone: Service Discovery: REST endpoint in KSM for getServiceList. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
5f10c2d8ce
HDFS-12980. Ozone: SCM: Restructuring container state transition and event. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
87b7774488
HDFS-12958. Ozone: remove setAllocatedBytes method in ContainerInfo. Contributed by Chen Liang.
2018-04-26 05:36:04 -07:00
ce19f09bd0
HDFS-12908. Ozone: write chunk call fails because of Metrics registry exception. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
4b9f66a19e
HDFS-12869. Ozone: Service Discovery: RPC endpoint in KSM for getServiceList. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
79432ee6cf
HDFS-12863. Ozone: Avoid configuration.get() call for each container report. Contributed by Akira Ajisaka.
2018-04-26 05:36:04 -07:00
0380dbb928
HDFS-12941. Ozone: ConfServlet does not trim values during the description parsing. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
4dae68eebf
HDFS-12741. Ozone: KSM: ADD support for KSM --createObjectStore command. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
caeeb78ca4
HDFS-12799. Ozone: SCM: Close containers: extend SCMCommandResponseProto with SCMCloseContainerCmdResponseProto. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
966853894f
HDFS-12795. Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE and LifeCycleEvent FULL_CONTAINER. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
26e270b908
HDFS-12751. Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close. Contributed by Chen Liang.
2018-04-26 05:36:04 -07:00
fd09c2ce5b
HDFS-12890 . Ozone: XceiverClient should have upper bound on async requests. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
2f3068bc72
HDFS-12698. Ozone: Use time units in the Ozone configuration values. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
8ff98e2af3
HDFS-12000. Ozone: Container : Add key versioning support-1. Contributed by Chen Liang.
2018-04-26 05:36:04 -07:00
c0c87dea9b
HDFS-12626. Ozone : delete open key entries that will no longer be closed. Contributed by Chen Liang.
2018-04-26 05:36:04 -07:00
6c630d0b09
HDFS-12899. Ozone: SCM: BlockManagerImpl close is called twice during StorageContainerManager#stop. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
74362cb503
HDFS-12901. Ozone: SCM: Expose StorageContainerManager#getScmId through container protocol. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
11473b8204
HDFS-12898. Ozone: TestSCMCli#testHelp and TestSCMCli#testNonExistCommand fail consistently. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
207523915d
HDFS-12588. Use GenericOptionsParser for scm and ksm daemon. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
7bba3943f0
HDFS-12876. Ozone: moving NodeType from OzoneConsts to Ozone.proto. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
85ec48a646
HDFS-12867. Ozone: TestOzoneConfigurationFields fails consistently. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
538e17824d
HDFS-12850. Ozone: TestContainerPersistence#testListContainer fails frequently due to timed out. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
e32e187448
HDFS-12864. Ozone: Turn off full synced write in RocksDB MetadataStore. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
8023ba50b5
HDFS-12807. Ozone: Expose RockDB stats via JMX for Ozone metadata stores. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
86802a461c
HDFS-12851. Ozone: Upgrade to latest ratis build. Contributed by Mukul Kumar Singh
2018-04-26 05:36:04 -07:00
ea86945754
HDFS-12842. Ozone: SCM: During startup SCM should check if the cluster is INITIALIZED. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
73ca8608da
HDFS-12786. Ozone: add port/service names to the ksm/scm web ui. Contributed by Elek Marton.
2018-04-26 05:36:04 -07:00
f9c11d952c
HDFS-12740. SCM should support a RPC to share the cluster Id with KSM and DataNodes. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
c8d8270f72
HDFS-12787. Ozone: SCM: Aggregate the metrics from all the container reports. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
cbe4f314b3
HDFS-12731. Ozone: Fix inconsistent default value in ozone settings. Contributed by Bharat Viswanadham.
2018-04-26 05:36:04 -07:00
4deb845d7c
HDFS-12759. Ozone: web: integrate configuration reader page to the SCM/KSM web ui. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
8e8ff85b16
HDFS-12830. Ozone: TestOzoneRpcClient#testPutKeyRatisThreeNodes fails. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
214b52dfce
HDFS-12500. Ozone: add logger for oz shell commands and move error stack traces to DEBUG level. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
419e86d580
HDFS-12805. Ozone: Redundant characters printed in exception log. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
93f1b04949
HDFS-12798. Ozone: scm web: fix the node status table. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
4460ac9c57
HDFS-12756. Ozone: Add datanodeID to heartbeat responses and container protocol. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
446e84357d
HDFS-12796. SCM should not start if Cluster Version file does not exist. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
740a06cdd7
HDFS-12719. Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
761926db2c
HDFS-12793. Ozone : TestSCMCli is failing consistently. Contributed by Chen Liang.
2018-04-26 05:36:04 -07:00
e395244e95
HDFS-12758. Ozone: Correcting assertEquals argument order in test cases. Contributed by Bharat Viswanadham.
2018-04-26 05:36:04 -07:00
cec96b296f
HDFS-12549. Ozone: OzoneClient: Support for REST protocol. Contributed by Nanda Kumar.
2018-04-26 05:36:04 -07:00
9734f505ea
HDFS-12739. Add Support for SCM --init command. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
709d56fdc9
HDFS-12474. Ozone: SCM: Handling container report with key count and container usage. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
2ec24a7542
HDFS-12774. Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
132f30c8ea
HDFS-12443. Ozone: Improve SCM block deletion throttling algorithm. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
7ebe79e879
HDFS-12720. Ozone: Ratis options are not passed from KSM Client protobuf helper correctly. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
0559265822
HDFS-12750. Ozone: Fix TestStorageContainerManager#testBlockDeletionTransactions. Contributed by Xiaoyu Yao.
2018-04-26 05:36:04 -07:00
0760418bec
HDFS-12697. Ozone services must stay disabled in secure setup for alpha. Contributed by Bharat Viswanadham.
2018-04-26 05:36:04 -07:00
b687902590
HDFS-12718. Ozone: fix thread number calculation in CBlockManager. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
76d34bca62
HDFS-12521. Ozone: SCM should read all Container info into memory when booting up. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
6291ca1e32
HDFS-12663. Ozone: OzoneClient: Remove protobuf classes exposed to clients through OzoneBucket. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
80357c0eee
HDFS-12678. Ozone: Corona: Add statistical information to json output. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
1b56a73a4f
HDFS-12680. Ozone: SCM: Lease support for container creation. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
338c909ac6
HDFS-12558. Ozone: Clarify the meaning of rpc.metrics.percentiles.intervals on KSM/SCM web ui. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
333dae888c
HDFS-12690. Ozone: generate swagger descriptor for the Ozone REST Api. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
0582d8b1b1
Revert "HDFS-12558. Ozone: Clarify the meaning of rpc.metrics.percentiles.intervals on KSM/SCM web ui. Contributed by Elek, Marton."
...
This reverts commit 18c0cdcec9
2018-04-26 05:36:04 -07:00
402a1c1ba3
HDFS-12558. Ozone: Clarify the meaning of rpc.metrics.percentiles.intervals on KSM/SCM web ui. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
731a69faa1
HDFS-12693. Ozone: Enable XFrame options for KSM/SCM web ui. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
6783dad766
HDFS-11468. Ozone: SCM: Add Node Metrics for SCM. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
393a02d8e1
HDFS-12692. Ozone: fix javadoc/unit test for calling MetadataStore.getRangeKVs with non existing key. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
6d9f914b55
HDFS-12684. Ozone: SCMMXBean NodeCount is overlapping with NodeManagerMXBean. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
cc86719451
HDFS-12675. Ozone: TestLeaseManager#testLeaseCallbackWithMultipleLeases fails. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
0f0417a12c
HDFS-12673. Ozone: Log elapsed time for block deletion tasks. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
06c6582694
HDFS-12585. Ozone: KSM UI: Add description for configs in UI. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
763484e596
HDFS-12661. Ozone: Support optional documentation link in KSM/SCM webui. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
a467017068
HDFS-12411. Ozone: Add container usage information to DN container report. Contributed by Xiaoyu Yao.
2018-04-26 05:36:04 -07:00
fb545e4291
HDFS-12415. Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
895a4cc60a
HDFS-12632. Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
9bb516118d
HDFS-12490. Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
8881309002
HDFS-12519. Ozone: Lease Manager framework. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
ebc4d4ebc3
HDFS-12475. Ozone: add documentation about Datanode http address. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
c85d3b2d25
HDFS-12593. Ozone: update Ratis to the latest snapshot. Contributed by Tsz Wo Nicholas Sze.
2018-04-26 05:36:04 -07:00
5ed663b32f
HDFS-12631. Ozone: ContainerStorageLocation#scmUsage should count only SCM usage. Contributed by Xiaoyu Yao.
2018-04-26 05:36:04 -07:00
d19b4c8763
HDFS-12583. Ozone: Fix swallow exceptions which makes hard to debug failures. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
9445a9267f
HDFS-12572. Ozone: OzoneFileSystem: delete/list status/rename/mkdir APIs. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
ae2b77a0e5
HDFS-12546. Ozone: DB listing operation performance improvement. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
b05ad0b315
HDFS-12611. Ozone: SCM Cli: Use the hostname of SCM server instead of the bind address. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
e76e10fd7a
HDFS-12609. Ozone: SCM: Refactoring of chill mode logic in NodeManager. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
e3b51d9074
HDFS-12598. Ozone: Fix 3 node ratis replication in Ozone. Contributed by Mukul Kumar Singh
2018-04-26 05:36:04 -07:00
3504af9411
HDFS-12537. Ozone: Reduce key creation overhead in Corona. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
9630621be7
HDFS-12610. Ozone: OzoneClient: RpcClient list calls throw NPE when iterating over empty list. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
c3ef381011
HDFS-12543. Ozone : allow create key without specifying size. Contributed by Chen Liang.
2018-04-26 05:36:04 -07:00
c97ce55d06
HDFS-12602. Add Ozone config UI to KSM and SCM index page. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
303ecae5d5
HDFS-12557. Ozone: Improve the formatting of the RPC stats on web UI. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
c17521b1bd
HDFS-12387. Ozone: Support Ratis as a first class replication mechanism. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
0b3270a8de
HDFS-12513. Ozone: Create UI page to show Ozone configs by tag. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
c52019c291
HDFS-12539. Ozone: refactor some functions in KSMMetadataManagerImpl to be more readable and reusable. Contributed by Yuanbo Liu.
2018-04-26 05:36:04 -07:00
ceec14bff5
HDFS-12467. Ozone: SCM: NodeManager should log when it comes out of chill mode. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
d7a94a21ae
HDFS-12471. Ozone: Reduce some KSM/SCM deletion log messages from INFO to DEBUG. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
6a754caca0
HDFS-12568. Ozone: Cleanup the ozone-default.xml. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
05246e2b32
HDFS-12060. Ozone: OzoneClient: Add list calls in RpcClient. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
7846636a5d
HDFS-12551. Ozone: Documentation: Add Ozone overview documentation. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
cb1fb3436e
HDFS-12563. Ozone: Creation time wrongly showed in OzoneRest.md. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
aaec2689f4
HDFS-12511. Ozone: Add tags to config. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
7363c8fc09
HDFS-12540. Ozone: node status text reported by SCM is a bit confusing. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
13fdb58490
HDFS-12554. Ozone: Fix TestDatanodeStateMachine#testDatanodeStateMachineWithInvalidConfiguration. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
9530153f33
HDFS-12268. Ozone: Add metrics for pending storage container requests. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
94090acf3a
HDFS-12469. Ozone: Create docker-compose definition to easily test real clusters. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
a44f3a777d
HDFS-12501. Ozone: Cleanup javac issues. Contributed by Yiqun Lin.
2018-04-26 05:36:04 -07:00
6b10723ec3
HDFS-12525. Ozone: OzoneClient: Verify bucket/volume name in create calls. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
5e4a6b686c
HDFS-12425. Ozone: OzoneFileSystem: read/write/create/open/getFileInfo APIs. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
a1a3ba6529
HDFS-12454. Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work. Contributed by Chen Liang.
2018-04-26 05:36:04 -07:00
2804435386
HDFS-12017. Ozone: Container: Move IPC port to 98xx range. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
b2447f8dd9
HDFS-11614. Ozone: Cleanup javadoc issues. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
9ff136bb02
HDFS-12210. Block Storage: volume creation times out while creating 3TB volume because of too many containers. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
dddded0016
Revert "Block Storage: volume creation times out while creating 3TB volume because of too many containers. Contributed by Mukul Kumar Singh." to fix commit message.
...
This reverts commit 087c69ba24
2018-04-26 05:36:04 -07:00
d303b7f40f
HDFS-12524. Ozone: Record number of keys scanned and hinted for getRangeKVs call. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
712bd70ac7
HDFS-12205. Ozone: List Key on an empty ozone bucket fails with command failed error. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
8052374e79
Block Storage: volume creation times out while creating 3TB volume because of too many containers. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
fd1564b87e
HDFS-12506. Ozone: ListBucket is too slow. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
46b65ec4fb
HDFS-12503. Ozone: some UX improvements to oz_debug. Contributed by Weiwei Yang.
2018-04-26 05:36:04 -07:00
1c354e51ac
HDFS-12477. Ozone: Some minor text improvement in SCM web UI. Contributed by Elek Marton.
2018-04-26 05:36:04 -07:00
0313bdf886
HDFS-11897. Ozone: KSM: Changing log level for client calls in KSM. Contributed by Shashikant Banerjee.
2018-04-26 05:36:04 -07:00
3b290fe3bf
HDFS-12466. Ozone: KSM: Make ozone.ksm.address as mandatory property for client. Contributed by Nandakumar.
2018-04-26 05:36:04 -07:00
Inigo Goiri
Yiqun Lin
Surendra Singh Lilhore
Steve Loughran
Siyao Meng
Erik Krogen
Kitti Nanasi
Wangda Tan
Da Zhou
tiwalter
Akira Ajisaka
Wei-Chiu Chuang
Masatake Iwasaki
Pranay Singh
Dinesh Chitlangia
shwetayakkali@cloudera.com
Takanobu Asanuma
Arpit Agarwal
Weiwei Yang
Sunil G
Giovanni Matteo Fumarola
Chao Sun
Konstantin V Shvachko
Chen Liang
Plamen Jeliazkov
Vinayakumar B
Sean Mackrory
Adam Antal
Tsz Wo Nicholas Sze
Brahma Reddy Battula
Ewan Higgs
Xiao Chen
Anu Engineer
Ajay Kumar
Shweta
Hrishikesh Gadre
Nanda kumar
Mingliang Liu
Daniel Templeton
Zsolt Venczel
Giovanni Matteo Fumarola
Márton Elek
drankye
Uma Maheswara Rao Gangumalla
Uma Maheswara Rao G
Rakesh Radhakrishnan
Kai Zheng
Virajith Jalaparti
Ewan Higgs
Bharat Viswanadham
Andrew Wang
Chris Douglas
Mukul Kumar Singh
Jitendra Pandey
Yongjun Zhang
Hanisha Koneru
Rushabh Shah
Takanobu Asanuma
Sammi Chen
Kihwal Lee
littlezhou
Aaron Fabbri
Lei Xu
Owen O'Malley
Xiaoyu Yao
Tsz-Wo Nicholas Sze
Weiwei Yang
yuanbo