Brahma Reddy Battula
04bba91585
HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota
...
(cherry picked from commit e7b63baca1
)
2018-11-13 13:12:56 +05:30
Arpit Agarwal
f514c08900
HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena.
...
(cherry picked from commit b6d4e19f34
)
2018-11-12 15:31:56 -08:00
Kitti Nanasi
bbc94de477
HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 8d99648c20
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ErasureCodingPolicyManager.java
(cherry picked from commit 01b8197893
)
2018-11-08 10:22:32 -08:00
Vinayakumar B
76be3515bf
HDFS-13772. Erasure coding: Unnecessary NameNode Logs displaying for Enabling/Disabling Erasure coding policies which are already enabled/disabled. Contributed by Ayush Saxena
...
(cherry picked from commit 8df2eb8119
)
2018-11-08 10:22:32 -08:00
Inigo Goiri
c4d390a775
HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen.
...
(cherry picked from commit 887244de4a
)
2018-11-06 11:21:19 -08:00
Inigo Goiri
4b47daa640
HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak.
...
(cherry picked from commit f3296501e0
)
(cherry picked from commit 9bf4f3d614
)
2018-11-05 16:53:28 -08:00
Akira Ajisaka
2ae21d5387
Addendum: Fix potential FSImage corruption. Contributed by Xiao Chen.
...
(cherry picked from commit dd70b1f538
)
2018-10-31 17:03:47 +09:00
Xiao Chen
20c9a12bc7
HDFS-14027. DFSStripedOutputStream should implement both hsync methods.
...
(cherry picked from commit db7e636824
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStream.java
(cherry picked from commit 399645ebc1
)
2018-10-29 19:14:12 -07:00
Wei-Chiu Chuang
0f34ff7722
Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
...
This reverts commit fa01a8fa0e
.
2018-10-28 17:07:29 -07:00
Anu Engineer
c5b704a34c
HDFS-14028. HDFS OIV temporary dir deletes folder.
...
Contributed by Adam Antal.
(cherry picked from commit 4f10d7e23f
)
2018-10-26 16:55:55 -07:00
Arpit Agarwal
f6469adbb1
HDFS-14029. Sleep in TestLazyPersistFiles should be put into a loop. Contributed by Adam Antal.
...
(cherry picked from commit 9b899f1ebd
)
2018-10-25 15:14:39 -07:00
Wei-Chiu Chuang
fa01a8fa0e
HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
...
(cherry picked from commit fb2b72e6fc
)
(cherry picked from commit fd02c501c0
)
(cherry picked from commit ef9f8ca13d
)
2018-10-25 09:38:26 -07:00
Ajay Kumar
2caf69debd
HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Wei-Chiu Chuang.
2018-10-24 22:35:06 -07:00
Inigo Goiri
1d5390679e
HDFS-14003. Fix findbugs warning in trunk for FSImageFormatPBINode. Contributed by Yiqun Lin.
...
(cherry picked from commit 0e56c883cd
)
2018-10-24 16:14:22 -07:00
Xiao Chen
e8832418bf
Fix potential FSImage corruption. Contributed by Daryn Sharp and Vinayakumar B.
...
(cherry picked from commit f1996ccbaee734d423caa9d47a571cfff98ef42c)
(cherry picked from commit 96cedb87b9
)
2018-10-24 16:10:51 -07:00
Inigo Goiri
6aef514795
HDFS-14021. TestReconstructStripedBlocksWithRackAwareness#testReconstructForNotEnoughRacks fails intermittently. Contributed by Xiao Chen.
...
(cherry picked from commit c1874046e2
)
2018-10-24 09:38:48 -07:00
Wei-Chiu Chuang
e4464f9598
Revert "HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Ajay Kumar."
...
This reverts commit d8cd07d5f5
.
2018-10-23 05:58:10 -07:00
Arpit Agarwal
d8cd07d5f5
HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Ajay Kumar.
...
(cherry picked from commit c58811c77d
)
2018-10-22 14:44:42 -07:00
drankye
b34c650a41
HDFS-13668. FSPermissionChecker may throws AIOOE when check inode permission. Contributed by He Xiaoqiao.
...
(cherry picked from commit 975d60685e
)
2018-10-18 08:31:12 -07:00
Xiao Chen
b9f65d717c
HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
...
(cherry picked from commit b6fc72a025
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
2018-10-15 11:00:39 -07:00
Hrishikesh Gadre
b170de8be5
HDFS-13926. ThreadLocal aggregations for FileSystem.Statistics are incorrect with striped reads.
...
Contributed by Xiao Chen, Hrishikesh Gadre.
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 323b76bccf
)
2018-10-09 19:54:56 -07:00
Brahma Reddy Battula
b28dacf60c
HDFS-13840. RBW Blocks which are having less GS should be added to Corrupt. Contributed by Brahma Reddy Battula
...
(cherry picked from commit e0ff8e2c10
)
2018-09-26 23:55:02 +05:30
Siyao Meng
2449795b8e
HDFS-13830. Backport HDFS-13141 to branch-3.0: WebHDFS: Add support for getting snasphottable directory list. Contributed by Siyao Meng, Lokesh Jain.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-09-21 12:41:03 -07:00
Chen Liang
78e0c0a1bb
HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen.
2018-09-19 14:51:23 -07:00
Arpit Agarwal
ffef819ee8
HADOOP-15772. Remove the 'Path ... should be specified as a URI' warnings on startup. Contributed by Ayush Saxena.
...
(cherry picked from commit 2eb597b151
)
2018-09-19 13:49:57 -07:00
Inigo Goiri
3fc3a5c01c
HADOOP-15684. triggerActiveLogRoll stuck on dead name node, when ConnectTimeoutException happens. Contributed by Rong Tang.
...
(cherry picked from commit 7f9a89e1b54a9712af50ffef70bed7cfb91ed34e)
2018-09-19 12:59:42 -07:00
Inigo Goiri
b93aeb43a4
HDFS-13908. TestDataNodeMultipleRegistrations is flaky. Contributed by Ayush Saxena.
...
(cherry picked from commit 56e0d635e0
)
2018-09-19 09:31:58 -07:00
Wei-Chiu Chuang
823b1fceee
HDFS-13868. WebHDFS: GETSNAPSHOTDIFF API NPE when param "snapshotname" is given but "oldsnapshotname" is not. Contributed by Pranay Singh.
...
(cherry picked from commit 28ceb34a72
)
(cherry picked from commit 7442b7941d
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
2018-09-19 03:20:26 -07:00
Wei-Chiu Chuang
2ef3911f7c
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
...
(cherry picked from commit a1de8cbac5
)
(cherry picked from commit 829399a9f3
)
2018-09-18 15:48:04 -07:00
Inigo Goiri
f0537b5161
HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js. Contributed by yanghuafeng.
...
(cherry picked from commit a9c1c55cafc0338bb35d2991f217d4157463f1d3)
2018-09-17 14:39:31 -07:00
Inigo Goiri
1314dc2397
HDFS-13914. Fix DN UI logs link broken when https is enabled after HDFS-13902. Contributed by Jianfei Jiang.
...
(cherry picked from commit e1b242a984
)
2018-09-13 09:18:11 -07:00
Brahma Reddy Battula
0c8aab690c
HDFS-13902. Add JMX, conf and stacks menus to the datanode page. Contributed by fengchuang.
...
(cherry picked from commit b2432d254c
)
2018-09-12 06:35:29 +05:30
Xiao Chen
a5da4df73c
HDFS-13051. Fix dead lock during async editlog rolling if edit queue is full. Contributed by Daryn Sharp.
...
(cherry picked from commit 8e54da1511
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLogRace.java
(cherry picked from commit 2dd27c999b
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestEditLogRace.java
2018-09-10 23:00:41 -07:00
Hrishikesh Gadre
25337c045a
HDFS-13812. Fix the inconsistent default refresh interval on Caching documentation. Contributed by Hrishikesh Gadre.
...
Signed-off-by: Xiao Chen <xiao@apache.org>
(cherry picked from commit 6ccb809c2d
)
2018-09-04 21:54:56 -07:00
Wei-Chiu Chuang
d06717ef94
Revert "HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng."
...
This reverts commit d89a485b25
.
2018-08-30 11:59:39 -07:00
Vinayakumar B
67a5491962
HDFS-13027. Handle possible NPEs due to deleted blocks in race condition. Contributed by Vinayakumar B.
...
(cherry picked from commit 65977e5d81
)
2018-08-30 22:17:00 +05:30
Yiqun Lin
6a547856ef
HDFS-13863. FsDatasetImpl should log DiskOutOfSpaceException. Contributed by Fei Hui.
...
(cherry picked from commit 582cb10ec7
)
2018-08-30 11:24:25 +08:00
Wei-Chiu Chuang
72e1e1904b
HDFS-13831. Make block increment deletion number configurable. Contributed by Ryan Wu.
2018-08-28 16:36:30 -07:00
Zsolt Venczel
2d1f819979
HDFS-13731. ReencryptionUpdater fails with ConcurrentModificationException during processCheckpoints. Contributed by Zsolt Venczel.
...
(cherry picked from commit 3e18b957eb
)
2018-08-28 15:14:57 -07:00
Wei-Chiu Chuang
d89a485b25
HDFS-13838. WebHdfsFileSystem.getFileStatus() won't return correct "snapshot enabled" status. Contributed by Siyao Meng.
...
(cherry picked from commit 26c2a97c56
)
(cherry picked from commit 41732e7b28
)
2018-08-27 16:04:16 -07:00
Wei-Chiu Chuang
bd46906bd8
HDFS-10240. Race between close/recoverLease leads to missing block. Contributed by Jinglun, zhouyingchao and Wei-Chiu Chuang.
...
(cherry picked from commit 865650052b
)
2018-08-21 15:44:08 -07:00
Xiao Chen
185c8f2abc
HDFS-13747. Statistic for list_located_status is incremented incorrectly by listStatusIterator. Contributed by Antal Mihalyi.
...
(cherry picked from commit c67b0650ea
)
2018-08-16 23:15:58 -07:00
Daniel Templeton
27508086de
HDFS-13746. Still occasional "Should be different group" failure in TestRefreshUserMappings#testGroupMappingRefresh
...
(Contributed by Siyao Meng via Daniel Templeton)
Change-Id: I9fad1537ace38367a463d9fe67aaa28d3178fc69
(cherry picked from commit 8512e1a91b
)
(cherry picked from commit fbedf89377
)
2018-08-16 15:02:18 -07:00
Xiao Chen
5d16301ad9
HDFS-13788. Update EC documentation about rack fault tolerance. Contributed by Kitti Nanasi.
...
(cherry picked from commit cede33997f
)
2018-08-14 11:59:05 -07:00
Wei-Chiu Chuang
6f2a46578f
HDFS-13758. DatanodeManager should throw exception if it has BlockRecoveryCommand but the block is not under construction. Contributed by chencan.
...
(cherry picked from commit 61a9b4f58b
)
(cherry picked from commit 7a115e8de4
)
2018-08-14 11:52:55 -07:00
Wei-Chiu Chuang
d502abe947
HDFS-13738. fsck -list-corruptfileblocks has infinite loop if user is not privileged. Contributed by Yuen-Kuei Hsueh.
...
(cherry picked from commit 4023eeba05
)
(cherry picked from commit 74d4fd975a
)
2018-08-13 17:37:36 -07:00
Wei-Chiu Chuang
4b606eb9fd
HDFS-13813. Exit NameNode if dangling child inode is detected when saving FsImage. Contributed by Siyao Meng.
...
(cherry picked from commit 23854443ef
)
(cherry picked from commit b38649c59a
)
2018-08-13 16:14:01 -07:00
Vinayakumar B
eecfbaff3b
HDFS-13786. EC: Display erasure coding policy for sub-directories is not working. Contributed by Ayush Saxena.
...
(cherry picked from commit 2b0f977241
)
2018-08-13 13:58:37 -07:00
Chen Liang
2d985b6c81
HDFS-13735. Make QJM HTTP URL connection timeout configurable. Contributed by Chao Sun.
2018-08-13 12:47:17 -07:00
Chao Sun
07054c5994
Remove super user privilege requirement for NameNode.getServiceStatus. Contributed by Chao Sun.
...
(cherry picked from commit a2a8c48699
)
2018-08-10 16:12:05 -07:00