Stephen O'Donnell
1e3a0b0d93
HDFS-7175. Client-side SocketTimeoutException during Fsck. Contributed by Stephen O'Donnell, Akira Ajisaka.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Co-authored-by: Akira Ajisaka <aajisaka@apache.org>
2020-01-31 16:13:02 -08:00
Kihwal Lee
799d4c1cf4
HDFS-15146. TestBalancerRPCDelay.testBalancerRPCDelay fails
...
intermittently. Contributed by Ahmed Hussein.
2020-01-29 11:00:27 -06:00
Chen Liang
483397c7f7
[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Conntributed by Chen Liang
2020-01-28 15:20:36 -08:00
Chen Liang
3e86807802
Revert "[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Contributed by Chen Liang."
...
This reverts commit ff8ff0f7e5
.
2020-01-28 15:19:47 -08:00
Chen Liang
ff8ff0f7e5
[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. Contributed by Chen Liang.
2020-01-28 15:14:58 -08:00
Inigo Goiri
1839c467f6
HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.
2020-01-28 10:10:35 -08:00
Inigo Goiri
061421fc6d
HDFS-15145. HttpFS: getAclStatus() returns permission as null. Contributed by hemanthboyina.
2020-01-28 10:04:38 -08:00
Ayush Saxena
87c198468b
HDFS-14993. checkDiskError doesn't work during datanode startup. Contributed by Yang Yun.
2020-01-28 23:09:38 +05:30
Ayush Saxena
f876dc228b
HDFS-15143. LocatedStripedBlock returns wrong block type. Contributed by Ayush Saxena.
2020-01-28 19:34:21 +05:30
Ayush Saxena
6d008c0d39
HDFS-15128. Unit test failing to clean testing data and crashed future Maven test run due to failure in TestDataNodeVolumeFailureToleration. Contributed by Ctest
2020-01-25 11:47:29 +05:30
Kihwal Lee
d10f77e3c9
HDFS-15119. Allow expiration of cached locations in DFSInputStream.
...
Contributed by Ahmed Hussein.
2020-01-24 09:15:27 -06:00
Ayush Saxena
92c58901d7
HDFS-15117. EC: Add getECTopologyResultForPolicies to DistributedFileSystem. Contributed by Ayush Saxena
2020-01-23 18:18:34 +05:30
Kihwal Lee
bd03053ea2
HDFS-14968. Add ability to log stale datanodes. Contributed by Ahmed Hussein.
2020-01-22 09:14:38 -06:00
Inigo Goiri
8cfc3673dc
HDFS-15092. TestRedudantBlocks#testProcessOverReplicatedAndRedudantBlock sometimes fails. Contributed by Fei Hui.
2020-01-21 13:29:20 -08:00
Inigo Goiri
b657822b98
HDFS-15126. TestDatanodeRegistration#testForcedRegistration fails intermittently. Contributed by Ahmed Hussein.
2020-01-21 13:22:53 -08:00
Akira Ajisaka
f6d20daf40
HADOOP-16808. Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin. Contributed by Xieming Li.
2020-01-21 18:03:24 +09:00
Akira Ajisaka
1defe3a65a
HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li.
2020-01-21 10:58:32 +09:00
Inigo Goiri
263413e838
HDFS-15112. RBF: Do not return FileNotFoundException when a subcluster is unavailable.
2020-01-16 10:39:14 -08:00
Vinayakumar B
edbbc03ce7
HADOOP-16621. [pb-upgrade] Remove Protobuf classes from signatures of Public APIs. Contributed by Vinayakumar B. ( #1803 )
2020-01-16 23:27:50 +05:30
Chao Sun
d7c4f8ab21
HDFS-13616. Batch listing of multiple directories ( #1725 )
2020-01-15 17:22:47 -08:00
Wei-Chiu Chuang
6b86a5110e
HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu.
2020-01-13 10:48:53 -08:00
Vinayakumar B
52b360a928
HADOOP-16797. Add Dockerfile for ARM builds. Contributed by Vinayakumar B. ( #1801 )
2020-01-13 10:40:29 +05:30
Ayush Saxena
cebce0a348
HDFS-14578. AvailableSpaceBlockPlacementPolicy always prefers local node. Contributed by Ayush Saxena.
2020-01-11 10:29:11 +05:30
Ayush Saxena
7b62409ace
HDFS-15108. RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update. Contributed by Ayush Saxena.
2020-01-11 10:21:31 +05:30
Chen Liang
26a969ec73
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.
2020-01-10 17:06:59 -08:00
Kihwal Lee
5fb901ac40
HDFS-15095. Fix TestDecommissioningStatus. Contributed by Ahmed Hussein.
2020-01-10 12:43:21 -06:00
Takanobu Asanuma
9da294a140
HDFS-15110. HttpFS: post requests are not supported for path "/". Contributed by hemanthboyina.
2020-01-10 17:53:19 +09:00
Akira Ajisaka
0315ef8448
HDFS-15100. RBF: Print stacktrace when DFSRouter fails to fetch/parse JMX output from NameNode. ( #1800 )
2020-01-10 13:16:57 +09:00
Ayush Saxena
b32757c616
HDFS-15107. dfs.client.server-defaults.validity.period.ms to support time units. Contributed by Ayush Saxena.
2020-01-10 08:14:56 +05:30
Takanobu Asanuma
782c0556fb
HDFS-15102. HttpFS: put requests are not supported for path "/". Contributed by hemanthboyina.
2020-01-10 09:52:13 +09:00
Surendra Singh Lilhore
bf45f3b80a
HDFS-14957. INodeReference Space Consumed was not same in QuotaUsage and ContentSummary. Contributed by hemanthboyina.
2020-01-09 12:04:05 +05:30
Ayush Saxena
8fe01db34a
HDFS-15094. RBF: Reuse ugi string in ConnectionPoolID. Contributed by Ayush Saxena.
2020-01-09 09:02:38 +05:30
Ayush Saxena
fd30f4c52b
HDFS-15096. RBF: GetServerDefaults Should be Cached At Router. Contributed by Ayush Saxena.
2020-01-09 08:26:51 +05:30
Rakesh Radhakrishnan
7030722e5d
HDFS-15080. Fix the issue in reading persistent memory cached data with an offset. Contributed by Feilong He.
2020-01-08 14:25:17 +05:30
Masatake Iwasaki
aba3f6c3e1
HDFS-15077. Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout. ( #1797 )
2020-01-08 16:45:39 +09:00
Masatake Iwasaki
a43c177f1d
HDFS-15072. HDFS MiniCluster fails to start when run in directory path with a %. ( #1775 )
2020-01-08 11:28:34 +09:00
Takanobu Asanuma
59aac00283
HDFS-15066. HttpFS: Implement setErasureCodingPolicy , unsetErasureCodingPolicy , getErasureCodingPolicy. Contributed by hemanthboyina.
2020-01-07 11:10:32 +09:00
Takanobu Asanuma
4a76ab777f
HDFS-15090. RBF: MountPoint Listing Should Return Flag Values Of Destination. Contributed by Ayush Saxena.
2020-01-06 18:09:59 +09:00
luhuachao
77ae7b9ce2
HDFS-15089. RBF: SmallFix for RBFMetrics in doc ( #1786 )
2020-01-06 12:31:13 +09:00
Ayush Saxena
f8644fbe9f
HDFS-15091. Cache Admin and Quota Commands Should Check SuperUser Before Taking Lock. Contributed by Ayush Saxena.
2020-01-04 19:02:59 +05:30
Masatake Iwasaki
037ec8cfb1
HDFS-15068. DataNode could meet deadlock if invoke refreshVolumes when register. Contributed by Aiphago.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2020-01-04 01:55:36 +09:00
Rakesh Radhakrishnan
d79cce20ab
HDFS-14740. Recover data blocks from persistent memory read cache during datanode restarts. Contributed by Feilong He.
2020-01-02 11:44:00 +05:30
Takanobu Asanuma
074050ca59
HDFS-15063. HttpFS: getFileStatus doesn't return ecPolicy. Contributed by hemanthboyina.
2020-01-01 11:26:38 +09:00
Ayush Saxena
62423910a4
HDFS-14937. [SBN read] ObserverReadProxyProvider should throw InterruptException. Contributed by xuzq.
2019-12-29 13:07:22 +05:30
Surendra Singh Lilhore
ee51eadda0
HDFS-15074. DataNode.DataTransfer thread should catch all the expception and log it. Contributed by hemanthboyina.
2019-12-29 11:15:54 +05:30
Takanobu Asanuma
dc32f583af
HDFS-14934. [SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0. Contributed by Ayush Saxena.
2019-12-28 21:32:15 +09:00
Ayush Saxena
8730a7bf60
HDFS-15003. RBF: Make Router support storage type quota. Contributed by Jinglun.
2019-12-27 09:22:58 +05:30
Ayush Saxena
80f91d14ab
HDFS-14997. Addendum: BPServiceActor processes commands from NameNode asynchronously. Contributed by Xiaoqiao He.
2019-12-27 09:12:44 +05:30
Ayush Saxena
300505c562
HDFS-15054. Delete Snapshot not updating new modification time. Contributed by hemanthboyina.
2019-12-25 12:42:50 +05:30
Ayush Saxena
df622cf4a3
HDFS-12999. When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice. Contributed by lufei and Fei Hui.
2019-12-25 11:07:25 +05:30
Chandra Sanivarapu
d8cd7098b4
HDFS-15073. Replace curator-shaded guava import with the standard one ( #1782 )
2019-12-25 10:50:01 +09:00
Konstantin V Shvachko
b98ac2a3af
HDFS-15076. Fix tests that hold FSDirectory lock, without holding FSNamesystem lock. Contributed by Konstantin V Shvachko.
2019-12-24 12:08:34 -08:00
Inigo Goiri
52d7b745c6
HDFS-15062. Add LOG when sendIBRs failed. Contributed by Fei Hui.
2019-12-19 09:42:17 -08:00
Inigo Goiri
b86895485d
HDFS-14997. BPServiceActor processes commands from NameNode asynchronously. Contributed by Xiaoqiao He.
2019-12-19 09:34:43 -08:00
Shashikant Banerjee
fdd96e46d1
HDFS-15012. NN fails to parse Edit logs after applying HDFS-13101. Contributed by Shashikant Banerjee.
2019-12-18 22:50:46 +05:30
Inigo Goiri
24080666e5
HDFS-14908. LeaseManager should check parent-child relationship when filter open files. Contributed by Jinglun.
2019-12-16 18:41:45 -08:00
Masatake Iwasaki
dc6cf17b34
HDFS-15048. Fix findbug in DirectoryScanner.
2019-12-16 19:00:57 +09:00
Ayush Saxena
7a87007545
HDFS-15038. TestFsck testFsckListCorruptSnapshotFiles is failing in trunk. Contributed by hemanthboyina.
2019-12-15 00:33:32 +05:30
Ayush Saxena
72aee114f8
HDFS-15053. RBF: Add permission check for safemode operation. Contributed by Xiaoqiao He.
2019-12-14 17:57:23 +05:30
Inigo Goiri
7fe924b1c0
HDFS-15016. RBF: getDatanodeReport() should return the latest update. Contributed by Inigo Goiri.
2019-12-13 10:51:14 -08:00
Chen Liang
65c4660bcd
HDFS-15036. Active NameNode should not silently fail the image transfer. Contributed by Chen Liang.
2019-12-12 10:22:05 -08:00
Masatake Iwasaki
bdd00f10b4
HDFS-15047. Document the new decommission monitor (HDFS-14854). ( #1755 )
2019-12-13 00:35:41 +09:00
He Xiaoqiao
0e28cd8f63
HDFS-15050. Optimize log information when DFSInputStream meet CannotObtainBlockLengthException. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-12-12 02:23:32 -08:00
Takanobu Asanuma
93bb368094
HDFS-14983. RBF: Add dfsrouteradmin -refreshSuperUserGroupsConfiguration command option. Contributed by Xieming Li
2019-12-12 10:56:19 +09:00
Erik Krogen
c174d50b30
HDFS-15032. Properly handle InvocationTargetExceptions in the proxy created by ProxyCombiner. This fixes a bug encountered by the HDFS balancer when used with Observer Nodes. Contributed by Erik Krogen.
2019-12-11 09:39:37 -08:00
Surendra Singh Lilhore
c2e9783d5f
HDFS-15045. DataStreamer#createBlockOutputStream() should log exception in warn. Contributed by Ravuri Sushma Sree.
2019-12-11 08:52:55 +05:30
Stephen O'Donnell
c93cb6790e
HDFS-14854. Create improved decommission monitor implementation. Contributed by Stephen O'Donnell.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-12-10 17:16:43 -08:00
Takanobu Asanuma
c4733377d0
HDFS-15040. RBF: Secured Router should not run when SecretManager is not running. ( #1745 )
2019-12-10 16:03:32 +09:00
Akira Ajisaka
9f09852051
HDFS-15043. RBF: The detail of the Exception is not shown in ZKDelegationTokenSecretManagerImpl ( #1748 )
2019-12-10 16:00:20 +09:00
Masatake Iwasaki
4dffd81bb7
HDFS-14522. Allow compact property description in xml in httpfs. ( #1737 )
2019-12-10 10:30:57 +09:00
Masatake Iwasaki
11cd5b6e39
HDFS-15028. Keep the capacity of volume and reduce a system call. Contributed by Yang Yun.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-12-07 08:46:45 +09:00
Wei-Chiu Chuang
ecd461f940
HDFS-14751. Synchronize on diffs in DirectoryScanner. Contributed by Lisheng Sun.
2019-12-06 15:10:40 -08:00
Wei-Chiu Chuang
313b76f8e9
HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.
2019-12-06 15:10:40 -08:00
Ayush Saxena
705b172b95
HDFS-14998. [SBN read] Update Observer Namenode doc for ZKFC after HDFS-14130. Contributed by Fei Hui.
2019-12-06 23:04:09 +05:30
Ayush Saxena
83a14559e5
HDFS-15023. [SBN read] ZKFC should check the state before joining the election. Contributed by Fei Hui.
2019-12-05 18:52:01 +05:30
Yiqun Lin
47fdae7904
HDFS-13811. RBF: Race condition between router admin quota update and periodic quota update service. Contributed by Jinglun.
2019-12-04 18:19:11 +08:00
Ayush Saxena
0c217feed8
HDFS-15026. TestPendingReconstruction#testPendingReconstruction() fail in trunk. Contributed by Lisheng Sun.
2019-12-03 09:18:09 +05:30
Takanobu Asanuma
4ede8bce28
HDFS-9695. HTTPFS - CHECKACCESS operation missing. Contributed by hemanthboyina
2019-12-03 09:38:36 +09:00
Ayush Saxena
6b2d6d4aaf
HDFS-15009. FSCK -list-corruptfileblocks return Invalid Entries. Contributed by hemanthboyina.
2019-11-29 23:55:37 +05:30
Surendra Singh Lilhore
44f7b9159d
HDFS-15013. Reduce NameNode overview tab response time. Contributed by HuangTao.
2019-11-29 00:42:31 +05:30
Surendra Singh Lilhore
0384687811
HDFS-15010. BlockPoolSlice#addReplicaThreadPool static pool should be initialized by static method. Contributed by Surendra Singh Lilhore.
2019-11-28 23:49:35 +05:30
Ayush Saxena
46166bd8d1
HDFS-14961. [SBN read] Prevent ZKFC changing Observer Namenode state. Contributed by Ayush Saxena.
2019-11-28 18:28:20 +05:30
Yiqun Lin
c3659f8f94
HDFS-15019. Refactor the unit test of TestDeadNodeDetection. Contributed by Lisheng Sun.
2019-11-28 14:41:49 +08:00
Yiqun Lin
2b452b4e60
HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago.
2019-11-28 10:43:35 +08:00
Yiqun Lin
c8bef4d6a6
HDFS-14649. Add suspect probe for DeadNodeDetector. Contributed by Lisheng Sun.
2019-11-27 10:57:20 +08:00
Ayush Saxena
049940e77b
HDFS-14519. NameQuota is not update after concat operation, so namequota is wrong. Contributed by Ranith Sardar.
2019-11-23 02:30:02 +05:30
Ayush Saxena
c422e36397
HDFS-13842. RBF: Exceptions are conflicting when creating the same mount entry twice. Contributed by Ranith Sardar.
2019-11-22 11:42:19 +05:30
Takanobu Asanuma
b25e94ce29
HDFS-14924. RenameSnapshot not updating new modification time. Contributed by hemanthboyina
2019-11-22 13:48:02 +09:00
Yiqun Lin
9b6906fe91
HDFS-14651. DeadNodeDetector checks dead node periodically. Contributed by Lisheng Sun.
2019-11-22 10:53:55 +08:00
Ayush Saxena
b89fd4dfe9
HDFS-15002. RBF: Fix annotation in RouterAdmin. Contributed by Jinglun.
2019-11-22 01:08:11 +05:30
Surendra Singh Lilhore
26270196a2
HDFS-14940. HDFS Balancer : Do not allow to set balancer maximum network bandwidth more than 1TB. Contributed by hemanthboyina.
2019-11-22 00:31:25 +05:30
Ayush Saxena
98d249dcda
HDFS-14996. RBF: GetFileStatus fails for directory with EC policy set in case of multiple destinations. Contributed by Ayush Saxena.
2019-11-21 12:08:42 +05:30
Inigo Goiri
3037762b2c
HDFS-14949. Add getServerDefaults() support to HttpFS. Contributed by hemanthboyina.
2019-11-20 10:51:58 -08:00
Surendra Singh Lilhore
fd264b8265
HDFS-14995. Use log variable directly instead of passing as argument in InvalidateBlocks#printBlockDeletionTime(). Contributed by Lisheng Sun.
2019-11-21 00:00:42 +05:30
He Xiaoqiao
0b50aa29fd
HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Mukul Kumar Singh <msingh@apache.org>
2019-11-19 12:16:57 -08:00
Surendra Singh Lilhore
c870514740
HDFS-14992. TestOfflineEditsViewer is failing in Trunk. Contributed by hemanthboyina.
2019-11-20 00:07:43 +05:30
Ayush Saxena
34cb595d2e
HDFS-14967. TestWebHDFS fails in Windows. Contributed by Renukaprasad C.
2019-11-18 18:49:58 +05:30
Ayush Saxena
12617fad2e
HDFS-14955. RBF: getQuotaUsage() on mount point should return global quota. Contributed by Jinglun.
2019-11-18 16:04:52 +05:30
Ayush Saxena
3b5a0e86c1
HDFS-14974. RBF: Make tests use free ports. Contributed by Inigo Goiri.
2019-11-18 15:49:36 +05:30
Yiqun Lin
b3119b9ab6
HDFS-14648. Implement DeadNodeDetector basic model. Contributed by Lisheng Sun.
2019-11-16 11:32:41 +08:00
Hui Fei
67f2c491fe
HDFS-14802. The feature of protect directories should be used in RenameOp ( #1669 )
2019-11-15 12:35:37 -08:00
He Xiaoqiao
c892a879dd
HDFS-14882. Consider DataNode load when #getBlockLocation. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Istvan Fajth <pifta@cloudera.com>
2019-11-15 12:16:31 -08:00
Erik Krogen
b2cc8b6b4a
HDFS-14973. More strictly enforce Balancer/Mover/SPS throttling of getBlocks RPCs to NameNodes. Contributed by Erik Krogen.
2019-11-15 10:10:37 -08:00
Erik Krogen
586defe711
HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.
2019-11-13 11:46:35 -08:00
Chao Sun
97ec34e117
HDFS-14959: [SBNN read] access time should be turned off ( #1706 ) Contributed by Chao Sun.
2019-11-12 11:35:50 -08:00
Inigo Goiri
40150da1e1
HDFS-14922. Prevent snapshot modification time got change on startup. Contributed by hemanthboyina.
2019-11-12 10:53:54 -08:00
Ayush Saxena
77934bc07b
HDFS-14975. Add CR for SetECPolicyCommand usage. Contributed by Fei Hui.
2019-11-11 11:05:34 +05:30
Wang Yuxuan
b25a37c322
HDFS-14962. RBF: ConnectionPool#newConnection() error log wrong protocol class ( #1699 ). Contributed by Yuxuan Wang.
2019-11-11 10:48:38 +05:30
Takanobu Asanuma
6663d6a5c2
HDFS-14928. UI: unifying the WebUI across different components. Contributed by Xieming Li
2019-11-11 14:04:57 +09:00
Surendra Singh Lilhore
320008bb7c
HDFS-14720. DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE. Contributed by hemanthboyina.
2019-11-09 22:14:35 +05:30
Ayush Saxena
42fc8884ab
HDFS-14815. RBF: Update the quota in MountTable when calling setQuota on a MountTable src. Contributed by Jinglun.
2019-11-08 08:48:52 +05:30
Ayush Saxena
247584eb63
HDFS-14958. TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup. Contributed by Jim Brennan.
2019-11-07 22:49:01 +05:30
Chen Liang
dd900259c4
HDFS-14941. Potential editlog race condition can cause corrupted file. Contributed by Chen Liang and Konstantin Shvachko.
2019-11-06 09:56:19 -08:00
Chen Liang
9d0d580031
HDFS-14806. Bootstrap standby may fail if with in-progress tailing. Contributed by Chen Liang and Erik Krogen.
2019-11-06 09:30:04 -08:00
Ayush Saxena
9e287054a8
HDFS-14942. Change Log Level to debug in JournalNodeSyncer#syncWithJournalAtIndex. Contributed by Lisheng Sun.
2019-11-06 22:02:03 +05:30
Ayush Saxena
dcf55838ae
HDFS-14880. Correct the sequence of statistics & exit message in balencer. Contributed by Renukaprasad C.
2019-11-06 21:45:03 +05:30
Surendra Singh Lilhore
c36014165c
HDFS-14384. When lastLocatedBlock token expire, it will take 1~3s second to refetch it. Contributed by Surendra Singh Lilhore.
2019-11-06 19:28:55 +05:30
Inigo Goiri
bfb8f28cc9
HDFS-14775. Add Timestamp for longest FSN write/read lock held log. Contributed by Chen Zhang.
2019-11-05 09:19:52 -08:00
Takanobu Asanuma
7901062707
HDFS-14891. RBF: namenode links in NameFederation Health page (federationhealth.html) cannot use https scheme. Contributed by Xieming Li
2019-11-05 15:03:09 +09:00
Ayush Saxena
b643a1cbe8
HDFS-14938. Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType(). Contributed by Lisheng Sun.
2019-11-05 09:23:20 +05:30
Ayush Saxena
2ffec347eb
HDFS-14946. Erasure Coding: Block recovery failed during decommissioning. Contributed by Fei Hui.
2019-11-05 01:37:15 +05:30
Wei-Chiu Chuang
eb73ba6ed5
HDFS-14945. Revise PacketResponder's log. Contributed by Xudong Cao.
2019-11-04 09:40:42 -08:00
Zhao Junwang
de6b8b0c0b
HDFS-14925. Rename operation should check nest snapshot ( #1670 )
...
If the src directory or any of its descendant is snapshottable
and the dst directory or any of its ancestors is snapshottable,
we consider this as nested snapshot, which should be denied.
Reviewed-by: Shashikant Banerjee <shashikant@apache.org>
2019-11-01 16:37:53 -07:00
Ayush Saxena
7d7acb004a
HDFS-13736. BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false. Contributed by hu xiaodong.
2019-11-01 22:50:10 +05:30
Inigo Goiri
f18bbdd9d8
HDFS-14927. RBF: Add metrics for async callers thread pool. Contributed by Leon Gao.
2019-11-01 10:14:31 -07:00
Surendra Singh Lilhore
02009c3bb7
HDFS-14768. EC : Busy DN replica should be consider in live replica check. Contributed by guojh.
2019-11-01 22:15:05 +05:30
Ayush Saxena
9d25ae7669
HDFS-14920. Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission. Contributed by Fei Hui.
2019-10-31 23:49:37 +05:30
Ayush Saxena
d9fbedc4ae
HDFS-14936. Add getNumOfChildren() for interface InnerNode. Contributed by Lisheng Sun.
2019-10-31 23:39:27 +05:30
Jonathan Hung
e6137d0e50
Make upstream aware of 2.10.0 release
2019-10-30 20:58:32 -07:00
Ayush Saxena
fa4904cdca
HDFS-14935. Refactor DFSNetworkTopology#isNodeInScope. Contributed by Lisheng Sun.
2019-10-29 12:30:24 +05:30
Eric Yang
30ed24a421
HDFS-14730. Removed unused configuration dfs.web.authentication.filter.
...
Contributed by Chen Zhang
2019-10-28 19:27:32 -04:00
Eric Badger
9ef6ed9c1c
HDFS-14931. hdfs crypto commands limit column width. Contributed by Eric Badger
2019-10-28 16:37:04 +00:00
zhaoyim
30db895b59
HDFS-14308. DFSStripedInputStream curStripeBuf is not freed by unbuffer() ( #1667 )
...
Reviewed-by: Aravindan Vijayan <avijayan@cloudera.com>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-25 13:09:14 -07:00
Takanobu Asanuma
862526530a
HDFS-14933. Fixing a typo in documentation of Observer NameNode. Contributed by Xieming Li
2019-10-25 15:23:05 +09:00
Takanobu Asanuma
0db0f1e399
HDFS-14917. Change the ICON of "Decommissioned & dead" datanode on "dfshealth.html". Contributed by Xieming Li
2019-10-25 10:27:38 +09:00
Wei-Chiu Chuang
a1b4eebcc9
HDFS-14910. Rename Snapshot with Pre Descendants Fail With IllegalArgumentException. Contributed by Wei-Chiu Chuang. ( #1672 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2019-10-24 13:09:52 -07:00
Eric Yang
ac6b6a6a85
HADOOP-16614. Add aarch64 support for dependent leveldbjni.
...
Contributed by liusheng
close #1546
2019-10-24 11:45:57 -04:00
Vinayakumar B
ee699dc26c
HDFS-14921. Remove SuperUser Check in Setting Storage Policy in FileStatus During Listing. Contributed by Ayush Saxena.
2019-10-24 12:14:09 +05:30
Mukul Kumar Singh
a901405ad8
HDFS-14884. Add sanity check that zone key equals feinfo key while setting Xattrs. Contributed by Mukul Kumar Singh.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-22 13:31:15 -07:00
Ayush Saxena
6020505943
HDFS-14915. Move Superuser Check Before Taking Lock For Encryption API. Contributed by Ayush Saxena.
2019-10-22 18:44:22 +05:30
Ayush Saxena
19f35cfd57
HDFS-14918. Remove useless getRedundancyThread from BlockManagerTestUtil. Contributed by Fei Hui.
2019-10-22 18:34:02 +05:30
Wei-Chiu Chuang
72003b19bf
HDFS-13901. INode access time is ignored because of race between open and rename. Contributed by Jinglun.
2019-10-21 17:31:43 -07:00
Kihwal Lee
c4e27ef773
HDFS-12749. DN may not send block report to NN after NN restart. Contributed by Xiaoqiao He.
2019-10-21 16:33:15 -05:00
Ayush Saxena
74c2329fc3
HDFS-14913. Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType(). Contributed by Ayush Saxena.
2019-10-21 18:35:12 +05:30
Ayush Saxena
ff6a492d66
HDFS-14916. RBF: line breaks are missing from the output of 'hdfs dfsrouteradmin -ls'. Contributed by Xieming Li.
2019-10-21 18:20:00 +05:30
Ayush Saxena
447f46d962
HDFS-14847. Erasure Coding: Blocks are over-replicated while EC decommissioning. Contributed by Fei Hui.
2019-10-20 06:10:59 +05:30
Inigo Goiri
e6f95eb0f7
HDFS-14887. RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable. Contributed by hemanthboyina.
2019-10-19 13:24:58 -07:00
Yuming Wang
3d41f33018
HADOOP-16152. Upgrade Eclipse Jetty version to 9.4.x. Contributed by Yuming Wang, Siyao Meng.
...
Co-authored-By: Siyao Meng <smeng@cloudera.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-18 08:25:02 -07:00
Surendra Singh Lilhore
54dc6b7d72
HDFS-14909. DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope. Contributed by Surendra Singh Lilhore.
2019-10-17 22:28:47 +05:30
Ayush Saxena
5527d79adb
HDFS-14810. Review FSNameSystem editlog sync. Contributed by Xiaoqiao He.
2019-10-17 21:56:30 +05:30