552ee44eba
HDFS-16834: Removes request stateID consistency constraint between clients in different connection pools. ( #5121 )
...
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Zander Xu <zanderxu@apache.org>
2022-11-11 15:26:31 +08:00
44b8bb7224
HDFS-16821: Fixes regression in HDFS-13522 that enables observer reads by default ( #5078 )
2022-11-07 08:43:04 -08:00
660530205e
HDFS-16833. NameNode should log internal EC blocks instead of the EC block group when it receives block reports. ( #5106 )
...
Reviewed-by: Tao Li <tomscut@apache.org>
2022-11-07 10:49:48 +09:00
e9319e696c
HDFS-16811. Support DecommissionBackoffMonitor Parameters reconfigurablereconfigurable ( #5068 )
...
Signed-off-by: Tao Li <tomscut@apache.org>
2022-11-04 14:18:59 +08:00
88f7f5bc01
HDFS-16802.Print options when accessing ClientProtocol#rename2(). ( #5013 )
...
Reviewed-by: Tao Li <tomscut@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Zander Xu <zanderxu@apache.org>
2022-10-28 16:31:20 +08:00
8396caa484
HDFS-16716. Improve appendToFile command: support appending on file with new block ( #4697 )
...
Reviewed-by: xuzq <15040255127@163.com>
Signed-off-by: Tao Li <tomscut@apache.org>
2022-10-27 19:03:15 +08:00
d26c35b228
HDFS-16817. Remove useless DataNode lock related configuration ( #5072 )
...
Reviewed-by: litao <tomleescut@gmail.com>
Signed-off-by: ZanderXu <zanderxu@apache.org>
2022-10-27 17:28:19 +08:00
545a556883
HDFS-16822. HostRestrictingAuthorizationFilter should pass through requests if they don't access WebHDFS API. ( #5079 )
...
Reviewed-by: Ashutosh Gupta <ashugpt@amazon.com>
Reviewed-by: Tao Li <tomscut@apache.org>
2022-10-27 14:39:01 +09:00
c5c00f3d2c
HDFS-16803.Improve some annotations in hdfs module. ( #5031 )
2022-10-20 10:58:23 +08:00
9a8aff69ff
HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS ( #4750 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-10-17 18:56:15 +08:00
d6b1e1eeb6
HDFS-16777. datatables@1.10.17 sonatype-2020-0988 vulnerability ( #5003 )
2022-10-12 14:51:12 -07:00
d14b88c698
HDFS-16774.Improve async delete replica on datanode ( #4903 )
...
HDFS-16774. Improve async delete replica on datanode to reduce the probability of ReplicationNotFoundException
Co-authored-by: Haiyang Hu <haiyang.hu@shopee.com>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-10-11 16:22:56 +08:00
4fe079f85f
HDFS-16795. Use secure XML parsers ( #4979 )
...
Contributed by P J Fanning
2022-10-10 18:56:35 +01:00
62ff4e36cf
HDFS-16787. Remove the redundant lock in DataSetLockManager#removeLock ( #4948 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-10-10 20:05:02 +08:00
b0b2cb4a16
HDFS-16783. Remove the redundant lock in deepCopyReplica and getFinalizedBlocks ( #4942 ). Contributed by ZanderXu.
...
Reviewed-by: Mingxiang Li <liaiphag0@gmail.com>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-10-10 19:52:22 +08:00
b0bfd09c41
HDFS-16798. HDFS-16798. SerialNumberMap should decrease current counter if the item exist. ( #4987 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-10-09 18:58:09 +08:00
4891bf5049
HDFS-13369. Fix for FSCK Report broken with RequestHedgingProxyProvider ( #4917 )
...
Contributed-by: navinko <nakumr@cloudera.com>
2022-09-30 23:28:12 +08:00
d9f435f6ac
HDFS-16766. XML External Entity (XXE) attacks can occur while processing XML received from an untrusted source ( #4886 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-09-27 15:44:25 +09:00
9a29075f91
HDFS-16776 Erasure Coding: The length of targets should be checked when DN gets a reconstruction task ( #4901 )
2022-09-23 12:27:56 +09:00
740e1ef357
HDFS-16706. ViewFS doc points to wrong mount table name ( #4803 )
2022-09-21 16:55:20 +05:30
40ab9c8ba7
HDFS-16341. Fix BlockPlacementPolicy details in hdfs defaults. ( #3691 ). Contributed by guophilipse.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-09-20 23:16:24 +05:30
e68006cd70
HDFS-16772. refreshHostsReader should use the latest configuration ( #4890 )
2022-09-19 13:27:07 -07:00
a73c4804d8
HADOOP-18446. [SBN read] Add a re-queue metric to RpcMetrics to quantify the number of re-queued RPCs ( #4871 )
...
Signed-off-by: Erik Krogen <xkrogen@apache.org>
Co-authored-by: zengqiang.xu <zengqiang.xu@shopee.com>
2022-09-16 10:09:01 -07:00
43c1ebae16
HDFS-16771. Follow-up for HDFS-16659: JN should tersely print logs about NewerTxnIdException ( #4882 )
...
Signed-off-by: Erik Krogen <xkrogen@apache.org>
Co-authored-by: zengqiang.xu <zengqiang.xu@shopee.com>
2022-09-15 12:44:36 -07:00
6422eaf301
HDFS-16767: RBF: Support observer node in Router-Based Federation.
...
Fixes #4127
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-09-14 16:00:14 -07:00
8ce71c8882
[Documentation] RBF: Duplicate statement to be removed for better readabilty ( #4881 )
2022-09-13 09:24:05 -07:00
1923096adb
Allow block reconstruction pending timeout to be refreshable ( #4567 )
...
Reviewed-by: Hiroyuki Adachi <hadachi@yahoo-corp.jp>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2022-09-12 11:45:01 +09:00
e77d54d1ee
HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.
...
Fixes #4311
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-09-09 15:43:28 -07:00
4a01fadb94
HDFS-16756. RBF proxies the client's user by the login user to enable CacheEntry ( #4853 ). Contributed by ZanderXu.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-09-09 12:47:36 +05:30
c947c326e8
HDFS-16659. JournalNode should throw NewerTxnIdException when SinceTxId is bigger than HighestWrittenTxId ( #4560 )
...
Co-authored-by: Zander Xu <zengqiang.xu@shopee.com>
Signed-off-by: Erik Krogen <xkrogen@apache.org>
2022-09-06 10:12:55 -07:00
be4c638e4c
HDFS-16748. RBF: DFSClient should uniquely identify writing files by namespace id and iNodeId via RBF ( #4813 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-09-05 17:46:15 +05:30
ac42519ade
HDFS-16593. Correct the BlocksRemoved metric on DataNode side ( #4353 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-09-05 19:35:48 +08:00
7b239a80fe
HDFS-16750. NameNode should use NameNode.getRemoteUser() to log audit event to avoid possible NPE ( #4821 )
2022-09-02 10:23:03 -07:00
2dd8b1342e
HDFS-16755. TestQJMWithFaults.testUnresolvableHostName() can fail due to unexpected host resolution ( #4833 )
...
Use ".invalid" domain from IETF RFC 2606 to ensure that the host doesn't resolve.
Contributed by Steve Vaughan Jr
2022-09-01 14:00:15 +01:00
71778a6cc5
HDFS-16735. Reduce the number of HeartbeatManager loops. ( #4780 ). Contributed by Shuyan Zhang.
...
Signed-off-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-29 11:30:21 +08:00
5567154f71
HDFS-16734. RBF: fix some bugs when handling getContentSummary RPC ( #4763 )
2022-08-26 16:04:33 -07:00
5736b34b2a
HDFS-16736. Link to Boost library in libhdfspp ( #4782 )
2022-08-26 09:11:44 -07:00
231a4468cd
HDFS-16732. [SBN READ] Avoid get location from observer when the block report is delayed ( #4756 )
...
Signed-off-by: Erik Krogen <xkrogen@apache.org>
2022-08-25 10:37:25 -07:00
1691cccc89
HDFS-16738. Invalid CallerContext caused NullPointerException ( #4791 )
2022-08-25 17:12:27 +08:00
8d4f51c432
HDFS-16728. RBF throw IndexOutOfBoundsException with disableNameServices ( #4734 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-24 20:27:15 +05:30
c37f01d95b
HDFS-16724. RBF should support get the information about ancestor mount points ( #4719 )
2022-08-23 13:25:42 -07:00
a3b1bafa34
HDFS-16669: Enhance client protocol to propagate last seen state IDs for multiple nameservices.
...
Fixes #4584
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-08-23 11:12:50 -07:00
6fbc38db95
HDFS-16686. GetJournalEditServlet fails to authorize valid Kerberos request ( #4724 )
2022-08-23 08:03:57 -07:00
183f09b1da
HDFS-16717. Replace NPE with IOException in DataNode.class ( #4699 ). Contributed by ZanderXu.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-23 18:17:32 +08:00
a9e5fb3313
HDFS-16684. Exclude the current JournalNode ( #4723 )
...
Exclude bound local addresses, including the use of a wildcard address in the bound host configurations.
* Allow sync attempts with unresolved addresses
* Update the comments.
* Remove unused import
Signed-off-by: stack <stack@apache.org>
2022-08-22 09:52:45 -07:00
7f176d080c
HDFS-16729. RBF: fix some unreasonably annotated docs. ( #4745 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-08-21 07:29:31 +09:00
5cc8c574d1
HDFS-16676. DatanodeAdminManager$Monitor reports a node as invalid continuously ( #4626 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-08-18 02:25:09 +08:00
86abeb401e
HDFS-16730. Update the doc that append to EC files is supported ( #4749 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
2022-08-17 05:41:41 +08:00
622ca0d51f
HDFS-16705. RBF supports healthMonitor timeout configurable and caching NN and client proxy in NamenodeHeartbeatService ( #4662 )
2022-08-15 13:55:16 -07:00
b1d4af2492
HDFS-16704. Datanode return empty response instead of NPE for GetVolumeInfo during restarting ( #4661 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2022-08-15 20:57:27 +08:00
Simbarashe Dzinamarira
Takanobu Asanuma
huhaiyang
jianghuazhu
M1eyu2018
Ashutosh Gupta
PJ Fanning
ZanderXu
Navink
Kidd5368
Samrat
GuoPhilipse
ZanderXu
Renukaprasad C
caozhiqiang
Steve Vaughan
zhangshuyan0
Gautham B A
zhengchenyu