f26d8bc9bd
HDFS-16886: Fixes error in documentation for StateStoreRecordsOperations. ( #5290 )
2023-01-11 19:46:51 +00:00
b56d483258
HDFS-16876: Changes cleanup of shared RouterStateIdContext to be driven by namenodeResolver data. ( #5282 )
2023-01-09 23:55:13 +00:00
cd19da1309
HDFS-16877: Enables state context for namenode in TestObserverWithRouter ( #5257 )
2023-01-07 00:18:35 +00:00
d25c1be517
HDFS-16861. RBF. Truncate API always fails when dirs use AllResolver oder on Router ( #5184 )
...
Co-authored-by: xiezhineng <xiezhineng@corp.netease.com>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Tao Li <tomscut@apache.org>
2022-12-26 21:19:33 +08:00
df093ef9af
HDFS-16831. [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time ( #5098 )
2022-12-23 14:16:42 +08:00
8a9bdb1edc
HDFS-16837. [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespaces ( #5123 )
2022-12-05 16:15:47 +08:00
03471a736c
HDFS-16851: RBF: Add a utility to dump the StateStore. ( #5155 )
2022-11-29 22:12:35 +00:00
909aeca86c
HDFS-16845: Adds configuration flag to allow clients to use router observer reads without using the ObserverReadProxyProvider. ( #5142 )
2022-11-29 00:49:10 +00:00
ec2856d79c
HDFS-16847: RBF: Prevents StateStoreFileSystemImpl from committing tmp file after encountering an IOException. ( #5145 )
2022-11-29 00:47:01 +00:00
e0974298ce
HDFS-16826. [RBF SBN] ConnectionManager should advance the client stateId for each request ( #5086 )
2022-11-25 09:23:33 +08:00
c71a68ca80
HDFS-16844: Adds resilancy when StateStore gets exceptions. ( #5138 )
...
Allows the StateStore to stay up when there are errors reading the data.
2022-11-18 17:24:08 +00:00
552ee44eba
HDFS-16834: Removes request stateID consistency constraint between clients in different connection pools. ( #5121 )
...
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Zander Xu <zanderxu@apache.org>
2022-11-11 15:26:31 +08:00
44b8bb7224
HDFS-16821: Fixes regression in HDFS-13522 that enables observer reads by default ( #5078 )
2022-11-07 08:43:04 -08:00
c5c00f3d2c
HDFS-16803.Improve some annotations in hdfs module. ( #5031 )
2022-10-20 10:58:23 +08:00
6422eaf301
HDFS-16767: RBF: Support observer node in Router-Based Federation.
...
Fixes #4127
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-09-14 16:00:14 -07:00
8ce71c8882
[Documentation] RBF: Duplicate statement to be removed for better readabilty ( #4881 )
2022-09-13 09:24:05 -07:00
e77d54d1ee
HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.
...
Fixes #4311
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-09-09 15:43:28 -07:00
4a01fadb94
HDFS-16756. RBF proxies the client's user by the login user to enable CacheEntry ( #4853 ). Contributed by ZanderXu.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-09-09 12:47:36 +05:30
be4c638e4c
HDFS-16748. RBF: DFSClient should uniquely identify writing files by namespace id and iNodeId via RBF ( #4813 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-09-05 17:46:15 +05:30
5567154f71
HDFS-16734. RBF: fix some bugs when handling getContentSummary RPC ( #4763 )
2022-08-26 16:04:33 -07:00
8d4f51c432
HDFS-16728. RBF throw IndexOutOfBoundsException with disableNameServices ( #4734 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-24 20:27:15 +05:30
c37f01d95b
HDFS-16724. RBF should support get the information about ancestor mount points ( #4719 )
2022-08-23 13:25:42 -07:00
a3b1bafa34
HDFS-16669: Enhance client protocol to propagate last seen state IDs for multiple nameservices.
...
Fixes #4584
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-08-23 11:12:50 -07:00
7f176d080c
HDFS-16729. RBF: fix some unreasonably annotated docs. ( #4745 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-08-21 07:29:31 +09:00
622ca0d51f
HDFS-16705. RBF supports healthMonitor timeout configurable and caching NN and client proxy in NamenodeHeartbeatService ( #4662 )
2022-08-15 13:55:16 -07:00
e0c8c6eed4
HDFS-16678. RBF should supports disable getNodeUsage() in RBFMetrics ( #4606 )
2022-08-12 12:01:58 -07:00
521e65acfe
HDFS-16723. Replace incorrect SafeModeException with StandbyException in RouterRpcServer.class ( #4716 ). Contributed by ZanderXu.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-08-13 00:21:11 +05:30
09cabaad68
HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets ( #4531 )
2022-08-11 13:23:32 -07:00
0fc7dd8228
HDFS-16687. RouterFsckServlet replicates code from DfsServlet base class ( #4681 )
2022-08-03 09:14:11 -07:00
f80fab2b90
HDFS-16671. RBF: RouterRpcFairnessPolicyController supports configurable permit acquire timeout ( #4597 )
2022-07-28 15:42:53 +08:00
2c96357051
HDFS-15079. RBF: Namenode needs to use the actual client Id and callId when going through RBF proxy. ( #4530 )
2022-07-23 22:19:37 +08:00
2f6916a313
HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. ( #4375 )
2022-07-21 18:42:55 -07:00
08a940d5dd
HDFS-16640. RBF: Show datanode IP list when click DN histogram in Router ( #4488 )
2022-07-21 16:21:31 -07:00
6f9c4359ec
HDFS-16283. RBF: reducing the load of renewLease() RPC ( #4524 ). Contributed by ZanderXu.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-07-14 07:26:40 +05:30
e8fd914c58
HDFS-16616. remove use of org.apache.hadoop.util.Sets ( #4400 )
...
Co-Authored by: Samrat Deb
2022-06-22 10:17:36 +05:30
f8c7e67fdc
HDFS-16628 RBF: Correct target directory when move to trash for kerberos login user. ( #4424 ). Contributed by Xiping Zhang.
2022-06-15 21:16:24 +08:00
6e11c94170
HDFS-16576. Remove unused imports in HDFS project ( #4389 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-06-09 22:39:00 +09:00
5952934ad5
HDFS-16599. Fix typo in hadoop-hdfs-rbf module ( #4368 ). Contributed by fanshilun.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-05-31 01:59:17 +05:30
995f7b0956
HDFS-16597. RBF: Improve RouterRpcServer#reload With Lambda ( #4362 ). Contributed by fanshilun.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-05-28 09:48:34 +05:30
96985f4c45
HDFS-15225. RBF: Add snapshot counts to content summary in router. ( #4356 ). Contributed by Ayush Saxena.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
2022-05-27 09:06:07 +05:30
0733e968ab
HADOOP-18224. Upgrade maven compiler plugin to 3.10.1 ( #4267 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-05-21 03:21:13 +09:00
dad2900b87
Revert "HDFS-14750. RBF: Support dynamic handler allocation in routers ( #4199 )" ( #4306 )
2022-05-13 14:44:41 +08:00
680af27aa6
HDFS-14750. RBF: Support dynamic handler allocation in routers ( #4199 )
2022-05-13 14:28:53 +08:00
2dfa928a20
HDFS-16521. DFS API to retrieve slow datanodes ( #4107 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-05-03 05:05:40 +08:00
b4ff49a394
HDFS-16539. RBF: Support refreshing/changing router fairness policy controller without rebooting router ( #4168 )
2022-04-27 14:42:30 +08:00
89279f0b90
HDFS-16255. RBF: Fix dead link to fedbalance document ( #4193 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-04-25 14:11:41 +09:00
34b3275bf4
HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS ( #4009 ). Contributed by tomscut.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-04-03 01:36:03 +05:30
1d5650c4d0
HDFS-13248: Namenode needs to use the actual client IP when going through the
...
RBF proxy. There is a new configuration knob dfs.namenode.ip-proxy-users that configures
the list of users than can set their client ip address using the client context.
Fixes #4081
2022-03-21 09:27:35 -07:00
e5549a2a68
HDFS-16503. Should verify whether the path name is valid in the WebHDFS ( #4067 ). Contributed by tomscut.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-03-21 12:40:51 +05:30
7b5eac27ff
HDFS-16495: RBF should prepend the client ip rather than append it.
...
Fixes #4054
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-03-14 10:21:35 -07:00
Simbarashe Dzinamarira
Neil
ZanderXu
Owen O'Malley
jianghuazhu
Renukaprasad C
ZanderXu
Steve Vaughan
slfan1989
wangzhaohui
Samrat
章锡平
Ashutosh Gupta
Ayush Saxena
Viraj Jasani
Hui Fei
Felix Nguyen
litao