6e11c94170
HDFS-16576. Remove unused imports in HDFS project ( #4389 )
...
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-06-09 22:39:00 +09:00
5952934ad5
HDFS-16599. Fix typo in hadoop-hdfs-rbf module ( #4368 ). Contributed by fanshilun.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-05-31 01:59:17 +05:30
995f7b0956
HDFS-16597. RBF: Improve RouterRpcServer#reload With Lambda ( #4362 ). Contributed by fanshilun.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-05-28 09:48:34 +05:30
96985f4c45
HDFS-15225. RBF: Add snapshot counts to content summary in router. ( #4356 ). Contributed by Ayush Saxena.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
2022-05-27 09:06:07 +05:30
0733e968ab
HADOOP-18224. Upgrade maven compiler plugin to 3.10.1 ( #4267 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-05-21 03:21:13 +09:00
dad2900b87
Revert "HDFS-14750. RBF: Support dynamic handler allocation in routers ( #4199 )" ( #4306 )
2022-05-13 14:44:41 +08:00
680af27aa6
HDFS-14750. RBF: Support dynamic handler allocation in routers ( #4199 )
2022-05-13 14:28:53 +08:00
2dfa928a20
HDFS-16521. DFS API to retrieve slow datanodes ( #4107 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2022-05-03 05:05:40 +08:00
b4ff49a394
HDFS-16539. RBF: Support refreshing/changing router fairness policy controller without rebooting router ( #4168 )
2022-04-27 14:42:30 +08:00
89279f0b90
HDFS-16255. RBF: Fix dead link to fedbalance document ( #4193 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2022-04-25 14:11:41 +09:00
34b3275bf4
HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS ( #4009 ). Contributed by tomscut.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-04-03 01:36:03 +05:30
1d5650c4d0
HDFS-13248: Namenode needs to use the actual client IP when going through the
...
RBF proxy. There is a new configuration knob dfs.namenode.ip-proxy-users that configures
the list of users than can set their client ip address using the client context.
Fixes #4081
2022-03-21 09:27:35 -07:00
e5549a2a68
HDFS-16503. Should verify whether the path name is valid in the WebHDFS ( #4067 ). Contributed by tomscut.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2022-03-21 12:40:51 +05:30
7b5eac27ff
HDFS-16495: RBF should prepend the client ip rather than append it.
...
Fixes #4054
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
2022-03-14 10:21:35 -07:00
66b72406bd
HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies ( #4000 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2022-03-08 17:27:04 +09:00
2f448acf39
HDFS-16459. RBF: register RBFMetrics in MetricsSystem for promethuessink ( #3999 )
2022-02-21 11:32:34 -08:00
48bef285a8
HDFS-16440. RBF: Support router get HAServiceStatus with Lifeline RPC address ( #3971 )
2022-02-15 08:44:17 -08:00
c777142ed3
RBF: Registry HDFS Router's rpcserver & rpcclient metrics for PrometheusSink. ( #3965 )
2022-02-10 09:17:30 -08:00
390967f1f0
RBF: Add search box in Router's tab-mounttable web page ( #3968 )
2022-02-09 09:17:23 -08:00
3e7a7c3c4a
HDFS-16411 RBF: RouterId is NULL when disable RourterRpcServer ( #3878 )
2022-02-08 08:40:57 -08:00
e2d620192a
HADOOP-18044. Hadoop - Upgrade to jQuery 3.6.0 ( #3791 )
...
Co-authored-by: luoyuan <luoyuan@shopee.com>
2022-01-12 11:40:32 +08:00
b88d5ae1c6
HDFS-16417. StaticRouterRpcFairnessPolicyController init ( #3871 )
2022-01-10 18:28:20 +08:00
61d424f385
HDFS-16393. RBF: Fix TestRouterRPCMultipleDestinationMountTableResolver. ( #3849 ). Contributed by Ayush Saxena.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
2022-01-04 07:50:01 +05:30
8d251bd629
HDFS-16391. Avoid evaluation of LOG.debug statement in NameNodeHeartbeatService ( #3820 )
2021-12-21 11:28:57 +00:00
04b6b9a87b
HADOOP-16908. Prune Jackson 1 from the codebase and restrict it's usage for future ( #3789 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-12-20 16:01:34 +09:00
cab7086fbc
HDFS-16369. RBF: Fix the retry logic of RouterRpcServer#invokeAtAvailableNs. ( #3745 ). Contributed by Ayush Saxena.
...
Reviewed-by: litao <tomleescut@gmail.com>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
2021-12-04 10:54:29 +05:30
196935a8d2
HDFS-16359. RBF: RouterRpcServer#invokeAtAvailableNs does not take effect when retrying ( #3731 ). Contributed by tomscut.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-12-02 19:10:35 +05:30
5b05068fdc
HDFS-16310. RBF: Add client port to CallerContext for Router ( #3635 )
2021-11-18 13:46:35 +09:00
89fcbd84f9
HDFS-16313. RBF: Add metrics for each sub cluster ( #3638 )
2021-11-16 09:47:25 +08:00
e14a2dcbba
HADOOP-18006. maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms ( #3648 )
...
Reviewed-by: Ahmed Hussein <ahussein@apache.org>
2021-11-15 22:57:24 +09:00
d2b8d6b534
HDFS-16302. RBF: RouterRpcFairnessPolicyController record requests accepted by each nameservice ( #3621 )
2021-11-08 09:52:16 +08:00
e5cee76785
HDFS-16273. RBF: RouterRpcFairnessPolicyController add availableHandleOnPerNs metrics ( #3553 )
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
2021-11-08 09:30:53 +09:00
6f7b965808
HDFS-16296. RouterRpcFairnessPolicyController add rejected permits for each nameservice ( #3613 )
2021-11-05 11:03:07 +08:00
634f8a2209
HDFS-16091. WebHDFS should support getSnapshotDiffReportListing. ( #3374 )
2021-10-31 09:29:34 +09:00
62c86eaa0e
HADOOP-17970. unguava: remove Preconditions from hdfs-projects modules ( #3566 )
2021-10-23 16:13:07 -05:00
516f36c6f1
HADOOP-17967. Keep restrict-imports-enforcer-rule for Guava VisibleForTesting in hadoop-main pom ( #3555 )
2021-10-21 16:54:25 +09:00
d09b380dc2
HDFS-16276. RBF: Remove the useless configuration of rpc isolation in md ( #3557 )
...
Co-authored-by: zhuxiangyi <43412979@qq.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-10-18 13:53:41 +09:00
263e4b595d
HDFS-16271. RBF: NullPointerException when setQuota through routers with quota disabled. Contributed by Chengwei Wang.
2021-10-16 14:35:18 +05:30
3ac0cc9e6f
HADOOP-17957. Replace Guava VisibleForTesting by Hadoop's own annotation in hadoop-hdfs-project modules ( #3530 )
...
Reviewed-by: Ahmed Hussein <ahussein@apache.org>
2021-10-11 15:32:49 +09:00
68c2accc20
HDFS-16247. RBF: Fix the ProcessingAvgTime and ProxyAvgTime code comments and document metrics describe ms unit ( #3511 )
2021-10-04 23:52:26 +08:00
c7e7b2f907
HDFS-16219. RBF: Set default map tasks and bandwidth in RouterFederationRename ( #3452 )
2021-09-22 15:34:51 +09:00
7c25a77911
HDFS-16217. RBF: Set default value of hdfs.fedbalance.procedure.scheduler.journal.uri by adding appropriate config resources ( #3434 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-09-17 16:39:29 +09:00
4d21655d04
HDFS-16218. Use HdfsConfiguration for passing in Router principal ( #3444 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-09-16 14:58:02 +09:00
2d479309cc
HDFS-16203. Discover datanodes with unbalanced block pool usage by the standard deviation ( #3366 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-09-16 10:00:02 +09:00
4f563ff1ba
HDFS-16225. Fix typo for FederationTestUtils ( #3428 ). Contributed by tomscut.
2021-09-14 14:28:19 +05:30
7f6553af75
HDFS-16221. RBF: Add usage of refreshCallQueue for Router ( #3421 )
2021-09-12 19:52:47 +08:00
90bc688c78
HDFS-16188. RBF: Router to support resolving monitored namenodes with DNS ( #3346 ) Contributed by Leon Gao
...
* Router to support resolving monitored namenodes with DNS
* Style
* fix style and test failure
* Add test for NNHAServiceTarget const
* Resolve comments
* Fix test
* Comments and style
* Create a simple function to extract port
* Use LambdaTestUtils.intercept
* fix javadoc
* Trigger Build
2021-09-10 16:40:08 -07:00
99cb2b6b7f
HDFS-16065. RBF: Add metrics to record Router's operations ( #3100 )
2021-09-09 18:45:23 +08:00
c0890e6d04
HDFS-16210. RBF: Add the option of refreshCallQueue to RouterAdmin ( #3379 )
2021-09-09 09:57:27 +08:00
364a1fbfb3
HDFS-16194. Simplify the code with DatanodeID#getXferAddrWithHostname ( #3354 ). Contributed by tomscut.
2021-09-05 14:19:01 +08:00
Ashutosh Gupta
slfan1989
Ayush Saxena
Viraj Jasani
Hui Fei
Felix Nguyen
litao
Owen O'Malley
Neil
YulongZ
luoyuan3471
wangzhaohui
Symious
Xiangyi Zhu
Masatake Iwasaki
Ahmed Hussein
huhaiyang
lfengnan
LeonGao