8af56de1fa
HADOOP-17560. Fix some spelling errors ( #2730 )
...
Co-authored-by: jiaguodong5 <jiaguodong5@jd.com>
2021-03-03 11:41:05 +09:00
2ce5752fa8
HDFS-15839. RBF: Cannot get method setBalancerBandwidth on Router Client. Contributed by Yang Yun.
2021-02-20 19:34:29 +05:30
0ed9e36282
HDFS-15834. Remove the usage of org.apache.log4j.Level ( #2696 )
2021-02-17 01:59:24 -05:00
2b3c5b1733
HDFS-15836. RBF: Fix contract tests after HADOOP-13327 ( #2702 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-02-16 14:50:50 +09:00
07a4220cd2
HDFS-15821. Add metrics for in-service datanodes ( #2690 ). Contributed by Zehao Chen.
2021-02-15 11:14:32 -06:00
394b9f7a5c
HDFS-15624. fix the function of setting quota by storage type ( #2377 )
...
1. puts NVDIMM to the end of storage type enum to make sure compatibility.
2. adds check to make sure the software layout version is satisfied
Co-authored-by: su xu <kevinbrandon@163.com>
Co-authored-by: huangtianhua <huangtianhua223@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2021-02-02 22:44:34 -08:00
e40f99f6d5
HDFS-15767. RBF: Router federation rename of directory. Contributed by Jinglun.
2021-01-26 14:25:27 +05:30
0d7ac54510
HDFS-14558. RBF: Isolation/Fairness documentation. Contributed by Fengnan Li.
2021-01-12 23:38:55 +08:00
2ba7ec2b48
HDFS-15766. RBF: MockResolver.getMountPoints() breaks the semantic of FileSubclusterResolver. Contributed by Jinglun.
2021-01-08 16:27:54 +05:30
77299ae992
HDFS-15748. RBF: Move the router related part from hadoop-federation-balance module to hadoop-hdfs-rbf. Contributed by Jinglun.
2021-01-05 00:05:03 +05:30
5ab1db9e21
HDFS-15380. RBF: Could not fetch real remote IP in RouterWebHdfsMethods. Contributed by tomscut.
2020-12-21 09:58:30 +05:30
2aea43bf4f
HDFS-15655. Add option to make balancer prefer to get cold blocks. Contributed by Yang Yun.
2020-12-20 23:06:19 +05:30
7dda804a1a
HDFS-14090. RBF: Improved isolation for downstream name nodes. {Static}. Contributed by Fengnan Li and CR Hota.
2020-12-04 22:56:37 +05:30
6a1d7d9ed2
HDFS-15677. TestRouterRpcMultiDestination#testGetCachedDatanodeReport fails on trunk. ( #2503 )
2020-12-01 08:06:52 +09:00
cd0490e8c6
Revert "YARN-10425. Replace the legacy placement engine in CS with the new one. Contributed by Gergely Pollak."
...
This reverts commit b0ab222a6c
2020-11-11 17:06:12 +01:00
b0ab222a6c
YARN-10425. Replace the legacy placement engine in CS with the new one. Contributed by Gergely Pollak.
2020-11-11 17:03:16 +01:00
f1d5652359
HDFS-15668. RBF: Fix RouterRPCMetrics annocation and document misplaced error. Contributed by Hongbing Wang.
2020-11-10 13:09:03 +08:00
b3ba74d72d
HDFS-15657. RBF: TestRouter#testNamenodeHeartBeatEnableDefault fails by BindException ( #2418 )
2020-10-28 19:12:23 +09:00
264c948e60
HDFS-15630. RBF: Fix wrong client IP info in CallerContext when requests mount points with multi-destinations. Contributed by Chengwei Wang
2020-10-23 14:06:22 +08:00
1e3a6efcef
HADOOP-17288. Use shaded guava from thirdparty. ( #2342 ). Contributed by Ayush Saxena.
2020-10-17 12:01:18 +05:30
69ef9b1ee8
HDFS-15620. RBF: Fix test failures after HADOOP-17281 ( #2375 )
2020-10-12 09:52:12 +09:00
518a212cff
HDFS-13293. RBF: The RouterRPCServer should transfer client IP via CallerContext to NamenodeRpcServer ( #2363 )
2020-10-09 16:12:22 +08:00
074f0d46af
HDFS-15613. RBF: Router FSCK fails after HDFS-14442. ( #2360 )
...
* Support getHAServiceState in DFSRouter
2020-10-07 13:37:45 +09:00
921ca1f554
HDFS-15543. RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled. Contributed by Hemanth Boyina.
2020-10-07 09:58:53 +05:30
a89ca56a1b
HDFS-15600 Fix TestRouterQuota#testStorageTypeQuota ( #2347 )
2020-09-29 19:00:55 -07:00
d686a655bc
HDFS-15603. RBF: Fix getLocationsForPath twice in create operation. Contributed by wangzhaohui.
2020-09-29 00:03:11 +05:30
fc8a6dd8a9
HDFS-15591. RBF: Fix webHdfs file display error. Contributed by wangzhaohui.
2020-09-28 23:55:31 +05:30
eae0035a2d
HDFS-15530. RBF: Fix typo in DFS_ROUTER_QUOTA_CACHE_UPDATE_INTERVAL var definition. Contributed by Sha Fanghao.
2020-09-28 09:40:39 -07:00
486ddb73f9
HADOOP-17283. Hadoop - Upgrade to jQuery 3.5.1 ( #2330 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2020-09-24 21:15:55 +09:00
474fa80bfb
HADOOP-17277. Correct spelling errors for separator ( #2322 )
...
Contributed by Hui Fei.
2020-09-22 17:10:33 +01:00
3e8b1e7426
HDFS-15554. RBF: force router check file existence in destinations before adding/updating mount points ( #2266 ). Contributed by Fengnan Li.
2020-09-21 23:24:13 +05:30
7a6265ac42
HDFS-14811. RBF: TestRouterRpc#testErasureCoding is flaky. Contributed by Chen Zhang.
2020-09-21 08:50:08 +05:30
8eba922bb3
HDFS-15579. RBF: The constructor of PathLocation may got some misunderstanding. Contributed by Janus Chow.
2020-09-20 08:54:25 +05:30
c78d18023d
HDFS-15555. RBF: Refresh cacheNS when SocketException occurs. ( #2267 )
2020-09-14 11:34:52 +09:00
ca8e7a7725
HDFS-15510. RBF: Quota and Content Summary was not correct in Multiple Destinations. Contributed by Hemanth Boyina.
2020-08-27 12:10:39 +09:00
6e618b6a7e
HDFS-15536. RBF: Clear Quota in Router was not consistent.
2020-08-26 13:03:08 +05:30
4813a37023
HDFS-15535. RBF: Fix Namespace path to snapshot path resolution for snapshot API. Contributed by Ayush Saxena.
2020-08-20 23:54:35 +05:30
9062814bab
HDFS-15508. [JDK 11] Fix javadoc errors in hadoop-hdfs-rbf module
2020-08-11 10:58:56 +09:00
82f3ffcd64
HDFS-15503. File and directory permissions are not able to be modified from WebUI.
2020-08-03 23:21:01 +05:30
c40cbc57fa
HADOOP-17091. [JDK11] Fix Javadoc errors ( #2098 )
2020-08-03 10:46:51 +09:00
68287371cc
HDFS-15488. Add a command to list all snapshots for a snaphottable root with snapshot Ids. ( #2166 )
2020-07-29 21:33:25 +05:30
8a9a674ef1
HDFS-15198. RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode. Contributed by zhengchenyu.
2020-07-18 15:36:55 +05:30
6bcb24d269
HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein.
2020-07-18 14:33:43 +05:30
84b74b335c
HDFS-15447 RBF: Add top real owners metrics for delegation tokens ( #2110 )
2020-07-12 00:10:12 -07:00
f91a8ad88b
HADOOP-17079. Optimize UGI#getGroups by adding UGI#getGroupsSet. ( #2085 )
2020-07-09 11:33:37 -07:00
f77bbc2123
HDFS-15312. Apply umask when creating directory by WebHDFS ( #2096 )
2020-07-06 19:01:46 -07:00
e820baa6e6
HDFS-15417. RBF: Get the datanode report from cache for federation WebHDFS operations ( #2080 )
2020-07-06 16:17:09 -07:00
84110d850e
HDFS-15383. RBF: Add support for router delegation token without watch ( #2047 )
...
Improving router's performance for delegation tokens related operations. It achieves the goal by removing watchers from router on tokens since based on our experience. The huge number of watches inside Zookeeper is degrading Zookeeper's performance pretty hard. The current limit is about 1.2-1.5 million.
2020-06-23 13:12:29 -07:00
9cbd76cc77
HDFS-15346. FedBalance tool implementation. Contributed by Jinglun.
2020-06-18 13:33:25 +08:00
e154084770
HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes ( #2026 )
2020-06-12 23:16:33 +05:30
JJiaguodong
Ayush Saxena
Akira Ajisaka
Zehao Chen
YaYun-Wang
Yiqun Lin
Masatake Iwasaki
Peter Bacsko
Hui Fei
Hui Fei
hemanthboyina
huangtianhua
Inigo Goiri
Aryan Gupta
lfengnan
Takanobu Asanuma
bshashikant
Xiaoyu Yao
Ye Ni
Vinayakumar B