55 Commits

Author SHA1 Message Date
Vinayakumar B
bc4098eb07 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
(cherry picked from commit 8571507efa3af3e4a5213a7e24c65e26162eac4d)
2018-11-16 17:43:49 +05:30
Inigo Goiri
0ba621029c HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui.
(cherry picked from commit f63ee083db7c261207b726f0f44be2e5a92124f3)
2018-10-12 10:12:40 -07:00
Inigo Goiri
5539dd97d2 HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena.
(cherry picked from commit 3bfff0f79e7246cbb2989c720c14cfa2566a9d1a)
2018-10-06 10:43:36 -07:00
Brahma Reddy Battula
3d67080a45 HDFS-13790. RBF: Move ClientProtocol APIs to its own module Contributed by Chao Sun. 2018-09-26 22:46:43 +05:30
Inigo Goiri
1b12925d69 HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.
(cherry picked from commit 527288ef891dc26019d003bd85ddfd50eb4f3b7b)
2018-09-06 16:50:09 -07:00
Inigo Goiri
2e744bd31d HDFS-13857. RBF: Choose to enable the default nameservice to read/write files. Contributed by yanghuafeng.
(cherry picked from commit 54f2044595206455484284b43e5976c8a1982aaf)
2018-09-04 12:18:38 -07:00
Yiqun Lin
8137b473aa HDFS-13634. RBF: Configurable value in xml for async connection request queue size. Contributed by CR Hota.
(cherry picked from commit a0ebb6b39f2932d3ea2fb5e287f52b841e108428)
2018-08-29 16:23:17 +08:00
Brahma Reddy Battula
2a8f4aefd4 HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng.
(cherry picked from commit 64ad0298d441559951bc9589a40f8aab17c93a5f)
2018-08-29 08:32:36 +05:30
Yiqun Lin
8e09ff918e HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache. Contributed by Fei Hui.
(cherry picked from commit 81847392badcd58d934333e7c3b5bf14b4fa1f3f)
2018-08-22 11:48:34 +08:00
Yiqun Lin
18ebe18305 HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma. 2018-08-20 23:08:26 +08:00
Yiqun Lin
e6fcaccf5a HDFS-13583. RBF: Router admin clrQuota is not synchronized with nameservice. Contributed by Dibyendu Karmakar.
(cherry picked from commit 17a87977f29ced49724f561a68565217c8cb4e94)
2018-07-24 11:21:37 +08:00
Yiqun Lin
8a68a1590f HDFS-13743. RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver. Contributed by Takanobu Asanuma.
(cherry picked from commit 7b25fb949bf6f02df997beeca7df46c9e84c8d96)
2018-07-20 17:33:31 +08:00
Yiqun Lin
4c2ab22130 HDFS-13733. RBF: Add Web UI configurations and descriptions to RBF document. Contributed by Takanobu Asanuma.
(cherry picked from commit 1af87df242c4286474961078d306a5692f85debc)
2018-07-17 10:49:50 +08:00
Inigo Goiri
436fceebf9 HDFS-13475. RBF: Admin cannot enforce Router enter SafeMode. Contributed by Chao Sun.
(cherry picked from commit 359ea4e18147af5677c6d88265e26de6b6c72999)
2018-07-16 09:47:57 -07:00
Yiqun Lin
fbe7192815 HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu Asanuma.
(cherry picked from commit 2ae13d41dcd4f49e6b4ebc099e5f8bb8280b9872)
2018-07-11 22:17:43 +08:00
Yiqun Lin
512d20e9c5 HDFS-13710. RBF: setQuota and getQuotaUsage should check the dfs.federation.router.quota.enable. Contributed by yanghuafeng.
(cherry picked from commit 43f7fe8aae0eca89cce4d67bfc4965fe8ce63e38)
2018-07-09 15:08:39 +08:00
Yiqun Lin
1a96293c63 HDFS-13528. RBF: If a directory exceeds quota limit then quota usage is not refreshed for other mount entries. Contributed by Dibyendu Karmakar.
(cherry picked from commit 3b637155a47d2aa93284969a96208347a647083d)
2018-07-04 15:07:47 +08:00
Rohith Sharma K S
0af3bea05d YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
(cherry picked from commit 2df73dace06cfd2b3193a14cd455297f8f989617)
2018-06-12 17:30:02 +05:30
Inigo Goiri
c8f183edd3 HDFS-13637. RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE. Contributed by CR Hota.
(cherry picked from commit e11d67404945d80db2eb8a99453606419dbdc938)
2018-06-01 17:01:02 -07:00
Yiqun Lin
11794e5eda HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota. 2018-05-11 18:56:59 +08:00
Yiqun Lin
b83ff77409 Revert "HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota."
This reverts commit d4a141e7b014f23d2b3bb1aa215a8799fdc5315e.
2018-05-11 18:53:12 +08:00
Yiqun Lin
d4a141e7b0 HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota.
(cherry picked from commit a922b9c82cc564e86dc0ef84bcc3597cb7b7c211)
2018-05-11 15:06:45 +08:00
Inigo Goiri
e7b5c0091d HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin.
(cherry picked from commit a3b416f69dc3965f247603f657df33bd74fd723e)
2018-05-03 11:26:51 -07:00
Yiqun Lin
06632c0665 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri.
(cherry picked from commit 37269261d1232bc71708f30c76193188258ef4bd)
(cherry picked from commit 5fef28d0d4b27c5df31d325650e46f5ab5f5630f)
2018-05-02 15:02:24 +08:00
Inigo Goiri
c8441811fd HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S.
(cherry picked from commit 484440602c5b69fbd8106010603c61ae051056dd)
2018-04-27 16:30:07 -07:00
Inigo Goiri
ae32e2140c HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari.
(cherry picked from commit f469628bba350ba79bc6a0d38f9dc1cb5eb65c77)
2018-04-27 15:16:46 -07:00
Yiqun Lin
87c9fff352 HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri.
(cherry picked from commit 0a293de00d5f123c7c8248459aa8ae88a45f39b1)
2018-04-27 10:41:16 +08:00
Inigo Goiri
1c3d746fc0 HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li.
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
2018-04-26 13:14:08 -07:00
Yiqun Lin
33ffc96085 HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri.
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
2018-04-25 15:25:16 +08:00
Yiqun Lin
cc5416d94a HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri.
(cherry picked from commit b06601acce38ed60b726b99e2830f38a1ee3d2b5)
2018-04-24 11:29:06 +08:00
Yiqun Lin
a975250303 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri.
(cherry picked from commit b6dae26f4490bbd03360b8df19ef00cf843430f3)
2018-04-21 14:53:12 +08:00
Inigo Goiri
a3c1735951 HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar.
(cherry picked from commit 1134af9ad1daf683204df8f95a8f03d7baaa74d4)
2018-04-19 14:58:02 -07:00
Wei Yan
8d720daa49 HDFS-13466. RBF: Add more router-related information to the UI.
(cherry picked from commit e4313e7e4725261b652dd7202048ff2373b05e28)
2018-04-17 15:06:48 -07:00
Yiqun Lin
88cb461c87 HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21acaeb2b7d56d19cd4996aa25151bd1)
2018-04-17 11:27:30 +08:00
Inigo Goiri
940d3e6f74 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042b70f9f0d7a2620c60de022768a7b13)
2018-04-11 12:04:18 -07:00
Inigo Goiri
9af5823dbb HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
2018-04-11 10:42:17 -07:00
Wei Yan
c65ac673a1 HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri.
(cherry picked from commit 8433f6256c7c67b583466c35f51b1918a4b77b02)
2018-04-11 09:08:11 -07:00
Yiqun Lin
ea51ef44fc HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.
(cherry picked from commit e87be8a2a49573897e40bfdf43541e3635e35c98)
2018-04-10 15:39:46 +08:00
Yiqun Lin
9baebf4b27 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.
(cherry picked from commit a92200f4a6cec57b7080d1cd6e2a20d79d772dd6)
2018-04-10 14:47:55 +08:00
Inigo Goiri
78ec00155e HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin.
(cherry picked from commit e9b9f48dad5ebb58ee529f918723089e8356c480)
2018-04-09 10:11:38 -07:00
Yiqun Lin
14827da747 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.
(cherry picked from commit 5700556cd65a558f4393e05acb7ea8db3ccd2f36)
2018-04-08 12:07:44 +08:00
Wei Yan
689a8252aa HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
2018-04-05 13:23:07 -07:00
Inigo Goiri
254ec1e4d3 HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri. 2018-04-03 09:29:20 -07:00
Inigo Goiri
c6a013c9e0 HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.
(cherry picked from commit dc8e3432013153ac11d31d6b462aa96f8ca2c443)
2018-03-31 09:47:36 -07:00
Yiqun Lin
f5aa36e194 HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.
(cherry picked from commit a71656c1c1bf6c680f1382a76ddcac870061f320)
2018-03-28 11:59:36 -07:00
Inigo Goiri
6b187d2ee0 HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.
(cherry picked from commit 4cef01147f98451de8acaa90f42a4d4cd4d0af45)
2018-03-27 10:33:31 -07:00
Inigo Goiri
90609f3561 HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.
(cherry picked from commit 947b2829844f2b4ce42f72b7e3ee27d7c4a27df2)
2018-03-26 09:44:34 -07:00
Yiqun Lin
622664648c HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.
(cherry picked from commit cfc3a1c8f06fba4f4bd5ffe8bb2a6944d066948e)
2018-03-26 20:03:20 +08:00
Wei Yan
69c08f3dd3 HDFS-12512. RBF: Add WebHDFS.
(cherry picked from commit 6e31a090842f8aeedb331b653b075499f8df6c60)
2018-03-23 10:39:08 -07:00
Inigo Goiri
3db8c7ff68 HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.
(cherry picked from commit e196d158a275bfdcfaf372e0f5bcbbc8bbe24106)
2018-03-22 13:37:06 -07:00