Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,426 Commits 326 Branches 371 Tags
Commit Graph

77 Commits

Author SHA1 Message Date
Duo Zhang
07f59c023c HADOOP-16598. Backport "HADOOP-16558 [COMMON+HDFS] use protobuf-maven-plugin to generate protobuf classes" to all active branches 
Signed-off-by: stack <stack@apache.org>
 2019-10-30 21:30:34 -07:00
Brahma Reddy Battula
ddea9d68a0 HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena. 
(cherry picked from commit 15d8f592b51d08a658e88c6a7a7596e0edf5793b)
(cherry picked from commit 7e10dd03b5e1a3f22b55a3b970239611e6f078c0)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
 2019-10-03 16:16:23 -07:00
Takanobu Asanuma
8d5460a045 HDFS-14838. RBF: Display RPC (instead of HTTP) Port Number in RBF web UI. Contributed by Xieming Li 
(cherry picked from commit c255333e20c9af6166db5931d70151011d540359)
 2019-09-11 17:11:13 +09:00
Zhankun Tang
ef79d98788 Preparing for 3.1.4 development 2019-09-04 16:11:36 +08:00
Chen Liang
53a88bfdb4 HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang. 2019-07-12 12:22:25 -07:00
Erik Krogen
849a6c6f0d HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang. 2019-07-12 11:49:58 -07:00
Erik Krogen
07a6510e6a HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun. 2019-07-12 11:03:31 -07:00
Sean Mackrory
fee1e67453 HADOOP-16213. Update guava to 27.0-jre. Contributed by Gabor Bota. 2019-06-13 07:38:43 -06:00
Takanobu Asanuma
8098ddaf40 HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka. 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
 2019-05-29 17:39:49 +09:00
Akira Ajisaka
f8bd5deec1
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:28:21 +09:00
Takanobu Asanuma
1fc74178eb HDFS-14037. Fix SSLFactory truststore reloader thread leak in URLConnectionFactory. 
(cherry picked from commit 55fb3c32fb48ca26a629d4d5f3f07e2858d09594)
 2019-03-27 03:29:42 +09:00
Wangda Tan
31ea2f7806 Preparing for 3.1.3 development 
Change-Id: I3c3d3ee47dc4fef239127b4452ff14676fa26e3d
 2019-01-07 10:04:58 -08:00
Vinayakumar B
53b6290949 HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 
(cherry picked from commit 8571507efa3af3e4a5213a7e24c65e26162eac4d)
 2018-11-16 17:31:25 +05:30
Giovanni Matteo Fumarola
92c6bde6be HDFS-14005. RBF: Web UI update to bootstrap-3.3.7. Contributed by Inigo Goiri. 2018-10-18 14:28:19 -07:00
Inigo Goiri
16e1ab4c99 HDFS-14000. RBF: Documentation should reflect right scripts for v3.0 and above. Contributed by CR Hota. 
(cherry picked from commit 7347fa2df3cfd48857f4ded3539a60101d026daf)
 2018-10-17 16:42:32 -07:00
Inigo Goiri
6342a7cb98 HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui. 
(cherry picked from commit f63ee083db7c261207b726f0f44be2e5a92124f3)
 2018-10-12 10:11:24 -07:00
Inigo Goiri
9bbf494c7f HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with No Active Namenode under nameservice. Contributed by Ayush Saxena. 
(cherry picked from commit 3bfff0f79e7246cbb2989c720c14cfa2566a9d1a)
 2018-10-06 10:41:49 -07:00
Brahma Reddy Battula
97b75f47fd HDFS-13790. RBF: Move ClientProtocol APIs to its own module Contributed by Chao Sun. 2018-09-26 22:40:48 +05:30
Brahma Reddy Battula
77dd456461 HDFS-13237. [Documentation] RBF: Mount points across multiple subclusters. Contributed Íñigo Goiri 
(cherry picked from commit 96892c469b16c5aaff1b7c42f66f820344256bc2)
 2018-09-11 10:13:35 +05:30
Brahma Reddy Battula
cbcdaefa37 HDFS-13862. RBF: Router logs are not capturing few of the dfsrouteradmin commands. Contributed by Ayush Saxena 
(cherry picked from commit 8944407d938bb8e38c7182a68b4b64d1a7c778ca)
 2018-09-09 23:21:45 +05:30
Inigo Goiri
a400ed3aab HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng. 
(cherry picked from commit 527288ef891dc26019d003bd85ddfd50eb4f3b7b)
 2018-09-06 16:48:44 -07:00
Yiqun Lin
c898757f55 HDFS-13815. RBF: Add check to order command. Contributed by Ranith Sardar. 
(cherry picked from commit 9315db5f5da09c2ef86be168465c16932afa2d85)
 2018-09-05 23:35:30 +08:00
Inigo Goiri
a26565960a HDFS-13857. RBF: Choose to enable the default nameservice to read/write files. Contributed by yanghuafeng. 
(cherry picked from commit 54f2044595206455484284b43e5976c8a1982aaf)
 2018-09-04 12:17:49 -07:00
Vinayakumar B
6776db5aec HDFS-13867. RBF: Add validation for max arguments for Router admin ls, clrQuota, setQuota, rm and nameservice commands. Contributed by Ayush Saxena. 
(cherry picked from commit 780df9034f265a8e602856b34cc21d9be02f5c48)
 2018-09-03 14:29:28 +05:30
Yiqun Lin
b9b2b97e9d HDFS-13634. RBF: Configurable value in xml for async connection request queue size. Contributed by CR Hota. 
(cherry picked from commit a0ebb6b39f2932d3ea2fb5e287f52b841e108428)
 2018-08-29 16:18:15 +08:00
Brahma Reddy Battula
c01c240f6f HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime should display by JMX with ms unit. Contributed by yanghuafeng. 
(cherry picked from commit 64ad0298d441559951bc9589a40f8aab17c93a5f)
 2018-08-29 08:31:19 +05:30
Brahma Reddy Battula
450ba6790d HDFS-13861. RBF: Illegal Router Admin command leads to printing usage for all commands. Contributed by Ayush Saxena. 
(cherry picked from commit cb9d371ae2cda1624fc83316ddc09de37d8d0bd3)
 2018-08-29 00:31:16 +05:30
Vinayakumar B
9265d1a61a HDFS-13858. RBF: Add check to have single valid argument to safemode command. Contributed by Ayush Saxena. 
(cherry picked from commit 75691ad600473d4d315434b0876d6d10d3050a6b)
 2018-08-28 09:21:42 +05:30
Yiqun Lin
0d73497aa7 HDFS-13821. RBF: Add dfs.federation.router.mount-table.cache.enable so that users can disable cache. Contributed by Fei Hui. 
(cherry picked from commit 81847392badcd58d934333e7c3b5bf14b4fa1f3f)
 2018-08-22 13:05:23 +08:00
Xiao Chen
c0ac0a5337 HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi. 2018-08-20 14:52:28 -07:00
Yiqun Lin
d7442c244f HDFS-13750. RBF: Router ID in RouterRpcClient is always null. Contributed by Takanobu Asanuma. 
(cherry picked from commit 01ff8178148790f7b0112058cf08d23d031b6868)
 2018-08-20 23:05:55 +08:00
Wangda Tan
5583711419 Preparing for 3.1.2 release 
Change-Id: If2793e2ed2b5b349a9e1f98f78df43f309dcfcbd
 2018-07-31 13:08:55 -07:00
Yiqun Lin
5aca0588ea HDFS-13583. RBF: Router admin clrQuota is not synchronized with nameservice. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 17a87977f29ced49724f561a68565217c8cb4e94)
 2018-07-24 11:19:21 +08:00
Yiqun Lin
823d576a66 HDFS-13743. RBF: Router throws NullPointerException due to the invalid initialization of MountTableResolver. Contributed by Takanobu Asanuma. 
(cherry picked from commit 7b25fb949bf6f02df997beeca7df46c9e84c8d96)
 2018-07-20 17:31:13 +08:00
Yiqun Lin
228508a0ee HDFS-13733. RBF: Add Web UI configurations and descriptions to RBF document. Contributed by Takanobu Asanuma. 
(cherry picked from commit 1af87df242c4286474961078d306a5692f85debc)
 2018-07-17 10:47:07 +08:00
Inigo Goiri
4898edf4f7 HDFS-13475. RBF: Admin cannot enforce Router enter SafeMode. Contributed by Chao Sun. 
(cherry picked from commit 359ea4e18147af5677c6d88265e26de6b6c72999)
 2018-07-16 09:47:00 -07:00
Yiqun Lin
99e98bf19a HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu Asanuma. 
(cherry picked from commit 2ae13d41dcd4f49e6b4ebc099e5f8bb8280b9872)
 2018-07-11 22:15:07 +08:00
Yiqun Lin
e994c4f8aa HDFS-13710. RBF: setQuota and getQuotaUsage should check the dfs.federation.router.quota.enable. Contributed by yanghuafeng. 
(cherry picked from commit 43f7fe8aae0eca89cce4d67bfc4965fe8ce63e38)
 2018-07-09 15:07:47 +08:00
Yiqun Lin
48addcdbbe HDFS-13528. RBF: If a directory exceeds quota limit then quota usage is not refreshed for other mount entries. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 3b637155a47d2aa93284969a96208347a647083d)
 2018-07-04 15:30:17 +08:00
Sunil G
aa8db00fc3 HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan. 2018-06-26 15:02:49 -07:00
Rohith Sharma K S
af0309d793 YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri. 
(cherry picked from commit 2df73dace06cfd2b3193a14cd455297f8f989617)
 2018-06-12 17:23:22 +05:30
Inigo Goiri
fdacc8a088 HDFS-13637. RBF: Router fails when threadIndex (in ConnectionPool) wraps around Integer.MIN_VALUE. Contributed by CR Hota. 
(cherry picked from commit e11d67404945d80db2eb8a99453606419dbdc938)
 2018-06-01 16:59:35 -07:00
Bharat Viswanadham
d0d3d5b2ad HDFS-13589: Add dfsAdmin command to query if upgrade is finalized. Contributed by Hanisha Koneru 
(cherry picked from commit bc6d9d4c796d3c9d27dbbe3266031bf2adecde4f)
 2018-05-23 10:23:45 -07:00
Yiqun Lin
3665217d50 HDFS-13346. RBF: Fix synchronization of router quota and nameservice quota. 
(cherry picked from commit a922b9c82cc564e86dc0ef84bcc3597cb7b7c211)
 2018-05-11 15:09:54 +08:00
Inigo Goiri
524dde4006 HDFS-13525. RBF: Add unit test TestStateStoreDisabledNameservice. Contributed by Yiqun Lin. 
(cherry picked from commit a3b416f69dc3965f247603f657df33bd74fd723e)
 2018-05-03 11:25:30 -07:00
Yiqun Lin
5fef28d0d4 HDFS-13488. RBF: Reject requests when a Router is overloaded. Contributed by Inigo Goiri. 
(cherry picked from commit 37269261d1232bc71708f30c76193188258ef4bd)
 2018-05-02 14:56:15 +08:00
Inigo Goiri
9923fa2490 HDFS-13508. RBF: Normalize paths (automatically) when adding, updating, removing or listing mount table entries. Contributed by Ekanth S. 
(cherry picked from commit 484440602c5b69fbd8106010603c61ae051056dd)
 2018-04-27 16:29:41 -07:00
Inigo Goiri
f26f764857 HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari. 
(cherry picked from commit f469628bba350ba79bc6a0d38f9dc1cb5eb65c77)
 2018-04-27 15:14:18 -07:00
Yiqun Lin
e097998c22 HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri. 
(cherry picked from commit 0a293de00d5f123c7c8248459aa8ae88a45f39b1)
 2018-04-27 10:39:21 +08:00
Inigo Goiri
921a3e1678 HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li. 
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
 2018-04-26 13:01:16 -07:00