Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,207 Commits 326 Branches 371 Tags
Commit Graph

4630 Commits

Author SHA1 Message Date
Vinayakumar B
62b82d7f41 HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B. 
(cherry picked from commit 09efdfe9e13c9695867ce4034aa6ec970c2032f1)
(cherry picked from commit b3eeea0b6e27f9e74c35d2a930b541617fc7c8f2)
 2018-01-17 14:23:33 +05:30
Brahma Reddy Battula
28f69755f1 HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S. 
(cherry picked from commit 880b9d24ff7b5f350ec99bac9b0862009460b486)
 2018-01-16 16:33:34 +05:30
Inigo Goiri
6dc0b885a4 HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri. 
(cherry picked from commit d9006d8a4e34eae78dfa1cf3be50eeb81c2fc11f)
 2018-01-09 19:02:45 -08:00
Wei Yan
5e8029eff9 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64aceed876f57f09eb9efe1872b6de98d2e)
 2018-01-08 15:13:53 -08:00
Inigo Goiri
c1d48cbda0 HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d5448f3771b0b95f91e7aa7961ae2cc)
 2018-01-05 09:14:25 -08:00
Tsz-Wo Nicholas Sze
f3a92d89f3 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham 
(cherry picked from commit c7499f2d242c64bee8f822a22161d956525f7153)
 2018-01-04 06:48:04 +05:30
Xiao Chen
141cc8ffa2 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e089420999dd9d97d981dcd0abd64b6166152d)
(cherry picked from commit 1d1401ad3898834a740f4b9bfcea83d28635a3b6)
(cherry picked from commit 31436a12d5cd7c8d96414fcf37f9b8aebe497cd3)
 2017-12-29 13:57:55 -08:00
Xiao Chen
947d484d35 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 50b233d35692d249d2115a2481cde770f50cf7a7)
 2017-12-28 11:56:12 -08:00
Yiqun Lin
06cfe4b11b HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b7743469f363eeae52c8abcf4fe7c65d5)
 2017-12-19 15:36:28 +08:00
Junping Du
c6f5d36ff2 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
 2017-12-18 22:38:26 -08:00
Jason Lowe
605b8560f6 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 9ae8d1a8de2ffbc8a0082a0089f477d4cefea030)
 2017-12-15 14:49:43 -06:00
Yiqun Lin
c629f33761 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1c88a27cd925bed93ebb599a164dd2e)
 2017-12-15 14:14:42 +08:00
Kihwal Lee
43b9fbc2b4 HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 
(cherry picked from commit 08a50da95fd8509d87c6a3e5b46862b8eb6f7318)
 2017-12-14 15:06:04 -06:00
Yiqun Lin
053a6fc126 HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:04:31 +08:00
Inigo Goiri
118d653eea HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad77a2ebb0466e7bc5933337b57f6fe30)
 2017-12-11 15:17:49 -08:00
Chris Douglas
ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit afc606c3aa9fc886ff2c17ec9a6a83e30c1adad0)
 2017-12-07 00:47:02 -08:00
Akira Ajisaka
89314b78dd
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb440095f12d3eda88101fa250ac000a)
(cherry picked from commit 046424cf8ab31043cf3df254ae9ea093d20ad5da)
 2017-12-07 13:25:02 +09:00
Akira Ajisaka
7fd6407886
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a537f8b558007cc92a5d1a8e59b5d86b)
(cherry picked from commit 4e92b1e89e19547e2dbb508c86f9acea19ad7158)
 2017-12-06 11:43:08 +09:00
Xiao Chen
55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 274bbb193f34d6f9a31d3d2f55d1b66ada6b47d4)
 2017-12-04 10:45:30 -08:00
Konstantin V Shvachko
0f5ec01ef7 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd73198fd610e59d1a4cd007c5fcc7205)
 2017-11-30 18:28:18 -08:00
Kihwal Lee
7d2b13f0be HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b5274059541565d7216bf98aa35347d)
 2017-11-29 15:16:17 -06:00
Wei Yan
5e31b109c6 HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d93ac22dc6fe1a05f18c1f266cc5e54)
 2017-11-29 09:49:51 -08:00
Konstantin V Shvachko
3f9f0055eb HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24b3f22f609366740c9c4f449edc61ac)
 2017-11-28 18:11:38 -08:00
Yiqun Lin
83c40758fa HDFS-12858. RBF: Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin. 
(cherry picked from commit 3d73d2f097aee130c93270d399cad3ff793b57f2)
 2017-11-28 13:46:02 +08:00
Kihwal Lee
3516ef45f3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 45f59bde60a21138fdb0fb846588db422d1c97a5)
 2017-11-27 17:01:34 -06:00
Inigo Goiri
ee267565b5 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri. 
(cherry picked from commit e182e777947a85943504a207deb3cf3ffc047910)
 2017-11-17 10:06:46 -08:00
John Zhuge
120d868963 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 
(cherry picked from commit 3123895db0518552eb357093fddf0e8ff1a6cadf)
 2017-11-09 09:18:53 -08:00
Brahma Reddy Battula
ce027c6f48 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf72b9b5f3807c522237f52121d98cd5)
 2017-11-08 14:46:27 +05:30
Arun Suresh
bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Weiwei Yang
3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b06705441f6f171eec7fb2fa77946ca204b)
(cherry picked from commit 0f20434e18cfedcc36c969cc2df25123153e0b99)
 2017-11-01 18:13:28 -07:00
Inigo Goiri
15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bff4c490a5d62f2e4fd0d3755305349c)
 2017-10-31 10:24:12 -07:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:20:24 -07:00
Zhe Zhang
736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit 86c2adc4528ffd27b744ee7e88109b86aaa3ec02.
 2017-10-24 15:05:26 -07:00
Arpit Agarwal
a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Inigo Goiri
12c81c67d7 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-19 17:40:42 -07:00
Inigo Goiri
629b88b4dd HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030525e4c7f3875e23807c6dbe778890f)
(cherry picked from commit 5d63a388d1c3ec8a658cb2fd9b34c240bddf15a0)
 2017-10-19 17:39:27 -07:00
Inigo Goiri
27295eecdd HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7b85524fd43bd68895d49814c16680a)
(cherry picked from commit 81601dac8ec7650bec14700b174910390a92fe1f)
 2017-10-19 17:39:19 -07:00
Inigo Goiri
7d795989e1 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d3479f19138bc66ea59baf41eb89061906)
(cherry picked from commit 6c69e23dcdf1cdbddd47bacdf2dace5c9f06e3ad)
 2017-10-19 17:39:18 -07:00
Inigo Goiri
f8a71e2f10 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa79055ef72406fa598e1c743b0c994b5da8)
(cherry picked from commit ad41c8155940f4da0e51439c97c6cc9c808c28df)
 2017-10-19 17:39:17 -07:00
Inigo Goiri
9ad1f90b9d HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9dbe64f89b858ccc1780723f3af58e7)
(cherry picked from commit 67785fe0063cfbfecab0e8deaae4a45d9c7c0073)
 2017-10-19 17:39:16 -07:00
Inigo Goiri
ec84369538 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d469b7e8f3bfa10151e4e1c546589734)
(cherry picked from commit 1f06b81ecb14044964176dd16fafaa0ee96bfe3d)
 2017-10-19 17:39:15 -07:00
Inigo Goiri
550ce086a1 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752afce87936f5c0d1e6d272fba798d7b)
(cherry picked from commit bc9e588a19c0aaf518de8dab719362be4a8d6a54)
 2017-10-19 17:39:14 -07:00
Inigo Goiri
23753ff3c5 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fafa807198054da0c02b2ebaafda76aa)
(cherry picked from commit cc58e7a983d8f1351089462f531993f7b4f0a9c5)
 2017-10-19 17:39:12 -07:00
Inigo Goiri
a100f63a16 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11ab1300325a6361124ee8ad6f68d7a4)
(cherry picked from commit 7cb6bdf09ed361e067ebf234230babd1391a7d4b)
 2017-10-19 17:39:11 -07:00
Inigo Goiri
36c3515fbb HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb3ac5dc7576535e66a75a5e3433247b)
(cherry picked from commit 346c9fce43ebf6a90fc56e0dc7c403f97cc5391f)
 2017-10-19 17:39:08 -07:00
Inigo Goiri
0b599cdc87 HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d94aed223dd6f2386a166eb2c7d67af)
(cherry picked from commit 67d10087aff9d4ab2748aefc1b97522495c148f8)
 2017-10-19 17:38:57 -07:00
Inigo Goiri
78abcb8f52 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbcf546481db0b0345772db2e9132372e)
(cherry picked from commit b3e6bd22e3c02b3e4f50396538f56a1bcb007638)
 2017-10-19 17:38:54 -07:00
Inigo Goiri
cc7c12ff18 HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661441150d35abd44b3a8606206b46441)
(cherry picked from commit 6f0de2731806628b5b01bd1350225692147590da)
 2017-10-19 17:38:33 -07:00
Inigo Goiri
e700db60a6 HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52191e733984d37f47b69719ccf11313)
(cherry picked from commit d8c81073320320a019fb3868be4f06f46aebea43)
 2017-10-19 17:38:32 -07:00