Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,154 Commits 326 Branches 371 Tags
Commit Graph

4615 Commits

Author SHA1 Message Date
Chris Douglas
ae3dc443f4 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit afc606c3aa9fc886ff2c17ec9a6a83e30c1adad0)
 2017-12-07 00:47:02 -08:00
Akira Ajisaka
89314b78dd
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb440095f12d3eda88101fa250ac000a)
(cherry picked from commit 046424cf8ab31043cf3df254ae9ea093d20ad5da)
 2017-12-07 13:25:02 +09:00
Akira Ajisaka
7fd6407886
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a537f8b558007cc92a5d1a8e59b5d86b)
(cherry picked from commit 4e92b1e89e19547e2dbb508c86f9acea19ad7158)
 2017-12-06 11:43:08 +09:00
Xiao Chen
55df9df9fb HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 274bbb193f34d6f9a31d3d2f55d1b66ada6b47d4)
 2017-12-04 10:45:30 -08:00
Konstantin V Shvachko
0f5ec01ef7 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd73198fd610e59d1a4cd007c5fcc7205)
 2017-11-30 18:28:18 -08:00
Kihwal Lee
7d2b13f0be HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b5274059541565d7216bf98aa35347d)
 2017-11-29 15:16:17 -06:00
Wei Yan
5e31b109c6 HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d93ac22dc6fe1a05f18c1f266cc5e54)
 2017-11-29 09:49:51 -08:00
Konstantin V Shvachko
3f9f0055eb HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24b3f22f609366740c9c4f449edc61ac)
 2017-11-28 18:11:38 -08:00
Yiqun Lin
83c40758fa HDFS-12858. RBF: Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin. 
(cherry picked from commit 3d73d2f097aee130c93270d399cad3ff793b57f2)
 2017-11-28 13:46:02 +08:00
Kihwal Lee
3516ef45f3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 45f59bde60a21138fdb0fb846588db422d1c97a5)
 2017-11-27 17:01:34 -06:00
Inigo Goiri
ee267565b5 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri. 
(cherry picked from commit e182e777947a85943504a207deb3cf3ffc047910)
 2017-11-17 10:06:46 -08:00
John Zhuge
120d868963 HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 
(cherry picked from commit 3123895db0518552eb357093fddf0e8ff1a6cadf)
 2017-11-09 09:18:53 -08:00
Brahma Reddy Battula
ce027c6f48 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf72b9b5f3807c522237f52121d98cd5)
 2017-11-08 14:46:27 +05:30
Arun Suresh
bb6a1aa5fa Preparing for 2.9.1 development 2017-11-02 22:49:38 -07:00
Weiwei Yang
3555397179 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b06705441f6f171eec7fb2fa77946ca204b)
(cherry picked from commit 0f20434e18cfedcc36c969cc2df25123153e0b99)
 2017-11-01 18:13:28 -07:00
Inigo Goiri
15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bff4c490a5d62f2e4fd0d3755305349c)
 2017-10-31 10:24:12 -07:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:20:24 -07:00
Zhe Zhang
736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit 86c2adc4528ffd27b744ee7e88109b86aaa3ec02.
 2017-10-24 15:05:26 -07:00
Arpit Agarwal
a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Inigo Goiri
12c81c67d7 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-19 17:40:42 -07:00
Inigo Goiri
629b88b4dd HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030525e4c7f3875e23807c6dbe778890f)
(cherry picked from commit 5d63a388d1c3ec8a658cb2fd9b34c240bddf15a0)
 2017-10-19 17:39:27 -07:00
Inigo Goiri
27295eecdd HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7b85524fd43bd68895d49814c16680a)
(cherry picked from commit 81601dac8ec7650bec14700b174910390a92fe1f)
 2017-10-19 17:39:19 -07:00
Inigo Goiri
7d795989e1 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d3479f19138bc66ea59baf41eb89061906)
(cherry picked from commit 6c69e23dcdf1cdbddd47bacdf2dace5c9f06e3ad)
 2017-10-19 17:39:18 -07:00
Inigo Goiri
f8a71e2f10 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa79055ef72406fa598e1c743b0c994b5da8)
(cherry picked from commit ad41c8155940f4da0e51439c97c6cc9c808c28df)
 2017-10-19 17:39:17 -07:00
Inigo Goiri
9ad1f90b9d HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9dbe64f89b858ccc1780723f3af58e7)
(cherry picked from commit 67785fe0063cfbfecab0e8deaae4a45d9c7c0073)
 2017-10-19 17:39:16 -07:00
Inigo Goiri
ec84369538 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d469b7e8f3bfa10151e4e1c546589734)
(cherry picked from commit 1f06b81ecb14044964176dd16fafaa0ee96bfe3d)
 2017-10-19 17:39:15 -07:00
Inigo Goiri
550ce086a1 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752afce87936f5c0d1e6d272fba798d7b)
(cherry picked from commit bc9e588a19c0aaf518de8dab719362be4a8d6a54)
 2017-10-19 17:39:14 -07:00
Inigo Goiri
23753ff3c5 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fafa807198054da0c02b2ebaafda76aa)
(cherry picked from commit cc58e7a983d8f1351089462f531993f7b4f0a9c5)
 2017-10-19 17:39:12 -07:00
Inigo Goiri
a100f63a16 HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11ab1300325a6361124ee8ad6f68d7a4)
(cherry picked from commit 7cb6bdf09ed361e067ebf234230babd1391a7d4b)
 2017-10-19 17:39:11 -07:00
Inigo Goiri
36c3515fbb HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb3ac5dc7576535e66a75a5e3433247b)
(cherry picked from commit 346c9fce43ebf6a90fc56e0dc7c403f97cc5391f)
 2017-10-19 17:39:08 -07:00
Inigo Goiri
0b599cdc87 HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d94aed223dd6f2386a166eb2c7d67af)
(cherry picked from commit 67d10087aff9d4ab2748aefc1b97522495c148f8)
 2017-10-19 17:38:57 -07:00
Inigo Goiri
78abcb8f52 HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbcf546481db0b0345772db2e9132372e)
(cherry picked from commit b3e6bd22e3c02b3e4f50396538f56a1bcb007638)
 2017-10-19 17:38:54 -07:00
Inigo Goiri
cc7c12ff18 HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661441150d35abd44b3a8606206b46441)
(cherry picked from commit 6f0de2731806628b5b01bd1350225692147590da)
 2017-10-19 17:38:33 -07:00
Inigo Goiri
e700db60a6 HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52191e733984d37f47b69719ccf11313)
(cherry picked from commit d8c81073320320a019fb3868be4f06f46aebea43)
 2017-10-19 17:38:32 -07:00
Inigo Goiri
0228ead4d1 HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849d23cf12c5d280c29f90908e6a90d40)
(cherry picked from commit 55da7fd7ebe2f3fa1c1c828dda727fddc75a1b81)
 2017-10-19 17:38:30 -07:00
Inigo Goiri
a09d7219c9 HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. 
(cherry picked from commit 47db6e9d8e2c264671c89fdd6cb11a7c762d2cce)
(cherry picked from commit 0ec82b8cdfaaa5f23d1a0f7f7fb8c9187c5e309b)
 2017-10-19 17:38:29 -07:00
Inigo Goiri
2f95eac8f6 HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 8a9cdebebf26841a0f1e99fb08135f4597f2eba2)
(cherry picked from commit ca4f209b49e3aad6a80306f7342c9b6b560a79a7)
 2017-10-19 17:38:28 -07:00
Inigo Goiri
7bd91fa2ed HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit c6e0bd640cdaf83a660fa050809cad6f1d4c6f4d)
(cherry picked from commit 4bf877b03f0e01c4bcedc689c66689701e62b560)
 2017-10-19 17:38:27 -07:00
Inigo
3f6d18ddf6 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6d94c90ece1c1d23d4c97e72c54e9991f5dbc481)
(cherry picked from commit 2c740a684a23663962119726bf0e7ecef173f6f1)
 2017-10-19 17:38:25 -07:00
Inigo
c3b8b5e49f HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 0f88e049156dce173afc0dbda864e29190dd2210)
(cherry picked from commit 533b986633e0a9076cf3918fba3e3b591c6f65f2)
 2017-10-19 17:38:24 -07:00
Inigo
096e8c4f35 HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6821e801724ac38e9737538b2164c9ae88792282)
(cherry picked from commit 2761bbc91a7b0a36c42b1b6569c5ecd4f236281b)
 2017-10-19 17:38:21 -07:00
Wei-Chiu Chuang
ce93a2b84b HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a41c573cc1f1e71c18871d243f952b9)
 2017-10-19 06:18:40 -07:00
Zhe Zhang
87f4407396 HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270ed3a653c44c0bc92396167b5022df6e)
(cherry picked from commit aecf6c50d351e7aed2008a682677a1edb104585d)
 2017-10-19 00:05:34 -07:00
Arpit Agarwal
0aa1b62b39 HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b8c9469e8c2b64c3268d671f5a43e75)
(cherry picked from commit 5897095d539be086ed37df011f024e37eb37b0cd)
 2017-10-17 23:44:13 -07:00
Wei-Chiu Chuang
a596c6f5eb HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8dbc8909c92d502d10a7f94d1de3171878a43b04)
 2017-10-16 12:59:41 -07:00
Xiao Chen
b2f27641dd HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:24 -07:00
Xiao Chen
d82edb49c7 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
 2017-10-16 09:51:27 -07:00
Xiao Chen
4b734fe386 HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:38 -07:00
Andrew Wang
1ddc49527a Revert "HDFS-12603. Enable async edit logging by default." 
This reverts commit 42d3229e6f604d13a0419ac32979500dae306066.
 2017-10-09 13:29:52 -07:00