Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,866 Commits 326 Branches 371 Tags
Commit Graph

6783 Commits

Author SHA1 Message Date
Inigo Goiri
53a7bd186d HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d5448f3771b0b95f91e7aa7961ae2cc)
 2018-01-05 09:12:43 -08:00
Lei Xu
47773d68b2 HDFS-12860. StripedBlockUtil#getRangesInternalBlocks throws exception for the block group size larger than 2GB. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 85067eaa8e352afeed9c094da3815100873c84e4)
 2018-01-04 10:33:34 -08:00
Sean Mackrory
91b59b7c28 HDFS-12913. TestDNFencingWithReplication sometimes fails because of NameNode in standby state. Contributed by Zsolt Venczel. 
(cherry picked from commit 45a47198b43a96817679d5bf9e570d405555e3eb)
 2018-01-04 08:47:02 -07:00
Lei Xu
8f9603cb9d HDFS-12915. Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy. (Contributed by Chris Douglas) 
(cherry picked from commit 6e3e1b8cde737e4c03b0f5279cab0239e7069a72)
 2017-12-29 12:23:33 -08:00
Xiao Chen
b7701495f4 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 
(cherry picked from commit 5bf7e594d7d54e5295fe4240c3d60c08d4755ab7)
 2017-12-28 11:55:14 -08:00
Lei Xu
2fbfaac6c0 HDFS-12938. TestErasureCodigCLI testAll failing consistently. (Contributed by Ajay Kumar) 
(cherry picked from commit b318bed01affa150d70661f263efff9a5c9422f6)
 2017-12-21 10:30:40 -08:00
Arpit Agarwal
d85576aefd HDFS-12845. JournalNode Test failures. Contributed by Bharat Viswanadham. 2017-12-19 14:12:25 -08:00
Yiqun Lin
f7b3950f27 HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b7743469f363eeae52c8abcf4fe7c65d5)
 2017-12-19 15:34:01 +08:00
Junping Du
53b9d81f46 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
 2017-12-18 22:40:04 -08:00
Yiqun Lin
a56f4c2ca7 HDFS-12930. Remove the extra space in HdfsImageViewer.md. Contributed by Rahul Pathak. 
(cherry picked from commit 25a36b74528678f56c63be643c76d819d6f07840)
 2017-12-19 11:25:01 +08:00
Erik Krogen
7c648d3e72 HDFS-12818. Support multiple storages in DataNodeCluster / SimulatedFSDataset. Contributed by Erik Krogen. 
(cherry picked from commit 94576b17fbc19c440efafb6c3322f53ec78a5b55)
 2017-12-18 11:41:06 -08:00
Lei Xu
0191a862a3 HDFS-12927. Update erasure coding doc to address unsupported APIs. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 949be14b0881186d76c3b60ee2f39ce67dc1654c)
 2017-12-15 10:29:08 -08:00
Lei Xu
2821edf6d0 HDFS-12819. Setting/Unsetting EC policy shows warning if the directory is not empty. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 1c15b1751c0698bd3063d5c25f556d4821b161d2)
 2017-12-15 10:06:00 -08:00
Yiqun Lin
61e16bff63 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1c88a27cd925bed93ebb599a164dd2e)
 2017-12-15 14:12:00 +08:00
Xiao Chen
cb2c5e1707 HDFS-12910. Secure Datanode Starter should log the port when it fails to bind. Contributed by Stephen O'Donnell and Nanda kumar. 
(cherry picked from commit e1cb278cd0287ce47f923941147d17540b199a99)
 2017-12-14 19:23:18 -08:00
Kihwal Lee
52c36d6d4d HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 
(cherry picked from commit f5a72424c0009c454aab6759c30f74b397a7e935)
 2017-12-14 15:00:27 -06:00
Jason Lowe
c661f30a78 HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 
(cherry picked from commit 80db744ee57c52a1dc306c576c663ccc76cced4c)
 2017-12-14 09:53:56 -06:00
Yiqun Lin
925f3e62db HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:02:37 +08:00
Andrew Wang
58225e4030 Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release. 
(cherry picked from commit d447152d4925a5f84d28a8ebd561286b39134d75)
 2017-12-13 13:05:45 -08:00
Wei-Chiu Chuang
8062a7428d HDFS-12891. Do not invalidate blocks if toInvalidate is empty. Contributed by Zsolt Venczel. 
(cherry picked from commit 55fc2d6485702a99c6d4bb261a720d1f0498af2b)
 2017-12-11 16:43:42 -08:00
Inigo Goiri
6a43fbe724 HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad77a2ebb0466e7bc5933337b57f6fe30)
 2017-12-11 15:16:19 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
ba874d6787 HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades. 
(cherry picked from commit f19638333b11da6dcab9a964e73a49947b8390fd)
 2017-12-08 08:03:23 -08:00
Xiao Chen
1d1401ad38 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e089420999dd9d97d981dcd0abd64b6166152d)
 2017-12-07 21:06:25 -08:00
Lei Xu
f3143d225a HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 67662e2ac9e68f32b725c8118cf2be79a662fca5)
 2017-12-07 11:20:19 -08:00
Akira Ajisaka
a8be4b559a
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb440095f12d3eda88101fa250ac000a)
 2017-12-07 13:23:58 +09:00
Xiao Chen
bf79246c5d HDFS-12872. EC Checksum broken when BlockAccessToken is enabled. 
(cherry picked from commit 56b1ff80dd9fbcde8d21a604eff0babb3a16418f)
 2017-12-05 20:48:46 -08:00
Akira Ajisaka
c81057d936
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a537f8b558007cc92a5d1a8e59b5d86b)
 2017-12-06 11:41:40 +09:00
Xiao Chen
55fa509eb6 HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 404eab4dc0582e0384b93664ea6ee77ccd5eeebc)
 2017-12-04 10:49:58 -08:00
Chris Douglas
2399c96ee7 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 42307e3c3abbfe0b83d9a2581deba327435b910f)
 2017-12-02 23:32:44 -08:00
Wei-Chiu Chuang
83b62a8eed HDFS-12836. startTxId could be greater than endTxId when tailing in-progress edit log. Contributed by Chao Sun. 
(cherry picked from commit 0faf50624580b86b64a828cdbbb630ae8994e2cd)
 2017-12-01 12:03:04 -08:00
Chris Douglas
6266c52680 Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak" 
This reverts commit 482fd5a880994f37fc3ad9e0cc2d127737b70aef.
 2017-12-01 11:19:17 -08:00
Chris Douglas
482fd5a880 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 5304698dc8c5667c33e6ed9c4a827ef57172a723)
 2017-12-01 10:30:08 -08:00
Konstantin V Shvachko
def87db9cb HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd73198fd610e59d1a4cd007c5fcc7205)
 2017-11-30 18:27:16 -08:00
Kihwal Lee
ee4525e071 HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b5274059541565d7216bf98aa35347d)
 2017-11-29 15:12:47 -06:00
Wei Yan
4b1a2152eb HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d93ac22dc6fe1a05f18c1f266cc5e54)
 2017-11-29 09:59:17 -08:00
Konstantin V Shvachko
4cbd5ea42b HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24b3f22f609366740c9c4f449edc61ac)
 2017-11-28 17:18:21 -08:00
Yiqun Lin
72d0be964d HDFS-12858. Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin. 
(cherry picked from commit 94bed5047113fb148194380853ff01e92897a91f)
 2017-11-28 11:52:29 +08:00
Kihwal Lee
1078d477c3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 738d1a206aba05f0b4be7d633b17db7fcd1c74bc)
 2017-11-22 13:02:45 -06:00
Lei Xu
a5a86680a4 HDFS-12847. Regenerate editsStored and editsStored.xml in HDFS tests. Contributed by Lei (Eddy) Xu. 2017-11-22 10:23:10 -08:00
Inigo Goiri
3cd5224693 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri. 
(cherry picked from commit e182e777947a85943504a207deb3cf3ffc047910)
 2017-11-17 10:08:04 -08:00
Weiwei Yang
f9f268cf52 HDFS-12814. Add blockId when warning slow mirror/disk in BlockReceiver. Contributed by Jiandan Yang. 2017-11-16 16:23:13 +08:00
Andrew Wang
1c8d334287 Preparing for 3.0.1 development 2017-11-14 11:17:18 -08:00
Akira Ajisaka
9051d1b851
HDFS-12732. Correct spellings of ramdomly to randomly in log. Contributed by hu xiaodong. 
(cherry picked from commit 3a3566e1d1ab5f78cfb734796b41802fe039196d)
 2017-11-09 15:18:32 +09:00
Brahma Reddy Battula
d25d3827d5 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf72b9b5f3807c522237f52121d98cd5)
 2017-11-08 14:49:10 +05:30
Weiwei Yang
19b1164fc6 HDFS-7060. Avoid taking locks when sending heartbeats from the DataNode. Contributed by Jiandan Yang. 2017-11-08 10:24:35 +08:00
Kihwal Lee
50b438b597 HDFS-12771. Add genstamp and block size to metasave Corrupt blocks list. Contributed by Kuhu Shukla. 
(cherry picked from commit 4d2dce40bbe5242953774e6a2fc0dc9111cf5ed0)
 2017-11-03 15:18:36 -05:00
Xiao Chen
71965747f4 HDFS-11467. Support ErasureCoding section in OIV XML/ReverseXML. Contributed by Huafeng Wang. 
(cherry picked from commit c8eb4beabad84686f869a2397f7188499cab12c9)
 2017-11-03 12:05:55 -07:00
Xiao Chen
621a50ebb1 HDFS-12725. BlockPlacementPolicyRackFaultTolerant fails with very uneven racks. 
(cherry picked from commit e1187bad8e9b9abb54a55b5f9ab8373b0f64e6d7)
 2017-11-02 21:53:20 -07:00
Xiao Chen
1c96e0d693 HDFS-12682. ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED. 
(cherry picked from commit 4f4cea56b25d5acc14dd6d61dea70fd4a0c7a9d9)
 2017-11-02 21:27:43 -07:00
Weiwei Yang
b2f717d967 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b06705441f6f171eec7fb2fa77946ca204b)
 2017-11-01 16:53:07 +08:00