Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,217 Commits 326 Branches 371 Tags
Commit Graph

4737 Commits

Author SHA1 Message Date
Wei-Chiu Chuang
2273499aef HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on power failure. Contributed by Vinayakumar B. 2018-01-12 10:01:57 -08:00
Yiqun Lin
66d58d2b9a HDFS-12934. RBF: Federation supports global quota. Contributed by Yiqun Lin. 2018-01-10 19:48:47 +08:00
Inigo Goiri
215a3d800a HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri. 
(cherry picked from commit d9006d8a4e34eae78dfa1cf3be50eeb81c2fc11f)
 2018-01-09 19:01:10 -08:00
Manoj Govindassamy
eadd3cecf9 HDFS-12985. NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted. 2018-01-08 16:21:21 -08:00
Wei Yan
223bb935e2 HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan. 
(cherry picked from commit 2ee0d64aceed876f57f09eb9efe1872b6de98d2e)
 2018-01-08 15:23:57 -08:00
Inigo Goiri
f7fedac6cd HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri. 
(cherry picked from commit 83b513ac6d5448f3771b0b95f91e7aa7961ae2cc)
 2018-01-05 09:13:52 -08:00
Xiao Chen
50b233d356 HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged. 2017-12-28 11:55:24 -08:00
Yiqun Lin
df3212aad5 HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin. 
(cherry picked from commit e040c97b7743469f363eeae52c8abcf4fe7c65d5)
 2017-12-19 15:35:40 +08:00
Tsz-Wo Nicholas Sze
c4e58ea823 HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham 2017-12-19 10:04:00 +08:00
Erik Krogen
da4e2f38e1 HDFS-12818. Support multiple storages in DataNodeCluster / SimulatedFSDataset. Contributed by Erik Krogen. 
(cherry picked from commit 94576b17fbc19c440efafb6c3322f53ec78a5b55)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/SimulatedFSDataset.java
 2017-12-18 12:23:20 -08:00
Jason Lowe
9ae8d1a8de HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar 2017-12-15 14:47:54 -06:00
Yiqun Lin
24c4d2a7a2 HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin. 
(cherry picked from commit ee028bfdf1c88a27cd925bed93ebb599a164dd2e)
 2017-12-15 14:13:54 +08:00
Kihwal Lee
08a50da95f HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah. 2017-12-14 15:03:47 -06:00
Yiqun Lin
22bc62058b HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:03:34 +08:00
Inigo Goiri
67c2826941 HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri. 
(cherry picked from commit 5cd1056ad77a2ebb0466e7bc5933337b57f6fe30)
 2017-12-11 15:17:17 -08:00
Xiao Chen
31436a12d5 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e089420999dd9d97d981dcd0abd64b6166152d)
(cherry picked from commit 1d1401ad3898834a740f4b9bfcea83d28635a3b6)
 2017-12-07 21:20:33 -08:00
Xiao Chen
c9d48352c2 HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 2017-12-07 21:20:33 -08:00
Chris Douglas
afc606c3aa HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 2017-12-07 00:43:21 -08:00
Akira Ajisaka
046424cf8a
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb440095f12d3eda88101fa250ac000a)
 2017-12-07 13:24:45 +09:00
Akira Ajisaka
4e92b1e89e
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a537f8b558007cc92a5d1a8e59b5d86b)
 2017-12-06 11:42:51 +09:00
Brahma Reddy Battula
ceb4043ae1 HDFS-11751. DFSZKFailoverController daemon exits with wrong status code. Contributed by Bharat Viswanadham 
(cherry picked from commit 6d16a99ae8821c13eec90132e2c63a96fce4b08a)
 2017-12-05 20:01:33 +05:30
Xiao Chen
274bbb193f HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 2017-12-04 10:40:22 -08:00
Konstantin V Shvachko
3c57defaa4 HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd73198fd610e59d1a4cd007c5fcc7205)
 2017-11-30 19:26:18 -08:00
Kihwal Lee
6fd9d11173 HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b5274059541565d7216bf98aa35347d)
 2017-11-29 15:15:41 -06:00
Wei Yan
9452cac210 HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d93ac22dc6fe1a05f18c1f266cc5e54)
 2017-11-29 10:12:15 -08:00
Konstantin V Shvachko
9d406e5dc8 HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24b3f22f609366740c9c4f449edc61ac)
 2017-11-28 17:52:08 -08:00
Yiqun Lin
3d73d2f097 HDFS-12858. RBF: Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin. 2017-11-28 13:42:41 +08:00
Kihwal Lee
45f59bde60 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 2017-11-27 16:52:18 -06:00
Tsz-Wo Nicholas Sze
ed879d4a72 HDFS-12813. RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1. Contributed by Mukul Kumar Singh 2017-11-20 17:11:18 -08:00
Inigo Goiri
b57ea38fcf HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri. 
(cherry picked from commit e182e777947a85943504a207deb3cf3ffc047910)
 2017-11-17 10:05:45 -08:00
Arpit Agarwal
f671c22e3e HDFS-12705. WebHdfsFileSystem exceptions should retain the caused by exception. Contributed by Hanisha Koneru. 2017-11-13 13:56:13 -08:00
John Zhuge
a42a19e139 HDFS-12052. Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS. Contributed by Zoran Dimitrijevic. 
(cherry picked from commit 12c8fdceaf263425661169cba25402df89d444c1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebServer.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
 2017-11-09 09:47:11 -08:00
John Zhuge
d946307faa HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend. 
(cherry picked from commit 3123895db0518552eb357093fddf0e8ff1a6cadf)
 2017-11-09 08:58:03 -08:00
Brahma Reddy Battula
eca6385fdd HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf72b9b5f3807c522237f52121d98cd5)
 2017-11-08 14:43:13 +05:30
Weiwei Yang
0f20434e18 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b06705441f6f171eec7fb2fa77946ca204b)
 2017-11-01 17:01:23 +08:00
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Inigo Goiri
15b839c446 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bff4c490a5d62f2e4fd0d3755305349c)
 2017-10-31 10:24:12 -07:00
Chris Douglas
9e721775a4 HADOOP-14986. Enforce JDK limitations. 
(cherry picked from commit b50def36970e0afa65bd3fd3f40d8c4f81119200)
(cherry picked from commit 1660a638f04435ca363fe4f07c7f03f109a6784a)
 2017-10-27 21:42:42 -07:00
Arpit Agarwal
8f28af4fac HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:45:11 -07:00
Junping Du
1f2a2ba2be Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:20:24 -07:00
John Zhuge
952aa3f168 HDFS-12710. HTTPFS HTTP max header size env variable is not respected in branch-2. Contributed by Istvan Fajth. 2017-10-26 17:43:01 -07:00
Zhe Zhang
736fb3b66c Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit 86c2adc4528ffd27b744ee7e88109b86aaa3ec02.
 2017-10-24 15:05:26 -07:00
Arpit Agarwal
a373094bf9 HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham. 2017-10-23 10:47:35 -07:00
Inigo Goiri
12c81c67d7 HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 2017-10-19 17:40:42 -07:00
Inigo Goiri
629b88b4dd HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030525e4c7f3875e23807c6dbe778890f)
(cherry picked from commit 5d63a388d1c3ec8a658cb2fd9b34c240bddf15a0)
 2017-10-19 17:39:27 -07:00
Inigo Goiri
27295eecdd HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7b85524fd43bd68895d49814c16680a)
(cherry picked from commit 81601dac8ec7650bec14700b174910390a92fe1f)
 2017-10-19 17:39:19 -07:00
Inigo Goiri
7d795989e1 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d3479f19138bc66ea59baf41eb89061906)
(cherry picked from commit 6c69e23dcdf1cdbddd47bacdf2dace5c9f06e3ad)
 2017-10-19 17:39:18 -07:00
Inigo Goiri
f8a71e2f10 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa79055ef72406fa598e1c743b0c994b5da8)
(cherry picked from commit ad41c8155940f4da0e51439c97c6cc9c808c28df)
 2017-10-19 17:39:17 -07:00
Inigo Goiri
9ad1f90b9d HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9dbe64f89b858ccc1780723f3af58e7)
(cherry picked from commit 67785fe0063cfbfecab0e8deaae4a45d9c7c0073)
 2017-10-19 17:39:16 -07:00
Inigo Goiri
ec84369538 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d469b7e8f3bfa10151e4e1c546589734)
(cherry picked from commit 1f06b81ecb14044964176dd16fafaa0ee96bfe3d)
 2017-10-19 17:39:15 -07:00