Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,793 Commits 326 Branches 371 Tags
Commit Graph

168 Commits

Author SHA1 Message Date
Wei-Chiu Chuang
13768fe6f0 HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout (#2533) 
(cherry picked from commit 2b4febcf576e2da29ab86e2920302b82b47e435d)
(cherry picked from commit 94c126cc9e9aadaf9aa28ebd55a8712aca54e709)
(cherry picked from commit 8af0fcf628b0a8ab1b9b44762eb4a9341f9d7b6a)
 2021-01-04 21:00:29 -08:00
Jim Brennan
777f426d6a HDFS-15711. Add Metrics to HttpFS Server. (#2521) Contributed by Ahmed Hussein and Kihwal Lee 2020-12-10 22:16:52 +00:00
Ahmed Hussein
5f5d7ecf59 HDFS-15706. HttpFS: Log more information on request failures. (#2515) 
(cherry picked from commit 07655a7040806c4c9687288de89e42cfacf0365e)
(cherry picked from commit a7dbd3b6f978d28ef7e046add2e3270ae3d9d9f6)
(cherry picked from commit f547cd43d140dc680fab1782cda071f4a41dddc5)
 2020-12-03 15:15:47 -08:00
Kihwal Lee
ffe6e39c96 HDFS-15628. HttpFS server throws NPE if a file is a symlink. Contributed by Ahmed Hussein. 
(cherry picked from commit e45407128d4e9a9804c777c8f845ad41e1280177)
 2020-10-16 11:41:17 -05:00
Wei-Chiu Chuang
286c94f13d HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu. 
(cherry picked from commit 6b86a5110e4b3f45bf55f97bd402680bf26cefb9)
(cherry picked from commit aa3c96474f52fba01d999fa75880e0948affbb01)
 2020-01-13 10:49:39 -08:00
Siyao Meng
df13f6d485 HADOOP-16703. Backport HADOOP-16152 to branch-3.1. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-11-19 12:14:27 -08:00
Siyao Meng
61dc877b00 HDFS-14686. HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null (#1192) Contributed by Siyao Meng. 
(cherry picked from commit 17e8cf501b384af93726e4f2e6f5e28c6e3a8f65)
 2019-10-04 09:19:30 -07:00
Inigo Goiri
bb1015719c HDFS-14850. Optimize FileSystemAccessService#getFileSystemConfiguration. Contributed by Lisheng Sun. 
(cherry picked from commit d8313b227495d748abe8884eee34db507476cee1)
 2019-10-03 18:21:32 -07:00
Siyao Meng
e0a5fee7f5 HDFS-14665. HttpFS: LISTSTATUS response is missing HDFS-specific fields (#1291) Contributed by Siyao Meng. 2019-08-20 10:49:51 -07:00
Chao Sun
90447baeb0 HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from 3ae775d74029b6ae82263739f598ceb25c597dcd)
(cherry picked from d38b617baaf10cb35f3a8eba904b930a142a071e)
 2019-08-08 10:42:27 -07:00
Takanobu Asanuma
2f6f42bc7b HDFS-12564. Add the documents of swebhdfs configurations on the client side. Contributed by Takanobu Asanuma. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 98d20656433cdec76c2108d24ff3b935657c1e80)
 2019-06-20 20:18:00 -07:00
Wei-Chiu Chuang
595ce94570 HDFS-13886. HttpFSFileSystem.getFileStatus() doesn't return "snapshot enabled" bit. Contributed by Siyao Meng. 
(cherry picked from commit 44857476fa993fbf9c97f979b91e19d27632c10a)
 2018-09-18 15:40:10 -07:00
Wei-Chiu Chuang
d1ea7df43d HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit e780556ae9229fe7a90817eb4e5449d7eed35dd8)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/http/TestHttpServer.java
 2018-09-05 10:17:58 -07:00
Inigo Goiri
e3ff9e36df HDFS-13537. TestHdfsHelper does not generate jceks path properly for relative path in Windows. Contributed by Xiao Liang. 
(cherry picked from commit 914b98a713f70667d4380ac752f6c4de931520d9)
 2018-05-09 16:52:45 -07:00
fang zhenyi
5e013d50d1
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings. 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-03-15 16:12:07 +09:00
Xiao Chen
9276ef0665 HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 2018-03-06 09:57:35 -08:00
Robert Kanter
21176a8ba7
HADOOP-15282. HADOOP-15235 broke TestHttpFSServerWebServer 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-03-04 07:33:47 -08:00
fang zhenyi
4d4dde5112
HADOOP-15223. Replace Collections.EMPTY* with empty* when available 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-02-18 22:19:39 +09:00
Chris Douglas
0e560f3b8d HDFS-12681. Make HdfsLocatedFileStatus a subtype of LocatedFileStatus 2017-11-29 20:28:06 -08:00
Arpit Agarwal
8acdf5c274 HDFS-12542. Update javadoc and documentation for listStatus. Contributed by Ajay Kumar. 2017-10-11 12:29:35 -07:00
Xiaoyu Yao
107c177782 HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar. 2017-10-03 13:02:12 -07:00
Andrew Wang
2f867115a8 Revert "HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS. Contributed by Weiwei Yang" 
This reverts commit 931a49800ef05ee0a6fdc143be1799abb228735d.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/client/HttpFSFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/FSOperations.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
 2017-09-14 15:02:27 -07:00
ChenSammi
e0b3c644e1 HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen 2017-09-14 09:15:29 +08:00
Andrew Wang
dd7916d3cd HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas. 2017-08-17 09:35:36 -07:00
Anu Engineer
d72124a442 HDFS-12162. Update listStatus document to describe the behavior when the argument is a file. Contributed by Ajay Kumar. 2017-08-14 11:32:49 -07:00
Wei-Chiu Chuang
8a4bff02c1 HDFS-12117. HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface. Contributed by Wellington Chevreuil. 2017-08-08 23:58:53 -07:00
Chris Douglas
12e44e7bda HDFS-6984. Serialize FileStatus via protobuf. 2017-08-02 12:12:48 -07:00
Sean Mackrory
1a1bf6b7d0 HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer. 2017-08-02 12:25:05 -06:00
Ravi Prakash
c98201b5d8 HDFS-12193. Fix style issues in HttpFS tests. Contributed by Zoran Dimitrijevic 2017-07-24 19:06:15 -07:00
John Zhuge
3b48f81411 HDFS-12166. Do not deprecate HTTPFS_TEMP. Contributed by John Zhuge. 
Change-Id: Icdd032de9feea3d0dde71bf8145b70497993d97f
 2017-07-20 20:45:09 -07:00
Yongjun Zhang
3556e36be3 HDFS-12139. HTTPFS liststatus returns incorrect pathSuffix for path of file. Contributed by Yongjun Zhang. 2017-07-19 10:56:50 -07:00
Tsz-Wo Nicholas Sze
931a49800e HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS. Contributed by Weiwei Yang 2017-07-12 14:15:04 -07:00
John Zhuge
ac0a04a6e1 HDFS-12114. Consistent HttpFS property names. Contributed by John Zhuge. 2017-07-11 21:06:41 -07:00
John Zhuge
12c8fdceaf HDFS-12052. Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS. Contributed by Zoran Dimitrijevic. 2017-07-11 11:19:08 -07:00
Brahma Reddy Battula
13de636b40 HDFS-11901. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin. 2017-05-31 23:09:08 +08:00
John Zhuge
ca2488c009 HDFS-11665. HttpFSServerWebServer$deprecateEnv may leak secret. Contributed by John Zhuge. 2017-04-18 09:28:52 -07:00
Andrew Wang
e8bdad7385 HDFS-11623. Move system erasure coding policies into hadoop-hdfs-client. 2017-04-07 16:46:28 -07:00
Chris Douglas
6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Chris Douglas
7297e82cb4 HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu 2017-03-30 10:17:11 -07:00
Andrew Wang
52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
John Zhuge
ed2d03f2a5 HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu. 2017-03-22 22:15:24 -07:00
Xiao Chen
69b23632c4 HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge. 2017-02-07 09:36:55 -08:00
Akira Ajisaka
4c2cf5560f HDFS-11223. Fix typos in HttpFs documentations. Contributed by Yiqun Lin. 2016-12-08 20:52:24 +09:00
Andrew Wang
ea2895f4ed HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore. 2016-12-07 15:52:16 -08:00
Wei-Chiu Chuang
1b5cceaffb Revert "HDFS-11201. Spelling errors in the logging, help, assertions and exception messages. Contributed by Grant Sohn." 
This reverts commit b9522e86a55564c2ccb5ca3f1ca871965cbe74de.
 2016-12-05 10:54:43 -08:00
Wei-Chiu Chuang
b9522e86a5 HDFS-11201. Spelling errors in the logging, help, assertions and exception messages. Contributed by Grant Sohn. 2016-12-05 10:48:25 -08:00
Akira Ajisaka
00096dcc0c HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 2016-11-29 19:47:02 +09:00
Akira Ajisaka
bb1b5e083b HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 2016-11-25 21:28:29 +09:00
Xiao Chen
d8bab3dcb6 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 2016-11-04 18:06:55 -07:00
Andrew Wang
7e521c5a49 HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:05 -07:00