516f36c6f1
HADOOP-17967. Keep restrict-imports-enforcer-rule for Guava VisibleForTesting in hadoop-main pom ( #3555 )
2021-10-21 16:54:25 +09:00
1151edf12e
HADOOP-17956. Replace all default Charset usage with UTF-8 ( #3529 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-10-14 13:07:24 +09:00
3ac0cc9e6f
HADOOP-17957. Replace Guava VisibleForTesting by Hadoop's own annotation in hadoop-hdfs-project modules ( #3530 )
...
Reviewed-by: Ahmed Hussein <ahussein@apache.org>
2021-10-11 15:32:49 +09:00
86e80752d1
HDFS-16240. Replace unshaded guava in HttpFSServerWebServer. ( #3492 )
2021-09-28 13:35:35 +09:00
f93e8fbf2d
HDFS-16129. Fixing the signature secret file misusage in HttpFS. Contributed by Tamas Domok
...
* HDFS-16129. Fixing the signature secret file misusage in HttpFS.
The signature secret file was not used in HttpFs.
- if the configuration did not contain the deprecated
httpfs.authentication.signature.secret.file option then it
used the random secret provider
- if both option (httpfs. and hadoop.http.) was set then
the HttpFSAuthenticationFilter could not read the file
because the file path was not substituted properly
!NOTE! behavioral change: the deprecated httpfs. configuration
values are overwritten with the hadoop.http. values.
The commit also contains a follow up change to the YARN-10814,
empty secret files will result in a random secret provider.
Co-authored-by: Tamas Domok <tdomok@cloudera.com>
2021-09-20 14:29:50 +02:00
4ef27a596f
HADOOP-17753. Keep restrict-imports-enforcer-rule for Guava Lists in top level hadoop-main pom ( #3087 )
2021-06-11 12:15:52 +09:00
eefa664fea
HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project ( #3073 )
2021-06-09 15:12:48 +09:00
b8ab19373d
Revert "HDFS-15982. Deleted data using HTTP API should be saved to the trash ( #2927 )"
...
This reverts commit 041488e8f5
2021-06-01 08:38:13 +05:30
986d0a4f1d
HADOOP-17732. Keep restrict-imports-enforcer-rule for Guava Sets in hadoop-main pom ( #3049 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-05-26 17:14:31 +09:00
028ec4704b
HADOOP-17720. Replace Guava Sets usage by Hadoop's own Sets in HDFS ( #3031 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2021-05-25 10:55:58 +09:00
041488e8f5
HDFS-15982. Deleted data using HTTP API should be saved to the trash ( #2927 )
...
Reviewed-by: Siyao Meng <siyao@apache.org>
2021-05-04 01:31:23 -07:00
af1f9f43ea
HADOOP-17133. Implement HttpServer2 metrics ( #2145 )
2021-03-25 12:09:43 -07:00
b4d97a8dc7
HDFS-15902. Improve the log for HTTPFS server operation. Contributed by Bhavik Patel.
2021-03-24 17:51:35 +09:00
23b343aed1
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2753 )
...
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
2021-03-11 10:56:07 +09:00
9a298d180d
Revert "HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2454 )"
...
This reverts commit 4cf3531583
2021-02-19 11:09:10 +09:00
4cf3531583
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin ( #2454 )
...
Use spotbugs instead of findbugs. Removed findbugs from the hadoop build images,
and added spotbugs in the images instead.
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
2021-02-17 10:38:20 +09:00
2b4febcf57
HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout ( #2533 )
2021-01-04 20:54:44 -08:00
3ec01b1bb3
HDFS-15711. Add Metrics to HttpFS Server. ( #2521 ) Contributed by Ahmed Hussein and Kihwal Lee
2020-12-10 13:09:53 -06:00
07655a7040
HDFS-15706. HttpFS: Log more information on request failures. ( #2515 )
2020-12-03 15:14:40 -08:00
2ce2198287
HADOOP-17394. [JDK 11] Fix error in mvn package -Pdocs ( #2488 )
...
Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
2020-11-26 11:32:10 +09:00
65002c9486
Revert "[JDK 11] Fix error in mvn package -Pdocs ( #2488 )" because JIRA ID is missing.
...
This reverts commit ce5b3d7975
2020-11-26 11:30:53 +09:00
ce5b3d7975
[JDK 11] Fix error in mvn package -Pdocs ( #2488 )
...
Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
2020-11-26 11:27:30 +09:00
1e3a6efcef
HADOOP-17288. Use shaded guava from thirdparty. ( #2342 ). Contributed by Ayush Saxena.
2020-10-17 12:01:18 +05:30
e45407128d
HDFS-15628. HttpFS server throws NPE if a file is a symlink. Contributed by Ahmed Hussein.
2020-10-14 17:26:04 -05:00
16aea11c94
HDFS-15611. Add list Snapshot command in WebHDFS. ( #2355 )
2020-10-07 10:34:32 +05:30
dfc2682213
HDFS-15581. Access Controlled HttpFS Server. Contributed by Richard Ross.
2020-09-22 10:53:04 -05:00
58def7cecb
HDFS-15499. Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion ( #2188 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2020-08-04 20:48:45 -07:00
f91a8ad88b
HADOOP-17079. Optimize UGI#getGroups by adding UGI#getGroupsSet. ( #2085 )
2020-07-09 11:33:37 -07:00
635e6a16d0
HDFS-15376. Update the error about command line POST in httpfs documentation. Contributed by bianqi.
2020-06-10 11:50:37 +05:30
263c76b678
HADOOP-17011. Tolerate leading and trailing spaces in fs.defaultFS. Contributed by Ctest
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-04-30 14:15:28 -07:00
31b2f687ef
HDFS-15265. HttpFS: validate content-type in HttpFSUtils. Contributed by hemanthboyina.
2020-04-29 13:41:36 -07:00
1fdfaebd98
HDFS-15275. HttpFS: Response of Create was not correct with noredirect and data are true. Contributed by hemanthboyina.
2020-04-20 23:09:33 +09:00
736659e0e1
HDFS-15252. HttpFS: setWorkingDirectory should not accept invalid paths. Contributed by hemanthboyina.
2020-04-02 19:21:02 +09:00
8914cf9167
Preparing for 3.4.0 development
2020-03-29 23:24:25 +05:30
9a3a28018a
HDFS-15190. HttpFS: Add Support for Storage Policy Satisfier. Contributed by hemanthboyina.
2020-02-29 10:30:26 +09:00
7dac7e1d13
HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency ( #1635 ). Contributed by Vinayakumar B.
2020-02-07 14:51:24 +05:30
061421fc6d
HDFS-15145. HttpFS: getAclStatus() returns permission as null. Contributed by hemanthboyina.
2020-01-28 10:04:38 -08:00
f6d20daf40
HADOOP-16808. Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin. Contributed by Xieming Li.
2020-01-21 18:03:24 +09:00
6b86a5110e
HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu.
2020-01-13 10:48:53 -08:00
9da294a140
HDFS-15110. HttpFS: post requests are not supported for path "/". Contributed by hemanthboyina.
2020-01-10 17:53:19 +09:00
782c0556fb
HDFS-15102. HttpFS: put requests are not supported for path "/". Contributed by hemanthboyina.
2020-01-10 09:52:13 +09:00
59aac00283
HDFS-15066. HttpFS: Implement setErasureCodingPolicy , unsetErasureCodingPolicy , getErasureCodingPolicy. Contributed by hemanthboyina.
2020-01-07 11:10:32 +09:00
074050ca59
HDFS-15063. HttpFS: getFileStatus doesn't return ecPolicy. Contributed by hemanthboyina.
2020-01-01 11:26:38 +09:00
4dffd81bb7
HDFS-14522. Allow compact property description in xml in httpfs. ( #1737 )
2019-12-10 10:30:57 +09:00
4ede8bce28
HDFS-9695. HTTPFS - CHECKACCESS operation missing. Contributed by hemanthboyina
2019-12-03 09:38:36 +09:00
3037762b2c
HDFS-14949. Add getServerDefaults() support to HttpFS. Contributed by hemanthboyina.
2019-11-20 10:51:58 -08:00
3d41f33018
HADOOP-16152. Upgrade Eclipse Jetty version to 9.4.x. Contributed by Yuming Wang, Siyao Meng.
...
Co-authored-By: Siyao Meng <smeng@cloudera.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-10-18 08:25:02 -07:00
eeb58a07e2
HDFS-14898. Use Relative URLS in Hadoop HDFS HTTP FS. Contributed by David Mollitor.
2019-10-10 01:03:33 +05:30
d8313b2274
HDFS-14850. Optimize FileSystemAccessService#getFileSystemConfiguration. Contributed by Lisheng Sun.
2019-09-28 17:20:44 -07:00
e346e3638c
HADOOP-15691 Add PathCapabilities to FileSystem and FileContext.
...
Contributed by Steve Loughran.
This complements the StreamCapabilities Interface by allowing applications to probe for a specific path on a specific instance of a FileSystem client
to offer a specific capability.
This is intended to allow applications to determine
* Whether a method is implemented before calling it and dealing with UnsupportedOperationException.
* Whether a specific feature is believed to be available in the remote store.
As well as a common set of capabilities defined in CommonPathCapabilities,
file systems are free to add their own capabilities, prefixed with
fs. + schema + .
The plan is to identify and document more capabilities -and for file systems which add new features, for a declaration of the availability of the feature to always be available.
Note
* The remote store is not expected to be checked for the feature;
It is more a check of client API and the client's configuration/knowledge
of the state of the remote system.
* Permissions are not checked.
Change-Id: I80bfebe94f4a8bdad8f3ac055495735b824968f5
2019-09-25 12:16:41 +01:00
Viraj Jasani
Masatake Iwasaki
Tamas Domok
Ayush Saxena
Akira Ajisaka
Takanobu Asanuma
Wei-Chiu Chuang
Ahmed Hussein
Kihwal Lee
bshashikant
Mingliang Liu
Xiaoyu Yao
Inigo Goiri
Brahma Reddy Battula
Vinayakumar B
Yuming Wang
Steve Loughran