a777264c7f
HADOOP-17919. Fix command line example in Hadoop Cluster Setup documentation. ( #3453 )
...
(cherry picked from commit 607c20c612
2021-09-17 13:35:54 +00:00
dac74b0e11
HDFS-16173.Improve CopyCommands#Put#executor queue configurability. ( #3302 )
...
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4c948313647c663043b2
2021-08-27 12:50:22 +08:00
2f29784293
HADOOP-17760. Delete hadoop.ssl.enabled and dfs.https.enable from docs and core-default.xml ( #3099 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 9e7c7ad129
2021-06-17 10:01:28 +09:00
0faa626bd8
HDFS-15759. EC: Verify EC reconstruction correctness on DataNode ( #2585 ) ( #2868 )
...
(cherry picked from commit 95e6892675
2021-04-12 19:45:49 -07:00
d566e4e41d
HDFS-15892. Add metric for editPendingQ in FSEditLogAsync ( #2770 )
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 4bd04126d6
2021-04-02 11:00:33 +09:00
35855007f6
HADOOP-17952. Fix the wrong CIDR range example in Proxy User documentation. ( #2780 )
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c8d327a4f1
2021-03-22 11:46:22 +09:00
7e20910d3d
HADOOP-17585. Correct timestamp format in the docs for the touch command. Contributed by Stephen O'Donnell.
...
(cherry picked from commit b1dc6c40a0
2021-03-14 15:10:12 +00:00
4fa57485e7
HADOOP-17546. Update Description of hadoop-http-auth-signature-secret in HttpAuthentication.md. Contributed by Ravuri Sushma sree.
...
(cherry picked from commit 9fd2198daa
2021-03-04 14:57:19 +09:00
5abf19a773
HADOOP-16764. Rewrite Python example codes using Python3 ( #1762 )
...
(cherry picked from commit fd7de2b82a
2021-02-20 19:15:16 +09:00
a17793534c
Make upstream aware of 3.2.2 release.
2021-01-09 18:07:46 +08:00
1c0ac5ed5c
HDFS-15751. Add documentation for msync() API to filesystem.md. Contributed by Konstantin V Shvachko.
...
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Chao Sun <sunchao@apache.org>
2021-01-03 16:31:01 +08:00
66e8f1ae09
YARN-10511. Update yarn.nodemanager.env-whitelist value in docs ( #2512 )
...
Reviewed-by: Adam Antal <adamantal@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 9170eb566b
2020-12-04 00:17:48 +09:00
42c71a5790
HADOOP-15691. Add PathCapabilities to FileSystem and FileContext.
...
Contributed by Steve Loughran.
This complements the StreamCapabilities Interface by allowing applications to probe for a specific path on a specific instance of a FileSystem client
to offer a specific capability.
This is intended to allow applications to determine
* Whether a method is implemented before calling it and dealing with UnsupportedOperationException.
* Whether a specific feature is believed to be available in the remote store.
As well as a common set of capabilities defined in CommonPathCapabilities,
file systems are free to add their own capabilities, prefixed with
fs. + schema + .
The plan is to identify and document more capabilities -and for file systems which add new features, for a declaration of the availability of the feature to always be available.
Note
* The remote store is not expected to be checked for the feature;
It is more a check of client API and the client's configuration/knowledge
of the state of the remote system.
* Permissions are not checked.
2020-08-19 17:15:06 +01:00
d245a4d7fe
HADOOP-7002. Wrong description of copyFromLocal and copyToLocal in documentation. Contributed by Andras Bokor.
...
(cherry picked from commit 19f26a020e
2020-05-29 14:51:45 +01:00
5b6c2b366e
HADOOP-14698. Make copyFromLocals -t option available for put as well. Contributed by Andras Bokor.
2020-05-29 12:10:50 +01:00
8ec1461b25
HADOOP-16042. Update the link to HadoopJavaVersion ( #1784 )
...
(cherry picked from commit d80d86264d
2019-12-27 17:20:26 +09:00
9ccfc2d6d3
Add 2.10.0 release notes for HDFS-12943
...
(cherry picked from commit ef9d12df24
2019-10-31 20:34:36 -07:00
5d2ffcc7aa
Make upstream aware of 2.10.0 release
...
(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)
2019-10-30 20:59:20 -07:00
f9f0338104
Make upstream aware of 3.2.1 release.
2019-09-23 12:03:53 +05:30
0c02217d9b
HDFS-14691. Wrong usage hint for hadoop fs command "test".
...
Contributed by Jianfei Jiang.
Change-Id: I9f5e89721ff210641375fbf42a70043f0d74458e
(cherry picked from commit 71aad60e51
2019-08-05 13:09:39 +01:00
d4492bdd9e
HADOOP-16459. Backport of HADOOP-16266. Add more fine-grained processing time metrics to the RPC layer. Contributed by Christopher Gregorian.
...
This commit also includes the follow-on commit 827a84778af96a2df38d
2019-07-30 14:41:36 -07:00
23b470ee92
HADOOP-16443. Improve help text for setfacl --set option.
...
Contributed by S O'Donnell.
Change-Id: I1da46c4c414a5d2b07ee15867508f0799440a413
2019-07-23 10:25:59 +01:00
b13110a6f0
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
2019-06-28 14:22:07 -07:00
b6ebe74526
HADOOP-16233. S3AFileStatus to declare that isEncrypted() is always true ( #685 )
...
This is needed to fix up some confusion about caching of job.addCache() handling of S3A paths; all parent dirs -the files are downloaded by the NM without using the DTs of the user submitting the job. This means that when you submit jobs to an EC2 cluster with lower IAM permissions than the user, cached resources don't get downloaded and the job doesn't start.
Production code changes:
* S3AFileStatus Adds "true" to the superclass's encrypted flag during construction.
Tests
* Base AbstractContractOpenTest can control whether zero byte files created in tests are encrypted. Not done via an XML attribute, just a subclass point. Thoughts?
* Verify that the filecache considers paths to not have the permissions which trigger reduce-privilege downloads
* And extend ITestDelegatedMRJob to test a completely different bucket (open street map), to verify that cached resources do get their tokens picked up
Docs:
* Advise FS developers to say all files are encrypted. It's otherwise harmless and it'll stop other people seeing impossible to debug error messages on app launch.
Contributed by Steve Loughran.
Change-Id: Ifaae4c9d735ccc5eafeebd2584b65daf2d4e5da3
(cherry picked from commit 366186d999
2019-04-03 21:35:19 +01:00
8037052c2b
HADOOP-16225. Fix links to the developer mailing lists in DownstreamDev.md. Contributed by Wanqiang Ji.
...
(cherry picked from commit ebd0d21538
2019-04-02 10:54:16 +09:00
3fe31b36fa
HADOOP-16140. hadoop fs expunge to add -immediate option to purge trash immediately.
...
Contributed by Stephen O'Donnell.
(cherry picked from commit 686c0141ef
2019-03-05 14:11:49 +00:00
649da5af04
Make upstream aware of 3.1.2 release
...
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
(cherry picked from commit 308f3168fa
2019-02-05 14:05:51 -08:00
bdd17be9ec
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
...
Contributed by Ewan Higgs and Steve Loughran.
(cherry picked from commit c1d24f8483
2019-02-04 17:10:19 +00:00
54d4abdfe9
HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian.
2019-01-18 11:54:20 -08:00
febafd0e4f
HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop.
...
Contributed by Bolke de Bruin
(cherry picked from commit d43af8b3db
2019-01-04 18:02:30 -05:00
7cfcabc473
HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak.
2018-12-03 12:44:19 -08:00
b722bfd6f5
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin.
...
(cherry picked from commit c9bfca217f
2018-11-30 13:30:32 +09:00
1a448565a8
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple"
...
This reverts commit 829a2e4d27d0edd37269
2018-11-29 17:53:23 +00:00
f6227367fb
Add 2.9.2 release notes and changes documents.
...
(cherry picked from commit 1a00b4e325
2018-11-20 14:25:48 +09:00
d79ea3844c
HADOOP-15855. Review hadoop credential doc, including object store details.
...
Contributed by Steve Loughran.
(cherry picked from commit 62d98ca92a
2018-10-30 15:58:44 +00:00
c62b440421
HADOOP-15693. Typo in Secure Mode documentation. Contributed by Thomas Levine.
2018-09-26 10:30:43 +09:00
ce03a93f78
HADOOP-15446. ABFS: tune imports & javadocs; stabilise tests.
...
Contributed by Steve Loughran and Da Zhou.
2018-09-17 19:54:01 +00:00
4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-11 08:55:34 -07:00
f2c2a68ec2
HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD
...
(Contributed by Laszlo Kollar via Daniel Templeton)
Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
2018-08-30 09:12:36 -07:00
d53a10b0a5
HADOOP-15705. Typo in the definition of "stable" in the interface classification
...
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
2018-08-29 13:59:32 -07:00
bed8cb6979
HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.
2018-08-23 21:54:38 +09:00
60ffec9f79
HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre.
2018-08-17 11:18:09 -07:00
49c687608b
Make 3.1.1 awared by other branches
2018-08-08 13:02:12 -07:00
9499df7b81
HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi.
2018-08-08 10:40:20 -07:00
2e4e02b4df
HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun.
2018-08-07 09:32:51 +08:00
7a68ac607c
HDFS-13674. Improve documentation on Metrics. Contributed by Chao Sun.
2018-07-09 14:27:34 +08:00
8e7548d33b
HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
2018-06-13 20:05:55 +08:00
7c3dc39083
Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
...
(cherry picked from commit 5a82f10e32
2018-06-11 15:13:18 -07:00
f3f544b004
Add 2.9.1 release notes and changes documents
2018-05-14 15:14:02 +08:00
66c9905b57
Revert "Add 2.9.1 release notes and changes documents"
...
This reverts commit e4dc346d65
2018-05-14 14:38:40 +08:00
Rintaro Ikeda
jianghuazhu
Takanobu Asanuma
Wei-Chiu Chuang
litao
kwangsun
He Xiaoqiao
Akira Ajisaka
Kengo Seki
Andrea Scarpino
Steve Loughran
S O'Donnell
Chandra Sanivarapu
Jonathan Hung
Jonathan Hung
Rohith Sharma K S
Jianfei Jiang
Christopher Gregorian
Erik Krogen
Steve Loughran
Wangda Tan
Chen Liang
Eric Yang
Giovanni Matteo Fumarola
Thomas Marquardt
Allen Wittenauer
Daniel Templeton
Xiao Chen
Yiqun Lin
Yongjun Zhang
Sammi Chen