Commit Graph

149 Commits

Author SHA1 Message Date
Steve Loughran 14ba19af06
HADOOP-17409. Remove s3guard from S3A module (#3534)
Completely removes S3Guard support from the S3A codebase.

If the connector is configured to use any metastore other than
the null and local stores (i.e. DynamoDB is selected) the s3a client
will raise an exception and refuse to initialize.

This is to ensure that there is no mix of S3Guard enabled and disabled
deployments with the same configuration but different hadoop releases
-it must be turned off completely.

The "hadoop s3guard" command has been retained -but the supported
subcommands have been reduced to those which are not purely S3Guard
related: "bucket-info" and "uploads".

This is major change in terms of the number of files
changed; before cherry picking subsequent s3a patches into
older releases, this patch will probably need backporting
first.

Goodbye S3Guard, your work is done. Time to die.

Contributed by Steve Loughran.
2022-01-17 18:08:57 +00:00
Viraj Jasani f64fda0f00
HADOOP-18055. Async Profiler endpoint for Hadoop daemons (#3824)
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2022-01-06 17:56:49 +08:00
Masatake Iwasaki e9a3c2950e
HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index. (#2716) 2021-02-24 07:46:02 +09:00
Brahma Reddy Battula 1ec5c67b5e HADOOP-16492. Support HuaweiCloud Object Storage as a Hadoop Backend File System. Contributed by zhongjun. 2021-01-11 18:12:12 +05:30
Akira Ajisaka 40542024df
HADOOP-17182. Remove breadcrumbs from web site (#2190)
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-08-07 23:29:52 -07:00
Yiqun Lin ff8bb67200 HDFS-15374. Add documentation for fedbalance tool. Contributed by Jinglun. 2020-07-01 14:18:18 +08:00
Uma Maheswara Rao G 76fa0222f0
HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide. Contributed by Uma Maheswara Rao G. 2020-06-05 10:58:21 -07:00
Zhankun Tang d40d7cc4f9 HADOOP-16670. Stripping Submarine code from Hadoop codebase. Contributed by Zhankun Tang.
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-01-21 20:07:31 -08:00
Eric Badger 0e22e9ab83 YARN-9562. Add Java changes for the new RuncContainerRuntime. Contributed by Eric Badger 2019-11-18 21:56:31 +00:00
Masatake Iwasaki a98c4dfc47 HADOOP-16702. Move documentation of hadoop-cos to under src directory.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-11-12 17:47:17 +09:00
Masatake Iwasaki b988487cae HADOOP-16701. Fix broken links in site index.
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-11-12 16:43:52 +09:00
Sammi Chen 8a9ede5cff HADOOP-15616. Incorporate Tencent Cloud COS File System Implementation. Contributed by Yang Yu. 2019-09-27 16:53:13 +08:00
Yiqun Lin 5043840b1d HDFS-14410. Make Dynamometer documentation properly compile onto the Hadoop site. Contributed by Erik Krogen. 2019-07-11 23:47:27 +08:00
Akira Ajisaka 48d7f00da8
HDFS-14590. [SBN Read] Add the document link to the top page. Contributed by Takanobu Asanuma. 2019-06-25 19:11:09 +09:00
Wanqiang Ji eb6be4643f YARN-9630. [UI2] Add a link in docs's top page
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-06-18 14:54:21 +09:00
Yiqun Lin 7b11b404a3 HADOOP-16097. Provide proper documentation for FairCallQueue. Contributed by Erik Krogen. 2019-02-13 11:16:04 +08:00
Akira Ajisaka eee29ed706
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code. 2018-12-31 06:28:24 +09:00
Sunil G 19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Weiwei Yang 1e7d6e55a5 YARN-7865. Node attributes documentation. Contributed by Naganarasimha G R. 2018-09-12 16:01:01 +05:30
Akira Ajisaka 418cc7f3ae
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota. 2018-07-11 14:46:43 -04:00
Xiaoyu Yao 7846636a5d HDFS-12551. Ozone: Documentation: Add Ozone overview documentation. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Weiwei Yang c398ab49d3 HDFS-12047. Ozone: Add REST API documentation. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Yiqun Lin 52aa60ed2f HDFS-11963. Ozone: Documentation: Add getting started page (addendum). Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer 8d289df627 HDFS-11963. Ozone: Documentation: Add getting started page. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Anu Engineer aa16380d71 HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Sunil G 427ad7ecc4 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 2018-04-17 15:08:31 +05:30
Takanobu Asanuma 7623cc5a98
HADOOP-15374. Add links of the new features of 3.1.0 to the top page
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-10 18:59:40 +09:00
weiy 6e2b5fa493 HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan 2018-03-19 22:13:40 -07:00
Yiqun Lin 4cc9a6d9bb HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 2018-03-08 16:02:34 +08:00
Wangda Tan 31db977cb3 HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda)
Change-Id: I5d66d0f034874623af22aecae0a0b858b65396ed
2018-02-17 12:28:55 +08:00
Daniel Templeton 69043ba8b5 HADOOP-14876. Create downstream developer docs from the compatibility guidelines 2017-11-15 10:03:29 -08:00
Andrew Wang 8b12574165 HADOOP-15037. Add site release notes for OrgQueue and resource types. 2017-11-13 18:49:22 -08:00
Daniel Templeton 040a38dc49 YARN-7369. Improve the resource types docs 2017-11-13 11:05:07 -08:00
Gour Saha 541b64c798 YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:15 -08:00
Jian He 7dd4490a44 YARN-7073. Yarn native services rest API documentation. Contributed by Gour Saha 2017-11-06 13:30:14 -08:00
Gour Saha 2ba38ce8ec YARN-5244. Documentation required for DNS Server implementation. Contributed by Jon Maron 2017-11-06 13:30:12 -08:00
Subru Krishnan 625039ef20 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 2017-10-25 15:51:27 -07:00
Yiqun Lin b90750cfb8 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 2017-10-24 10:46:09 +08:00
Chris Trezzo e46d5bb962 MAPREDUCE-5951. Add support for the YARN Shared Cache. 2017-10-12 10:59:20 -07:00
Andrew Wang 132cdac0dd HADOOP-14939. Update project release notes with HDFS-10467 for 3.0.0. Contributed by Inigo Goiri. 2017-10-10 10:16:36 -07:00
Chris Trezzo 7e76f85bc6 YARN-2960. Add documentation for the YARN shared cache. 2017-10-05 10:38:41 -07:00
Andrew Wang cae1c734fe HADOOP-14928. Update site release notes for 3.0.0 GA. 2017-10-04 14:59:40 -07:00
Andrew Wang 373d0a5195 HADOOP-14909. Fix the word of erasure encoding in the top page. Contributed by Takanobu Asanuma. 2017-09-29 13:34:36 -07:00
Ming Ma ce943eb17a HDFS-11035. Better documentation for maintenace mode and upgrade domain. 2017-09-20 09:36:33 -07:00
Aaron Fabbri 49467165a5
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran. 2017-09-14 14:10:48 -07:00
Wangda Tan 6b88cd1901 YARN-7056. Document Resource Profiles feature. (Sunil G via wangda)
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
2017-09-12 09:19:12 -07:00
Vrushali C bea3e4df76 YARN-6047 Documentation updates for TimelineService v2 (Contributed by Rohith Sharma) 2017-08-30 11:29:54 +05:30
Subru Krishnan d6c29b2f5b YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru).
(cherry picked from commit 749ca890e6)
2017-08-01 17:28:25 -07:00
Masatake Iwasaki fbc0c2bd76 YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation. (iwasakims) 2017-02-15 13:09:10 +09:00
Sidharta S 307ec58ffb YARN-5258. Document Use of Docker with LinuxContainerExecutor (Contributed by Daniel Templeton) 2017-02-07 16:29:21 -08:00