d447152d49
Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release.
2017-12-13 13:05:32 -08:00
75a3ab88f5
HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter)
2017-11-30 07:39:15 -08:00
69043ba8b5
HADOOP-14876. Create downstream developer docs from the compatibility guidelines
2017-11-15 10:03:29 -08:00
bf6a660232
HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
2017-11-09 10:16:12 -08:00
d015e0bbd5
HDFS-7878. API - expose a unique file identifier.
2017-10-31 09:44:01 -07:00
81225430d0
HDFS-206. Support for head in FSShell. Contributed by Gabor Bota.
2017-10-31 08:34:01 -06:00
1ad863e220
Update CHANGES.md and RELEASENOTES for 2.8.2 release.
2017-10-26 19:13:58 -07:00
075358eb6f
HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin.
2017-10-11 15:58:20 -07:00
b34b3ff94b
Add 3.0.0-beta1 CHANGES and RELEASENOTES.
2017-10-03 17:14:40 -07:00
4d5dd75b60
HADOOP-14908. CrossOriginFilter should trigger regex on more input (Johannes Alberti via aw)
2017-10-03 10:58:28 -07:00
0807470808
HADOOP-14897. Loosen compatibility guidelines for native dependencies
2017-09-25 14:12:25 +02:00
423ebcaf51
HDFS-12320. Add quantiles for transactions batched in Journal sync. Contributed by Hanisha Koneru.
2017-09-23 10:34:13 -07:00
7618fa9194
HADOOP-13714. Tighten up our compatibility guidelines for Hadoop 3
2017-09-16 09:20:33 +02:00
49467165a5
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran.
2017-09-14 14:10:48 -07:00
190410085b
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
...
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 19:06:49 -07:00
ac12e153a8
HDFS-12317. HDFS metrics render error in the page of Github. Contributed by Yiqun Lin.
2017-08-31 17:23:17 +08:00
99e558b13b
HADOOP-14398. Modify documents for the FileSystem Builder API. (Lei (Eddy) Xu)
2017-08-17 18:06:23 -07:00
a4eb7016cb
HDFS-12198. Document missing namenode metrics that were added recently. Contributed by Yiqun Lin.
2017-08-07 18:47:33 +09:00
fe3341786a
HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu)
2017-08-04 11:21:58 -07:00
f4c6b00a9f
HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen.
2017-08-03 15:44:51 -07:00
1a1bf6b7d0
HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.
2017-08-02 12:25:05 -06:00
3a0b84d9c9
HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu.
2017-08-02 06:06:25 +00:00
746189ad8c
HADOOP-14229. hadoop.security.auth_to_local example is incorrect in the documentation. Contributed by Andras Bokor.
2017-07-28 11:43:36 -07:00
c6330f22a5
HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang.
2017-07-27 16:48:24 -07:00
f10864a820
Add release notes, changes, jdiff for 3.0.0-alpha4
2017-07-07 11:01:59 -07:00
d6df0fdbbd
Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable. Contributed by luhuichun via lei.
2017-06-28 13:47:23 -07:00
8dbd53ef9f
HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B.
2017-06-22 17:37:08 +05:30
45ff4d38e6
HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun.
2017-06-20 11:55:09 -07:00
a2121cb0d9
HADOOP-14465. LdapGroupsMapping - support user and group search base. Contributed by Shwetha G S and Mingliang Liu
2017-06-09 14:55:07 -07:00
abdd609e51
HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger.
2017-06-06 00:21:03 +08:00
2cd612ba8e
Update 3.0.0-alpha3 changes, release notes, jdiff.
2017-05-26 14:14:38 -07:00
52661e0912
HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
2017-05-23 23:52:42 +08:00
2a8fcf0c9a
HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin.
2017-05-23 02:16:25 +08:00
c80d3bc480
HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin
2017-05-21 01:23:35 -07:00
1db186f662
HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou
2017-05-19 14:21:01 -07:00
3873904a94
HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou
2017-05-10 14:33:33 -07:00
81092b1f11
HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru.
2017-05-03 16:29:30 -07:00
30cd265134
Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
...
This reverts commit 08fb82d6d1
2017-05-03 16:28:47 -07:00
08fb82d6d1
HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru.
2017-05-03 15:46:08 -07:00
667966c13c
HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran
2017-04-20 17:13:36 -07:00
654372db85
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
...
This closes #214
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-04-18 17:14:22 +09:00
84a8848aae
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu.
2017-04-18 16:43:50 +09:00
96cbb4fce2
HADOOP-14202. fix jsvc/secure user var inconsistencies
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
8c591b8d19
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
2017-03-30 11:16:05 -07:00
4966a6e26e
HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy.
2017-03-29 14:37:21 -07:00
d8e6d6df4c
Add 2.8.0 RELEASENOTEs.md and CHANGES.md.
2017-03-25 14:02:25 -07:00
52b00600df
HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy.
2017-03-24 11:44:46 -07:00
fd26783aaf
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-03-10 00:21:20 -08:00
959940b0ab
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-07 10:12:35 -08:00
d9dc444dc7
YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang)
2017-03-06 14:02:49 -08:00
209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma.
2017-03-07 01:34:51 +09:00
05237636d3
YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
2017-03-03 07:57:37 -06:00
8f4817f2c5
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
...
This reverts commit e61491d476
2017-03-02 16:20:48 -08:00
e61491d476
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-02 15:38:25 -08:00
cc45da79fd
HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor.
2017-02-13 10:14:45 -08:00
69b23632c4
HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge.
2017-02-07 09:36:55 -08:00
3ea6d3517e
HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin.
2017-02-04 11:01:27 +08:00
cb8f3f3adf
HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin.
2017-02-04 10:58:08 +09:00
ff02bdfe65
Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release.
2017-01-25 15:39:40 -08:00
9c0a4d3e71
HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge.
2017-01-24 21:30:10 -08:00
e015b56319
HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
2017-01-20 14:48:04 +08:00
f5839fd6df
YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton)
2017-01-19 12:45:17 -08:00
0eb4b513b7
HADOOP-13673. Update scripts to be smarter when running with privilege
...
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
2017-01-18 14:39:05 -08:00
4046794a53
HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru.
2017-01-10 10:43:11 -08:00
4a659ff40f
HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin.
2017-01-05 19:34:32 -08:00
5d182949ba
HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge.
2017-01-05 17:21:57 -08:00
a0a2761621
HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales
2017-01-04 14:46:25 +00:00
88731c731a
Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
...
This reverts commit 451efb08fe
2017-01-03 14:44:26 -08:00
451efb08fe
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-01-03 13:08:38 -08:00
6938b67711
HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin.
2016-12-31 16:16:02 +05:30
ded2d08f33
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
2016-12-27 07:18:08 -08:00
22befbd585
MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
2016-12-23 04:48:04 +09:00
f6e2521eb2
HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
2016-12-21 14:17:47 +09:00
80b8023276
HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
2016-12-09 18:21:42 +05:30
860d49aa6a
HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran
2016-11-23 16:42:27 -08:00
de4894936a
HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R.
2016-11-23 16:42:06 -08:00
beb70fed4f
HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
...
This closes #131
2016-11-22 13:12:23 -08:00
ae8849fe37
HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran
2016-11-17 14:11:38 -08:00
de0132748d
MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen.
2016-11-05 03:49:19 +09:00
112f04eb1b
HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
2016-10-28 15:33:27 -07:00
309a43925c
HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
2016-10-25 09:03:03 -07:00
efdf810cf9
HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge.
2016-10-18 18:18:43 -07:00
bedfec0c10
HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini.
2016-10-18 15:00:44 +09:00
987ee51141
HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
2016-10-17 13:25:58 -07:00
ed9fcbec54
HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory.
2016-10-17 05:04:49 -07:00
b84c4891f9
HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
2016-10-11 17:05:00 -07:00
ebd4f39a39
HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran.
2016-10-07 12:51:40 +01:00
9a61b52fbe
HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao.
2016-10-05 20:41:08 +09:00
ea839bd48e
HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
2016-09-17 22:25:39 -07:00
7cad7b7046
HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
2016-09-15 23:42:34 +09:00
58ed4fa544
HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
...
This commit includes the following changes:
HADOOP-13356. Add a function to handle command_subcommand_OPTS
HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
HADOOP-13357. Modify common to use hadoop_subcommand_opts
HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
HADOOP-13564. modify mapred to use hadoop_subcommand_opts
HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
HADOOP-13360. Documentation for HADOOP_subcommand_OPTS
This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
f388a20943
Add CHANGES and release notes for 3.0.0-alpha1 to site
2016-09-06 09:51:55 -07:00
c37346d0e3
HADOOP-12726. Unsupported FS operations should throw UnsupportedOperationException. Contributed by Daniel Templeton.
2016-08-23 14:12:52 -07:00
8aae8d6bf0
HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu.
2016-08-24 00:03:27 +09:00
f0efea490e
HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen.
2016-08-23 04:14:24 -07:00
8179f9a493
HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu.
2016-08-19 16:15:00 +09:00
382d615260
HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu)
2016-08-15 20:22:14 -07:00
d892ae9576
HADOOP-13441. Document LdapGroupsMapping keystore password properties. Contributed by Yuanbo Liu.
2016-08-11 11:57:43 -07:00
5fda66e4a3
HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran.
2016-07-22 15:38:18 -07:00
32b033d57c
YARN-5052 Update timeline service v2 documentation to capture information about filters (Varun Saxena via Vrushali C)
2016-07-10 08:46:03 -07:00
Andrew Wang
Robert Kanter
Daniel Templeton
John Zhuge
Chris Douglas
Sean Mackrory
Junping Du
Anu Engineer
Allen Wittenauer
Aaron Fabbri
Yiqun Lin
Lei Xu
Akira Ajisaka
Masatake Iwasaki
Ravi Prakash
Yongjun Zhang
Vinayakumar B
Mingliang Liu
Brahma Reddy Battula
Arpit Agarwal
Kengo Seki
Wei-Chiu Chuang
Ray Chiang
Jason Lowe
Xiao Chen
Jason Lowe
Chris Nauroth
Steve Loughran
Vrushali Channapattan