Commit Graph

3200 Commits

Author SHA1 Message Date
Brahma Reddy Battula 31bec2c16b HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
(cherry picked from commit dcd03df9f9)
2017-03-01 10:49:36 +05:30
Wei-Chiu Chuang f9c663f45c HADOOP-13508. FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria.
(cherry picked from commit 84ec079911)
2017-02-13 10:47:20 -08:00
Kihwal Lee 6b3443fbf5 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp.
(cherry picked from commit 0c01cf5798)
2017-02-09 16:20:48 -06:00
Kihwal Lee 47bbe431bf HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp.
(cherry picked from commit d008b55153)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Server.java
2017-02-09 11:04:29 -06:00
Kihwal Lee bb98856af9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
(cherry picked from commit a0bfb41504)
2017-02-09 10:14:18 -06:00
Xiao Chen 04076e783b HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-02-08 23:52:59 -08:00
Kihwal Lee 2bbcaa8ad0 HADOOP-14050. Add process name to kms process. Contributed by Rushabh S Shah.
(cherry picked from commit 7baa6dac54)
2017-02-03 15:40:34 -06:00
Eric Yang e72f485d8c HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
(cherry picked from commit a847903b6e)
2017-01-21 15:49:32 -08:00
Akira Ajisaka b8b8b9a32b HADOOP-14001. Improve delegation token validity checking.
(cherry picked from commit 1763467210)
(cherry picked from commit c6c29d0080)
2017-01-19 17:59:18 +09:00
Kihwal Lee 7d949cc432 HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger.
(cherry picked from commit 706d630eb9)
2017-01-17 15:13:56 -06:00
Steve Loughran e32cd52481 HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran 2017-01-11 17:15:01 +00:00
Junping Du 7706a63fb4 Preparing for 2.8.1 development after cutting off 2.8.0 branch. 2017-01-10 18:03:51 -08:00
Vinod Kumar Vavilapalli 9721735ce9 HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba.
(cherry picked from commit 069c6c62de)
(cherry picked from commit 4041d2b49e)
2017-01-05 13:23:47 -08:00
Masatake Iwasaki a631247c2a HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims)
(cherry picked from commit 9eec6cbedc)
2017-01-04 18:04:43 +00:00
Akira Ajisaka 58a1753373 HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang.
(cherry picked from commit 01d31fe938)
(cherry picked from commit 3e2d26a97f)
2017-01-04 14:20:04 +09:00
Mingliang Liu a58a1b55bf Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
This reverts commit d61af93bef.
2017-01-03 14:45:46 -08:00
Mingliang Liu d61af93bef HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
(cherry picked from commit 451efb08fe)
2017-01-03 13:09:53 -08:00
Brahma Reddy Battula b8be8f0d4f HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin. 2016-12-31 16:27:17 +05:30
Akira Ajisaka ae053df2d8 HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
(cherry picked from commit f6e2521eb2)
(cherry picked from commit 897b4a6a77)
2016-12-21 14:20:39 +09:00
Xiaoyu Yao 691a32c6f6 HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
(cherry picked from commit f5e0bd30fd)
(cherry picked from commit 85083567be)
2016-12-14 14:01:32 -08:00
Akira Ajisaka 901bc5eef5 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
(cherry picked from commit 72bff192cd)
(cherry picked from commit 190b2dca62)
2016-12-14 18:54:39 +09:00
Xiaoyu Yao bd4e5bc501 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
(cherry picked from commit 4c38f11cec)
2016-12-09 21:38:42 -08:00
Wei-Chiu Chuang 983d487e98 HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.
(cherry picked from commit b606e025f1)

Conflicts:
   hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShell.java

(cherry picked from commit 6c93c1870c)
2016-12-09 15:40:14 -08:00
Brahma Reddy Battula 3957161a97 HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
(cherry picked from commit 80b8023276)
2016-12-09 18:44:27 +05:30
Andrew Wang 092d0602c2 HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn.
(cherry picked from commit 7b988e8899)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/util/GF256.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/KDiag.java

(cherry picked from commit 6bd600eef2)
2016-12-05 23:21:17 -08:00
Xiao Chen 49f9e7cf71 HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge.
(cherry picked from commit 291df5c7fb)
2016-12-05 09:35:54 -08:00
Akira Ajisaka 129beeeddd HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge.
(cherry picked from commit 00096dcc0c)
(cherry picked from commit 0c895e8a62)
2016-11-29 19:51:38 +09:00
Robert Kanter 92ee5e2077 HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
(cherry picked from commit 47ca9e26fb)
(cherry picked from commit 285edf691d)
2016-11-28 18:23:23 -08:00
Brahma Reddy Battula 713d800e7b HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula.
(cherry picked from commit ee3d437a33)
(cherry picked from commit 1c0fa25dc1)
2016-11-25 20:20:37 +05:30
Steve Loughran 24715cefe8 HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli 2016-11-24 17:51:49 +00:00
Brahma Reddy Battula 1e25fd6b3b HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula.
(cherry picked from commit 13501053dd)
2016-11-24 22:25:36 +05:30
Mingliang Liu 834e2ddbab HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran
(cherry picked from commit 2bf9a15e8a)
2016-11-22 14:35:32 -08:00
Mingliang Liu ed9dcdae57 HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 2016-11-22 13:24:42 -08:00
Brahma Reddy Battula 9be7b353dd HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
(cherry picked from commit afcf8d38e7)
2016-11-22 20:36:32 +05:30
Akira Ajisaka 402606323a HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka.
(cherry picked from commit c65d6b6541)
(cherry picked from commit d29e3d0f52)
2016-11-21 11:29:00 +09:00
Mingliang Liu 416f6f3605 HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran
(cherry picked from commit ae8849fe37)
2016-11-17 14:27:34 -08:00
Kihwal Lee 0fb1306f93 HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula.
(cherry picked from commit bd3735554f)
2016-11-17 12:20:01 -06:00
Mingliang Liu c60ed3a3e4 HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula
(cherry picked from commit aab9737a05)
2016-11-16 20:11:10 -08:00
Xiao Chen cf366a0fd6 HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk.
(cherry picked from commit 61c0bedf77)
(cherry picked from commit efc9ffc3b6)
2016-11-15 16:26:59 -08:00
Mingliang Liu 0feb9bb4a9 HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran
This closes #158

(cherry picked from commit 04014c4c73)
2016-11-14 19:55:45 -08:00
Zhe Zhang c6e7b631bd HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
(cherry picked from commit 818915aabb)
2016-11-14 16:39:26 -08:00
Yongjun Zhang 51f5bab695 HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang.
(cherry picked from commit fd2f22adec)
2016-11-10 23:41:48 -08:00
Xiao Chen b1b609c003 HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception.
(cherry picked from commit 367c3d4121)
(cherry picked from commit ede909144d)
2016-11-09 09:10:06 -08:00
Zhe Zhang d93dc01e3d HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
(cherry picked from commit 77c13c3857)
(cherry picked from commit 758638d08d)
2016-11-08 16:10:53 -08:00
Zhe Zhang 384b7b71a3 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
(cherry picked from commit 3dbad5d823)
(cherry picked from commit b245e9ce2f)
2016-11-07 16:15:20 -08:00
Steve Loughran 5231c527aa HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt 2016-11-07 12:36:38 +00:00
Xiaoyu Yao 5073289c4a Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao."
This reverts commit 5abc788825.
2016-11-04 16:22:45 -07:00
Robert Kanter f9a7b83a53 HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable (xiaochen via rkanter)
(cherry picked from commit 0b36dcda7c)
2016-11-04 09:24:34 -07:00
Xiao Chen a22ca0aa58 HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
(cherry picked from commit 7154a20bcb)
2016-11-03 13:10:41 -07:00
Andrew Wang e393dd788e HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:25 -07:00