Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,065 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3211 Commits

Author SHA1 Message Date
Zhe Zhang 8ca9915d0f HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a8)
(cherry picked from commit f98f4bb6ca)
 2017-03-22 22:32:41 -07:00
John Zhuge 3ed867fef3 HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei) 
(cherry picked from commit 15066a3e8ddacd36bf7be9fba0b10c350ae45668)
(cherry picked from commit 00dec84cc2)
 2017-03-21 09:14:17 -07:00
John Zhuge 3a8b120c78 HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. 
(cherry picked from commit 84e2c11f96)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestCommonConfigurationFields.java
 2017-03-21 08:37:18 -07:00
John Zhuge e792f1671d HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane 
(cherry picked from commit 19f373a46b)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java
 2017-03-20 21:29:17 -07:00
Erik Krogen c7b6e0dd6e HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 
(cherry picked from commit e1a99802fc)
 2017-03-17 17:42:29 -07:00
Mingliang Liu 026ae87236 HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit fd26783aaf)
 2017-03-10 00:22:16 -08:00
Lei Xu 5eaec560d9 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 
(cherry picked from commit e015b56319)
(cherry picked from commit 01624f0c1b)
 2017-03-09 15:21:32 -08:00
John Zhuge cdfa86cadd Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran" 
This reverts commit 53a12fa721.

(cherry picked from commit 98142d2f72)

Change-Id: I3a7613a7f4f0e9c80bb6d3c40a53742f807fc689
 2017-03-08 11:47:36 -08:00
Jian He 2e8e51ad40 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:49:42 -08:00
Andrew Wang 2bfa57488b HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers. 
(cherry picked from commit ec839b94c0)
(cherry picked from commit cf5a1390aa)
 2017-03-06 10:47:39 -08:00
Jason Lowe daf3b5ee67 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang 
(cherry picked from commit 05237636d3)
 2017-03-03 08:02:31 -06:00
Brahma Reddy Battula 31bec2c16b HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 
(cherry picked from commit dcd03df9f9)
 2017-03-01 10:49:36 +05:30
Wei-Chiu Chuang f9c663f45c HADOOP-13508. FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria. 
(cherry picked from commit 84ec079911)
 2017-02-13 10:47:20 -08:00
Kihwal Lee 6b3443fbf5 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 
(cherry picked from commit 0c01cf5798)
 2017-02-09 16:20:48 -06:00
Kihwal Lee 47bbe431bf HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 
(cherry picked from commit d008b55153)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Server.java
 2017-02-09 11:04:29 -06:00
Kihwal Lee bb98856af9 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 
(cherry picked from commit a0bfb41504)
 2017-02-09 10:14:18 -06:00
Xiao Chen 04076e783b HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-02-08 23:52:59 -08:00
Kihwal Lee 2bbcaa8ad0 HADOOP-14050. Add process name to kms process. Contributed by Rushabh S Shah. 
(cherry picked from commit 7baa6dac54)
 2017-02-03 15:40:34 -06:00
Eric Yang e72f485d8c HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 
(cherry picked from commit a847903b6e)
 2017-01-21 15:49:32 -08:00
Akira Ajisaka b8b8b9a32b HADOOP-14001. Improve delegation token validity checking. 
(cherry picked from commit 1763467210)
(cherry picked from commit c6c29d0080)
 2017-01-19 17:59:18 +09:00
Kihwal Lee 7d949cc432 HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger. 
(cherry picked from commit 706d630eb9)
 2017-01-17 15:13:56 -06:00
Steve Loughran e32cd52481 HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran 2017-01-11 17:15:01 +00:00
Junping Du 7706a63fb4 Preparing for 2.8.1 development after cutting off 2.8.0 branch. 2017-01-10 18:03:51 -08:00
Vinod Kumar Vavilapalli 9721735ce9 HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba. 
(cherry picked from commit 069c6c62de)
(cherry picked from commit 4041d2b49e)
 2017-01-05 13:23:47 -08:00
Masatake Iwasaki a631247c2a HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims) 
(cherry picked from commit 9eec6cbedc)
 2017-01-04 18:04:43 +00:00
Akira Ajisaka 58a1753373 HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang. 
(cherry picked from commit 01d31fe938)
(cherry picked from commit 3e2d26a97f)
 2017-01-04 14:20:04 +09:00
Mingliang Liu a58a1b55bf Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran" 
This reverts commit d61af93bef.
 2017-01-03 14:45:46 -08:00
Mingliang Liu d61af93bef HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit 451efb08fe)
 2017-01-03 13:09:53 -08:00
Brahma Reddy Battula b8be8f0d4f HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin. 2016-12-31 16:27:17 +05:30
Akira Ajisaka ae053df2d8 HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin. 
(cherry picked from commit f6e2521eb2)
(cherry picked from commit 897b4a6a77)
 2016-12-21 14:20:39 +09:00
Xiaoyu Yao 691a32c6f6 HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao. 
(cherry picked from commit f5e0bd30fd)
(cherry picked from commit 85083567be)
 2016-12-14 14:01:32 -08:00
Akira Ajisaka 901bc5eef5 HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin. 
(cherry picked from commit 72bff192cd)
(cherry picked from commit 190b2dca62)
 2016-12-14 18:54:39 +09:00
Xiaoyu Yao bd4e5bc501 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4c38f11cec)
 2016-12-09 21:38:42 -08:00
Wei-Chiu Chuang 983d487e98 HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge. 
(cherry picked from commit b606e025f1)

Conflicts:
   hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShell.java

(cherry picked from commit 6c93c1870c)
 2016-12-09 15:40:14 -08:00
Brahma Reddy Battula 3957161a97 HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin. 
(cherry picked from commit 80b8023276)
 2016-12-09 18:44:27 +05:30
Andrew Wang 092d0602c2 HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn. 
(cherry picked from commit 7b988e8899)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/util/GF256.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/KDiag.java

(cherry picked from commit 6bd600eef2)
 2016-12-05 23:21:17 -08:00
Xiao Chen 49f9e7cf71 HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge. 
(cherry picked from commit 291df5c7fb)
 2016-12-05 09:35:54 -08:00
Akira Ajisaka 129beeeddd HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 
(cherry picked from commit 00096dcc0c)
(cherry picked from commit 0c895e8a62)
 2016-11-29 19:51:38 +09:00
Robert Kanter 92ee5e2077 HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 
(cherry picked from commit 47ca9e26fb)
(cherry picked from commit 285edf691d)
 2016-11-28 18:23:23 -08:00
Brahma Reddy Battula 713d800e7b HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula. 
(cherry picked from commit ee3d437a33)
(cherry picked from commit 1c0fa25dc1)
 2016-11-25 20:20:37 +05:30
Steve Loughran 24715cefe8 HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli 2016-11-24 17:51:49 +00:00
Brahma Reddy Battula 1e25fd6b3b HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula. 
(cherry picked from commit 13501053dd)
 2016-11-24 22:25:36 +05:30
Mingliang Liu 834e2ddbab HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran 
(cherry picked from commit 2bf9a15e8a)
 2016-11-22 14:35:32 -08:00
Mingliang Liu ed9dcdae57 HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 2016-11-22 13:24:42 -08:00
Brahma Reddy Battula 9be7b353dd HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 
(cherry picked from commit afcf8d38e7)
 2016-11-22 20:36:32 +05:30
Akira Ajisaka 402606323a HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka. 
(cherry picked from commit c65d6b6541)
(cherry picked from commit d29e3d0f52)
 2016-11-21 11:29:00 +09:00
Mingliang Liu 416f6f3605 HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran 
(cherry picked from commit ae8849fe37)
 2016-11-17 14:27:34 -08:00
Kihwal Lee 0fb1306f93 HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula. 
(cherry picked from commit bd3735554f)
 2016-11-17 12:20:01 -06:00
Mingliang Liu c60ed3a3e4 HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula 
(cherry picked from commit aab9737a05)
 2016-11-16 20:11:10 -08:00
Xiao Chen cf366a0fd6 HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk. 
(cherry picked from commit 61c0bedf77)
(cherry picked from commit efc9ffc3b6)
 2016-11-15 16:26:59 -08:00