c1947a71ff
Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
...
This reverts commit c11c2ee649
2016-06-06 16:51:41 +08:00
c11c2ee649
Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
...
This reverts commit d316f44059
2016-06-03 18:11:12 -07:00
7d4c16bae9
Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
...
This reverts commit 7e0824faa9
2016-06-03 18:10:49 -07:00
071aeab585
Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."
...
This reverts commit 658072d62e
2016-06-03 18:10:49 -07:00
5bfadb8e6b
Revert "HADOOP-13226 Support async call retry and failover."
...
This reverts commit f7189d6a1c
2016-06-03 18:10:47 -07:00
03c4724c88
HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen.
...
(cherry picked from commit 713cb71820
2016-06-03 17:01:11 -07:00
5e6ee5aafb
HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu.
...
(cherry picked from commit d82bc85018
2016-06-03 16:38:38 -07:00
7f865bf438
YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du
...
(cherry picked from commit 99cc439e29
2016-06-03 11:11:20 -07:00
043a0c2e6c
HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran.
2016-06-03 08:56:07 -07:00
b6d5546e24
HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka)
2016-06-03 16:04:11 +09:00
3740974413
HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit aadb77e412
2016-06-02 20:59:40 +09:00
6843e55208
HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou.
...
(cherry picked from commit 99675e00df
2016-06-02 19:15:48 +09:00
55eda958cc
HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen.
...
(cherry picked from commit 35356de1ba
2016-06-01 13:13:28 -07:00
b29bf5d335
HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel)
2016-06-01 14:17:50 +01:00
a64e1425ed
HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe)
...
(cherry picked from commit 8ceb06e239
2016-05-31 18:05:28 -07:00
f7189d6a1c
HADOOP-13226 Support async call retry and failover.
2016-05-31 17:01:43 -07:00
cbf87869b8
HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit bca31fe276
2016-05-31 09:35:28 -07:00
001c8f5d7b
HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 4ca8859583
2016-05-27 18:48:55 -07:00
41c02757a5
HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang)
2016-05-26 22:54:07 -07:00
b4c8729cf9
HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha)
2016-05-26 14:39:07 -07:00
4c8ab5e162
HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang
2016-05-27 17:16:32 +08:00
afe603d973
HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha)
...
(cherry picked from commit 57c31a3fef
2016-05-24 16:34:45 -07:00
15f997cca6
HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran)
2016-05-21 14:19:56 +01:00
d38f2090fa
HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth.
...
(cherry picked from commit bcde1562d2
2016-05-20 12:47:52 -07:00
eb160561e0
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong.
2016-05-20 13:52:30 +01:00
658072d62e
HADOOP-13168. Support Future.get with timeout in ipc async calls.
2016-05-19 15:58:15 -07:00
2d846fdcbd
YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
...
(cherry picked from commit feb90ffcca
2016-05-19 13:02:05 -07:00
151ecdf26d
HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.
2016-05-19 14:44:44 +01:00
686691df60
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
2016-05-18 14:55:31 -07:00
42f64b3bcc
HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B.
...
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
2016-05-18 09:32:15 -07:00
feabfe9cda
HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe)
...
(cherry picked from commit f2c1d9181f
2016-05-18 09:19:45 -07:00
e9dd0d84e5
Revert "HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder."
...
This reverts commit e205421555
2016-05-18 17:57:46 +09:00
e205421555
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
...
(cherry picked from commit 7154ace712
2016-05-17 17:44:34 -07:00
937bc924cb
HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 9478484845744d5edc87
2016-05-17 15:51:47 -07:00
7f03c1c90e
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 9fe5828f05
2016-05-17 15:56:21 +09:00
9330a7b4de
HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee)
...
(cherry picked from commit 61f46be071
2016-05-16 18:59:19 -07:00
af70fc42e7
HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.
...
(cherry picked from commit a9a8297cad
2016-05-16 15:26:48 -07:00
8a316676b7
HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
...
(cherry picked from commit 1f2794b4fa
2016-05-13 10:02:47 -07:00
d6f6b99c83
HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
...
(cherry picked from commit 3bfd29949f
2016-05-12 23:48:58 -07:00
1370dfc775
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:23:31 +01:00
d6d13ec670
YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)
...
(cherry picked from commit 0bbe01f8d5
2016-05-12 10:14:24 -07:00
257b2f5beb
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:57:05 +01:00
15bfcde238
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
...
(cherry picked from commit 687233f20d
2016-05-11 14:02:03 -07:00
788f80b617
HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay)
2016-05-11 14:38:21 -04:00
31279ae45e
HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
...
(cherry picked from commit dee279b532
2016-05-11 10:58:42 -07:00
0ff3ec1f67
HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel)
2016-05-11 14:19:41 +01:00
eb4182f8f5
HADOOP-10694. Remove synchronized input streams from Writable deserialization. Contributed by Gopal V and Rajesh Balamohan.
...
(cherry picked from commit 6e56578031
2016-05-10 17:27:43 -07:00
de4daf9d22
YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts.
...
(cherry picked from commit 6b1c1cb01c
2016-05-10 21:37:24 +00:00
f47ea0cc3f
HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel)
2016-05-10 21:40:13 +01:00
092b199741
HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel).
2016-05-10 21:33:11 +01:00
7cbf306e4c
HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeStream javadoc. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit 0f0c6415af
2016-05-10 10:03:41 -07:00
e2216a96d7
HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 28023b7759
2016-05-10 09:49:00 -07:00
1d563f4d7e
HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge.
...
(cherry picked from commit 8ef75a702e
2016-05-06 17:23:31 -07:00
35859872b7
HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit dacd1f50fe
2016-05-05 18:15:32 -07:00
d18a991817
HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao)
...
(cherry picked from commit 4e5e87ddd4
2016-05-05 17:58:41 -07:00
b66b85094a
HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException
2016-05-05 15:50:50 -07:00
5b53833171
HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma)
...
(cherry picked from commit 1268cf5fbe
2016-05-04 17:04:44 -07:00
cb0a035bd1
HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor)
2016-05-04 09:49:51 -07:00
2d01ffaf24
HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang.
...
(cherry picked from commit 355325bcc7
2016-05-04 15:18:41 +09:00
a50dc05a60
HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri
...
(cherry picked from commit c1cc6ac667
2016-05-02 22:37:36 -07:00
7e0824faa9
HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou
2016-05-02 11:20:10 -07:00
b16c376c3b
HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
...
(cherry picked from commit 2beedead72
2016-05-02 09:43:42 -07:00
ac8fb579c6
Remove parent's env vars from child processes
2016-04-29 09:26:09 -07:00
7271e91b79
HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen.
2016-04-27 17:13:50 -07:00
4289cb8b36
HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
...
(cherry picked from commit 0a152103f1
2016-04-27 15:06:35 -07:00
14b8701a63
HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor)
2016-04-27 10:07:08 -07:00
9d3ddb0b4d
YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode
...
(cherry picked from commit 4beff01354
2016-04-26 21:02:04 -07:00
dba737f1e5
HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu)
2016-04-26 20:46:47 -07:00
c12fcbde44
HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang.
...
(cherry picked from commit 68b4564e78
2016-04-27 10:48:26 +09:00
d316f44059
HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou
2016-04-26 17:21:20 -07:00
5bceaa9683
HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims)
...
(cherry picked from commit bec5b4cd8c
2016-04-25 22:46:50 +09:00
88e1427a03
HDFS-9525. hadoop utilities need to support provided delegation tokens. Contributed by HeeSoo Kim
2016-04-23 20:50:56 -07:00
5949436010
HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor.
...
(cherry picked from commit c610031cab
2016-04-23 06:20:44 +09:00
d0718ed466
HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp.
...
(cherry picked from commit 9dbdc8e12d
2016-04-22 15:03:56 -05:00
edcb2a8410
HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel)
2016-04-22 11:24:50 +01:00
a0605ff002
HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers
2016-04-21 20:16:08 -07:00
5353289c8c
HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
...
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
2016-04-21 20:16:02 -07:00
432531dcf7
HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
...
(cherry picked from commit b4be288c5d
2016-04-21 10:19:35 -07:00
a2a65922dd
HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 5bd7b592e5
2016-04-20 23:11:42 -07:00
8d11a771b3
HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel
2016-04-15 17:43:52 +01:00
5ae74507c0
HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 6e6b6dd5aa
2016-04-15 14:15:33 +09:00
e124c3a2ae
HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel)
2016-04-14 12:45:10 +01:00
a59e05ad0a
HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel)
2016-04-14 10:35:20 +01:00
03bf09865f
HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor.
...
(cherry picked from commit 27b131e79c
2016-04-14 10:57:50 +09:00
d9d12b9e72
HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
...
(cherry picked from commit 042a3ae960
2016-04-13 17:42:28 -07:00
42040f706a
HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 8ced42daff
2016-04-13 16:42:55 -07:00
2b0b332e2f
HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
...
(cherry picked from commit 35f0770555
2016-04-12 16:29:15 -07:00
bb1ed426d1
HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang.
2016-04-12 15:28:05 +09:00
8f968171bd
HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran.
...
(cherry picked from commit a409508b3f
2016-04-12 14:55:25 +09:00
4041d2b49e
HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba.
...
(cherry picked from commit 069c6c62de
2016-04-11 12:03:39 -07:00
26a23eff82
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
...
(cherry picked from commit 843ee8d59d
2016-04-08 13:37:46 -07:00
c8797e0e39
HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel)
2016-04-08 12:59:01 +01:00
2f983b161f
HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen.
...
(cherry picked from commit 594c70f779
2016-04-07 23:50:36 -07:00
46352de1a2
HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou
2016-04-07 14:49:48 +08:00
d72db7d3aa
HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
2016-04-07 14:39:22 +08:00
aea518ef30
Addendum : HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B)
2016-04-07 14:33:48 +08:00
c2b271fe05
HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B
...
This closes #91
(cherry picked from commit 8d29e2451f
2016-04-07 10:17:43 +05:30
42bc565630
YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev
2016-04-06 16:14:13 -07:00
1371f993a9
HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer.
2016-04-06 17:43:31 +09:00
2542e9bccf
HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
...
(cherry picked from commit 85ec5573eb
2016-04-06 03:26:33 +09:00
Tsz-Wo Nicholas Sze
Andrew Wang
Chris Nauroth
Jian He
Akira Ajisaka
Masatake Iwasaki
Steve Loughran
Colin Patrick Mccabe
Xiaoyu Yao
Yongjun Zhang
Karthik Kambatla
Kai Zheng
Karthik Kambatla
Sangjin Lee
Jing Zhao
Larry McCay
Tsuyoshi Ozawa
Eric Payne
Harsh J
Ming Ma
Arpit Agarwal
Chris Douglas
Robert Kanter
Lei Xu
Ravi Prakash
Kihwal Lee
Vinod Kumar Vavilapalli
Suresh Srinivas
Vinayakumar B