Commit Graph

2915 Commits

Author SHA1 Message Date
Chris Douglas b5c8bac817 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri
(cherry picked from commit c1cc6ac667)
(cherry picked from commit a50dc05a60)
2016-05-02 22:38:08 -07:00
Xiaoyu Yao 643d2fd3c1 HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
(cherry picked from commit 5bd7b592e5)
(cherry picked from commit a2a65922dd)
2016-05-02 19:38:03 -07:00
Tsz-Wo Nicholas Sze a1ba6eee38 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:34:59 -07:00
Tsz-Wo Nicholas Sze bdc45bef64 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-02 11:34:22 -07:00
Lei Xu 5477c31c5c HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
(cherry picked from commit 0a152103f1)
(cherry picked from commit 4289cb8b36)
2016-05-02 10:21:59 -07:00
Colin Patrick Mccabe ef9e7a10e4 HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
(cherry picked from commit 2beedead72)
(cherry picked from commit b16c376c3b)
2016-05-02 09:44:07 -07:00
Robert Kanter 3c3d003402 Remove parent's env vars from child processes
(cherry picked from commit ac8fb579c6)
2016-04-29 15:30:06 -07:00
Andrew Wang 0d4fbf01be HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen.
(cherry picked from commit 7271e91b79)
2016-04-27 17:14:00 -07:00
Arpit Agarwal 7cd0177310 HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:07:20 -07:00
Arpit Agarwal b39e9efeeb HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:48:13 -07:00
Masatake Iwasaki b4ed3285a1 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang.
(cherry picked from commit 68b4564e78)
2016-04-27 11:05:56 +09:00
Masatake Iwasaki e01242edb4 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims)
(cherry picked from commit bec5b4cd8c)
2016-04-25 22:50:07 +09:00
Akira Ajisaka 9891f51829 HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor.
(cherry picked from commit c610031cab)
(cherry picked from commit 5949436010)
2016-04-23 06:21:03 +09:00
Kihwal Lee 989cd895e3 HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp.
(cherry picked from commit 9dbdc8e12d)
2016-04-22 15:06:25 -05:00
Steve Loughran 5df89f9a8a HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:24:24 +01:00
Larry McCay adf937fbc0 HADOOP-13011 - Clearly Document the Password Details for Keystore-based
Credential Providers
2016-04-21 20:04:29 -07:00
Steve Loughran 1dddf1ac8a HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2016-04-15 17:43:38 +01:00
Akira Ajisaka 71b7f1f85f HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi.
(cherry picked from commit 6e6b6dd5aa)
(cherry picked from commit 5ae74507c0)
2016-04-15 14:25:16 +09:00
Steve Loughran 302d499cf1 HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel)
(cherry picked from commit c329cab92c)
2016-04-15 14:20:11 +09:00
Steve Loughran 4d90014560 HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:26 +01:00
Steve Loughran 6b1f86f7f6 HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:04 +01:00
Akira Ajisaka 284718decc HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor.
(cherry picked from commit 27b131e79c)
(cherry picked from commit 03bf09865f)
2016-04-14 10:58:05 +09:00
Xiaoyu Yao df78ea84df HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao.
(cherry picked from commit 8ced42daff)
2016-04-13 16:43:45 -07:00
Colin Patrick Mccabe 59b0661c7f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
(cherry picked from commit 35f0770555)
(cherry picked from commit 2b0b332e2f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
2016-04-12 16:30:58 -07:00
Akira Ajisaka e2b8bdbe0a HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran.
(cherry picked from commit a409508b3f)
(cherry picked from commit 8f968171bd)
2016-04-12 14:55:42 +09:00
Chris Nauroth 1b5b85e560 HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
(cherry picked from commit 843ee8d59d)
(cherry picked from commit 26a23eff82)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
2016-04-08 13:44:27 -07:00
Andrew Wang bc148530d4 HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen.
(cherry picked from commit 594c70f779)
(cherry picked from commit 2f983b161f)
2016-04-07 23:51:19 -07:00
Tsz-Wo Nicholas Sze 413e5b4926 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:51:50 +08:00
Suresh Srinivas cbd10bfa8c HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
2016-04-07 14:47:04 +08:00
Akira Ajisaka e426d1bb3f HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer.
(cherry picked from commit 1371f993a9)
2016-04-06 17:44:54 +09:00
Masatake Iwasaki 886273e123 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
(cherry picked from commit 85ec5573eb)
2016-04-06 03:29:49 +09:00
Kihwal Lee f9764d073f HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit ef3da82357)
2016-04-05 09:16:51 -05:00
Arpit Agarwal 334beb337f HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:38 -07:00
Steve Loughran ab67b50543 HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:14 +01:00
Akira Ajisaka 7887fab815 HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
(cherry picked from commit a8d8b80a20)
(cherry picked from commit 80d122d7fe)
2016-04-01 14:01:14 +09:00
Xiaoyu Yao dc78250aa4 HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao.
(cherry picked from commit aac4d65bf9)
2016-03-31 15:44:19 -07:00
Xiaoyu Yao a0c001c0b9 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao.
(cherry picked from commit d95c6eb32c)
2016-03-31 08:58:46 -07:00
Akira Ajisaka 2d7084db20 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak.
(cherry picked from commit acca149ec9)
(cherry picked from commit b4fbc22688)
2016-03-31 16:06:03 +09:00
Zhe ZHang 2da1194699 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 9216993b02)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
2016-03-30 14:19:29 -07:00
Colin Patrick Mccabe 28c81640d3 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
(cherry picked from commit e3d15a2e23)
(cherry picked from commit 9df2e54160)
2016-03-29 17:15:31 -07:00
Arpit Agarwal 9c4631b6f1 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:25 -07:00
Andrew Wang cb79533777 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
(cherry picked from commit 8bfaa80037)
(cherry picked from commit a61a90c562)
2016-03-28 14:14:07 -07:00
Akira Ajisaka b029011a23 HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 01cfee6381)
(cherry picked from commit 42d312663f)
2016-03-28 15:58:40 +09:00
Jason Lowe 25b476e93b HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
(cherry picked from commit 9a09200a1f)
2016-03-25 23:00:18 +00:00
Andrew Wang d2c33ba61e HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen.
(cherry picked from commit d4df7849a5)
(cherry picked from commit c58599acba)
2016-03-25 15:29:09 -07:00
Andrew Wang e0dad0b53a HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 938222b2e2)
(cherry picked from commit daf24eeb6b)
2016-03-23 14:57:32 -07:00
Benoy Antony 1b263ea490 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay.
(cherry picked from commit e7ed05e4f5)
2016-03-21 13:31:55 -07:00
Andrew Wang ea44650a64 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
(cherry picked from commit e3bb38d625)
(cherry picked from commit e826d860a7)
2016-03-21 11:40:26 -07:00
Haohui Mai 88e7466c4b HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:43:10 -07:00
Tsz-Wo Nicholas Sze d59c2c4518 HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:55:20 -07:00