Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,282 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3275 Commits

Author SHA1 Message Date
Vinayakumar B 3bf5379adb HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma) 
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
(cherry picked from commit 06b76f1586)
 2016-06-14 15:59:36 +05:30
Akira Ajisaka 8295351e54 HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 
(cherry picked from commit e3ba9ad3f1)
(cherry picked from commit d219550e8b)
 2016-06-14 10:24:53 +09:00
Andrew Wang 08ff8d7482 HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 
(cherry picked from commit 0accc3306d)
(cherry picked from commit 6a8d3233fc)
 2016-06-13 11:44:08 -07:00
Akira Ajisaka f5cdf94725 HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis. 
This closes #97.

(cherry picked from commit 8a1dccecce)
(cherry picked from commit 035eea4d12)
 2016-06-11 03:33:40 +09:00
Wangda Tan 9436548152 YARN-3426. Add jdiff support to YARN. (vinodkv via wangda) 2016-06-10 09:56:18 -07:00
Steve Loughran faf9a9f4e0 HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:58:30 +01:00
Steve Loughran 7e09601a90 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:51 +01:00
Junping Du 333490ba45 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 
(cherry picked from commit c14c1b298e)
(cherry picked from commit 19eb997f67)
 2016-06-07 09:26:05 -07:00
Tsz-Wo Nicholas Sze 49535c0683 Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 886e239606.
 2016-06-06 16:54:02 +08:00
Tsz-Wo Nicholas Sze c949001eee Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 308d28640d.
 2016-06-06 16:53:41 +08:00
Tsz-Wo Nicholas Sze 8ccc8aeb6c Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 8a07026e77.
 2016-06-06 16:53:31 +08:00
Tsz-Wo Nicholas Sze 2cf663bb59 Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit d740a90260.
 2016-06-06 16:53:24 +08:00
Andrew Wang d740a90260 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit bdc45bef64.
 2016-06-03 18:17:33 -07:00
Andrew Wang 8a07026e77 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit a1ba6eee38.
 2016-06-03 18:17:33 -07:00
Andrew Wang 308d28640d Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit fa7c7f2510.
 2016-06-03 18:12:31 -07:00
Andrew Wang 886e239606 Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit a8941d7790.
 2016-06-03 18:12:30 -07:00
Andrew Wang d712b2ee3b HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 713cb71820)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java

(cherry picked from commit 03c4724c88)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
 2016-06-03 17:03:40 -07:00
Chris Nauroth e54f073cfe HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 
(cherry picked from commit d82bc85018)
(cherry picked from commit 5e6ee5aafb)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestLdapGroupsMapping.java
 2016-06-03 16:40:48 -07:00
Jian He 3c2bd19fa5 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du 
(cherry picked from commit 99cc439e29)
 2016-06-03 11:11:49 -07:00
Chris Nauroth b8216c10d8 HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran. 2016-06-03 08:56:36 -07:00
Akira Ajisaka d0dc5aaa2d HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 
(cherry picked from commit b6d5546e24)
 2016-06-03 16:04:40 +09:00
Masatake Iwasaki 5b3d9ca0cd HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 
(cherry picked from commit aadb77e412)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit 3740974413)
 2016-06-02 21:04:48 +09:00
Akira Ajisaka f7e1a1eaa7 HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou. 
(cherry picked from commit 99675e00df)
(cherry picked from commit 6843e55208)
 2016-06-02 19:15:57 +09:00
Andrew Wang 4ad9ca85fb HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 35356de1ba)
(cherry picked from commit 55eda958cc)
 2016-06-01 13:13:38 -07:00
Steve Loughran 809e359d2d HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel) 2016-06-01 14:17:18 +01:00
Colin Patrick Mccabe 6fe1c67fa1 HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 8ceb06e239)
(cherry picked from commit a64e1425ed)
 2016-05-31 18:26:37 -07:00
Tsz-Wo Nicholas Sze a8941d7790 HADOOP-13226 Support async call retry and failover. 2016-05-31 17:16:44 -07:00
Jing Zhao 03c4491d89 HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze. 2016-05-31 17:16:26 -07:00
Andrew Wang 63f73d78a1 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit bca31fe276)
 2016-05-31 09:35:30 -07:00
Xiaoyu Yao 1d2928ece7 HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4ca8859583)
(cherry picked from commit 001c8f5d7b)
 2016-05-27 18:51:46 -07:00
Tsz-Wo Nicholas Sze fa7c7f2510 HADOOP-13168. Support Future.get with timeout in ipc async calls. 2016-05-26 12:22:57 -07:00
Steve Loughran f2aef95bd3 HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran) 2016-05-21 14:20:19 +01:00
Chris Nauroth 877af3ec7e HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth. 
(cherry picked from commit bcde1562d2)
(cherry picked from commit d38f2090fa)
 2016-05-20 12:50:23 -07:00
Steve Loughran f32b37ec89 HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong. 2016-05-20 13:51:56 +01:00
Jian He 61fa9256c5 YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong 
(cherry picked from commit feb90ffcca)
 2016-05-19 13:02:24 -07:00
Steve Loughran 7a001ae19b HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel. 2016-05-19 14:47:46 +01:00
Andrew Wang 64e75c34a3 HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder. 2016-05-18 14:57:17 -07:00
Chris Nauroth 4ce5a58ca9 HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B. 
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
(cherry picked from commit 42f64b3bcc)
 2016-05-18 09:32:24 -07:00
Colin Patrick Mccabe 7bbf42b82f HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe) 
(cherry picked from commit f2c1d9181f)
(cherry picked from commit feabfe9cda)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
 2016-05-18 09:20:31 -07:00
Xiaoyu Yao 744d5edc87 HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9478484845)
 2016-05-17 15:44:28 -07:00
Akira Ajisaka 388b2010ae HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi. 
(cherry picked from commit 9fe5828f05)
(cherry picked from commit 7f03c1c90e)
 2016-05-17 15:56:36 +09:00
Sangjin Lee 29699d8e7e HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale) 
(cherry picked from commit 1f2794b4fa)
 2016-05-13 10:03:06 -07:00
Andrew Wang 5da54eb3d4 HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu. 
(cherry picked from commit 3bfd29949f)
(cherry picked from commit d6f6b99c83)
 2016-05-12 23:49:00 -07:00
Steve Loughran 8d74a58042 HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel 
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
 2016-05-12 19:23:18 +01:00
Steve Loughran af5e5d6d47 HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel. 2016-05-12 13:56:48 +01:00
Colin Patrick Mccabe 5f04795aed HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe) 
(cherry picked from commit 687233f20d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java

(cherry picked from commit 15bfcde238)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
 2016-05-11 14:24:51 -07:00
Varun Vasudev 4d275d0a25 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana. 
(cherry picked from commit d37eb828ff)
(cherry picked from commit 2451a0a8e0)
 2016-05-11 14:12:18 -07:00
Larry McCay ee2c2afdc3 HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay) 2016-05-11 14:39:13 -04:00
Chris Nauroth e9ee258d04 HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay. 
(cherry picked from commit dee279b532)
(cherry picked from commit 31279ae45e)
 2016-05-11 10:58:56 -07:00
Steve Loughran ed2230ec7d HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel) 2016-05-11 14:19:12 +01:00
Eric Payne 235caef236 YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts. 
(cherry picked from commit 6b1c1cb01c)
 2016-05-10 21:45:37 +00:00
Steve Loughran 11b170adc8 HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel) 2016-05-10 21:40:23 +01:00
Steve Loughran d13cd394e5 HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel). 2016-05-10 21:33:26 +01:00
Andrew Wang 8653bcbe67 HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge. 
(cherry picked from commit 8ef75a702e)
 2016-05-06 17:26:51 -07:00
Xiaoyu Yao 59eeee7501 HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit dacd1f50fe)
(cherry picked from commit 35859872b7)
 2016-05-05 18:23:00 -07:00
Xiaoyu Yao 4d0b19eec2 HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao) 
(cherry picked from commit 4e5e87ddd4)
 2016-05-05 18:01:38 -07:00
Tsz-Wo Nicholas Sze 9daa36b8ea HDFS-10346: add org.apache.hadoop.util.StringUtils import. 2016-05-05 15:58:06 -07:00
Tsz-Wo Nicholas Sze 528240f593 HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 15:53:51 -07:00
Ming Ma d6e95ae47b HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 
(cherry picked from commit 1268cf5fbe)
 2016-05-04 17:07:36 -07:00
Masatake Iwasaki d53121da36 HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang. 
(cherry picked from commit 355325bcc7)
 2016-05-04 15:22:55 +09:00
Chris Douglas b5c8bac817 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri 
(cherry picked from commit c1cc6ac667)
(cherry picked from commit a50dc05a60)
 2016-05-02 22:38:08 -07:00
Xiaoyu Yao 643d2fd3c1 HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 
(cherry picked from commit 5bd7b592e5)
(cherry picked from commit a2a65922dd)
 2016-05-02 19:38:03 -07:00
Tsz-Wo Nicholas Sze a1ba6eee38 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:34:59 -07:00
Tsz-Wo Nicholas Sze bdc45bef64 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-02 11:34:22 -07:00
Lei Xu 5477c31c5c HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 0a152103f1)
(cherry picked from commit 4289cb8b36)
 2016-05-02 10:21:59 -07:00
Colin Patrick Mccabe ef9e7a10e4 HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 2beedead72)
(cherry picked from commit b16c376c3b)
 2016-05-02 09:44:07 -07:00
Robert Kanter 3c3d003402 Remove parent's env vars from child processes 
(cherry picked from commit ac8fb579c6)
 2016-04-29 15:30:06 -07:00
Andrew Wang 0d4fbf01be HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen. 
(cherry picked from commit 7271e91b79)
 2016-04-27 17:14:00 -07:00
Arpit Agarwal 7cd0177310 HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:07:20 -07:00
Arpit Agarwal b39e9efeeb HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:48:13 -07:00
Masatake Iwasaki b4ed3285a1 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang. 
(cherry picked from commit 68b4564e78)
 2016-04-27 11:05:56 +09:00
Masatake Iwasaki e01242edb4 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims) 
(cherry picked from commit bec5b4cd8c)
 2016-04-25 22:50:07 +09:00
Akira Ajisaka 9891f51829 HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor. 
(cherry picked from commit c610031cab)
(cherry picked from commit 5949436010)
 2016-04-23 06:21:03 +09:00
Kihwal Lee 989cd895e3 HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d)
 2016-04-22 15:06:25 -05:00
Steve Loughran 5df89f9a8a HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:24:24 +01:00
Larry McCay adf937fbc0 HADOOP-13011 - Clearly Document the Password Details for Keystore-based 
Credential Providers
 2016-04-21 20:04:29 -07:00
Steve Loughran 1dddf1ac8a HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2016-04-15 17:43:38 +01:00
Akira Ajisaka 71b7f1f85f HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi. 
(cherry picked from commit 6e6b6dd5aa)
(cherry picked from commit 5ae74507c0)
 2016-04-15 14:25:16 +09:00
Steve Loughran 302d499cf1 HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel) 
(cherry picked from commit c329cab92c)
 2016-04-15 14:20:11 +09:00
Steve Loughran 4d90014560 HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:26 +01:00
Steve Loughran 6b1f86f7f6 HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:04 +01:00
Akira Ajisaka 284718decc HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor. 
(cherry picked from commit 27b131e79c)
(cherry picked from commit 03bf09865f)
 2016-04-14 10:58:05 +09:00
Xiaoyu Yao df78ea84df HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8ced42daff)
 2016-04-13 16:43:45 -07:00
Colin Patrick Mccabe 59b0661c7f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe) 
(cherry picked from commit 35f0770555)
(cherry picked from commit 2b0b332e2f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2016-04-12 16:30:58 -07:00
Akira Ajisaka e2b8bdbe0a HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran. 
(cherry picked from commit a409508b3f)
(cherry picked from commit 8f968171bd)
 2016-04-12 14:55:42 +09:00
Chris Nauroth 1b5b85e560 HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran. 
(cherry picked from commit 843ee8d59d)
(cherry picked from commit 26a23eff82)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
 2016-04-08 13:44:27 -07:00
Andrew Wang bc148530d4 HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen. 
(cherry picked from commit 594c70f779)
(cherry picked from commit 2f983b161f)
 2016-04-07 23:51:19 -07:00
Tsz-Wo Nicholas Sze 413e5b4926 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:51:50 +08:00
Suresh Srinivas cbd10bfa8c HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
 2016-04-07 14:47:04 +08:00
Akira Ajisaka e426d1bb3f HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer. 
(cherry picked from commit 1371f993a9)
 2016-04-06 17:44:54 +09:00
Masatake Iwasaki 886273e123 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 85ec5573eb)
 2016-04-06 03:29:49 +09:00
Kihwal Lee f9764d073f HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit ef3da82357)
 2016-04-05 09:16:51 -05:00
Arpit Agarwal 334beb337f HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:38 -07:00
Steve Loughran ab67b50543 HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:14 +01:00
Akira Ajisaka 7887fab815 HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula. 
(cherry picked from commit a8d8b80a20)
(cherry picked from commit 80d122d7fe)
 2016-04-01 14:01:14 +09:00
Xiaoyu Yao dc78250aa4 HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao. 
(cherry picked from commit aac4d65bf9)
 2016-03-31 15:44:19 -07:00
Xiaoyu Yao a0c001c0b9 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao. 
(cherry picked from commit d95c6eb32c)
 2016-03-31 08:58:46 -07:00
Akira Ajisaka 2d7084db20 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak. 
(cherry picked from commit acca149ec9)
(cherry picked from commit b4fbc22688)
 2016-03-31 16:06:03 +09:00
Zhe ZHang 2da1194699 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 9216993b02)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
 2016-03-30 14:19:29 -07:00
Colin Patrick Mccabe 28c81640d3 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe) 
(cherry picked from commit e3d15a2e23)
(cherry picked from commit 9df2e54160)
 2016-03-29 17:15:31 -07:00
Arpit Agarwal 9c4631b6f1 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:25 -07:00
Andrew Wang cb79533777 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge. 
(cherry picked from commit 8bfaa80037)
(cherry picked from commit a61a90c562)
 2016-03-28 14:14:07 -07:00
Akira Ajisaka b029011a23 HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 01cfee6381)
(cherry picked from commit 42d312663f)
 2016-03-28 15:58:40 +09:00
Jason Lowe 25b476e93b HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f)
 2016-03-25 23:00:18 +00:00
Andrew Wang d2c33ba61e HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen. 
(cherry picked from commit d4df7849a5)
(cherry picked from commit c58599acba)
 2016-03-25 15:29:09 -07:00
Andrew Wang e0dad0b53a HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 938222b2e2)
(cherry picked from commit daf24eeb6b)
 2016-03-23 14:57:32 -07:00
Benoy Antony 1b263ea490 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 
(cherry picked from commit e7ed05e4f5)
 2016-03-21 13:31:55 -07:00
Andrew Wang ea44650a64 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d625)
(cherry picked from commit e826d860a7)
 2016-03-21 11:40:26 -07:00
Haohui Mai 88e7466c4b HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:43:10 -07:00
Tsz-Wo Nicholas Sze d59c2c4518 HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:55:20 -07:00
Colin Patrick Mccabe ffa9f2db70 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe) 
(cherry picked from commit 6e9a582eb1)
(cherry picked from commit b67b5b09a7)
 2016-03-11 12:27:32 -08:00
Steve Loughran a44eec1fde Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit 0d3272b54e.
 2016-03-11 16:59:59 +00:00
Masatake Iwasaki 0d3272b54e HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 682adc6ba9)
 2016-03-11 15:08:23 +09:00
Allen Wittenauer a7164e90bf HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 
(cherry picked from commit 55f73a1cbd)
(cherry picked from commit 95d30a6ec6)
 2016-03-09 19:39:31 -08:00
Allen Wittenauer 095b485e48 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 
(cherry picked from commit d759b4bd74)
(cherry picked from commit 140a33df9b)
 2016-03-09 19:39:28 -08:00
Colin Patrick Mccabe 56ab796094 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019)
(cherry picked from commit 5998b20d63)
 2016-03-09 16:38:15 -08:00
Allen Wittenauer 8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 81a7ad45c9.
 2016-03-09 09:59:33 -08:00
Arpit Agarwal 0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Akira Ajisaka 65769fbf3c HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d)
 2016-03-09 15:33:25 +09:00
Chris Nauroth a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68)
 2016-03-08 21:23:07 -08:00
Akira Ajisaka 2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544)
(cherry picked from commit 0586386472)
 2016-03-08 14:30:01 +09:00
Arpit Agarwal a63f1039f9 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:42 -08:00
Ming Ma 47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff0)
 2016-03-07 20:32:32 -08:00
Andrew Wang 352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 
(cherry picked from commit 391da36d93)
(cherry picked from commit fed2339e28)
 2016-03-07 14:00:15 -08:00
Chris Nauroth d5134dadbc HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 
(cherry picked from commit 2759689d7d)
(cherry picked from commit 592f161e13)
 2016-03-04 15:30:37 -08:00
Masatake Iwasaki 9d551a3adf HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

(cherry picked from commit 722182fdfb)
 2016-03-04 14:13:30 +09:00
Andrew Wang c6e37f6782 HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:03:13 -08:00
Allen Wittenauer a9f041d694 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 
(cherry picked from commit 8cecad2d56)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml

(cherry picked from commit b0d3b0c1f8)
 2016-03-03 20:58:56 -08:00
Akira Ajisaka 833d84ab58 HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0a9f00af5e)
(cherry picked from commit 899715a15e)
 2016-03-03 23:33:01 +09:00
Akira Ajisaka b4710b5052 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c3136cbd8)
(cherry picked from commit 96a0939d5b)
 2016-03-03 23:23:27 +09:00
Akira Ajisaka 85a62dcb5b HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 
(cherry picked from commit eb864d35d6)
(cherry picked from commit 9e87f59dea)
 2016-03-03 18:52:05 +09:00
Masatake Iwasaki 64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317ccc)
 2016-03-03 17:15:09 +09:00
Chris Nauroth f563c53535 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f98dff329b)
(cherry picked from commit bce33b5179)
 2016-03-01 13:19:03 -08:00
Akira Ajisaka aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 
(cherry picked from commit 67e8489ac6)
 2016-03-02 00:22:29 +09:00
Chris Nauroth f1236c5d7c HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay. 
(cherry picked from commit d251e55415)
(cherry picked from commit e402371b6a)
 2016-02-29 22:00:41 -08:00
Jian He 07623aa941 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 
(cherry picked from commit d8f390d015)
 2016-02-29 16:25:00 -08:00
Haohui Mai 69b195d619 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:15:25 -08:00
Masatake Iwasaki c7824e8e9e HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims) 
(cherry picked from commit 809ebc0b14)
 2016-02-29 18:26:09 +09:00
Suresh Srinivas 2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
(cherry picked from commit fca24fbbaa)
 2016-02-29 11:36:18 +09:00
Chris Nauroth 60611c9c75 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay. 
(cherry picked from commit 7634d404b7)
(cherry picked from commit 2e761dabd8)
 2016-02-28 11:23:09 -08:00
Li Lu 8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9) 
(cherry-picked from commit 7545ce6636)
 2016-02-27 22:04:23 -08:00
Steve Loughran 6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Chris Nauroth d55863de0f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit 798babf661)
(cherry picked from commit c692d7c52f)
 2016-02-26 21:59:20 -08:00
Suresh Srinivas cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
 2016-02-27 01:26:31 +09:00
Masatake Iwasaki 7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit b0091338f2)
 2016-02-26 15:33:21 +09:00
Xiaoyu Yao 6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00
cnauroth d4bbdd9d28 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao. 
(cherry picked from commit d6b181c6fa)
(cherry picked from commit ef9131fbcddc01a9d8cb3dfd0a729ed9d17d788e)
 2016-02-24 13:56:12 -08:00
cnauroth 8ad907f06a HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty. 
(cherry picked from commit 3369a4f691)
(cherry picked from commit 9ea19a861f)
 2016-02-23 21:38:01 -08:00
cnauroth 606547dbd2 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 
(cherry picked from commit 27b77751c1)
(cherry picked from commit a5511debdb)
 2016-02-22 17:30:53 -08:00
Zhe Zhang 6d4a4e785b HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
 2016-02-22 14:15:11 -08:00
cnauroth 746d669847 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki. 
(cherry picked from commit d4f5fc23b2)
(cherry picked from commit 3f14eed580)
 2016-02-22 13:39:57 -08:00
Junping Du e3ed99cfe0 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala. 
(cherry picked from commit 18f9b77a32)
(cherry picked from commit e38c2ef6c5)
(cherry picked from commit 78a4c34894)
 2016-02-19 14:34:56 -08:00
Yongjun Zhang 62ba1e415a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a963baba10)
 2016-02-19 09:58:09 -08:00
cnauroth 49602ef580 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 
(cherry picked from commit 8ab7658025)
(cherry picked from commit b4c4f30fa4)
 2016-02-18 14:07:15 -08:00
Tsz-Wo Nicholas Sze 207ed9601f HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:59:58 -08:00
cnauroth e5c8a34446 HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit 779a69e28d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-02-18 10:16:06 -08:00
cnauroth 2e047429be HADOOP-12691. Move files to correct location. 
(cherry picked from commit da77f423d1)
(cherry picked from commit 2b9ea68ef8)
 2016-02-18 10:15:31 -08:00
Xiaoyu Yao 5ff2012f64 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 
(cherry picked from commit fe5624b85d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java

(cherry picked from commit ad4fcd1f9f)
 2016-02-17 16:05:24 -08:00
Zhe Zhang 64d39b83cc HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz) 
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
 2016-02-17 13:32:18 -08:00
cnauroth 26ce37a1a6 HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay. 
(cherry picked from commit 76fab26c5c)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java

(cherry picked from commit 6731bb468d)
 2016-02-17 12:20:49 -08:00
Xiaoyu Yao 5953421544 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao. 
(cherry picked from commit fd1befb6ba)
 2016-02-17 08:47:30 -08:00
Vinayakumar B e88c01fa58 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea309431)
(cherry picked from commit 2bf5a005fa)
 2016-02-17 10:15:43 +05:30
Vinayakumar B 8d6fb15b03 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 
(cherry picked from commit 4b0e59fdc0)
(cherry picked from commit e79a5e4460)
 2016-02-16 17:33:44 +05:30
Akira Ajisaka bb02c3c803 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 
(cherry picked from commit 1c48e50ce7)
(cherry picked from commit a670165bbd)
 2016-02-15 11:39:09 +09:00
Junping Du aed60ae0bf Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48)
(cherry picked from commit a28be9edc7)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-13 01:48:50 -08:00
Masatake Iwasaki e0fccc9c94 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims) 
(cherry picked from commit 36ba5cac37)
 2016-02-13 15:02:15 +09:00
cnauroth b846401307 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty. 
(cherry picked from commit 91a96eaa53)
(cherry picked from commit ac5a793590)
 2016-02-12 15:50:28 -08:00
Arpit Agarwal 8c1cf718aa HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:20 -08:00
Vinayakumar B 26934cf6c7 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit c78740a979)
(cherry picked from commit 488e6cbe16)
 2016-02-12 11:56:00 +05:30
Andrew Wang 9afa321fd2 HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen. 
(cherry picked from commit 8fdef0bd9d)
(cherry picked from commit fb57c01eaa)
 2016-02-11 17:21:55 -08:00
cnauroth ddd82d24be HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth. 
(cherry picked from commit 70c756d35e)
(cherry picked from commit 25dcb88630)
 2016-02-11 16:53:21 -08:00
Zhe Zhang 66a19d675e Add HADOOP-12764 to CHANGES.txt. 
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
 2016-02-11 09:35:06 -08:00
Zhe Zhang 9023751de6 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz) 
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
 2016-02-11 09:29:45 -08:00
Uma Maheswara Rao G 4324a3d012 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit df4dcd3e75)
 2016-02-10 15:07:33 -08:00
Jason Lowe cad1436570 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger 
(cherry picked from commit 6f03959e4d)
 2016-02-10 21:55:53 +00:00
Sangjin Lee 13bb016ba9 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 
(cherry picked from commit 58acbf940a)
 2016-02-08 13:59:10 -08:00
cnauroth 44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran. 
(cherry picked from commit cf3261570a)
(cherry picked from commit a76611d4ec)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-02-08 09:36:58 -08:00
Steve Loughran f4bcc76df6 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:17:30 +00:00
cnauroth be115634f2 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran. 
(cherry picked from commit cfa8513890)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

(cherry picked from commit 4db6cc44cd)
 2016-02-05 15:52:26 -08:00
cnauroth e01d8393b6 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay. 
(cherry picked from commit a37e423e84)
(cherry picked from commit 5752df2362)
 2016-02-05 14:38:40 -08:00
Kihwal Lee 150240cce0 HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla. 
(cherry picked from commit 49e176c29f)
 2016-02-05 15:48:32 -06:00
Colin Patrick Mccabe 4fb2a098f4 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe) 
(cherry picked from commit 9086dd58c3)
(cherry picked from commit 86760c0f52)
 2016-02-05 10:58:39 -08:00
Xiaoyu Yao 740a1385d2 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou. 
(cherry picked from commit 5d00067ca7)
 2016-02-05 10:41:02 -08:00
Xuan acd90c6819 YARN-4662. Document some newly added metrics. Contributed by Jian He 
(cherry picked from commit 63c63e298c)
(cherry picked from commit dfad608b22)
 2016-02-03 20:06:57 -08:00
Sangjin Lee b49ac969bc HADOOP-12761. incremental maven build is not really incremental (sjlee) 
(cherry picked from commit 4dc0a39493)
 2016-02-03 09:02:02 -08:00
Junping Du 847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Andrew Wang 1d15c90233 HADOOP-12755. Fix typo in defaultFS warning message. 
(cherry picked from commit 8171874dd1)
(cherry picked from commit b4ad58796b)
 2016-02-02 11:57:00 -08:00
Colin Patrick Mccabe bc00b8ce9e HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe) 
(cherry picked from commit 2e8ab3d465)
(cherry picked from commit b94fbdf6f0)
 2016-01-27 11:40:59 -08:00
Yongjun Zhang 62206dd2ed HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 97056c3355)
 2016-01-27 08:05:33 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40)
 2016-01-25 15:47:39 -08:00
Walter Su 26673b312d HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 6eacdea0e4)
 2016-01-25 19:43:21 +08:00
Akira Ajisaka c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a)
(cherry picked from commit 38ec290455)
 2016-01-25 14:00:03 +09:00
Akira Ajisaka d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 736eb17a79)
(cherry picked from commit 4edd7bd820)
 2016-01-25 13:48:46 +09:00
Kihwal Lee 330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 
(cherry picked from commit b5db1d4410)
 2016-01-22 09:20:39 -06:00
Akira Ajisaka 2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki. 
(cherry picked from commit 0bae506c22)
(cherry picked from commit 6368d102b9)
 2016-01-22 21:09:23 +09:00
Xiaoyu Yao 67f711edba HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu. 
(cherry picked from commit f3427d3766)
 2016-01-21 13:56:09 -08:00
Akira Ajisaka 68509ae839 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey. 
(cherry picked from commit 2ac39ca762)
(cherry picked from commit cd5c66b080)
 2016-01-22 02:46:04 +09:00
Vinayakumar B a02fab85ee HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal) 
(cherry picked from commit 446987e20a)
(cherry picked from commit c13929b385)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-21 20:14:31 +05:30
Colin Patrick Mccabe de5175d216 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 
(cherry picked from commit b2c155f810)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/CompileMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/TestMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/util/Exec.java
 2016-01-21 16:04:05 +05:30
Lei Xu b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
 2016-01-20 14:35:59 -08:00
Ravi Prakash a359dc87d4 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano 
(cherry picked from commit 1acc509b45)
(cherry picked from commit 2cbb8bbd72)
 2016-01-19 14:01:51 -08:00
Wangda Tan 5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 
(cherry picked from commit 89d1fd5dac)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-19 21:31:35 +08:00
Akira Ajisaka ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 
(cherry picked from commit 92c5f565fd)
(cherry picked from commit 3a8d372518)
 2016-01-19 13:32:54 +09:00
cnauroth ffc0d98886 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth. 
(cherry picked from commit 8bc93db2e7)
(cherry picked from commit 62d6166211)
 2016-01-18 09:13:31 -08:00
cnauroth 23d729f841 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay. 
(cherry picked from commit 06f4ac0ccd)
(cherry picked from commit 9600736d89)
 2016-01-18 09:09:56 -08:00
Ravi Prakash 5468c40fe7 HADOOP-12689. S3 filesystem operations stopped working correctly 
(cherry picked from commit 2d16f40dab)
(cherry picked from commit 6330683778)
 2016-01-15 15:19:15 -08:00
Akira Ajisaka 8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge. 
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b53173)
 2016-01-15 10:58:20 +09:00
Akira Ajisaka 91c1736b7a Correct the section of HADOOP-12590 in CHANGES.txt. 2016-01-15 10:53:16 +09:00
Steve Loughran 1fc36b824c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 
(cherry picked from commit 80734bc346)
 2016-01-15 10:41:56 +09:00
Jason Lowe 4ab508ead4 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 
(cherry picked from commit cdf8895259)
 2016-01-14 23:48:12 +00:00
Jason Lowe fe77cb1df0 Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6 
(cherry picked from commit 651c23e8ef)
 2016-01-14 23:43:09 +00:00
Benoy Antony 6cfeb84a36 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-14 14:42:04 -08:00
Yongjun Zhang a7d33b934a Revert "HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge." 
This reverts commit b3fa190297.
 2016-01-14 13:06:03 -08:00
Akira Ajisaka b3fa190297 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge. 
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit 722d9e569ee6891e71274e758474063f25f5babf)
 2016-01-15 00:32:07 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa) 
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753da)
 2016-01-13 14:56:35 -08:00
cnauroth c3f4cb927a HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
(cherry picked from commit 2605e78e44)
 2016-01-12 15:42:00 -08:00
Lei Xu 39f07295fb HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) 
(cherry picked from commit 126705f67e)
 2016-01-12 12:21:00 -08:00
Akira Ajisaka 3fced13eae HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
(cherry picked from commit 6f80be98758ff5d53a192f86ada6cc4062fcdef8)
 2016-01-12 13:35:03 +09:00
cnauroth e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth. 
(cherry picked from commit 0e76f1fcea)
(cherry picked from commit 813841e10b)
 2016-01-09 22:18:30 -08:00
cnauroth f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f0fa6d869b)
(cherry picked from commit debd13387d)
 2016-01-08 20:19:18 -08:00
Steve Loughran 092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
cnauroth 506a517f9f HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade. 
(cherry picked from commit 978bbdfeb2)
(cherry picked from commit 4753676a34)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-06 11:17:01 -08:00
Yongjun Zhang f372d3faae HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang) 
(cherry picked from commit 28bd138018)
 2016-01-05 11:19:39 -08:00
Uma Mahesh 68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 
(cherry picked from commit 778146eaae)
 2016-01-04 15:14:14 -08:00
Akira Ajisaka a319df412f HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi. 
(cherry picked from commit 1af2917856)
(cherry picked from commit 40b41ac8fc)
 2016-01-04 20:33:57 +09:00
Akira Ajisaka 22ac1a1ac0 Set release date for 2.6.3 
(cherry picked from commit db99e30f67)
(cherry picked from commit 247ab92464)
 2016-01-04 16:13:06 +09:00
Akira Ajisaka 13a48f6256 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2e)
(cherry picked from commit d98cfe611f)
 2016-01-04 14:32:21 +09:00
Xiaoyu Yao c16e126d16 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth. 
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
 2015-12-30 11:16:06 -08:00
Xiaoyu Yao a48fdc1907 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit ab725cff66)
 2015-12-30 10:44:13 -08:00
Xiaoyu Yao beec7a2efb HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang. 
(cherry picked from commit 993311e547)
 2015-12-28 10:47:20 -08:00
Akira Ajisaka c60792e6e5 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki. 
(cherry picked from commit babe025fb0)
 2015-12-28 14:39:51 +09:00
Akira Ajisaka 1cd85efd71 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6)
(cherry picked from commit 7526a2a005)
 2015-12-21 21:23:40 +09:00
Chris Douglas 4150d08a4b HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri 
(cherry picked from commit 8652cce5b2)
(cherry picked from commit d984ba4fd7)
 2015-12-18 18:31:36 -08:00
cnauroth d6f1d3b6ca HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 
(cherry picked from commit 932956458d)
(cherry picked from commit dd91cf9fa5)
 2015-12-18 16:54:36 -08:00
Xiaoyu Yao f3ee0e7857 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 
(cherry picked from commit cbc7b6bf97)
(cherry picked from commit eb7f9901b4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:43 -08:00
Jian He f355645ca4 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan 
(cherry picked from commit 755dda8dd8)

(cherry picked from commit be404e1680)
 2015-12-18 16:34:42 -08:00
Arpit Agarwal cef21b7aaa HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:08:22 -08:00
Zhe Zhang 65effb76d9 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
 2015-12-18 16:06:42 -08:00
Akira Ajisaka e09d026105 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 061c05cc05)
(cherry picked from commit af49823499)
 2015-12-18 14:00:42 +09:00
Akira Ajisaka c18bf20154 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki. 
(cherry picked from commit bd5e207432)
(cherry picked from commit e06c291245)
 2015-12-18 13:13:12 +09:00
Vinod Kumar Vavilapalli 753c9292c2 HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos) 
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62)
 2015-12-16 14:42:09 -08:00
Uma Mahesh 58cc106378 HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh) 
(cherry picked from commit ae67c8424c)
 2015-12-15 15:21:58 -08:00
Akira Ajisaka 028f66b8a2 HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit eee0cf4611)
(cherry picked from commit 5047ee56af)
 2015-12-11 16:19:12 +09:00
Uma Mahesh 9c5650cf03 HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh) 
(cherry picked from commit ad53c52063)
 2015-12-08 23:03:19 -08:00
mattf 05a7fb3a9a HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:46:36 -08:00
Haohui Mai 274af9b579 HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:44:36 +08:00
Akira Ajisaka 78552d8857 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu. 
(cherry picked from commit 3857fed2c8)
(cherry picked from commit 15c2f709c6)
 2015-12-03 11:52:11 +08:00
Junping Du 12fb8b4cc5 Add 2.6.4 as release entry to CHANGES.txt 2015-12-02 07:38:03 -08:00
Arpit Agarwal a99274ea96 HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 15:29:39 -08:00
Yongjun Zhang 3b9043348a HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 0348e769ab)
(cherry picked from commit 165abe6c4f)
 2015-12-01 15:01:56 -08:00
Allen Wittenauer 81a7ad45c9 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:15:57 -08:00
cnauroth 6417121ddb HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth. 
(cherry picked from commit b2c78536cb)
(cherry picked from commit 669743ce11)
 2015-11-28 15:40:25 -08:00
Vinod Kumar Vavilapalli efaef45a24 Reverting previous commit which added 2.9.0 entries. Don't need that in branch-2.8. 
Revert "Adding release 2.8.0 to CHANGES.txt"

This reverts commit 767815f317.
 2015-11-25 17:49:48 -08:00
Vinod Kumar Vavilapalli 767815f317 Adding release 2.8.0 to CHANGES.txt 
(cherry picked from commit d57fd181c7)
 2015-11-25 17:37:47 -08:00
Robert Kanter 8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4)
 2015-11-25 17:03:52 -08:00
Akira Ajisaka 4257991257 HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang. 
(cherry picked from commit b53f20135599cc7825b6213794e2f999bc43e2ad)
 2015-11-26 01:21:32 +09:00
Tom Zeng d6f7d22929 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049 
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
(cherry picked from commit b4c6b511e7)
 2015-11-24 18:39:01 -08:00
Allen Wittenauer 38f8952c4d HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw) 2015-11-24 12:48:02 -08:00
Jason Lowe 7923130114 Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula." 
This reverts commit 4356e8a5ef.

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
(cherry picked from commit 17b1a5482b)
 2015-11-24 19:13:26 +00:00
Jian He b339a4b8d6 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan 
(cherry picked from commit 8676a118a1)
 2015-11-23 17:20:24 -08:00
Haohui Mai 75b007260b Revert "HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling." 
This reverts commit 74d67b2250.
 2015-11-23 14:59:55 -08:00
Haohui Mai 1cdf422ba8 HADOOP-9822. create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor. Contributed by Tsuyoshi Ozawa. 2015-11-23 13:23:14 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) c824920527 HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 70c26703f4)
 2015-11-23 10:00:40 -08:00
Haohui Mai f826195ee5 HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). Contributed by Gabor Liptak. 2015-11-22 23:07:51 -08:00
Haohui Mai c07fab5f6f HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:03:05 -08:00
Haohui Mai 16bcf66c1b HADOOP-11677. Add cookie flags for logs and static contexts. Contributed by nijel. 2015-11-22 19:53:19 -08:00
Haohui Mai 579f9030da HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran. 2015-11-22 19:46:13 -08:00
Haohui Mai afac7a2640 HADOOP-10068. Improve log4j regex in testFindContainingJar. Contributed by Robert Rati. 2015-11-22 18:29:10 -08:00
Haohui Mai 1d175f0f3f HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux. 2015-11-22 18:12:53 -08:00
Haohui Mai c7a9cbbdde HADOOP-10555. Add offset support to MurmurHash. Contributed by Sergey Shelukhin. 2015-11-22 18:00:41 -08:00
Haohui Mai 6ed8f24041 HADOOP-10035. Cleanup TestFilterFileSystem. Contributed by Suresh Srinivas. 2015-11-22 17:30:14 -08:00
Haohui Mai ac0694eb6e HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. Contributed by Varun Saxena. 2015-11-22 17:25:29 -08:00
Haohui Mai def7490b29 HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. Contributed by Masatake Iwasaki. 2015-11-22 16:56:22 -08:00
Haohui Mai 812dbea5c0 HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts. Contributed by Radhey Shah. 2015-11-22 16:04:06 -08:00
Haohui Mai 64add87f5c HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. Contributed by Vijay Singh. 2015-11-22 16:00:44 -08:00
Haohui Mai 74d67b2250 HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling. 2015-11-22 15:43:34 -08:00
Steve Loughran edcd0dc0b2 Revert "HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter." 
This reverts commit b7e3f419bd.
 2015-11-22 11:41:44 +00:00
Haohui Mai b7e3f419bd HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 2015-11-19 15:47:41 -08:00
Haohui Mai 03c292efb7 HADOOP-11901. BytesWritable fails to support 2G chunks due to integer overflow. Contributed by Reynold Xin. 2015-11-19 12:54:16 -08:00
Tsuyoshi Ozawa aa792b7d0c HADOOP-12575. Add build instruction for docker toolbox instead of boot2docker. Contributed by Kai Sasaki. 
(cherry picked from commit 25e82b4eb9)
 2015-11-19 17:44:21 +09:00
Tsuyoshi Ozawa c5fb02ba25 HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead of get() and getSize(). Contributed by Akira AJISAKA. 
(cherry picked from commit bd166f0eed)
 2015-11-19 17:27:35 +09:00
Tsuyoshi Ozawa eb4c9765d9 HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package. Contributed by Dustin Cote. 
(cherry picked from commit 989b9e3e11)
 2015-11-19 01:38:40 +09:00
Eric Yang 123e0b16f2 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431740 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8064849203)
 2015-11-19 01:36:24 +09:00
Akira Ajisaka d5782a4199 HADOOP-12568. Update core-default.xml to describe posixGroups support. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4a3b8f1ed2)
 2015-11-18 17:23:34 +09:00
cnauroth 397836a7b3 HADOOP-12567. NPE in SaslRpcServer. Contributed by Sergey Shelukhin. 
(cherry picked from commit 7fab5c8cec)
 2015-11-17 16:00:33 -08:00
Akira Ajisaka 8de7911eb3 MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun. 
(cherry picked from commit a7f776ffdf)
 2015-11-17 15:18:32 +09:00
Tsuyoshi Ozawa d66fe1155b Move HADOOP-11361, HADOOP-12348 and HADOOP-12482 from 2.8.0 to 2.7.3 in CHANGES.txt for backporting. 
(cherry picked from commit c753617a48)
 2015-11-14 14:44:17 +09:00
Akira Ajisaka 1b9385c56c Move HADOOP-12374 from 2.8.0 to 2.7.3 in CHANGES.txt. 
(cherry picked from commit 47c79a2a4d)
 2015-11-14 13:15:35 +09:00
Akira Ajisaka c5c663c05d HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad. 
(cherry picked from commit f94d892704)
 2015-11-13 21:53:23 +09:00
Haohui Mai 5d9212c139 HADOOP-12562. Make hadoop dockerfile usable by Yetus. Contributed by Allen Wittenauer. 2015-11-12 10:20:33 -08:00
Tsuyoshi Ozawa f6cecbfce5 Updated CHANGES.txt to move HADOOP-12526 to 2.6.3. 2015-11-11 23:21:36 +09:00
Vinod Kumar Vavilapalli b742ea7fe6 HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in 
the first patch committed. (Karthik Kambatla via vinodkv)
 2015-11-10 12:16:52 -08:00
Colin Patrick Mccabe 7a47989bc9 HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 493e8ae552)
 2015-11-10 10:58:36 -08:00
Lei Xu a7243de1a1 HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) 
(cherry picked from commit 0eb9c60c5b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-09 23:02:38 -08:00
Haohui Mai c91bd3aabb HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:26:01 -08:00
Sangjin Lee 7802248c23 HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 17:46:37 -08:00
Lei Xu 47941858af Revert "HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)" 
This reverts commit 01ae30796d.
 2015-11-06 09:52:21 -08:00
Jason Lowe 836bfdd646 Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3 
(cherry picked from commit 74a9a51886)
 2015-11-06 17:18:23 +00:00
Lei Xu 01ae30796d HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei) 
(cherry picked from commit bff7c90a56)
 2015-11-05 18:36:55 -08:00
Colin Patrick Mccabe f7e6a5dfb1 Revert "HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)" 
This reverts commit bb3b2977cd.
 2015-11-05 11:11:27 -08:00
Colin Patrick Mccabe bb3b2977cd HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe) 
(cherry picked from commit 482e35c55a)
 2015-11-05 10:46:12 -08:00
cnauroth 81f7e8af22 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade. 
(cherry picked from commit 0fb1867fd6)
 2015-11-04 10:29:01 -08:00
Haohui Mai 6d92778191 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit e7203b6954.
 2015-11-04 10:22:21 -08:00
Jason Lowe b9389ac5b5 HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li 
(cherry picked from commit b9d25c3ee2)
 2015-11-04 16:35:12 +00:00
Jason Lowe 8334d86472 Add 2.7.3 release to CHANGES.txt 
(cherry picked from commit 0383a3973b)
 2015-11-04 16:27:28 +00:00
cnauroth afff29113a HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. Contributed by Chris Nauroth. 
(cherry picked from commit 957f0311a1)
 2015-11-02 22:25:12 -08:00
cnauroth c1d7b26e94 HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade. 
(cherry picked from commit 9e7dcab185)
 2015-11-02 10:21:46 -08:00
cnauroth c260d7ec78 HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth. 
(cherry picked from commit 28790692624177d89fb1e4f59e2f83a659fc3089)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-02 09:39:27 -08:00
Arpit Agarwal bb2ee9f8eb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:11 -08:00
Sangjin Lee b2d6ea5e18 Updated the 2.6.2 final release date. 
(cherry picked from commit a4a6b5b4b4)
 2015-10-30 18:49:21 -07:00
Suresh Srinivas b8d586fd8a HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 16acd69e58)
 2015-10-30 14:27:45 -07:00
Jason Lowe 8dce482f61 Creating 2.6.3 entries in CHANGES.txt files. 
(cherry picked from commit eadf7b3096)
 2015-10-30 14:52:06 +00:00
Zhe Zhang 30791cb0d0 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java

Change-Id: I5f5895bac4f7d7e66e95788765a514b80b9b6766
 2015-10-29 11:21:57 -07:00
Jian He 7d109ef5b5 YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du 
(cherry picked from commit c41699965e)
 2015-10-29 00:01:20 -07:00
Vinayakumar B dea66a8392 HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina) 
(cherry picked from commit 7d2d16f4ee)
 2015-10-29 11:30:59 +05:30
Sangjin Lee 16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
cnauroth c7f87dc2d0 HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth. 
(cherry picked from commit 2d10cb8e00)
 2015-10-28 09:44:21 -07:00
Steve Loughran fe079c8b20 HADOOP-12514. Make static fields in GenericTestUtils for assertExceptionContains() package-private and final. (Mingliang Liu via stevel) 2015-10-28 10:36:26 +00:00
cnauroth af0f2e27d1 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth. 
(cherry picked from commit bf8e452982)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
 2015-10-27 23:08:32 -07:00
cnauroth 0377795e06 HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu. 
(cherry picked from commit 1f7ecb0c84)
 2015-10-27 22:56:33 -07:00
cnauroth a23f79b92c HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth. 
(cherry picked from commit 73822de7c3)
 2015-10-27 22:49:04 -07:00
Zhihai Xu 73612294bd HADOOP-12178. NPE during handling of SASL setup if problem with SASL resolver class. Contributed by Steve Loughran 
(cherry picked from commit ed9806ea40)
 2015-10-27 10:09:45 -07:00
Tsuyoshi Ozawa 1035637200 HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. Contributed by Akira AJISAKA. 
(cherry picked from commit ea6b183a1a)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
 2015-10-27 10:58:50 +09:00
Jing Zhao 7d25646741 HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. Contributed by Steve Loughran. 
(cherry picked from commit a01a209fbe)
 2015-10-26 14:03:38 -07:00
Tsuyoshi Ozawa 07169e25ce HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by Akihiro Suda. 
(cherry picked from commit 123b3db743)
 2015-10-26 23:19:14 +09:00
Tsuyoshi Ozawa e85ebf0825 YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula. 
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
 2015-10-26 17:06:46 +09:00
Jitendra Pandey 63cebf57d0 HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu. 2015-10-23 12:17:20 -07:00
Jonathan Eagles 6db7bfbcfd YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles) 
(cherry picked from commit f8adeb712d)
 2015-10-23 10:43:59 -05:00
Tsuyoshi Ozawa de739cabb1 HADOOP-7266. Deprecate metrics v1. Contributed by Akira AJISAKA. 
(cherry picked from commit 35a303dfbe)
 2015-10-23 23:48:36 +09:00
Tsuyoshi Ozawa 525a67a62e HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa) 2015-10-23 06:54:24 +09:00
Tsuyoshi Ozawa 7d4246a5da Revert "HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong." 
This reverts commit 3ed9db0a38.
 2015-10-23 06:53:56 +09:00
cnauroth b023539c19 HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade. 
(cherry picked from commit cb282d5b89)
 2015-10-22 14:30:09 -07:00
Junping Du d5145b58f6 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong. 
(cherry picked from commit 0fce5f9a49)
 2015-10-22 13:42:12 -07:00
cnauroth 10398daadf HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade. 
(cherry picked from commit 47641fcbc9)
 2015-10-22 12:21:44 -07:00
Tsuyoshi Ozawa 3ed9db0a38 HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong. 
(cherry picked from commit 381610da62)
 2015-10-22 11:59:25 +09:00
Andrew Wang 7a9b97e6b7 HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen. 
(cherry picked from commit d1cdce77fa)
 2015-10-21 15:21:15 -07:00
Ming Ma 39e7548cd9 HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma) 
(cherry picked from commit e27c2ae8ba)
 2015-10-21 08:24:02 -07:00
Kihwal Lee e327233e80 HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee. 
(cherry picked from commit 01b103f4ff)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestRPC.java
 2015-10-20 15:19:01 -05:00
Kihwal Lee e86819c91f HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee. 
(cherry picked from commit 6144e0137b)
 2015-10-19 10:56:19 -05:00
Vinayakumar B b6dce3834d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 7f0e1eb43d)
 2015-10-19 12:16:44 +05:30
yliu 2c0dbf728a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:52:39 +08:00
Steve Loughran f7d746a81b HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:17 +01:00
Steve Loughran b390aae467 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:34 +01:00
Steve Loughran 10932aad29 HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel). 2015-10-18 11:45:11 +01:00
cnauroth 6774a1732a HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay. 
(cherry picked from commit a121fa1d39)
 2015-10-15 16:45:08 -07:00
cnauroth adb015847d HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth. 
(cherry picked from commit fdd7406224)
 2015-10-15 15:55:06 -07:00
Sangjin Lee afa57f1b48 HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee) 
(cherry picked from commit 8d2d3eb7bb)
 2015-10-15 11:49:03 -07:00
Steve Loughran 0e4fb329ed HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:33 +01:00
Colin Patrick Mccabe d37f88674f HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe) 
(cherry picked from commit d286032b71)
 2015-10-13 16:21:13 -07:00
Steve Loughran 5eab51a24f HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:47:54 +01:00