3086 Commits

Author SHA1 Message Date
Akira Ajisaka
e426d1bb3f HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer.
(cherry picked from commit 1371f993a9fa59d7e91321f022eab9974319d641)
2016-04-06 17:44:54 +09:00
Masatake Iwasaki
886273e123 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
(cherry picked from commit 85ec5573eb9fd746a9295ecc6fe1ae683073aaf5)
2016-04-06 03:29:49 +09:00
Kihwal Lee
f9764d073f HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit ef3da823573cbf16fd1d84479330dd457f95e0ff)
2016-04-05 09:16:51 -05:00
Arpit Agarwal
334beb337f HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:38 -07:00
Steve Loughran
ab67b50543 HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:14 +01:00
Akira Ajisaka
7887fab815 HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
(cherry picked from commit a8d8b80a205c78bf0aa65d32a6a83c16d3ea3f0b)
(cherry picked from commit 80d122d7fe3b9b6e32f111c7e7accdb5bf436cdd)
2016-04-01 14:01:14 +09:00
Xiaoyu Yao
dc78250aa4 HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao.
(cherry picked from commit aac4d65bf9c6d68f53610e5fe9997a391e3fa053)
2016-03-31 15:44:19 -07:00
Xiaoyu Yao
a0c001c0b9 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao.
(cherry picked from commit d95c6eb32cec7768ac418fb467b1198ccf3cf0dc)
2016-03-31 08:58:46 -07:00
Akira Ajisaka
2d7084db20 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak.
(cherry picked from commit acca149ec96f2932bebc492452a63a159de9ce47)
(cherry picked from commit b4fbc22688124020e90be04827d0f8b35bbe50bb)
2016-03-31 16:06:03 +09:00
Zhe ZHang
2da1194699 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 9216993b027fde7c0ae47f25432a3776b5f21f6b)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
2016-03-30 14:19:29 -07:00
Colin Patrick Mccabe
28c81640d3 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
(cherry picked from commit e3d15a2e236f93325c67f9e52fb16f645c44238a)
(cherry picked from commit 9df2e54160d3d959138857757d2d64d595b54093)
2016-03-29 17:15:31 -07:00
Arpit Agarwal
9c4631b6f1 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:25 -07:00
Andrew Wang
cb79533777 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
(cherry picked from commit 8bfaa80037365c0790083313a905d1e7d88b0682)
(cherry picked from commit a61a90c5621f7cbc28d150aeaa1fbd92ad76e498)
2016-03-28 14:14:07 -07:00
Akira Ajisaka
b029011a23 HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 01cfee63815a1c9d63652edc21db63626df7e53c)
(cherry picked from commit 42d312663fd1399d4b5eaa99584090ddaaec1d9b)
2016-03-28 15:58:40 +09:00
Jason Lowe
25b476e93b HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
(cherry picked from commit 9a09200a1f5f752e266d4fb8e0c808073080bde8)
2016-03-25 23:00:18 +00:00
Andrew Wang
d2c33ba61e HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen.
(cherry picked from commit d4df7849a5caf749403bd89d29652f69c9c3f5a8)
(cherry picked from commit c58599acba369fd18f42e4c0c32094440787b2cc)
2016-03-25 15:29:09 -07:00
Andrew Wang
e0dad0b53a HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 938222b2e20791d6eb410e36f8fec3e1520e1078)
(cherry picked from commit daf24eeb6bdb99b811a3e5077181cb4299e3577f)
2016-03-23 14:57:32 -07:00
Benoy Antony
1b263ea490 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay.
(cherry picked from commit e7ed05e4f5b0421e93f2f2cadc5beda3d28b9911)
2016-03-21 13:31:55 -07:00
Andrew Wang
ea44650a64 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
(cherry picked from commit e3bb38d62567eafe57d16b78deeba1b71c58e41c)
(cherry picked from commit e826d860a7f587fac95e0abf257750d0a40ec65d)
2016-03-21 11:40:26 -07:00
Haohui Mai
88e7466c4b HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:43:10 -07:00
Tsz-Wo Nicholas Sze
d59c2c4518 HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:55:20 -07:00
Colin Patrick Mccabe
ffa9f2db70 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe)
(cherry picked from commit 6e9a582eb1ab040f532fbe95694f5272cda34188)
(cherry picked from commit b67b5b09a7eee9c56b4ff6855b1912c188a82cbd)
2016-03-11 12:27:32 -08:00
Steve Loughran
a44eec1fde Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)"
This reverts commit 0d3272b54efb9566fedbc83286cec17dbd41e05c.
2016-03-11 16:59:59 +00:00
Masatake Iwasaki
0d3272b54e HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
(cherry picked from commit 682adc6ba9db3bed94fd4ea3d83761db6abfe695)
2016-03-11 15:08:23 +09:00
Allen Wittenauer
a7164e90bf HADOOP-12798. Update changelog and release notes (2016-03-04) (aw)
(cherry picked from commit 55f73a1cbd45a62774e471b7a8a1e0cc40eecdd4)
(cherry picked from commit 95d30a6ec6648ec3a3ee602d9a8e60fc6001c20e)
2016-03-09 19:39:31 -08:00
Allen Wittenauer
095b485e48 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw)
(cherry picked from commit d759b4bd74ae3d530f8091fa5765664fc850530b)
(cherry picked from commit 140a33df9b8e3ce2dd4b1cb5c765c8e3c4780ee1)
2016-03-09 19:39:28 -08:00
Colin Patrick Mccabe
56ab796094 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
(cherry picked from commit 700b0e4019cf483f7532609711812150b8c44742)
(cherry picked from commit 5998b20d63fae09b08bd8bad1aca98551c0ac65a)
2016-03-09 16:38:15 -08:00
Allen Wittenauer
8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)"
This reverts commit 81a7ad45c9b3f38a4b99e897bb304c362fb1bdf5.
2016-03-09 09:59:33 -08:00
Arpit Agarwal
0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Akira Ajisaka
65769fbf3c HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d551d4426201b1290cfa1da8e7b2ab2)
2016-03-09 15:33:25 +09:00
Chris Nauroth
a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68c65956b3dd69b6a93baab1be2beac7)
2016-03-08 21:23:07 -08:00
Akira Ajisaka
2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
(cherry picked from commit f86850b544dcb34ee3c9336fad584309e886dbed)
(cherry picked from commit 0586386472dddf68826a8d2b6aa647c86d1f18ad)
2016-03-08 14:30:01 +09:00
Arpit Agarwal
a63f1039f9 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:42 -08:00
Ming Ma
47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
(cherry picked from commit 49eedc7ff02ea61764f416f0e2ddf81370aec5fb)
2016-03-07 20:32:32 -08:00
Andrew Wang
352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang)
(cherry picked from commit 391da36d93358038c50c15d91543f6c765fa0471)
(cherry picked from commit fed2339e285e84a40514f877703b2712a2305a6f)
2016-03-07 14:00:15 -08:00
Chris Nauroth
d5134dadbc HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
(cherry picked from commit 2759689d7d23001f007cb0dbe2521de90734dd5c)
(cherry picked from commit 592f161e13be9577c2a4e8a53887e71af6ab5c4c)
2016-03-04 15:30:37 -08:00
Masatake Iwasaki
9d551a3adf HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

(cherry picked from commit 722182fdfbb654be655fbca42f34bba5a05c2f6d)
2016-03-04 14:13:30 +09:00
Andrew Wang
c6e37f6782 HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:03:13 -08:00
Allen Wittenauer
a9f041d694 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 8cecad2d564d89d0f56e98de80a6f9b0bcb39d7a)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml

(cherry picked from commit b0d3b0c1f86469d1f16a79a2b06f060c3e6f1c26)
2016-03-03 20:58:56 -08:00
Akira Ajisaka
833d84ab58 HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0a9f00af5e11913935ebf426d9da74278dd011af)
(cherry picked from commit 899715a15efb7646d2da5f6bd881c903b9a6e56e)
2016-03-03 23:33:01 +09:00
Akira Ajisaka
b4710b5052 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c3136cbd8ff5f4eaf9c2c0145975439d0249db3)
(cherry picked from commit 96a0939d5bc26ff42262d9057f9e53c22d090e1d)
2016-03-03 23:23:27 +09:00
Akira Ajisaka
85a62dcb5b HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
(cherry picked from commit eb864d35d6c5f0c0af67032d5f6925aa123273af)
(cherry picked from commit 9e87f59dea25ebb90e7bc3ae640da25c4b8e9a82)
2016-03-03 18:52:05 +09:00
Masatake Iwasaki
64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit f70e317cccf14185cc24ea3cb57ffc63b00158cc)
2016-03-03 17:15:09 +09:00
Chris Nauroth
f563c53535 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)
(cherry picked from commit bce33b51790b90f0655e36df3a0394f5691f8d6e)
2016-03-01 13:19:03 -08:00
Akira Ajisaka
aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka)
(cherry picked from commit 67e8489ac6df70e07d530017bb7ddee017e57e5b)
2016-03-02 00:22:29 +09:00
Chris Nauroth
f1236c5d7c HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
(cherry picked from commit d251e55415f1fab085159b9eb3b43214d100b6a8)
(cherry picked from commit e402371b6a0854a89e7bd573b04e43fed5e3e9cf)
2016-02-29 22:00:41 -08:00
Jian He
07623aa941 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du
(cherry picked from commit d8f390d015510950ccf78174af8891cd613d4438)
2016-02-29 16:25:00 -08:00
Haohui Mai
69b195d619 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:15:25 -08:00
Masatake Iwasaki
c7824e8e9e HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b146135d86433e9c7bfa17e294b7928f2)
2016-02-29 18:26:09 +09:00
Suresh Srinivas
2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeeadd1f248b6961078303d75d41f241919)
(cherry picked from commit fca24fbbaa1f8dd13514084f6cdee6a111b31765)
2016-02-29 11:36:18 +09:00