Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,906 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2015 Commits

Author SHA1 Message Date
Jason Lowe 6fc68a379b HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger 
(cherry picked from commit c82745432a)
 2016-08-03 20:20:24 +00:00
Arpit Agarwal ad653de2d7 HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor) 2016-08-02 15:18:24 -07:00
Arpit Agarwal 745ba1160b HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:43:50 -07:00
Chris Nauroth 06df0cd87f HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin. 
(cherry picked from commit 0458a2af6e)
(cherry picked from commit ec522a1907)
 2016-08-02 12:43:58 -07:00
Akira Ajisaka f39ed9ea8e HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon. 
(cherry picked from commit 5469e128d3)
 2016-08-02 10:18:52 +09:00
Chris Nauroth 244285488d HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin. 
(cherry picked from commit 255ea45e50)
(cherry picked from commit df2ed6b2c4)
 2016-07-26 15:33:42 -07:00
Jing Zhao 54be36a6d6 HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. 
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
 2016-07-25 09:51:59 -07:00
Arpit Agarwal bbf711c030 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-07-25 09:51:59 -07:00
Chris Nauroth 0456069aca HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran. 
(cherry picked from commit 5fda66e4a3)
(cherry picked from commit e6ba69b4db)
 2016-07-22 15:39:12 -07:00
Chris Nauroth af3c860bb1 HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge. 
(cherry picked from commit 43cf6b101d)
(cherry picked from commit 382bcf21e7)
 2016-07-21 14:12:47 -07:00
Jakob Homan 9442e1d48e HADOOP-12009. Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. backport to 2.8 2016-07-21 21:50:25 +01:00
Allen Wittenauer 35885e9540 HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw) 
(cherry picked from commit b3649adf6a)
(cherry picked from commit 84c785036f)
 2016-07-20 11:30:52 -07:00
Steve Loughran 0f1e02a298 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:19 +01:00
Akira Ajisaka f2508d78b2 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki. 
(cherry picked from commit dc065dd64c)
(cherry picked from commit 8fe2c450b3)
 2016-07-19 16:06:35 -07:00
Akira Ajisaka cf79ac5fa9 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki. 
(cherry picked from commit c2bcffb34e)
(cherry picked from commit 09375baad1)
 2016-07-18 11:50:53 -07:00
Zhe Zhang cbd885b6fa HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 
(cherry picked from commit 728bf7f698)
(cherry picked from commit b95f1af8a9)
 2016-07-13 16:47:01 -07:00
Akira Ajisaka 213b7f40de HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R. 
(cherry picked from commit 505ce88437)
(cherry picked from commit ee1e45e4b2)
 2016-07-13 13:10:27 -07:00
Tsuyoshi Ozawa fa9ff4997e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa) 
(cherry picked from commit 77ffe76212)
 2016-07-13 21:41:11 +09:00
Lei Xu d1d280fcfa HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei) 
(cherry picked from commit a290a98b6a)
 2016-07-12 16:51:55 -07:00
Jitendra Pandey 324923e1bc HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-12 14:38:20 -07:00
Robert Kanter 2e2caeb50e HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter) 
(cherry picked from commit 042a3ae960)
 2016-07-12 14:37:57 -07:00
Steve Loughran 310c08454f HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse. 2016-07-11 17:21:14 +01:00
Akira Ajisaka a8cfcce542 Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux." 
This reverts commit 1d175f0f3f.
 2016-07-09 21:01:07 -07:00
Jitendra Pandey 9c7ce389c7 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:04:47 -07:00
Jitendra Pandey bc7fd76a1f HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:37:32 -07:00
Andrew Wang 47c13c4f7d HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 7d2070493e)
(cherry picked from commit 22eb53eb71)
 2016-06-27 18:46:59 -07:00
Andrew Wang 59a70977c3 HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen. 
(cherry picked from commit 771f798edf)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java

(cherry picked from commit d8a69c8737)
 2016-06-27 18:29:58 -07:00
Akira Ajisaka a0f6109907 MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 2016-06-27 15:19:21 -07:00
Arpit Agarwal f7bd302550 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:51:16 -07:00
Tsz-Wo Nicholas Sze ce788c207f HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:51:45 +08:00
Jing Zhao e251654ee4 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 
(cherry picked from commit 0bbb4ddd79)
 2016-06-25 15:51:35 +08:00
Colin Patrick Mccabe 2d681a9246 Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 975786492c)
(cherry picked from commit e751bb4497)
 2016-06-24 09:47:41 -07:00
Andrew Wang f28c270c96 Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen." 
This reverts commit 4ad9ca85fb.
 2016-06-23 11:09:06 -07:00
Steve Loughran 1eb45180a6 HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:41:52 +01:00
Akira Ajisaka 6fefb8f4a4 HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton. 
(cherry picked from commit e15cd43369)
(cherry picked from commit 65b4f2682e)
 2016-06-21 20:17:42 +09:00
Colin Patrick Mccabe c5dafb4ad7 HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 8c1f81d4bf)
(cherry picked from commit 14df17383c)
 2016-06-20 14:30:51 -07:00
Colin Patrick Mccabe c610b60331 HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe) 
(cherry picked from commit 5370a6ffae)
(cherry picked from commit 7db1e57cc1)

Conflicts:
    hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemStorageStatistics.java
 2016-06-20 10:53:14 -07:00
Akira Ajisaka 615a023be3 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 
(cherry picked from commit fc6b50cc57)
(cherry picked from commit 39ea0891d2)
 2016-06-20 17:08:19 +09:00
Brahma Reddy Battula 9d27530c36 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 
(cherry picked from commit 3f27f40503)
 2016-06-20 12:40:11 +05:30
Chris Nauroth 55658dcaa3 Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)" 
This reverts commit 62206dd2ed.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-06-17 23:51:27 -07:00
Akira Ajisaka 242263c56d HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 
(cherry picked from commit 09e82acaf9)
(cherry picked from commit a36aa920f4)
 2016-06-17 16:21:31 +09:00
Xiaoyu Yao e84a9c976a HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 
(cherry picked from commit ddf66427ff)
 2016-06-16 20:12:55 -07:00
Konstantin V Shvachko 408848d1e9 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:33:05 -07:00
Colin Patrick Mccabe 04682cc6b0 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe) 
(cherry picked from commit bf780406f2)
(cherry picked from commit 56c997a1a6)
 2016-06-16 17:03:52 -07:00
Colin Patrick Mccabe b07cd9c6a9 HADOOP-13284. FileSystemStorageStatistics must not attempt to read non-existent rack-aware read stats in branch-2.8 (Mingliang Liu via cmccabe) 2016-06-16 16:45:41 -07:00
Chris Nauroth eddefbd01b HADOOP-13241. document s3a better. Contributed by Steve Loughran. 
(cherry picked from commit 127d2c7281)
(cherry picked from commit e4b63ed7b4)
 2016-06-16 11:19:00 -07:00
Masatake Iwasaki 3c9d31c55a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki. 
(cherry picked from commit 20b13d109a)
 2016-06-14 19:52:48 +09:00
Vinayakumar B 3bf5379adb HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma) 
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
(cherry picked from commit 06b76f1586)
 2016-06-14 15:59:36 +05:30
Akira Ajisaka 8295351e54 HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 
(cherry picked from commit e3ba9ad3f1)
(cherry picked from commit d219550e8b)
 2016-06-14 10:24:53 +09:00
Andrew Wang 08ff8d7482 HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 
(cherry picked from commit 0accc3306d)
(cherry picked from commit 6a8d3233fc)
 2016-06-13 11:44:08 -07:00
Steve Loughran faf9a9f4e0 HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:58:30 +01:00
Steve Loughran 7e09601a90 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:51 +01:00
Junping Du 333490ba45 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 
(cherry picked from commit c14c1b298e)
(cherry picked from commit 19eb997f67)
 2016-06-07 09:26:05 -07:00
Tsz-Wo Nicholas Sze 49535c0683 Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 886e239606.
 2016-06-06 16:54:02 +08:00
Tsz-Wo Nicholas Sze c949001eee Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit 308d28640d.
 2016-06-06 16:53:41 +08:00
Tsz-Wo Nicholas Sze 8ccc8aeb6c Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 8a07026e77.
 2016-06-06 16:53:31 +08:00
Tsz-Wo Nicholas Sze 2cf663bb59 Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit d740a90260.
 2016-06-06 16:53:24 +08:00
Andrew Wang d740a90260 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit bdc45bef64.
 2016-06-03 18:17:33 -07:00
Andrew Wang 8a07026e77 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit a1ba6eee38.
 2016-06-03 18:17:33 -07:00
Andrew Wang 308d28640d Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit fa7c7f2510.
 2016-06-03 18:12:31 -07:00
Andrew Wang 886e239606 Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit a8941d7790.
 2016-06-03 18:12:30 -07:00
Andrew Wang d712b2ee3b HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 
(cherry picked from commit 713cb71820)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java

(cherry picked from commit 03c4724c88)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
 2016-06-03 17:03:40 -07:00
Chris Nauroth e54f073cfe HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 
(cherry picked from commit d82bc85018)
(cherry picked from commit 5e6ee5aafb)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestLdapGroupsMapping.java
 2016-06-03 16:40:48 -07:00
Jian He 3c2bd19fa5 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du 
(cherry picked from commit 99cc439e29)
 2016-06-03 11:11:49 -07:00
Akira Ajisaka f7e1a1eaa7 HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou. 
(cherry picked from commit 99675e00df)
(cherry picked from commit 6843e55208)
 2016-06-02 19:15:57 +09:00
Andrew Wang 4ad9ca85fb HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 35356de1ba)
(cherry picked from commit 55eda958cc)
 2016-06-01 13:13:38 -07:00
Colin Patrick Mccabe 6fe1c67fa1 HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 8ceb06e239)
(cherry picked from commit a64e1425ed)
 2016-05-31 18:26:37 -07:00
Tsz-Wo Nicholas Sze a8941d7790 HADOOP-13226 Support async call retry and failover. 2016-05-31 17:16:44 -07:00
Jing Zhao 03c4491d89 HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze. 2016-05-31 17:16:26 -07:00
Andrew Wang 63f73d78a1 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit bca31fe276)
 2016-05-31 09:35:30 -07:00
Xiaoyu Yao 1d2928ece7 HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 4ca8859583)
(cherry picked from commit 001c8f5d7b)
 2016-05-27 18:51:46 -07:00
Tsz-Wo Nicholas Sze fa7c7f2510 HADOOP-13168. Support Future.get with timeout in ipc async calls. 2016-05-26 12:22:57 -07:00
Steve Loughran f2aef95bd3 HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran) 2016-05-21 14:20:19 +01:00
Chris Nauroth 877af3ec7e HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth. 
(cherry picked from commit bcde1562d2)
(cherry picked from commit d38f2090fa)
 2016-05-20 12:50:23 -07:00
Steve Loughran f32b37ec89 HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong. 2016-05-20 13:51:56 +01:00
Jian He 61fa9256c5 YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong 
(cherry picked from commit feb90ffcca)
 2016-05-19 13:02:24 -07:00
Steve Loughran 7a001ae19b HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel. 2016-05-19 14:47:46 +01:00
Andrew Wang 64e75c34a3 HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder. 2016-05-18 14:57:17 -07:00
Chris Nauroth 4ce5a58ca9 HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B. 
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
(cherry picked from commit 42f64b3bcc)
 2016-05-18 09:32:24 -07:00
Colin Patrick Mccabe 7bbf42b82f HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe) 
(cherry picked from commit f2c1d9181f)
(cherry picked from commit feabfe9cda)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
 2016-05-18 09:20:31 -07:00
Xiaoyu Yao 744d5edc87 HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao. 
(cherry picked from commit 9478484845)
 2016-05-17 15:44:28 -07:00
Akira Ajisaka 388b2010ae HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi. 
(cherry picked from commit 9fe5828f05)
(cherry picked from commit 7f03c1c90e)
 2016-05-17 15:56:36 +09:00
Andrew Wang 5da54eb3d4 HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu. 
(cherry picked from commit 3bfd29949f)
(cherry picked from commit d6f6b99c83)
 2016-05-12 23:49:00 -07:00
Steve Loughran 8d74a58042 HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel 
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
 2016-05-12 19:23:18 +01:00
Steve Loughran af5e5d6d47 HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel. 2016-05-12 13:56:48 +01:00
Colin Patrick Mccabe 5f04795aed HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe) 
(cherry picked from commit 687233f20d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java

(cherry picked from commit 15bfcde238)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
 2016-05-11 14:24:51 -07:00
Varun Vasudev 4d275d0a25 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana. 
(cherry picked from commit d37eb828ff)
(cherry picked from commit 2451a0a8e0)
 2016-05-11 14:12:18 -07:00
Larry McCay ee2c2afdc3 HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay) 2016-05-11 14:39:13 -04:00
Chris Nauroth e9ee258d04 HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay. 
(cherry picked from commit dee279b532)
(cherry picked from commit 31279ae45e)
 2016-05-11 10:58:56 -07:00
Eric Payne 235caef236 YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts. 
(cherry picked from commit 6b1c1cb01c)
 2016-05-10 21:45:37 +00:00
Steve Loughran 11b170adc8 HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel) 2016-05-10 21:40:23 +01:00
Steve Loughran d13cd394e5 HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel). 2016-05-10 21:33:26 +01:00
Andrew Wang 8653bcbe67 HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge. 
(cherry picked from commit 8ef75a702e)
 2016-05-06 17:26:51 -07:00
Xiaoyu Yao 59eeee7501 HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit dacd1f50fe)
(cherry picked from commit 35859872b7)
 2016-05-05 18:23:00 -07:00
Xiaoyu Yao 4d0b19eec2 HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao) 
(cherry picked from commit 4e5e87ddd4)
 2016-05-05 18:01:38 -07:00
Tsz-Wo Nicholas Sze 9daa36b8ea HDFS-10346: add org.apache.hadoop.util.StringUtils import. 2016-05-05 15:58:06 -07:00
Tsz-Wo Nicholas Sze 528240f593 HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 15:53:51 -07:00
Ming Ma d6e95ae47b HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 
(cherry picked from commit 1268cf5fbe)
 2016-05-04 17:07:36 -07:00
Chris Douglas b5c8bac817 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri 
(cherry picked from commit c1cc6ac667)
(cherry picked from commit a50dc05a60)
 2016-05-02 22:38:08 -07:00
Xiaoyu Yao 643d2fd3c1 HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 
(cherry picked from commit 5bd7b592e5)
(cherry picked from commit a2a65922dd)
 2016-05-02 19:38:03 -07:00
Tsz-Wo Nicholas Sze a1ba6eee38 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:34:59 -07:00
Tsz-Wo Nicholas Sze bdc45bef64 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-02 11:34:22 -07:00
Lei Xu 5477c31c5c HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 0a152103f1)
(cherry picked from commit 4289cb8b36)
 2016-05-02 10:21:59 -07:00
Colin Patrick Mccabe ef9e7a10e4 HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 2beedead72)
(cherry picked from commit b16c376c3b)
 2016-05-02 09:44:07 -07:00
Robert Kanter 3c3d003402 Remove parent's env vars from child processes 
(cherry picked from commit ac8fb579c6)
 2016-04-29 15:30:06 -07:00
Arpit Agarwal 7cd0177310 HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:07:20 -07:00
Arpit Agarwal b39e9efeeb HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:48:13 -07:00
Masatake Iwasaki e01242edb4 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims) 
(cherry picked from commit bec5b4cd8c)
 2016-04-25 22:50:07 +09:00
Akira Ajisaka 9891f51829 HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor. 
(cherry picked from commit c610031cab)
(cherry picked from commit 5949436010)
 2016-04-23 06:21:03 +09:00
Kihwal Lee 989cd895e3 HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d)
 2016-04-22 15:06:25 -05:00
Steve Loughran 5df89f9a8a HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:24:24 +01:00
Steve Loughran 4d90014560 HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:26 +01:00
Steve Loughran 6b1f86f7f6 HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:04 +01:00
Akira Ajisaka 284718decc HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor. 
(cherry picked from commit 27b131e79c)
(cherry picked from commit 03bf09865f)
 2016-04-14 10:58:05 +09:00
Xiaoyu Yao df78ea84df HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8ced42daff)
 2016-04-13 16:43:45 -07:00
Colin Patrick Mccabe 59b0661c7f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe) 
(cherry picked from commit 35f0770555)
(cherry picked from commit 2b0b332e2f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java
 2016-04-12 16:30:58 -07:00
Chris Nauroth 1b5b85e560 HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran. 
(cherry picked from commit 843ee8d59d)
(cherry picked from commit 26a23eff82)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
 2016-04-08 13:44:27 -07:00
Tsz-Wo Nicholas Sze 413e5b4926 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:51:50 +08:00
Suresh Srinivas cbd10bfa8c HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
 2016-04-07 14:47:04 +08:00
Akira Ajisaka e426d1bb3f HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer. 
(cherry picked from commit 1371f993a9)
 2016-04-06 17:44:54 +09:00
Masatake Iwasaki 886273e123 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 85ec5573eb)
 2016-04-06 03:29:49 +09:00
Kihwal Lee f9764d073f HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java

(cherry picked from commit ef3da82357)
 2016-04-05 09:16:51 -05:00
Arpit Agarwal 334beb337f HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:38 -07:00
Akira Ajisaka 7887fab815 HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula. 
(cherry picked from commit a8d8b80a20)
(cherry picked from commit 80d122d7fe)
 2016-04-01 14:01:14 +09:00
Xiaoyu Yao dc78250aa4 HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao. 
(cherry picked from commit aac4d65bf9)
 2016-03-31 15:44:19 -07:00
Xiaoyu Yao a0c001c0b9 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao. 
(cherry picked from commit d95c6eb32c)
 2016-03-31 08:58:46 -07:00
Zhe ZHang 2da1194699 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 9216993b02)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
 2016-03-30 14:19:29 -07:00
Colin Patrick Mccabe 28c81640d3 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe) 
(cherry picked from commit e3d15a2e23)
(cherry picked from commit 9df2e54160)
 2016-03-29 17:15:31 -07:00
Arpit Agarwal 9c4631b6f1 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:25 -07:00
Andrew Wang cb79533777 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge. 
(cherry picked from commit 8bfaa80037)
(cherry picked from commit a61a90c562)
 2016-03-28 14:14:07 -07:00
Jason Lowe 25b476e93b HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f)
 2016-03-25 23:00:18 +00:00
Andrew Wang ea44650a64 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d625)
(cherry picked from commit e826d860a7)
 2016-03-21 11:40:26 -07:00
Tsz-Wo Nicholas Sze d59c2c4518 HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:55:20 -07:00
Colin Patrick Mccabe ffa9f2db70 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe) 
(cherry picked from commit 6e9a582eb1)
(cherry picked from commit b67b5b09a7)
 2016-03-11 12:27:32 -08:00
Steve Loughran a44eec1fde Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit 0d3272b54e.
 2016-03-11 16:59:59 +00:00
Masatake Iwasaki 0d3272b54e HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 682adc6ba9)
 2016-03-11 15:08:23 +09:00
Allen Wittenauer 8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 81a7ad45c9.
 2016-03-09 09:59:33 -08:00
Arpit Agarwal 0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Ming Ma 47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff0)
 2016-03-07 20:32:32 -08:00
Andrew Wang 352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 
(cherry picked from commit 391da36d93)
(cherry picked from commit fed2339e28)
 2016-03-07 14:00:15 -08:00
Masatake Iwasaki 64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317ccc)
 2016-03-03 17:15:09 +09:00
Akira Ajisaka aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 
(cherry picked from commit 67e8489ac6)
 2016-03-02 00:22:29 +09:00
Jian He 07623aa941 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 
(cherry picked from commit d8f390d015)
 2016-02-29 16:25:00 -08:00
Suresh Srinivas 2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
(cherry picked from commit fca24fbbaa)
 2016-02-29 11:36:18 +09:00
Chris Nauroth 60611c9c75 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay. 
(cherry picked from commit 7634d404b7)
(cherry picked from commit 2e761dabd8)
 2016-02-28 11:23:09 -08:00
Li Lu 8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9) 
(cherry-picked from commit 7545ce6636)
 2016-02-27 22:04:23 -08:00
Steve Loughran 6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Suresh Srinivas cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
 2016-02-27 01:26:31 +09:00
Masatake Iwasaki 7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit b0091338f2)
 2016-02-26 15:33:21 +09:00
Xiaoyu Yao 6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00