Commit Graph

3461 Commits

Author SHA1 Message Date
Akira Ajisaka 2231ef22f5 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou.
(cherry picked from commit 1381483233)
2016-07-14 23:15:34 -07:00
Zhe Zhang b95f1af8a9 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
(cherry picked from commit 728bf7f698)
2016-07-13 16:38:09 -07:00
Akira Ajisaka ee1e45e4b2 HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R.
(cherry picked from commit 505ce88437)
2016-07-13 13:08:06 -07:00
Tsuyoshi Ozawa 22e719b16e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
(cherry picked from commit 77ffe76212)
2016-07-13 21:28:20 +09:00
Lei Xu 82c3c66dcb HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei)
(cherry picked from commit a290a98b6a)
2016-07-12 16:50:12 -07:00
Steve Loughran 89121745c0 HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse. 2016-07-11 17:21:00 +01:00
Akira Ajisaka f4b63a391b Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux."
This reverts commit 1d175f0f3f.
2016-07-09 21:00:13 -07:00
Jitendra Pandey e4023f8b13 HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-08 14:20:00 -07:00
Jitendra Pandey 63b64a20c2 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:00:34 -07:00
Akira Ajisaka f78be97469 MAPREDUCE-6717. Remove deprecated StringUtils.getFormattedTimeWithDiff. Contributed by Shen Yinjie.
(cherry picked from commit d1626a7b37)
2016-07-07 11:19:33 -07:00
Jian He 46f8204992 YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du
(cherry picked from commit d792a90206)
2016-07-05 18:06:03 -07:00
Jitendra Pandey 06b89f0d14 HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:35:50 -07:00
Vinayakumar B 1458e66593 HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B)
(cherry picked from commit c25021fb71)
2016-07-01 12:21:47 +05:30
Masatake Iwasaki b7b5807d2c HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims)
(cherry picked from commit 5c07c573db)
2016-06-30 07:23:30 +09:00
Steve Loughran a82ea9275e HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki 2016-06-29 14:31:27 +01:00
Andrew Wang 22eb53eb71 HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen.
(cherry picked from commit 7d2070493e)
2016-06-27 18:46:50 -07:00
Andrew Wang d8a69c8737 HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen.
(cherry picked from commit 771f798edf)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2016-06-27 18:29:39 -07:00
Arpit Agarwal f73e748754 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:49:04 -07:00
Tsz-Wo Nicholas Sze 20ee619e32 HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:46:33 +08:00
Sangjin Lee ae90d4dd90 HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 2016-06-24 14:48:36 -07:00
Colin Patrick Mccabe e751bb4497 Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
(cherry picked from commit 975786492c)
2016-06-24 09:47:25 -07:00
Andrew Wang 8a1ee4d2b5 Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen."
This reverts commit 55eda958cc.
2016-06-23 11:08:52 -07:00
Allen Wittenauer 2a956baaab HADOOP-13245. Fix up some misc create-release issues (aw)
(cherry picked from commit e2f640942b)
2016-06-23 15:15:23 +09:00
Masatake Iwasaki 81497a4451 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims)
(cherry picked from commit 67089875f0)
2016-06-22 23:48:06 +09:00
Steve Loughran fb9167fdef HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:42:30 +01:00
Akira Ajisaka 65b4f2682e HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton.
(cherry picked from commit e15cd43369)
2016-06-21 20:17:00 +09:00
Colin Patrick Mccabe 14df17383c HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe)
(cherry picked from commit 8c1f81d4bf)
2016-06-20 14:30:21 -07:00
Colin Patrick Mccabe 7db1e57cc1 HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe)
(cherry picked from commit 5370a6ffae)
2016-06-20 10:50:30 -07:00
Akira Ajisaka 39ea0891d2 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde.
(cherry picked from commit fc6b50cc57)
2016-06-20 17:08:02 +09:00
Brahma Reddy Battula 3f27f40503 HDFS-10474. hftp copy fails when file name with Chinese+special char in branch-2 (Contributed by Brahma Reddy Battula) 2016-06-20 12:38:18 +05:30
Arpit Agarwal bd33cc0179 HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:17:10 -07:00
Chris Nauroth b726b5c52c Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)"
This reverts commit a1f913fb6e.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-06-17 23:50:55 -07:00
Xiaoyu Yao ed5d3a62ce HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao.
(cherry picked from commit 0761379fe4)
2016-06-17 15:30:51 -07:00
Akira Ajisaka a36aa920f4 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang.
(cherry picked from commit 09e82acaf9)
2016-06-17 16:21:05 +09:00
Xiaoyu Yao ddf66427ff HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 2016-06-16 20:12:17 -07:00
Akira Ajisaka 1ef89a767d MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao.
(cherry picked from commit 51d497fa93)
2016-06-17 11:05:13 +09:00
Konstantin V Shvachko 77ed9bafdd HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:26:46 -07:00
Colin Patrick Mccabe 56c997a1a6 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe)
(cherry picked from commit bf780406f2)
2016-06-16 16:59:46 -07:00
Chris Nauroth e4b63ed7b4 HADOOP-13241. document s3a better. Contributed by Steve Loughran.
(cherry picked from commit 127d2c7281)
2016-06-16 11:18:40 -07:00
Vinayakumar B 6ab1f545fb HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B)
(cherry picked from commit cc6c265171)
2016-06-16 16:56:27 +05:30
Jitendra Pandey 14b849489a HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin. 2016-06-15 13:29:29 -07:00
Masatake Iwasaki 9c66fffe4a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki.
(cherry picked from commit 20b13d109a)
2016-06-14 19:46:33 +09:00
Vinayakumar B 06b76f1586 HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma)
(cherry picked from commit 5cd19e429e7aef8751599dc5f54ffe29a9dc3ea9)
2016-06-14 15:59:07 +05:30
Akira Ajisaka d219550e8b HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
(cherry picked from commit e3ba9ad3f1)
2016-06-14 10:20:43 +09:00
Andrew Wang 6a8d3233fc HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge.
(cherry picked from commit 0accc3306d)
2016-06-13 11:43:56 -07:00
Karthik Kambatla 63da641910 HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha)
(cherry picked from commit 49b4064644)
2016-06-12 14:28:19 -07:00
Jing Zhao 9c7002b122 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu.
(cherry picked from commit 0bbb4ddd79)
2016-06-10 10:40:53 -07:00
Chris Nauroth 1925942294 Revert "HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane."
This reverts commit a8f03ef7ea.
2016-06-09 15:17:18 -07:00
Chris Nauroth a8f03ef7ea HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane.
(cherry picked from commit 9581fb715c)

Conflicts:
	hadoop-tools/hadoop-tools-dist/pom.xml
	hadoop-tools/pom.xml
2016-06-09 14:49:05 -07:00
Steve Loughran 6350e4b1fb HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 20:59:54 +01:00
Steve Loughran df29f77846 HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 16:36:27 +01:00
Junping Du 19eb997f67 HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe.
(cherry picked from commit c14c1b298e)
2016-06-07 09:20:51 -07:00
Tsz-Wo Nicholas Sze 074588d78b Revert "Revert "HADOOP-13226 Support async call retry and failover.""
This reverts commit 5bfadb8e6b.
2016-06-06 16:52:24 +08:00
Tsz-Wo Nicholas Sze 09a543fc86 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls.""
This reverts commit 071aeab585.
2016-06-06 16:52:02 +08:00
Tsz-Wo Nicholas Sze 7b9062f405 Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou""
This reverts commit 7d4c16bae9.
2016-06-06 16:51:48 +08:00
Tsz-Wo Nicholas Sze c1947a71ff Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
This reverts commit c11c2ee649.
2016-06-06 16:51:41 +08:00
Andrew Wang c11c2ee649 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
This reverts commit d316f44059.
2016-06-03 18:11:12 -07:00
Andrew Wang 7d4c16bae9 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
This reverts commit 7e0824faa9.
2016-06-03 18:10:49 -07:00
Andrew Wang 071aeab585 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."
This reverts commit 658072d62e.
2016-06-03 18:10:49 -07:00
Andrew Wang 5bfadb8e6b Revert "HADOOP-13226 Support async call retry and failover."
This reverts commit f7189d6a1c.
2016-06-03 18:10:47 -07:00
Andrew Wang 03c4724c88 HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen.
(cherry picked from commit 713cb71820)

 Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProviderDelegationTokenExtension.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSUtilClient.java
2016-06-03 17:01:11 -07:00
Chris Nauroth 5e6ee5aafb HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu.
(cherry picked from commit d82bc85018)
2016-06-03 16:38:38 -07:00
Jian He 7f865bf438 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du
(cherry picked from commit 99cc439e29)
2016-06-03 11:11:20 -07:00
Chris Nauroth 043a0c2e6c HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran. 2016-06-03 08:56:07 -07:00
Akira Ajisaka b6d5546e24 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (aajisaka) 2016-06-03 16:04:11 +09:00
Masatake Iwasaki 3740974413 HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula.
(cherry picked from commit aadb77e412)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
2016-06-02 20:59:40 +09:00
Akira Ajisaka 6843e55208 HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou.
(cherry picked from commit 99675e00df)
2016-06-02 19:15:48 +09:00
Andrew Wang 55eda958cc HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen.
(cherry picked from commit 35356de1ba)
2016-06-01 13:13:28 -07:00
Steve Loughran b29bf5d335 HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel) 2016-06-01 14:17:50 +01:00
Colin Patrick Mccabe a64e1425ed HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe)
(cherry picked from commit 8ceb06e239)
2016-05-31 18:05:28 -07:00
Tsz-Wo Nicholas Sze f7189d6a1c HADOOP-13226 Support async call retry and failover. 2016-05-31 17:01:43 -07:00
Andrew Wang cbf87869b8 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang.
(cherry picked from commit bca31fe276)
2016-05-31 09:35:28 -07:00
Xiaoyu Yao 001c8f5d7b HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao.
(cherry picked from commit 4ca8859583)
2016-05-27 18:48:55 -07:00
Yongjun Zhang 41c02757a5 HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang) 2016-05-26 22:54:07 -07:00
Karthik Kambatla b4c8729cf9 HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha) 2016-05-26 14:39:07 -07:00
Kai Zheng 4c8ab5e162 HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang 2016-05-27 17:16:32 +08:00
Karthik Kambatla afe603d973 HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha)
(cherry picked from commit 57c31a3fef)
2016-05-24 16:34:45 -07:00
Steve Loughran 15f997cca6 HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran) 2016-05-21 14:19:56 +01:00
Chris Nauroth d38f2090fa HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth.
(cherry picked from commit bcde1562d2)
2016-05-20 12:47:52 -07:00
Steve Loughran eb160561e0 HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong. 2016-05-20 13:52:30 +01:00
Tsz-Wo Nicholas Sze 658072d62e HADOOP-13168. Support Future.get with timeout in ipc async calls. 2016-05-19 15:58:15 -07:00
Jian He 2d846fdcbd YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
(cherry picked from commit feb90ffcca)
2016-05-19 13:02:05 -07:00
Steve Loughran 151ecdf26d HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel. 2016-05-19 14:44:44 +01:00
Andrew Wang 686691df60 HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder. 2016-05-18 14:55:31 -07:00
Chris Nauroth 42f64b3bcc HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B.
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
2016-05-18 09:32:15 -07:00
Colin Patrick Mccabe feabfe9cda HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe)
(cherry picked from commit f2c1d9181f)
2016-05-18 09:19:45 -07:00
Akira Ajisaka e9dd0d84e5 Revert "HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder."
This reverts commit e205421555.
2016-05-18 17:57:46 +09:00
Andrew Wang e205421555 HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
(cherry picked from commit 7154ace712)
2016-05-17 17:44:34 -07:00
Xiaoyu Yao 937bc924cb HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao.
(cherry picked from commit 9478484845)
(cherry picked from commit 744d5edc87)
2016-05-17 15:51:47 -07:00
Akira Ajisaka 7f03c1c90e HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
(cherry picked from commit 9fe5828f05)
2016-05-17 15:56:21 +09:00
Sangjin Lee 9330a7b4de HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee)
(cherry picked from commit 61f46be071)
2016-05-16 18:59:19 -07:00
Jing Zhao af70fc42e7 HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.
(cherry picked from commit a9a8297cad)
2016-05-16 15:26:48 -07:00
Sangjin Lee 8a316676b7 HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
(cherry picked from commit 1f2794b4fa)
2016-05-13 10:02:47 -07:00
Andrew Wang d6f6b99c83 HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
(cherry picked from commit 3bfd29949f)
2016-05-12 23:48:58 -07:00
Steve Loughran 1370dfc775 HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:23:31 +01:00
Sangjin Lee d6d13ec670 YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)
(cherry picked from commit 0bbe01f8d5)
2016-05-12 10:14:24 -07:00
Steve Loughran 257b2f5beb HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel. 2016-05-12 13:57:05 +01:00
Colin Patrick Mccabe 15bfcde238 HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
(cherry picked from commit 687233f20d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
2016-05-11 14:02:03 -07:00
Larry McCay 788f80b617 HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay) 2016-05-11 14:38:21 -04:00
Chris Nauroth 31279ae45e HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit dee279b532)
2016-05-11 10:58:42 -07:00
Steve Loughran 0ff3ec1f67 HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel) 2016-05-11 14:19:41 +01:00
Tsuyoshi Ozawa eb4182f8f5 HADOOP-10694. Remove synchronized input streams from Writable deserialization. Contributed by Gopal V and Rajesh Balamohan.
(cherry picked from commit 6e56578031)
2016-05-10 17:27:43 -07:00
Eric Payne de4daf9d22 YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts.
(cherry picked from commit 6b1c1cb01c)
2016-05-10 21:37:24 +00:00
Steve Loughran f47ea0cc3f HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel) 2016-05-10 21:40:13 +01:00
Steve Loughran 092b199741 HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel). 2016-05-10 21:33:11 +01:00
Akira Ajisaka 7cbf306e4c HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeStream javadoc. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 0f0c6415af)
2016-05-10 10:03:41 -07:00
Harsh J e2216a96d7 HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 28023b7759)
2016-05-10 09:49:00 -07:00
Andrew Wang 1d563f4d7e HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge.
(cherry picked from commit 8ef75a702e)
2016-05-06 17:23:31 -07:00
Xiaoyu Yao 35859872b7 HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
(cherry picked from commit dacd1f50fe)
2016-05-05 18:15:32 -07:00
Xiaoyu Yao d18a991817 HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao)
(cherry picked from commit 4e5e87ddd4)
2016-05-05 17:58:41 -07:00
Tsz-Wo Nicholas Sze b66b85094a HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 15:50:50 -07:00
Ming Ma 5b53833171 HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma)
(cherry picked from commit 1268cf5fbe)
2016-05-04 17:04:44 -07:00
Arpit Agarwal cb0a035bd1 HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor) 2016-05-04 09:49:51 -07:00
Masatake Iwasaki 2d01ffaf24 HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang.
(cherry picked from commit 355325bcc7)
2016-05-04 15:18:41 +09:00
Chris Douglas a50dc05a60 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri
(cherry picked from commit c1cc6ac667)
2016-05-02 22:37:36 -07:00
Tsz-Wo Nicholas Sze 7e0824faa9 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:20:10 -07:00
Colin Patrick Mccabe b16c376c3b HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
(cherry picked from commit 2beedead72)
2016-05-02 09:43:42 -07:00
Robert Kanter ac8fb579c6 Remove parent's env vars from child processes 2016-04-29 09:26:09 -07:00
Lei Xu 4289cb8b36 HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
(cherry picked from commit 0a152103f1)
2016-04-27 15:06:35 -07:00
Arpit Agarwal 14b8701a63 HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:07:08 -07:00
Jian He 9d3ddb0b4d YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode
(cherry picked from commit 4beff01354)
2016-04-26 21:02:04 -07:00
Arpit Agarwal dba737f1e5 HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:46:47 -07:00
Masatake Iwasaki c12fcbde44 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang.
(cherry picked from commit 68b4564e78)
2016-04-27 10:48:26 +09:00
Tsz-Wo Nicholas Sze d316f44059 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-04-26 17:21:20 -07:00
Masatake Iwasaki 5bceaa9683 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims)
(cherry picked from commit bec5b4cd8c)
2016-04-25 22:46:50 +09:00
Ravi Prakash 88e1427a03 HDFS-9525. hadoop utilities need to support provided delegation tokens. Contributed by HeeSoo Kim 2016-04-23 20:50:56 -07:00
Akira Ajisaka 5949436010 HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor.
(cherry picked from commit c610031cab)
2016-04-23 06:20:44 +09:00
Kihwal Lee d0718ed466 HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp.
(cherry picked from commit 9dbdc8e12d)
2016-04-22 15:03:56 -05:00
Steve Loughran edcb2a8410 HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:24:50 +01:00
Larry McCay a0605ff002 HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers 2016-04-21 20:16:08 -07:00
Jing Zhao 5353289c8c HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
2016-04-21 20:16:02 -07:00
Xiaoyu Yao 432531dcf7 HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
(cherry picked from commit b4be288c5d)
2016-04-21 10:19:35 -07:00
Xiaoyu Yao a2a65922dd HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
(cherry picked from commit 5bd7b592e5)
2016-04-20 23:11:42 -07:00
Akira Ajisaka 5ae74507c0 HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi.
(cherry picked from commit 6e6b6dd5aa)
2016-04-15 14:15:33 +09:00
Steve Loughran e124c3a2ae HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:10 +01:00
Steve Loughran a59e05ad0a HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:20 +01:00
Akira Ajisaka 03bf09865f HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor.
(cherry picked from commit 27b131e79c)
2016-04-14 10:57:50 +09:00
Robert Kanter d9d12b9e72 HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
(cherry picked from commit 042a3ae960)
2016-04-13 17:42:28 -07:00
Xiaoyu Yao 42040f706a HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao.
(cherry picked from commit 8ced42daff)
2016-04-13 16:42:55 -07:00
Colin Patrick Mccabe 2b0b332e2f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
(cherry picked from commit 35f0770555)
2016-04-12 16:29:15 -07:00
Akira Ajisaka bb1ed426d1 HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:28:05 +09:00
Akira Ajisaka 8f968171bd HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran.
(cherry picked from commit a409508b3f)
2016-04-12 14:55:25 +09:00
Vinod Kumar Vavilapalli 4041d2b49e HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba.
(cherry picked from commit 069c6c62de)
2016-04-11 12:03:39 -07:00
Chris Nauroth 26a23eff82 HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
(cherry picked from commit 843ee8d59d)
2016-04-08 13:37:46 -07:00
Steve Loughran c8797e0e39 HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel) 2016-04-08 12:59:01 +01:00
Tsz-Wo Nicholas Sze 46352de1a2 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:49:48 +08:00
Suresh Srinivas d72db7d3aa HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
2016-04-07 14:39:22 +08:00
Vinayakumar B aea518ef30 Addendum : HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B) 2016-04-07 14:33:48 +08:00
Vinayakumar B c2b271fe05 HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B
This closes #91

(cherry picked from commit 8d29e2451f)
2016-04-07 10:17:43 +05:30
Jian He 42bc565630 YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev 2016-04-06 16:14:13 -07:00
Akira Ajisaka 1371f993a9 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer. 2016-04-06 17:43:31 +09:00
Masatake Iwasaki 2542e9bccf HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
(cherry picked from commit 85ec5573eb)
2016-04-06 03:26:33 +09:00
Kihwal Lee ef3da82357 HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
2016-04-05 09:16:05 -05:00
Arpit Agarwal 30e12edb67 HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:28 -07:00
Steve Loughran 20e808d83e HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:51 +01:00
Akira Ajisaka 80d122d7fe HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
(cherry picked from commit a8d8b80a20)
2016-04-01 13:59:45 +09:00
Xiaoyu Yao ab9dc84d4a HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao.
(cherry picked from commit aac4d65bf9)
(cherry picked from commit dc78250aa4)
2016-03-31 15:50:17 -07:00
Jian He 3afc2caec8 YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage 2016-03-31 14:31:38 -07:00
Xiaoyu Yao 6db3c9d394 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao.
(cherry picked from commit d95c6eb32c)
(cherry picked from commit a0c001c0b9)
2016-03-31 09:05:37 -07:00
Zhe ZHang 9216993b02 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 2016-03-30 14:14:05 -07:00
Colin Patrick Mccabe 9df2e54160 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
(cherry picked from commit e3d15a2e23)
2016-03-29 17:14:36 -07:00
Arpit Agarwal 759d0acdd4 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:10 -07:00
Andrew Wang a61a90c562 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
(cherry picked from commit 8bfaa80037)
2016-03-28 14:14:05 -07:00
Robert Kanter 5a552973f4 HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter)
(cherry picked from commit 8cac1bb09f)
2016-03-28 10:37:58 -07:00
Junping Du ae29b1a17b MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 90fcb16c0f)
2016-03-28 05:31:46 -07:00
Akira Ajisaka 42d312663f HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 01cfee6381)
2016-03-28 15:58:28 +09:00
Jason Lowe 5e823d839d HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
(cherry picked from commit 9a09200a1f)
2016-03-25 22:59:14 +00:00
Andrew Wang daf24eeb6b HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 938222b2e2)
2016-03-23 14:57:18 -07:00
Andrew Wang e826d860a7 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
(cherry picked from commit e3bb38d625)
2016-03-21 11:39:19 -07:00
Sangjin Lee d956e0a0bb HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-21 10:56:32 -07:00
Haohui Mai 478a25b929 HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:41:20 -07:00
Chris Nauroth 283e44f978 HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison.
(cherry picked from commit 33239c9925)
2016-03-18 16:33:28 -07:00
Steve Loughran 186a7c6bb3 YARN-4593 Deadlock in AbstractService.getConfig() (stevel) 2016-03-16 14:35:13 +00:00
Steve Loughran 1463400aad HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel) 2016-03-16 14:31:50 +00:00
Tsz-Wo Nicholas Sze f85d979a3f HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:49:34 -07:00
Colin Patrick Mccabe b67b5b09a7 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe)
(cherry picked from commit 6e9a582eb1)
2016-03-11 12:27:12 -08:00
Steve Loughran 1c96fd0a23 Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)"
This reverts commit 7994ab3fa0.
2016-03-11 16:59:42 +00:00
Masatake Iwasaki 7994ab3fa0 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
(cherry picked from commit 682adc6ba9)
2016-03-11 15:05:34 +09:00
Harsh J 2e32aa5475 HADOOP-11404. Clarify the "expected client Kerberos principal is null" authorization message. Contributed by Stephen Chu
(cherry picked from commit 318c9b68b0)
2016-03-10 17:09:56 +05:30
Allen Wittenauer 95d30a6ec6 HADOOP-12798. Update changelog and release notes (2016-03-04) (aw)
(cherry picked from commit 55f73a1cbd)
2016-03-09 19:39:13 -08:00
Allen Wittenauer 140a33df9b HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw)
(cherry picked from commit d759b4bd74)
2016-03-09 19:39:05 -08:00
Allen Wittenauer 9f4b3eaac0 Revert "HADOOP-12366. expose calculated paths (aw)"
This reverts commit 45bb467918.
2016-03-09 09:59:19 -08:00
Arpit Agarwal a06ecb085e HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:36 -08:00
Akira Ajisaka 0d8ad99e0d HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
2016-03-09 15:33:14 +09:00
Chris Nauroth 38a031ce68 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
(cherry picked from commit 89b16d27e2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml
2016-03-08 21:22:57 -08:00
Andrew Wang 7e29d732ee HADOOP-12895. SSLFactory#createSSLSocketFactory exception message is wrong. Contributed by Wei-Chiu Chuang.
(cherry picked from commit a3cc6e2511)
2016-03-08 13:52:01 -08:00
Akira Ajisaka 0586386472 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
(cherry picked from commit f86850b544)
2016-03-08 14:29:46 +09:00
Arpit Agarwal 9d67f98e05 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:34 -08:00
Ming Ma aae39ff973 HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
(cherry picked from commit 49eedc7ff0)
2016-03-07 20:27:10 -08:00
Andrew Wang fed2339e28 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang)
(cherry picked from commit 391da36d93)
2016-03-07 14:00:08 -08:00
Chris Nauroth 592f161e13 HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
(cherry picked from commit 2759689d7d)
2016-03-04 15:30:28 -08:00
Masatake Iwasaki 722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
(cherry picked from commit cbd31328a6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
2016-03-04 14:12:44 +09:00
Andrew Wang 670944810c HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:58 -08:00
Allen Wittenauer b0d3b0c1f8 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
(cherry picked from commit 8cecad2d56)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml
2016-03-03 20:54:08 -08:00
Akira Ajisaka 899715a15e HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0a9f00af5e)
2016-03-03 23:32:51 +09:00
Akira Ajisaka 96a0939d5b HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1c3136cbd8)
2016-03-03 23:23:12 +09:00
Akira Ajisaka 9e87f59dea HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
(cherry picked from commit eb864d35d6)
2016-03-03 18:51:50 +09:00
Masatake Iwasaki 69e024f8fa HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit f70e317ccc)
2016-03-03 17:14:53 +09:00
Arpit Agarwal 7b4a1001ea HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:38 -08:00
Colin Patrick Mccabe 5998b20d63 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
(cherry picked from commit 700b0e4019)
2016-03-02 18:18:45 -08:00
Andrew Wang 3fecfe1352 HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng.
(cherry picked from commit 480302b4ba)
2016-03-02 09:40:33 -08:00
Chris Nauroth bce33b5179 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
(cherry picked from commit f98dff329b)
2016-03-01 13:18:57 -08:00
Akira Ajisaka 67e8489ac6 HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 2016-03-02 00:20:57 +09:00
Chris Nauroth e402371b6a HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
(cherry picked from commit d251e55415)
2016-02-29 22:00:27 -08:00
Karthik Kambatla c1855a33eb HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha)
(cherry picked from commit 680f3fc02d)
2016-02-29 19:00:22 -08:00
Jian He 3e842de1d5 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 2016-02-29 16:24:30 -08:00
Haohui Mai c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Masatake Iwasaki 32c7791a6c HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
(cherry picked from commit 809ebc0b14)
2016-02-29 18:23:33 +09:00
Suresh Srinivas fca24fbbaa HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
2016-02-29 11:35:19 +09:00
Chris Nauroth 2e761dabd8 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
(cherry picked from commit 7634d404b7)
2016-02-28 11:23:02 -08:00
Li Lu 090f74c741 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
(cherry-picked from commit 7545ce6636)
2016-02-27 22:03:49 -08:00
Steve Loughran 4d870b1faa HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:53 +00:00
Chris Nauroth c692d7c52f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
(cherry picked from commit 798babf661)
2016-02-26 21:59:14 -08:00
Lei Xu 49a10a3cec HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei)
(cherry picked from commit 2093acf6b6)
2016-02-26 10:48:35 -08:00
Suresh Srinivas b1d497a7de HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
2016-02-27 01:27:00 +09:00
Masatake Iwasaki b0091338f2 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 2016-02-26 15:32:07 +09:00
Karthik Kambatla 6722e17f6d HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit c2460dad64)
2016-02-25 16:36:07 -08:00
Xiaoyu Yao 7ad6ca1eb2 HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:50:36 -08:00
cnauroth 92e49cdd04 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
(cherry picked from commit d6b181c6fa)
2016-02-24 14:05:55 -08:00
cnauroth 9ea19a861f HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
(cherry picked from commit 3369a4f691)
2016-02-23 21:37:56 -08:00
Colin Patrick Mccabe 7dfcf40352 HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe)
(cherry picked from commit d9c409a428)
2016-02-23 11:27:55 -08:00
cnauroth a5511debdb HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
(cherry picked from commit 27b77751c1)
2016-02-22 17:30:32 -08:00
Zhe Zhang 56b7f2c2c1 HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:14:39 -08:00
cnauroth 3f14eed580 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
(cherry picked from commit d4f5fc23b2)
2016-02-22 13:39:45 -08:00
Junping Du e38c2ef6c5 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala.
(cherry picked from commit 18f9b77a32)
2016-02-19 14:22:39 -08:00
Yongjun Zhang 36c08f793a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit a963baba10)
2016-02-19 09:57:45 -08:00
cnauroth b4c4f30fa4 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
(cherry picked from commit 8ab7658025)
2016-02-18 14:07:09 -08:00
Tsz-Wo Nicholas Sze 38fc086940 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 12:02:00 -08:00
Robert Kanter f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter)
(cherry picked from commit a365a3941c)
2016-02-18 11:11:32 -08:00
cnauroth 779a69e28d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
2016-02-18 10:09:33 -08:00
Xiaoyu Yao ad4fcd1f9f HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
(cherry picked from commit fe5624b85d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
2016-02-17 16:05:07 -08:00
Zhe Zhang e226dbbc8a HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:31:48 -08:00
cnauroth 6731bb468d HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
(cherry picked from commit 76fab26c5c)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
2016-02-17 12:20:41 -08:00
Xiaoyu Yao 91c4a3a816 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
(cherry picked from commit fd1befb6ba)
2016-02-17 08:44:37 -08:00
Masatake Iwasaki 3e80aece2e HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims)
(cherry picked from commit 1a1c2f5bab)
2016-02-18 00:25:20 +09:00
Vinayakumar B 2bf5a005fa HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
(cherry picked from commit 96ea309431)
2016-02-17 10:15:08 +05:30
Vinayakumar B e79a5e4460 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
(cherry picked from commit 4b0e59fdc0)
2016-02-16 17:32:35 +05:30
Akira Ajisaka a670165bbd HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
(cherry picked from commit 1c48e50ce7)
2016-02-15 11:38:54 +09:00
Junping Du a28be9edc7 Set the release date for 2.6.4.
(cherry picked from commit ec12ce8f48)
2016-02-13 01:44:12 -08:00
Masatake Iwasaki 7a67f8f709 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
(cherry picked from commit 36ba5cac37)
2016-02-13 15:01:08 +09:00
cnauroth ac5a793590 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
(cherry picked from commit 91a96eaa53)
2016-02-12 15:50:19 -08:00
Arpit Agarwal 63f51208a8 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:12 -08:00
Vinayakumar B 488e6cbe16 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
(cherry picked from commit c78740a979)
2016-02-12 11:55:16 +05:30
Karthik Kambatla 383f3ff28c HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha)
(cherry picked from commit 33ce7f6c07)
2016-02-11 20:45:23 -08:00
Andrew Wang fb57c01eaa HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
(cherry picked from commit 8fdef0bd9d)
2016-02-11 17:21:50 -08:00
cnauroth 25dcb88630 HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
(cherry picked from commit 70c756d35e)
2016-02-11 16:53:12 -08:00
Zhe Zhang dfd49a027e Add HADOOP-12764 to CHANGES.txt.
Change-Id: Ie32b71b7bd8892a3bb434aec12cdf2c43c61b897
2016-02-11 09:34:32 -08:00
Uma Maheswara Rao G e90f7ef988 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75)
2016-02-10 15:04:42 -08:00
Jason Lowe fa9b3e6302 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4d)
2016-02-10 21:54:50 +00:00
Sangjin Lee 463195dbe6 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a)
2016-02-08 13:57:44 -08:00
cnauroth a76611d4ec HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570a)
2016-02-08 09:36:18 -08:00
Varun Vasudev 2451a0a8e0 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit d37eb828ff)
2016-02-08 20:19:51 +05:30
Varun Vasudev 368a11f3dd Revert "HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana."
This reverts commit f3bbe0bd02.

(cherry picked from commit af218101e5)
2016-02-08 20:17:10 +05:30
Varun Vasudev fd971debee HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit f3bbe0bd02)
2016-02-08 14:23:19 +05:30
Andrew Wang 915ce5d960 HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. Contributed by Daniel Templeton.
(cherry picked from commit 5b59a0ea85)
2016-02-06 20:52:49 -08:00
Steve Loughran 60474a769e HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:20:24 +00:00
cnauroth 4db6cc44cd HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
2016-02-05 15:52:14 -08:00
cnauroth 5752df2362 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e84)
2016-02-05 14:38:31 -08:00
Kihwal Lee 51a705432c HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f)
2016-02-05 15:47:56 -06:00
Colin Patrick Mccabe 86760c0f52 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3)
2016-02-05 10:57:47 -08:00
Xiaoyu Yao e0a356fee3 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7)
2016-02-05 10:38:02 -08:00
Xuan dfad608b22 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298c)
2016-02-03 20:06:25 -08:00
Sangjin Lee b0ab6df079 HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a39493)
2016-02-03 09:00:41 -08:00
Junping Du 3583c77ee8 Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:09:17 -08:00
Andrew Wang b4ad58796b HADOOP-12755. Fix typo in defaultFS warning message.
(cherry picked from commit 8171874dd1)
2016-02-02 11:56:47 -08:00
Karthik Kambatla 363a8212ec HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha)
(cherry picked from commit ee005e010c)
2016-01-28 17:45:50 -08:00
Colin Patrick Mccabe b94fbdf6f0 HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d465)
2016-01-27 11:40:42 -08:00
Yongjun Zhang a1f913fb6e HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355)
2016-01-27 08:05:17 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 97f6cfa94b Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40)
2016-01-25 15:47:02 -08:00
Walter Su 75b83af20e HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 6eacdea0e4)
2016-01-25 19:42:56 +08:00
Akira Ajisaka 38ec290455 HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a)
2016-01-25 13:59:48 +09:00
Akira Ajisaka 4edd7bd820 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a79)
2016-01-25 13:48:28 +09:00
Kihwal Lee b5db1d4410 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:19:23 -06:00
Akira Ajisaka 6368d102b9 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
(cherry picked from commit 0bae506c22)
2016-01-22 21:09:09 +09:00
Xiaoyu Yao 4d9efaf3b0 HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
(cherry picked from commit f3427d3766)
2016-01-21 13:55:42 -08:00
Akira Ajisaka cd5c66b080 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
(cherry picked from commit 2ac39ca762)
2016-01-22 02:45:54 +09:00
Vinayakumar B c13929b385 HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
(cherry picked from commit 446987e20a)
2016-01-21 20:10:11 +05:30
Masatake Iwasaki 54df2a4352 HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims)
(cherry picked from commit 9eec6cbedc)
2016-01-21 18:17:03 +09:00
Lei Xu c57f55223c HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
(cherry picked from commit 2ec438e8f7)
2016-01-20 14:26:47 -08:00
Ravi Prakash 2cbb8bbd72 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
(cherry picked from commit 1acc509b45)
2016-01-19 14:00:54 -08:00
Wangda Tan 23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac)
2016-01-19 21:28:51 +08:00
Akira Ajisaka 3a8d372518 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
(cherry picked from commit 92c5f565fd)
2016-01-19 13:31:48 +09:00
cnauroth 62d6166211 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
(cherry picked from commit 8bc93db2e7)
2016-01-18 09:09:05 -08:00
cnauroth 2b9ea68ef8 HADOOP-12691. Move files to correct location.
(cherry picked from commit da77f423d1)
2016-01-16 07:47:52 -08:00
Colin Patrick Mccabe c33603be36 HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng via cmccabe)
(cherry picked from commit 2a30386539)

Conflicts:
	BUILDING.txt
	hadoop-common-project/hadoop-common/src/CMakeLists.txt
	hadoop-project-dist/pom.xml
2016-01-15 14:10:13 -08:00
Colin Patrick Mccabe 48b8c99479 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
(cherry picked from commit b2c155f810)
2016-01-15 13:22:14 -08:00
Andrew Wang 2a6224aa0f HADOOP-12713. Disable spurious checkstyle checks.
(cherry picked from commit 5d5a22a878)
2016-01-15 11:58:58 -08:00
Akira Ajisaka a2d0c8ff9c Move HADOOP-12590 from 2.9.0 to 2.8.0 in CHANGES.txt.
(cherry picked from commit 1da762c745)
2016-01-15 10:48:58 +09:00
Jason Lowe 81cda7608b HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
(cherry picked from commit cdf8895259)
2016-01-14 23:47:29 +00:00
Jason Lowe 86456b01eb Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6
(cherry picked from commit 651c23e8ef)
2016-01-14 23:42:58 +00:00
cnauroth 9600736d89 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit 06f4ac0ccd)
2016-01-14 11:56:11 -08:00
Colin Patrick Mccabe cea1c71087 HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)
(cherry picked from commit b1ed28fa77)

Conflicts:
	hadoop-common-project/hadoop-common/pom.xml
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml
2016-01-14 11:13:13 -08:00
Akira Ajisaka f0b1b53173 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
2016-01-15 00:33:06 +09:00
Colin Patrick Mccabe 2baeaa20a3 HDFS-9517. Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe)
(cherry picked from commit 8315582c4f)
2016-01-13 16:33:02 -08:00
Karthik Kambatla 327297a600 HADOOP-12683. Add number of samples in last interval in snapshot of MutableStat. (Vikram Srivastava via kasha)
(cherry picked from commit fb64e6051a)
2016-01-13 15:44:08 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 1fba4051f8 HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753da)
2016-01-13 14:56:08 -08:00
cnauroth 2605e78e44 HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
2016-01-12 15:41:46 -08:00
Lei Xu 63b8be149a HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) 2016-01-12 12:21:29 -08:00
Colin Patrick Mccabe 181437cccf HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP address (cmccabe)
(cherry picked from commit 30c7dfd8ba)
2016-01-12 10:46:57 -08:00
Akira Ajisaka df95343047 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
2016-01-12 13:34:44 +09:00
cnauroth 813841e10b HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
(cherry picked from commit 0e76f1fcea)
2016-01-09 22:18:22 -08:00
Benoy Antony 4e5f77b7f5 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony)
(cherry picked from commit dec8dfdfa6)
2016-01-09 13:43:15 -08:00
Steve Loughran 80734bc346 HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 2016-01-09 11:10:20 +00:00
cnauroth debd13387d HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
(cherry picked from commit f0fa6d869b)
2016-01-08 20:19:11 -08:00
rohithsharmaks 20bb5c403e Revert "HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)"
This reverts commit 2b252844e0.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit ed18527e38)
2016-01-08 14:37:01 +05:30
Steve Loughran ee9611719f HADOOP-12573. TestRPC.testClientBackOff failing. (Xiao Chen via stevel) 2016-01-07 16:18:25 +00:00
Steve Loughran c6f7c30a8d HADOOP-12597. In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name. (Surendra Singh Lilhore via stevel) 2016-01-07 16:00:37 +00:00
Steve Loughran c329cab92c HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel) 2016-01-07 15:03:59 +00:00
Steve Loughran 38181e1dcd HADOOP-12655. TestHttpServer.testBindAddress patch - move from improvement to bug fix 2016-01-07 15:03:05 +00:00
Steve Loughran 83932ced71 HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider than expected. (Wei-Chiu Chuang via stevel) 2016-01-07 14:51:34 +00:00
Steve Loughran ccd2be99cc HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. (BELUGA BEHR via stevel) 2016-01-07 14:45:19 +00:00
Steve Loughran 29747001f0 HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:47 +00:00
rohithsharmaks 2c841e6564 HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)
(cherry picked from commit 2b252844e0)
2016-01-07 10:43:52 +05:30
cnauroth 4753676a34 HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
(cherry picked from commit 978bbdfeb2)
2016-01-06 11:16:18 -08:00
Ravi Prakash 6330683778 HADOOP-12689. S3 filesystem operations stopped working correctly
(cherry picked from commit 2d16f40dab)
2016-01-05 23:43:17 -08:00
Yongjun Zhang fc6c940464 HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang)
(cherry picked from commit 28bd138018)
2016-01-05 11:19:22 -08:00
Uma Mahesh cdd796d199 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng
(cherry picked from commit 778146eaae)
2016-01-04 15:04:46 -08:00
Akira Ajisaka 40b41ac8fc HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi.
(cherry picked from commit 1af2917856)
2016-01-04 20:33:46 +09:00
Akira Ajisaka 247ab92464 Set release date for 2.6.3
(cherry picked from commit db99e30f67)
2016-01-04 16:12:52 +09:00
Akira Ajisaka d98cfe611f HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki.
(cherry picked from commit 64ae85fd2e)
2016-01-04 14:32:08 +09:00
Xiaoyu Yao a65e159c59 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth.
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
2015-12-30 11:12:02 -08:00
Xiaoyu Yao d590c17851 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit ab725cff66)
2015-12-30 10:43:44 -08:00
Xiaoyu Yao c664062fb3 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang.
(cherry picked from commit 993311e547)
2015-12-28 10:42:15 -08:00
Akira Ajisaka babe025fb0 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki. 2015-12-28 14:38:56 +09:00
Karthik Kambatla a98887d8b5 HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha)
(cherry picked from commit 8b1837fcd1)
2015-12-23 14:38:24 -08:00
Akira Ajisaka 7526a2a005 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
(cherry picked from commit fa544020f6)
2015-12-21 21:23:28 +09:00
Chris Douglas d984ba4fd7 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri
(cherry picked from commit 8652cce5b2)
2015-12-18 18:31:20 -08:00
cnauroth dd91cf9fa5 HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal.
(cherry picked from commit 932956458d)
2015-12-18 16:25:06 -08:00
Arpit Agarwal e0a40b2dc2 HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:06:12 -08:00
Zhe Zhang 223b47b398 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:05:21 -08:00
Akira Ajisaka af49823499 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit 061c05cc05)
2015-12-18 14:00:07 +09:00
Akira Ajisaka e06c291245 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki.
(cherry picked from commit bd5e207432)
2015-12-18 13:12:56 +09:00
Vinod Kumar Vavilapalli 36781a3a5a HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos)
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62)
2015-12-16 14:41:25 -08:00
Uma Mahesh dd3867ab9f HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh)
(cherry picked from commit ae67c8424c)
2015-12-15 15:19:27 -08:00
Akira Ajisaka 5047ee56af HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki.
(cherry picked from commit eee0cf4611)
2015-12-11 16:18:58 +09:00
Robert Kanter 8dfaa7ded6 HADOOP-12625. Add a config to disable the /logs endpoints (rkanter)
(cherry picked from commit e27fffdb90)
2015-12-09 14:35:50 -08:00
Uma Mahesh d20681896b HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh)
(cherry picked from commit ad53c52063)
2015-12-08 22:57:00 -08:00
mattf 472541291b HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:35:25 -08:00
Haohui Mai 417fbf2dca HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:42:24 +08:00
Steve Loughran af14458de7 HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072] 2015-12-06 17:42:56 +00:00
Xiaoyu Yao eb7f9901b4 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao.
(cherry picked from commit cbc7b6bf97)
2015-12-04 16:57:58 -08:00
Jian He be404e1680 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
(cherry picked from commit 755dda8dd8)
2015-12-03 17:46:09 -08:00
Akira Ajisaka 15c2f709c6 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu.
(cherry picked from commit 3857fed2c8)
2015-12-03 11:51:56 +08:00
Arpit Agarwal 19c2c22bbe HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 09:29:07 -08:00
Allen Wittenauer 45bb467918 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:16:20 -08:00
Junping Du 092c469059 Creating 2.6.4 entries in CHANGES.txt files.
(cherry picked from commit 028894281b)
2015-12-01 08:18:57 -08:00
cnauroth 669743ce11 HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth.
(cherry picked from commit b2c78536cb)
2015-11-28 15:40:13 -08:00
Yongjun Zhang 165abe6c4f HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit 0348e769ab)
2015-11-25 18:48:10 -08:00
Vinod Kumar Vavilapalli b20e77eba3 Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0 2015-11-25 17:47:22 -08:00
Vinod Kumar Vavilapalli 767815f317 Adding release 2.8.0 to CHANGES.txt
(cherry picked from commit d57fd181c7)
2015-11-25 17:37:47 -08:00
Robert Kanter 8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
(cherry picked from commit 7fd00b3db4)
2015-11-25 17:03:52 -08:00
Akira Ajisaka 4257991257 HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang.
(cherry picked from commit b53f20135599cc7825b6213794e2f999bc43e2ad)
2015-11-26 01:21:32 +09:00
Allen Wittenauer 38f8952c4d HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw) 2015-11-24 12:48:02 -08:00
Jason Lowe 7923130114 Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula."
This reverts commit 4356e8a5ef.

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
(cherry picked from commit 17b1a5482b)
2015-11-24 19:13:26 +00:00
Jian He b339a4b8d6 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
(cherry picked from commit 8676a118a1)
2015-11-23 17:20:24 -08:00
Haohui Mai 75b007260b Revert "HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling."
This reverts commit 74d67b2250.
2015-11-23 14:59:55 -08:00
Haohui Mai 1cdf422ba8 HADOOP-9822. create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor. Contributed by Tsuyoshi Ozawa. 2015-11-23 13:23:14 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) c824920527 HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 70c26703f4)
2015-11-23 10:00:40 -08:00
Haohui Mai f826195ee5 HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). Contributed by Gabor Liptak. 2015-11-22 23:07:51 -08:00
Haohui Mai c07fab5f6f HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:03:05 -08:00
Haohui Mai 16bcf66c1b HADOOP-11677. Add cookie flags for logs and static contexts. Contributed by nijel. 2015-11-22 19:53:19 -08:00
Haohui Mai 579f9030da HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran. 2015-11-22 19:46:13 -08:00
Haohui Mai afac7a2640 HADOOP-10068. Improve log4j regex in testFindContainingJar. Contributed by Robert Rati. 2015-11-22 18:29:10 -08:00
Haohui Mai 1d175f0f3f HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux. 2015-11-22 18:12:53 -08:00
Haohui Mai c7a9cbbdde HADOOP-10555. Add offset support to MurmurHash. Contributed by Sergey Shelukhin. 2015-11-22 18:00:41 -08:00
Haohui Mai 6ed8f24041 HADOOP-10035. Cleanup TestFilterFileSystem. Contributed by Suresh Srinivas. 2015-11-22 17:30:14 -08:00
Haohui Mai ac0694eb6e HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. Contributed by Varun Saxena. 2015-11-22 17:25:29 -08:00
Haohui Mai def7490b29 HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. Contributed by Masatake Iwasaki. 2015-11-22 16:56:22 -08:00
Haohui Mai 812dbea5c0 HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts. Contributed by Radhey Shah. 2015-11-22 16:04:06 -08:00
Haohui Mai 64add87f5c HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. Contributed by Vijay Singh. 2015-11-22 16:00:44 -08:00
Haohui Mai 74d67b2250 HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling. 2015-11-22 15:43:34 -08:00
Steve Loughran edcd0dc0b2 Revert "HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter."
This reverts commit b7e3f419bd.
2015-11-22 11:41:44 +00:00
Haohui Mai b7e3f419bd HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 2015-11-19 15:47:41 -08:00
Haohui Mai 03c292efb7 HADOOP-11901. BytesWritable fails to support 2G chunks due to integer overflow. Contributed by Reynold Xin. 2015-11-19 12:54:16 -08:00
Tsuyoshi Ozawa aa792b7d0c HADOOP-12575. Add build instruction for docker toolbox instead of boot2docker. Contributed by Kai Sasaki.
(cherry picked from commit 25e82b4eb9)
2015-11-19 17:44:21 +09:00
Tsuyoshi Ozawa c5fb02ba25 HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead of get() and getSize(). Contributed by Akira AJISAKA.
(cherry picked from commit bd166f0eed)
2015-11-19 17:27:35 +09:00
Tsuyoshi Ozawa eb4c9765d9 HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package. Contributed by Dustin Cote.
(cherry picked from commit 989b9e3e11)
2015-11-19 01:38:40 +09:00
Eric Yang 123e0b16f2 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431740 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8064849203)
2015-11-19 01:36:24 +09:00
Akira Ajisaka d5782a4199 HADOOP-12568. Update core-default.xml to describe posixGroups support. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4a3b8f1ed2)
2015-11-18 17:23:34 +09:00
cnauroth 397836a7b3 HADOOP-12567. NPE in SaslRpcServer. Contributed by Sergey Shelukhin.
(cherry picked from commit 7fab5c8cec)
2015-11-17 16:00:33 -08:00
Akira Ajisaka 8de7911eb3 MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun.
(cherry picked from commit a7f776ffdf)
2015-11-17 15:18:32 +09:00
Tsuyoshi Ozawa d66fe1155b Move HADOOP-11361, HADOOP-12348 and HADOOP-12482 from 2.8.0 to 2.7.3 in CHANGES.txt for backporting.
(cherry picked from commit c753617a48)
2015-11-14 14:44:17 +09:00
Akira Ajisaka 1b9385c56c Move HADOOP-12374 from 2.8.0 to 2.7.3 in CHANGES.txt.
(cherry picked from commit 47c79a2a4d)
2015-11-14 13:15:35 +09:00
Akira Ajisaka c5c663c05d HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad.
(cherry picked from commit f94d892704)
2015-11-13 21:53:23 +09:00
Haohui Mai 5d9212c139 HADOOP-12562. Make hadoop dockerfile usable by Yetus. Contributed by Allen Wittenauer. 2015-11-12 10:20:33 -08:00
Tsuyoshi Ozawa f6cecbfce5 Updated CHANGES.txt to move HADOOP-12526 to 2.6.3. 2015-11-11 23:21:36 +09:00
Vinod Kumar Vavilapalli b742ea7fe6 HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in
the first patch committed. (Karthik Kambatla via vinodkv)
2015-11-10 12:16:52 -08:00
Colin Patrick Mccabe 7a47989bc9 HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 (Mingliang Liu via Colin P. McCabe)
(cherry picked from commit 493e8ae552)
2015-11-10 10:58:36 -08:00
Lei Xu a7243de1a1 HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei)
(cherry picked from commit 0eb9c60c5b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-11-09 23:02:38 -08:00
Haohui Mai c91bd3aabb HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:26:01 -08:00
Sangjin Lee 7802248c23 HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 17:46:37 -08:00
Lei Xu 47941858af Revert "HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)"
This reverts commit 01ae30796d.
2015-11-06 09:52:21 -08:00
Jason Lowe 836bfdd646 Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3
(cherry picked from commit 74a9a51886)
2015-11-06 17:18:23 +00:00
Lei Xu 01ae30796d HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)
(cherry picked from commit bff7c90a56)
2015-11-05 18:36:55 -08:00
Colin Patrick Mccabe f7e6a5dfb1 Revert "HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)"
This reverts commit bb3b2977cd.
2015-11-05 11:11:27 -08:00
Colin Patrick Mccabe bb3b2977cd HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)
(cherry picked from commit 482e35c55a)
2015-11-05 10:46:12 -08:00
cnauroth 81f7e8af22 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade.
(cherry picked from commit 0fb1867fd6)
2015-11-04 10:29:01 -08:00
Haohui Mai 6d92778191 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou."
This reverts commit e7203b6954.
2015-11-04 10:22:21 -08:00
Jason Lowe b9389ac5b5 HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li
(cherry picked from commit b9d25c3ee2)
2015-11-04 16:35:12 +00:00
Jason Lowe 8334d86472 Add 2.7.3 release to CHANGES.txt
(cherry picked from commit 0383a3973b)
2015-11-04 16:27:28 +00:00
cnauroth afff29113a HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. Contributed by Chris Nauroth.
(cherry picked from commit 957f0311a1)
2015-11-02 22:25:12 -08:00
cnauroth c1d7b26e94 HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade.
(cherry picked from commit 9e7dcab185)
2015-11-02 10:21:46 -08:00
cnauroth c260d7ec78 HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth.
(cherry picked from commit 28790692624177d89fb1e4f59e2f83a659fc3089)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-11-02 09:39:27 -08:00
Arpit Agarwal bb2ee9f8eb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:11 -08:00
Sangjin Lee b2d6ea5e18 Updated the 2.6.2 final release date.
(cherry picked from commit a4a6b5b4b4)
2015-10-30 18:49:21 -07:00
Suresh Srinivas b8d586fd8a HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438213 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 16acd69e58)
2015-10-30 14:27:45 -07:00
Jason Lowe 8dce482f61 Creating 2.6.3 entries in CHANGES.txt files.
(cherry picked from commit eadf7b3096)
2015-10-30 14:52:06 +00:00
Zhe Zhang 30791cb0d0 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java

Change-Id: I5f5895bac4f7d7e66e95788765a514b80b9b6766
2015-10-29 11:21:57 -07:00
Jian He 7d109ef5b5 YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
(cherry picked from commit c41699965e)
2015-10-29 00:01:20 -07:00
Vinayakumar B dea66a8392 HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina)
(cherry picked from commit 7d2d16f4ee)
2015-10-29 11:30:59 +05:30
Sangjin Lee 16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
cnauroth c7f87dc2d0 HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth.
(cherry picked from commit 2d10cb8e00)
2015-10-28 09:44:21 -07:00
Steve Loughran fe079c8b20 HADOOP-12514. Make static fields in GenericTestUtils for assertExceptionContains() package-private and final. (Mingliang Liu via stevel) 2015-10-28 10:36:26 +00:00
cnauroth af0f2e27d1 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth.
(cherry picked from commit bf8e452982)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
2015-10-27 23:08:32 -07:00
cnauroth 0377795e06 HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu.
(cherry picked from commit 1f7ecb0c84)
2015-10-27 22:56:33 -07:00
cnauroth a23f79b92c HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth.
(cherry picked from commit 73822de7c3)
2015-10-27 22:49:04 -07:00
Zhihai Xu 73612294bd HADOOP-12178. NPE during handling of SASL setup if problem with SASL resolver class. Contributed by Steve Loughran
(cherry picked from commit ed9806ea40)
2015-10-27 10:09:45 -07:00
Tsuyoshi Ozawa 1035637200 HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. Contributed by Akira AJISAKA.
(cherry picked from commit ea6b183a1a)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
2015-10-27 10:58:50 +09:00
Jing Zhao 7d25646741 HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. Contributed by Steve Loughran.
(cherry picked from commit a01a209fbe)
2015-10-26 14:03:38 -07:00
Tsuyoshi Ozawa 07169e25ce HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by Akihiro Suda.
(cherry picked from commit 123b3db743)
2015-10-26 23:19:14 +09:00
Tsuyoshi Ozawa e85ebf0825 YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
2015-10-26 17:06:46 +09:00
Jitendra Pandey 63cebf57d0 HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu. 2015-10-23 12:17:20 -07:00
Jonathan Eagles 6db7bfbcfd YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
(cherry picked from commit f8adeb712d)
2015-10-23 10:43:59 -05:00
Tsuyoshi Ozawa de739cabb1 HADOOP-7266. Deprecate metrics v1. Contributed by Akira AJISAKA.
(cherry picked from commit 35a303dfbe)
2015-10-23 23:48:36 +09:00
Tsuyoshi Ozawa 525a67a62e HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa) 2015-10-23 06:54:24 +09:00
Tsuyoshi Ozawa 7d4246a5da Revert "HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong."
This reverts commit 3ed9db0a38.
2015-10-23 06:53:56 +09:00
cnauroth b023539c19 HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade.
(cherry picked from commit cb282d5b89)
2015-10-22 14:30:09 -07:00
Junping Du d5145b58f6 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.
(cherry picked from commit 0fce5f9a49)
2015-10-22 13:42:12 -07:00
cnauroth 10398daadf HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade.
(cherry picked from commit 47641fcbc9)
2015-10-22 12:21:44 -07:00
Tsuyoshi Ozawa 3ed9db0a38 HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong.
(cherry picked from commit 381610da62)
2015-10-22 11:59:25 +09:00
Andrew Wang 7a9b97e6b7 HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen.
(cherry picked from commit d1cdce77fa)
2015-10-21 15:21:15 -07:00
Ming Ma 39e7548cd9 HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma)
(cherry picked from commit e27c2ae8ba)
2015-10-21 08:24:02 -07:00
Kihwal Lee e327233e80 HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee.
(cherry picked from commit 01b103f4ff)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestRPC.java
2015-10-20 15:19:01 -05:00
Kihwal Lee e86819c91f HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee.
(cherry picked from commit 6144e0137b)
2015-10-19 10:56:19 -05:00
Vinayakumar B b6dce3834d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N)
(cherry picked from commit 7f0e1eb43d)
2015-10-19 12:16:44 +05:30
yliu 2c0dbf728a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:52:39 +08:00
Steve Loughran f7d746a81b HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:17 +01:00
Steve Loughran b390aae467 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:34 +01:00
Steve Loughran 10932aad29 HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel). 2015-10-18 11:45:11 +01:00
cnauroth 6774a1732a HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay.
(cherry picked from commit a121fa1d39)
2015-10-15 16:45:08 -07:00
cnauroth adb015847d HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth.
(cherry picked from commit fdd7406224)
2015-10-15 15:55:06 -07:00
Sangjin Lee afa57f1b48 HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee)
(cherry picked from commit 8d2d3eb7bb)
2015-10-15 11:49:03 -07:00
Steve Loughran 0e4fb329ed HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:33 +01:00
Colin Patrick Mccabe d37f88674f HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe)
(cherry picked from commit d286032b71)
2015-10-13 16:21:13 -07:00
Steve Loughran 5eab51a24f HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:47:54 +01:00
Tsuyoshi Ozawa 171e54e12c HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7. (stevel and ozawa)
(cherry picked from commit 33fefa33e5)
2015-10-14 05:32:01 +09:00
Haohui Mai 5c5362980c HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 2015-10-13 13:20:17 -07:00
Steve Loughran 38f86c0842 HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) 2015-10-13 21:13:41 +01:00
Haohui Mai 950e8a459e HADOOP-12474. MiniKMS should use random ports for Jetty server by default. Contributed by Mingliang Liu. 2015-10-13 13:08:03 -07:00
Colin Patrick Mccabe 535c903bc6 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe)
(cherry picked from commit 6716f15964)
2015-10-13 12:25:48 -07:00
Jitendra Pandey e7203b6954 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:14:01 -07:00
yliu 146f297d7d HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:05:47 +08:00
Haohui Mai f6b0fcdc75 Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu."
This reverts commit a412edf5c4.
2015-10-10 03:25:16 -07:00
Haohui Mai a412edf5c4 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:13 -07:00
Akira Ajisaka 2c6c9e315c HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang.
(cherry picked from commit e1bf8b3df6)
2015-10-09 11:10:54 +09:00
Akira Ajisaka 613c7088fd HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit 7fbf69bf47)
2015-10-08 06:09:02 +09:00
Steve Loughran fa3e774295 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:33 +01:00
cnauroth 535762fadb HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth.
(cherry picked from commit 5f6edb30c2)
2015-10-05 20:12:33 -07:00
Colin Patrick Mccabe a509413c9a HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 3e1752f9fb)
2015-10-05 11:36:00 -07:00
Vinod Kumar Vavilapalli b876babdc7 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan.
(cherry picked from commit f1c19b9365)
2015-10-05 10:57:55 -07:00
Tsuyoshi Ozawa e6514c6a3b HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8.
(cherry picked from commit 30e2f836a2)
2015-10-05 08:15:40 +09:00
Harsh J 21b4ba48ce HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.
(cherry picked from commit c918f7be5e)
2015-10-03 18:39:22 +05:30
Jason Lowe 3e3733437f YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu
(cherry picked from commit fdf02d1f26)
2015-10-02 20:21:32 +00:00
Akira Ajisaka 966f9508c3 HADOOP-12230. hadoop-project declares duplicate, conflicting curator dependencies. Contributed by Rakesh R. 2015-10-02 12:40:05 +02:00
Zhihai Xu 07f9405692 HADOOP-8437. getLocalPathForWrite should throw IOException for invalid paths. Contributed by Brahma Reddy Battula
(cherry picked from commit fd026f535c)
2015-10-01 12:04:27 -07:00
Karthik Kambatla db145e0c9a HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. (kasha) 2015-10-01 11:29:50 -07:00
Akira Ajisaka c6f30e5913 HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru.
(cherry picked from commit ecbfd68974)
2015-10-01 18:35:19 +02:00
yliu 3625222635 HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) 2015-09-30 11:04:09 +08:00
Haohui Mai baa6ef0207 HDFS-9174. Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread. Contributed by Yi Liu. 2015-09-29 14:56:13 -07:00
Colin Patrick Mccabe 171bd1cb2b HADOOP-12447. Clean up some htrace integration issues (cmccabe)
(cherry picked from commit 850d679acb)
2015-09-29 09:38:10 -07:00
yliu 9c47ab32b1 HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu) 2015-09-29 16:23:50 +08:00
Ming Ma ac7d85efb2 HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down. (Xiao Chen via mingma)
(cherry picked from commit 5c3b663bf9)
2015-09-28 18:14:29 -07:00
Kihwal Lee 95b8f1f3a6 HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu.
(cherry picked from commit 3abbdc929b)
2015-09-28 17:33:20 -05:00
Colin Patrick Mccabe 3b9d32627f HDFS-9080. Update htrace version to 4.0.1 (cmccabe)
(cherry picked from commit 892ade689f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/BlockStorageLocationUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
2015-09-28 08:15:00 -07:00
Vinayakumar B 1c7b3b98c1 HADOOP-11984. Enable parallel JUnit tests in pre-commit (Contributed by Chris Nauroth)
(cherry picked from commit f0f984e4e6)
2015-09-27 14:12:34 +05:30
Vinayakumar B b46e4ceafd HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid (Contributed by nijel)
(cherry picked from commit 861b52db24)
2015-09-26 21:37:24 +05:30
cnauroth 85c0cb0075 HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 7fe521b1dd)
2015-09-25 22:34:10 -07:00
Yongjun Zhang 16ae3f5d46 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang)
(cherry picked from commit 3187dbd7a8)
2015-09-24 21:41:48 -07:00
Zhihai Xu 4ba0febd58 HADOOP-12252. LocalDirAllocator should not throw NPE with empty string configuration. Contributed by Zhihai Xu
(cherry picked from commit 52c1f272ec)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-09-24 12:40:39 -07:00
Harsh J 9bb6fba759 HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389799 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a7e450c7cc)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-09-24 12:30:55 -07:00
Arpit Agarwal 3c06162259 HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:58 -07:00
Haohui Mai 75c70339ab HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth. 2015-09-23 19:34:19 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) f48af332a7 Release process for 2.6.1: Set the release date for 2.6.1
(cherry picked from commit 1f707ecffd)
2015-09-23 15:12:30 -07:00
Vinayakumar B 017dff9877 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore)
(cherry picked from commit a2c76e5f26)
2015-09-23 15:45:21 +05:30
Tsuyoshi Ozawa 52cc2ca488 HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
(cherry picked from commit dfd807afab)
2015-09-22 12:54:44 +09:00
Steve Loughran a38dceda66 HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) 2015-09-19 12:41:29 +01:00
Zhihai Xu 6c66dd4875 HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu
(cherry picked from commit 88d89267ff)
2015-09-18 10:44:53 -07:00
Zhihai Xu 7c429fbaa9 Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu"
This reverts commit 7576b4247b.
2015-09-18 10:25:38 -07:00
Zhihai Xu 7576b4247b Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu
(cherry picked from commit e690a32e57)
2015-09-18 08:27:58 -07:00
Wangda Tan 1f75e951f5 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda)
(cherry picked from commit 6b97fa6652)
2015-09-17 17:47:22 -07:00
Jason Lowe 316296e35f MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
(cherry picked from commit 58d1a02b8d)
2015-09-17 14:31:57 +00:00
Haohui Mai d5936aa48c HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:54 -07:00
Eric Yang b4bb8e1731 HADOOP-12374. Updated expunge command description.
(WeiWei Yang via eyang)
2015-09-15 20:05:01 -07:00
Akira Ajisaka e38e5b56bd HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu.
(cherry picked from commit 77aaf4cf7d)
2015-09-16 10:20:53 +09:00
Vinayakumar B 2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru)
(cherry picked from commit ce69c9b54c)
2015-09-16 00:18:59 +05:30
cnauroth be9354d010 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu.
(cherry picked from commit b2017d9b03)
2015-09-15 10:42:02 -07:00
Vinayakumar B aa963ab441 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore)
(cherry picked from commit a440567491)
2015-09-15 17:33:15 +05:30
Steve Loughran 988749e6ea HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:06 +01:00
Steve Loughran c8fe31e03a HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:55:42 +01:00
Steve Loughran c4128165b5 syncing branch-2 and trunk CHANGES.TXT to be closer together 2015-09-12 18:52:04 +01:00