Commit Graph

2875 Commits

Author SHA1 Message Date
Zhe Zhang 84dcd1a802 HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it configurable. (zhz)
Change-Id: Iabb766f6311b83a1ac03093b0ba26a0284b74d70
2016-02-11 09:29:14 -08:00
Uma Maheswara Rao G e90f7ef988 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
(cherry picked from commit df4dcd3e75)
2016-02-10 15:04:42 -08:00
Jason Lowe fa9b3e6302 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
(cherry picked from commit 6f03959e4d)
2016-02-10 21:54:50 +00:00
Sangjin Lee 463195dbe6 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
(cherry picked from commit 58acbf940a)
2016-02-08 13:57:44 -08:00
cnauroth a76611d4ec HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570a)
2016-02-08 09:36:18 -08:00
Varun Vasudev 2451a0a8e0 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit d37eb828ff)
2016-02-08 20:19:51 +05:30
Varun Vasudev 368a11f3dd Revert "HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana."
This reverts commit f3bbe0bd02.

(cherry picked from commit af218101e5)
2016-02-08 20:17:10 +05:30
Varun Vasudev fd971debee HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
(cherry picked from commit f3bbe0bd02)
2016-02-08 14:23:19 +05:30
Andrew Wang 915ce5d960 HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. Contributed by Daniel Templeton.
(cherry picked from commit 5b59a0ea85)
2016-02-06 20:52:49 -08:00
Steve Loughran 60474a769e HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:20:24 +00:00
cnauroth 4db6cc44cd HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
2016-02-05 15:52:14 -08:00
cnauroth 5752df2362 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e84)
2016-02-05 14:38:31 -08:00
Kihwal Lee 51a705432c HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f)
2016-02-05 15:47:56 -06:00
Colin Patrick Mccabe 86760c0f52 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3)
2016-02-05 10:57:47 -08:00
Xiaoyu Yao e0a356fee3 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7)
2016-02-05 10:38:02 -08:00
Xuan dfad608b22 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298c)
2016-02-03 20:06:25 -08:00
Sangjin Lee b0ab6df079 HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a39493)
2016-02-03 09:00:41 -08:00
Junping Du 3583c77ee8 Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:09:17 -08:00
Andrew Wang b4ad58796b HADOOP-12755. Fix typo in defaultFS warning message.
(cherry picked from commit 8171874dd1)
2016-02-02 11:56:47 -08:00
Karthik Kambatla 363a8212ec HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha)
(cherry picked from commit ee005e010c)
2016-01-28 17:45:50 -08:00
Colin Patrick Mccabe b94fbdf6f0 HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d465)
2016-01-27 11:40:42 -08:00
Yongjun Zhang a1f913fb6e HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355)
2016-01-27 08:05:17 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 97f6cfa94b Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40)
2016-01-25 15:47:02 -08:00
Walter Su 75b83af20e HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 6eacdea0e4)
2016-01-25 19:42:56 +08:00
Akira Ajisaka 38ec290455 HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a)
2016-01-25 13:59:48 +09:00
Akira Ajisaka 4edd7bd820 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a79)
2016-01-25 13:48:28 +09:00
Kihwal Lee b5db1d4410 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:19:23 -06:00
Akira Ajisaka 6368d102b9 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
(cherry picked from commit 0bae506c22)
2016-01-22 21:09:09 +09:00
Xiaoyu Yao 4d9efaf3b0 HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
(cherry picked from commit f3427d3766)
2016-01-21 13:55:42 -08:00
Akira Ajisaka cd5c66b080 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
(cherry picked from commit 2ac39ca762)
2016-01-22 02:45:54 +09:00
Vinayakumar B c13929b385 HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
(cherry picked from commit 446987e20a)
2016-01-21 20:10:11 +05:30
Masatake Iwasaki 54df2a4352 HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims)
(cherry picked from commit 9eec6cbedc)
2016-01-21 18:17:03 +09:00
Lei Xu c57f55223c HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
(cherry picked from commit 2ec438e8f7)
2016-01-20 14:26:47 -08:00
Ravi Prakash 2cbb8bbd72 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
(cherry picked from commit 1acc509b45)
2016-01-19 14:00:54 -08:00
Wangda Tan 23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac)
2016-01-19 21:28:51 +08:00
Akira Ajisaka 3a8d372518 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
(cherry picked from commit 92c5f565fd)
2016-01-19 13:31:48 +09:00
cnauroth 62d6166211 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
(cherry picked from commit 8bc93db2e7)
2016-01-18 09:09:05 -08:00
cnauroth 2b9ea68ef8 HADOOP-12691. Move files to correct location.
(cherry picked from commit da77f423d1)
2016-01-16 07:47:52 -08:00
Colin Patrick Mccabe c33603be36 HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng via cmccabe)
(cherry picked from commit 2a30386539)

Conflicts:
	BUILDING.txt
	hadoop-common-project/hadoop-common/src/CMakeLists.txt
	hadoop-project-dist/pom.xml
2016-01-15 14:10:13 -08:00
Colin Patrick Mccabe 48b8c99479 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
(cherry picked from commit b2c155f810)
2016-01-15 13:22:14 -08:00
Andrew Wang 2a6224aa0f HADOOP-12713. Disable spurious checkstyle checks.
(cherry picked from commit 5d5a22a878)
2016-01-15 11:58:58 -08:00
Akira Ajisaka a2d0c8ff9c Move HADOOP-12590 from 2.9.0 to 2.8.0 in CHANGES.txt.
(cherry picked from commit 1da762c745)
2016-01-15 10:48:58 +09:00
Jason Lowe 81cda7608b HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
(cherry picked from commit cdf8895259)
2016-01-14 23:47:29 +00:00
Jason Lowe 86456b01eb Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6
(cherry picked from commit 651c23e8ef)
2016-01-14 23:42:58 +00:00
cnauroth 9600736d89 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit 06f4ac0ccd)
2016-01-14 11:56:11 -08:00
Colin Patrick Mccabe cea1c71087 HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)
(cherry picked from commit b1ed28fa77)

Conflicts:
	hadoop-common-project/hadoop-common/pom.xml
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/pom.xml
2016-01-14 11:13:13 -08:00
Akira Ajisaka f0b1b53173 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
2016-01-15 00:33:06 +09:00
Colin Patrick Mccabe 2baeaa20a3 HDFS-9517. Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe)
(cherry picked from commit 8315582c4f)
2016-01-13 16:33:02 -08:00
Karthik Kambatla 327297a600 HADOOP-12683. Add number of samples in last interval in snapshot of MutableStat. (Vikram Srivastava via kasha)
(cherry picked from commit fb64e6051a)
2016-01-13 15:44:08 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 1fba4051f8 HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753da)
2016-01-13 14:56:08 -08:00
cnauroth 2605e78e44 HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
2016-01-12 15:41:46 -08:00
Lei Xu 63b8be149a HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) 2016-01-12 12:21:29 -08:00
Colin Patrick Mccabe 181437cccf HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP address (cmccabe)
(cherry picked from commit 30c7dfd8ba)
2016-01-12 10:46:57 -08:00
Akira Ajisaka df95343047 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
2016-01-12 13:34:44 +09:00
cnauroth 813841e10b HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
(cherry picked from commit 0e76f1fcea)
2016-01-09 22:18:22 -08:00
Benoy Antony 4e5f77b7f5 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony)
(cherry picked from commit dec8dfdfa6)
2016-01-09 13:43:15 -08:00
Steve Loughran 80734bc346 HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 2016-01-09 11:10:20 +00:00
cnauroth debd13387d HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
(cherry picked from commit f0fa6d869b)
2016-01-08 20:19:11 -08:00
rohithsharmaks 20bb5c403e Revert "HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)"
This reverts commit 2b252844e0.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit ed18527e38)
2016-01-08 14:37:01 +05:30
Steve Loughran ee9611719f HADOOP-12573. TestRPC.testClientBackOff failing. (Xiao Chen via stevel) 2016-01-07 16:18:25 +00:00
Steve Loughran c6f7c30a8d HADOOP-12597. In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name. (Surendra Singh Lilhore via stevel) 2016-01-07 16:00:37 +00:00
Steve Loughran c329cab92c HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel) 2016-01-07 15:03:59 +00:00
Steve Loughran 38181e1dcd HADOOP-12655. TestHttpServer.testBindAddress patch - move from improvement to bug fix 2016-01-07 15:03:05 +00:00
Steve Loughran 83932ced71 HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider than expected. (Wei-Chiu Chuang via stevel) 2016-01-07 14:51:34 +00:00
Steve Loughran ccd2be99cc HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. (BELUGA BEHR via stevel) 2016-01-07 14:45:19 +00:00
Steve Loughran 29747001f0 HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:47 +00:00
rohithsharmaks 2c841e6564 HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)
(cherry picked from commit 2b252844e0)
2016-01-07 10:43:52 +05:30
cnauroth 4753676a34 HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
(cherry picked from commit 978bbdfeb2)
2016-01-06 11:16:18 -08:00
Ravi Prakash 6330683778 HADOOP-12689. S3 filesystem operations stopped working correctly
(cherry picked from commit 2d16f40dab)
2016-01-05 23:43:17 -08:00
Yongjun Zhang fc6c940464 HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang)
(cherry picked from commit 28bd138018)
2016-01-05 11:19:22 -08:00
Uma Mahesh cdd796d199 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng
(cherry picked from commit 778146eaae)
2016-01-04 15:04:46 -08:00
Akira Ajisaka 40b41ac8fc HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi.
(cherry picked from commit 1af2917856)
2016-01-04 20:33:46 +09:00
Akira Ajisaka 247ab92464 Set release date for 2.6.3
(cherry picked from commit db99e30f67)
2016-01-04 16:12:52 +09:00
Akira Ajisaka d98cfe611f HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki.
(cherry picked from commit 64ae85fd2e)
2016-01-04 14:32:08 +09:00
Xiaoyu Yao a65e159c59 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth.
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
2015-12-30 11:12:02 -08:00
Xiaoyu Yao d590c17851 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit ab725cff66)
2015-12-30 10:43:44 -08:00
Xiaoyu Yao c664062fb3 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang.
(cherry picked from commit 993311e547)
2015-12-28 10:42:15 -08:00
Akira Ajisaka babe025fb0 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki. 2015-12-28 14:38:56 +09:00
Karthik Kambatla a98887d8b5 HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha)
(cherry picked from commit 8b1837fcd1)
2015-12-23 14:38:24 -08:00
Akira Ajisaka 7526a2a005 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
(cherry picked from commit fa544020f6)
2015-12-21 21:23:28 +09:00
Chris Douglas d984ba4fd7 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri
(cherry picked from commit 8652cce5b2)
2015-12-18 18:31:20 -08:00
cnauroth dd91cf9fa5 HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal.
(cherry picked from commit 932956458d)
2015-12-18 16:25:06 -08:00
Arpit Agarwal e0a40b2dc2 HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:06:12 -08:00
Zhe Zhang 223b47b398 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:05:21 -08:00
Akira Ajisaka af49823499 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit 061c05cc05)
2015-12-18 14:00:07 +09:00
Akira Ajisaka e06c291245 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki.
(cherry picked from commit bd5e207432)
2015-12-18 13:12:56 +09:00
Vinod Kumar Vavilapalli 36781a3a5a HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos)
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62)
2015-12-16 14:41:25 -08:00
Uma Mahesh dd3867ab9f HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh)
(cherry picked from commit ae67c8424c)
2015-12-15 15:19:27 -08:00
Akira Ajisaka 5047ee56af HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki.
(cherry picked from commit eee0cf4611)
2015-12-11 16:18:58 +09:00
Robert Kanter 8dfaa7ded6 HADOOP-12625. Add a config to disable the /logs endpoints (rkanter)
(cherry picked from commit e27fffdb90)
2015-12-09 14:35:50 -08:00
Uma Mahesh d20681896b HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh)
(cherry picked from commit ad53c52063)
2015-12-08 22:57:00 -08:00
mattf 472541291b HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:35:25 -08:00
Haohui Mai 417fbf2dca HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:42:24 +08:00
Steve Loughran af14458de7 HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072] 2015-12-06 17:42:56 +00:00
Xiaoyu Yao eb7f9901b4 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao.
(cherry picked from commit cbc7b6bf97)
2015-12-04 16:57:58 -08:00
Jian He be404e1680 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
(cherry picked from commit 755dda8dd8)
2015-12-03 17:46:09 -08:00
Akira Ajisaka 15c2f709c6 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu.
(cherry picked from commit 3857fed2c8)
2015-12-03 11:51:56 +08:00
Arpit Agarwal 19c2c22bbe HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 09:29:07 -08:00
Allen Wittenauer 45bb467918 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:16:20 -08:00
Junping Du 092c469059 Creating 2.6.4 entries in CHANGES.txt files.
(cherry picked from commit 028894281b)
2015-12-01 08:18:57 -08:00