Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,769 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

2314 Commits

Author SHA1 Message Date
Akira Ajisaka 96a0939d5b HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c3136cbd8)
 2016-03-03 23:23:12 +09:00
Akira Ajisaka 9e87f59dea HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 
(cherry picked from commit eb864d35d6)
 2016-03-03 18:51:50 +09:00
Masatake Iwasaki 69e024f8fa HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317ccc)
 2016-03-03 17:14:53 +09:00
Arpit Agarwal 7b4a1001ea HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:38 -08:00
Colin Patrick Mccabe 5998b20d63 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019)
 2016-03-02 18:18:45 -08:00
Akira Ajisaka 67e8489ac6 HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 2016-03-02 00:20:57 +09:00
Karthik Kambatla c1855a33eb HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha) 
(cherry picked from commit 680f3fc02d)
 2016-02-29 19:00:22 -08:00
Jian He 3e842de1d5 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 2016-02-29 16:24:30 -08:00
Haohui Mai c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Suresh Srinivas fca24fbbaa HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
 2016-02-29 11:35:19 +09:00
Chris Nauroth 2e761dabd8 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay. 
(cherry picked from commit 7634d404b7)
 2016-02-28 11:23:02 -08:00
Li Lu 090f74c741 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9) 
(cherry-picked from commit 7545ce6636)
 2016-02-27 22:03:49 -08:00
Steve Loughran 4d870b1faa HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:53 +00:00
Chris Nauroth c692d7c52f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit 798babf661)
 2016-02-26 21:59:14 -08:00
Lei Xu 49a10a3cec HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei) 
(cherry picked from commit 2093acf6b6)
 2016-02-26 10:48:35 -08:00
Suresh Srinivas b1d497a7de HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
 2016-02-27 01:27:00 +09:00
Masatake Iwasaki b0091338f2 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 2016-02-26 15:32:07 +09:00
Karthik Kambatla 6722e17f6d HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha) 
(cherry picked from commit c2460dad64)
 2016-02-25 16:36:07 -08:00
Xiaoyu Yao 7ad6ca1eb2 HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:50:36 -08:00
cnauroth 92e49cdd04 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao. 
(cherry picked from commit d6b181c6fa)
 2016-02-24 14:05:55 -08:00
Colin Patrick Mccabe 7dfcf40352 HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe) 
(cherry picked from commit d9c409a428)
 2016-02-23 11:27:55 -08:00
cnauroth a5511debdb HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 
(cherry picked from commit 27b77751c1)
 2016-02-22 17:30:32 -08:00
Zhe Zhang 56b7f2c2c1 HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
 2016-02-22 14:14:39 -08:00
Junping Du e38c2ef6c5 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala. 
(cherry picked from commit 18f9b77a32)
 2016-02-19 14:22:39 -08:00
Yongjun Zhang 36c08f793a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a963baba10)
 2016-02-19 09:57:45 -08:00
cnauroth b4c4f30fa4 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 
(cherry picked from commit 8ab7658025)
 2016-02-18 14:07:09 -08:00
Tsz-Wo Nicholas Sze 38fc086940 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 12:02:00 -08:00
Robert Kanter f864faaafa HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) 
(cherry picked from commit a365a3941c)
 2016-02-18 11:11:32 -08:00
cnauroth 779a69e28d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 
(cherry picked from commit 5d1889a66d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java
 2016-02-18 10:09:33 -08:00
Xiaoyu Yao ad4fcd1f9f HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 
(cherry picked from commit fe5624b85d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
 2016-02-17 16:05:07 -08:00
Zhe Zhang e226dbbc8a HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz) 
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
 2016-02-17 13:31:48 -08:00
Xiaoyu Yao 91c4a3a816 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao. 
(cherry picked from commit fd1befb6ba)
 2016-02-17 08:44:37 -08:00
Masatake Iwasaki 3e80aece2e HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit 1a1c2f5bab)
 2016-02-18 00:25:20 +09:00
Vinayakumar B 2bf5a005fa HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea309431)
 2016-02-17 10:15:08 +05:30
Vinayakumar B e79a5e4460 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 
(cherry picked from commit 4b0e59fdc0)
 2016-02-16 17:32:35 +05:30
Akira Ajisaka a670165bbd HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 
(cherry picked from commit 1c48e50ce7)
 2016-02-15 11:38:54 +09:00
Masatake Iwasaki 7a67f8f709 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims) 
(cherry picked from commit 36ba5cac37)
 2016-02-13 15:01:08 +09:00
Arpit Agarwal 63f51208a8 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:12 -08:00
Vinayakumar B 488e6cbe16 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula) 
(cherry picked from commit c78740a979)
 2016-02-12 11:55:16 +05:30
Karthik Kambatla 383f3ff28c HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha) 
(cherry picked from commit 33ce7f6c07)
 2016-02-11 20:45:23 -08:00
Uma Maheswara Rao G e90f7ef988 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit df4dcd3e75)
 2016-02-10 15:04:42 -08:00
Jason Lowe fa9b3e6302 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger 
(cherry picked from commit 6f03959e4d)
 2016-02-10 21:54:50 +00:00
Sangjin Lee 463195dbe6 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 
(cherry picked from commit 58acbf940a)
 2016-02-08 13:57:44 -08:00
cnauroth a76611d4ec HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran. 
(cherry picked from commit cf3261570a)
 2016-02-08 09:36:18 -08:00
Varun Vasudev 2451a0a8e0 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana. 
(cherry picked from commit d37eb828ff)
 2016-02-08 20:19:51 +05:30
Andrew Wang 915ce5d960 HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. Contributed by Daniel Templeton. 
(cherry picked from commit 5b59a0ea85)
 2016-02-06 20:52:49 -08:00
Steve Loughran 60474a769e HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:20:24 +00:00
cnauroth 4db6cc44cd HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran. 
(cherry picked from commit cfa8513890)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh
 2016-02-05 15:52:14 -08:00
cnauroth 5752df2362 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay. 
(cherry picked from commit a37e423e84)
 2016-02-05 14:38:31 -08:00
Kihwal Lee 51a705432c HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla. 
(cherry picked from commit 49e176c29f)
 2016-02-05 15:47:56 -06:00
Colin Patrick Mccabe 86760c0f52 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe) 
(cherry picked from commit 9086dd58c3)
 2016-02-05 10:57:47 -08:00
Xiaoyu Yao e0a356fee3 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou. 
(cherry picked from commit 5d00067ca7)
 2016-02-05 10:38:02 -08:00
Xuan dfad608b22 YARN-4662. Document some newly added metrics. Contributed by Jian He 
(cherry picked from commit 63c63e298c)
 2016-02-03 20:06:25 -08:00
Andrew Wang b4ad58796b HADOOP-12755. Fix typo in defaultFS warning message. 
(cherry picked from commit 8171874dd1)
 2016-02-02 11:56:47 -08:00
Karthik Kambatla 363a8212ec HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha) 
(cherry picked from commit ee005e010c)
 2016-01-28 17:45:50 -08:00
Colin Patrick Mccabe b94fbdf6f0 HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe) 
(cherry picked from commit 2e8ab3d465)
 2016-01-27 11:40:42 -08:00
Yongjun Zhang a1f913fb6e HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 97056c3355)
 2016-01-27 08:05:17 -08:00
Walter Su 75b83af20e HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 6eacdea0e4)
 2016-01-25 19:42:56 +08:00
Akira Ajisaka 38ec290455 HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a)
 2016-01-25 13:59:48 +09:00
Akira Ajisaka 4edd7bd820 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 736eb17a79)
 2016-01-25 13:48:28 +09:00
Kihwal Lee b5db1d4410 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:19:23 -06:00
Xiaoyu Yao 4d9efaf3b0 HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu. 
(cherry picked from commit f3427d3766)
 2016-01-21 13:55:42 -08:00
Vinayakumar B c13929b385 HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal) 
(cherry picked from commit 446987e20a)
 2016-01-21 20:10:11 +05:30
Masatake Iwasaki 54df2a4352 HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims) 
(cherry picked from commit 9eec6cbedc)
 2016-01-21 18:17:03 +09:00
Lei Xu c57f55223c HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 
(cherry picked from commit 2ec438e8f7)
 2016-01-20 14:26:47 -08:00
Ravi Prakash 2cbb8bbd72 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano 
(cherry picked from commit 1acc509b45)
 2016-01-19 14:00:54 -08:00
Wangda Tan 23deeb4230 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 
(cherry picked from commit 89d1fd5dac)
 2016-01-19 21:28:51 +08:00
Akira Ajisaka 3a8d372518 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 
(cherry picked from commit 92c5f565fd)
 2016-01-19 13:31:48 +09:00
cnauroth 2b9ea68ef8 HADOOP-12691. Move files to correct location. 
(cherry picked from commit da77f423d1)
 2016-01-16 07:47:52 -08:00
Colin Patrick Mccabe 48b8c99479 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 
(cherry picked from commit b2c155f810)
 2016-01-15 13:22:14 -08:00
Jason Lowe 81cda7608b HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 
(cherry picked from commit cdf8895259)
 2016-01-14 23:47:29 +00:00
Akira Ajisaka f0b1b53173 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge. 
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
 2016-01-15 00:33:06 +09:00
Karthik Kambatla 327297a600 HADOOP-12683. Add number of samples in last interval in snapshot of MutableStat. (Vikram Srivastava via kasha) 
(cherry picked from commit fb64e6051a)
 2016-01-13 15:44:08 -08:00
cnauroth 2605e78e44 HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
 2016-01-12 15:41:46 -08:00
Lei Xu 63b8be149a HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) 2016-01-12 12:21:29 -08:00
Colin Patrick Mccabe 181437cccf HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP address (cmccabe) 
(cherry picked from commit 30c7dfd8ba)
 2016-01-12 10:46:57 -08:00
Akira Ajisaka df95343047 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
 2016-01-12 13:34:44 +09:00
Benoy Antony 4e5f77b7f5 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 
(cherry picked from commit dec8dfdfa6)
 2016-01-09 13:43:15 -08:00
Steve Loughran 80734bc346 HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 2016-01-09 11:10:20 +00:00
rohithsharmaks 20bb5c403e Revert "HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)" 
This reverts commit 2b252844e0.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit ed18527e38)
 2016-01-08 14:37:01 +05:30
Steve Loughran ee9611719f HADOOP-12573. TestRPC.testClientBackOff failing. (Xiao Chen via stevel) 2016-01-07 16:18:25 +00:00
Steve Loughran c329cab92c HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel) 2016-01-07 15:03:59 +00:00
Steve Loughran 83932ced71 HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider than expected. (Wei-Chiu Chuang via stevel) 2016-01-07 14:51:34 +00:00
Steve Loughran ccd2be99cc HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. (BELUGA BEHR via stevel) 2016-01-07 14:45:19 +00:00
Steve Loughran 29747001f0 HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:47 +00:00
rohithsharmaks 2c841e6564 HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks) 
(cherry picked from commit 2b252844e0)
 2016-01-07 10:43:52 +05:30
Yongjun Zhang fc6c940464 HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang) 
(cherry picked from commit 28bd138018)
 2016-01-05 11:19:22 -08:00
Uma Mahesh cdd796d199 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 
(cherry picked from commit 778146eaae)
 2016-01-04 15:04:46 -08:00
Akira Ajisaka 40b41ac8fc HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi. 
(cherry picked from commit 1af2917856)
 2016-01-04 20:33:46 +09:00
Akira Ajisaka d98cfe611f HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 
(cherry picked from commit 64ae85fd2e)
 2016-01-04 14:32:08 +09:00
Xiaoyu Yao d590c17851 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit ab725cff66)
 2015-12-30 10:43:44 -08:00
Xiaoyu Yao c664062fb3 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang. 
(cherry picked from commit 993311e547)
 2015-12-28 10:42:15 -08:00
Karthik Kambatla a98887d8b5 HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha) 
(cherry picked from commit 8b1837fcd1)
 2015-12-23 14:38:24 -08:00
Akira Ajisaka 7526a2a005 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6)
 2015-12-21 21:23:28 +09:00
Chris Douglas d984ba4fd7 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri 
(cherry picked from commit 8652cce5b2)
 2015-12-18 18:31:20 -08:00
cnauroth dd91cf9fa5 HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 
(cherry picked from commit 932956458d)
 2015-12-18 16:25:06 -08:00
Zhe Zhang 223b47b398 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
 2015-12-18 16:05:21 -08:00
Akira Ajisaka af49823499 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 061c05cc05)
 2015-12-18 14:00:07 +09:00
Akira Ajisaka e06c291245 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki. 
(cherry picked from commit bd5e207432)
 2015-12-18 13:12:56 +09:00
Uma Mahesh dd3867ab9f HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh) 
(cherry picked from commit ae67c8424c)
 2015-12-15 15:19:27 -08:00
Akira Ajisaka 5047ee56af HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit eee0cf4611)
 2015-12-11 16:18:58 +09:00
Robert Kanter 8dfaa7ded6 HADOOP-12625. Add a config to disable the /logs endpoints (rkanter) 
(cherry picked from commit e27fffdb90)
 2015-12-09 14:35:50 -08:00
Uma Mahesh d20681896b HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh) 
(cherry picked from commit ad53c52063)
 2015-12-08 22:57:00 -08:00
Haohui Mai 417fbf2dca HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:42:24 +08:00
Steve Loughran af14458de7 HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072] 2015-12-06 17:42:56 +00:00
Xiaoyu Yao eb7f9901b4 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 
(cherry picked from commit cbc7b6bf97)
 2015-12-04 16:57:58 -08:00
Jian He be404e1680 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan 
(cherry picked from commit 755dda8dd8)
 2015-12-03 17:46:09 -08:00
Akira Ajisaka 15c2f709c6 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu. 
(cherry picked from commit 3857fed2c8)
 2015-12-03 11:51:56 +08:00
Arpit Agarwal 19c2c22bbe HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 09:29:07 -08:00
Allen Wittenauer 45bb467918 HADOOP-12366. expose calculated paths (aw) 2015-12-01 08:16:20 -08:00
cnauroth 669743ce11 HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth. 
(cherry picked from commit b2c78536cb)
 2015-11-28 15:40:13 -08:00
Yongjun Zhang 165abe6c4f HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 0348e769ab)
 2015-11-25 18:48:10 -08:00
Robert Kanter 8c6273d117 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 
(cherry picked from commit 7fd00b3db4)
 2015-11-25 17:03:52 -08:00
Allen Wittenauer 38f8952c4d HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw) 2015-11-24 12:48:02 -08:00
Jason Lowe 7923130114 Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula." 
This reverts commit 4356e8a5ef.

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
(cherry picked from commit 17b1a5482b)
 2015-11-24 19:13:26 +00:00
Jian He b339a4b8d6 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan 
(cherry picked from commit 8676a118a1)
 2015-11-23 17:20:24 -08:00
Haohui Mai 75b007260b Revert "HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling." 
This reverts commit 74d67b2250.
 2015-11-23 14:59:55 -08:00
Haohui Mai 1cdf422ba8 HADOOP-9822. create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor. Contributed by Tsuyoshi Ozawa. 2015-11-23 13:23:14 -08:00
Haohui Mai f826195ee5 HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). Contributed by Gabor Liptak. 2015-11-22 23:07:51 -08:00
Haohui Mai c07fab5f6f HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:03:05 -08:00
Haohui Mai 16bcf66c1b HADOOP-11677. Add cookie flags for logs and static contexts. Contributed by nijel. 2015-11-22 19:53:19 -08:00
Haohui Mai 579f9030da HADOOP-11149. Increase the timeout of TestZKFailoverController. Contributed by Steve Loughran. 2015-11-22 19:46:13 -08:00
Haohui Mai afac7a2640 HADOOP-10068. Improve log4j regex in testFindContainingJar. Contributed by Robert Rati. 2015-11-22 18:29:10 -08:00
Haohui Mai 1d175f0f3f HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux. 2015-11-22 18:12:53 -08:00
Haohui Mai c7a9cbbdde HADOOP-10555. Add offset support to MurmurHash. Contributed by Sergey Shelukhin. 2015-11-22 18:00:41 -08:00
Haohui Mai 6ed8f24041 HADOOP-10035. Cleanup TestFilterFileSystem. Contributed by Suresh Srinivas. 2015-11-22 17:30:14 -08:00
Haohui Mai 812dbea5c0 HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts. Contributed by Radhey Shah. 2015-11-22 16:04:06 -08:00
Haohui Mai 74d67b2250 HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling. 2015-11-22 15:43:34 -08:00
Steve Loughran edcd0dc0b2 Revert "HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter." 
This reverts commit b7e3f419bd.
 2015-11-22 11:41:44 +00:00
Haohui Mai b7e3f419bd HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 2015-11-19 15:47:41 -08:00
Haohui Mai 03c292efb7 HADOOP-11901. BytesWritable fails to support 2G chunks due to integer overflow. Contributed by Reynold Xin. 2015-11-19 12:54:16 -08:00
Tsuyoshi Ozawa c5fb02ba25 HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead of get() and getSize(). Contributed by Akira AJISAKA. 
(cherry picked from commit bd166f0eed)
 2015-11-19 17:27:35 +09:00
Tsuyoshi Ozawa eb4c9765d9 HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package. Contributed by Dustin Cote. 
(cherry picked from commit 989b9e3e11)
 2015-11-19 01:38:40 +09:00
Eric Yang 123e0b16f2 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431740 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 8064849203)
 2015-11-19 01:36:24 +09:00
Akira Ajisaka d5782a4199 HADOOP-12568. Update core-default.xml to describe posixGroups support. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4a3b8f1ed2)
 2015-11-18 17:23:34 +09:00
cnauroth 397836a7b3 HADOOP-12567. NPE in SaslRpcServer. Contributed by Sergey Shelukhin. 
(cherry picked from commit 7fab5c8cec)
 2015-11-17 16:00:33 -08:00
Akira Ajisaka 8de7911eb3 MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun. 
(cherry picked from commit a7f776ffdf)
 2015-11-17 15:18:32 +09:00
Akira Ajisaka c5c663c05d HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad. 
(cherry picked from commit f94d892704)
 2015-11-13 21:53:23 +09:00
Vinod Kumar Vavilapalli b742ea7fe6 HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in 
the first patch committed. (Karthik Kambatla via vinodkv)
 2015-11-10 12:16:52 -08:00
Colin Patrick Mccabe 7a47989bc9 HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 493e8ae552)
 2015-11-10 10:58:36 -08:00
Lei Xu a7243de1a1 HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) 
(cherry picked from commit 0eb9c60c5b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-09 23:02:38 -08:00
Haohui Mai c91bd3aabb HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:26:01 -08:00
Lei Xu 47941858af Revert "HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)" 
This reverts commit 01ae30796d.
 2015-11-06 09:52:21 -08:00
Lei Xu 01ae30796d HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei) 
(cherry picked from commit bff7c90a56)
 2015-11-05 18:36:55 -08:00
Colin Patrick Mccabe f7e6a5dfb1 Revert "HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)" 
This reverts commit bb3b2977cd.
 2015-11-05 11:11:27 -08:00
Colin Patrick Mccabe bb3b2977cd HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe) 
(cherry picked from commit 482e35c55a)
 2015-11-05 10:46:12 -08:00
Haohui Mai 6d92778191 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit e7203b6954.
 2015-11-04 10:22:21 -08:00
Jason Lowe b9389ac5b5 HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li 
(cherry picked from commit b9d25c3ee2)
 2015-11-04 16:35:12 +00:00
cnauroth afff29113a HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. Contributed by Chris Nauroth. 
(cherry picked from commit 957f0311a1)
 2015-11-02 22:25:12 -08:00
Arpit Agarwal bb2ee9f8eb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:11 -08:00
Zhe Zhang 30791cb0d0 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java

Change-Id: I5f5895bac4f7d7e66e95788765a514b80b9b6766
 2015-10-29 11:21:57 -07:00
Jian He 7d109ef5b5 YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du 
(cherry picked from commit c41699965e)
 2015-10-29 00:01:20 -07:00
Vinayakumar B dea66a8392 HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina) 
(cherry picked from commit 7d2d16f4ee)
 2015-10-29 11:30:59 +05:30
Steve Loughran fe079c8b20 HADOOP-12514. Make static fields in GenericTestUtils for assertExceptionContains() package-private and final. (Mingliang Liu via stevel) 2015-10-28 10:36:26 +00:00
cnauroth af0f2e27d1 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth. 
(cherry picked from commit bf8e452982)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
 2015-10-27 23:08:32 -07:00
Zhihai Xu 73612294bd HADOOP-12178. NPE during handling of SASL setup if problem with SASL resolver class. Contributed by Steve Loughran 
(cherry picked from commit ed9806ea40)
 2015-10-27 10:09:45 -07:00
Tsuyoshi Ozawa 1035637200 HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. Contributed by Akira AJISAKA. 
(cherry picked from commit ea6b183a1a)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
 2015-10-27 10:58:50 +09:00
Jing Zhao 7d25646741 HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. Contributed by Steve Loughran. 
(cherry picked from commit a01a209fbe)
 2015-10-26 14:03:38 -07:00
Tsuyoshi Ozawa e85ebf0825 YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula. 
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
 2015-10-26 17:06:46 +09:00
Jitendra Pandey 63cebf57d0 HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu. 2015-10-23 12:17:20 -07:00
Jonathan Eagles 6db7bfbcfd YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles) 
(cherry picked from commit f8adeb712d)
 2015-10-23 10:43:59 -05:00
Tsuyoshi Ozawa de739cabb1 HADOOP-7266. Deprecate metrics v1. Contributed by Akira AJISAKA. 
(cherry picked from commit 35a303dfbe)
 2015-10-23 23:48:36 +09:00
Tsuyoshi Ozawa 525a67a62e HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa) 2015-10-23 06:54:24 +09:00
Junping Du d5145b58f6 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong. 
(cherry picked from commit 0fce5f9a49)
 2015-10-22 13:42:12 -07:00
Andrew Wang 7a9b97e6b7 HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen. 
(cherry picked from commit d1cdce77fa)
 2015-10-21 15:21:15 -07:00
Ming Ma 39e7548cd9 HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma) 
(cherry picked from commit e27c2ae8ba)
 2015-10-21 08:24:02 -07:00
Kihwal Lee e327233e80 HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee. 
(cherry picked from commit 01b103f4ff)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestRPC.java
 2015-10-20 15:19:01 -05:00
Kihwal Lee e86819c91f HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee. 
(cherry picked from commit 6144e0137b)
 2015-10-19 10:56:19 -05:00
Vinayakumar B b6dce3834d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 7f0e1eb43d)
 2015-10-19 12:16:44 +05:30
yliu 2c0dbf728a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:52:39 +08:00
Steve Loughran f7d746a81b HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:17 +01:00
Steve Loughran b390aae467 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:34 +01:00
Sangjin Lee afa57f1b48 HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee) 
(cherry picked from commit 8d2d3eb7bb)
 2015-10-15 11:49:03 -07:00
Steve Loughran 0e4fb329ed HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:33 +01:00
Colin Patrick Mccabe d37f88674f HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe) 
(cherry picked from commit d286032b71)
 2015-10-13 16:21:13 -07:00
Steve Loughran 5eab51a24f HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:47:54 +01:00
Haohui Mai 5c5362980c HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 2015-10-13 13:20:17 -07:00
Steve Loughran 38f86c0842 HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) 2015-10-13 21:13:41 +01:00
Colin Patrick Mccabe 535c903bc6 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe) 
(cherry picked from commit 6716f15964)
 2015-10-13 12:25:48 -07:00
Jitendra Pandey e7203b6954 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:14:01 -07:00
yliu 146f297d7d HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:05:47 +08:00
Akira Ajisaka 2c6c9e315c HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 
(cherry picked from commit e1bf8b3df6)
 2015-10-09 11:10:54 +09:00
Akira Ajisaka 613c7088fd HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 7fbf69bf47)
 2015-10-08 06:09:02 +09:00
Steve Loughran fa3e774295 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:33 +01:00
Colin Patrick Mccabe a509413c9a HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 3e1752f9fb)
 2015-10-05 11:36:00 -07:00
Vinod Kumar Vavilapalli b876babdc7 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan. 
(cherry picked from commit f1c19b9365)
 2015-10-05 10:57:55 -07:00
Tsuyoshi Ozawa e6514c6a3b HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8. 
(cherry picked from commit 30e2f836a2)
 2015-10-05 08:15:40 +09:00
Harsh J 21b4ba48ce HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian. 
(cherry picked from commit c918f7be5e)
 2015-10-03 18:39:22 +05:30
Jason Lowe 3e3733437f YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 
(cherry picked from commit fdf02d1f26)
 2015-10-02 20:21:32 +00:00
Zhihai Xu 07f9405692 HADOOP-8437. getLocalPathForWrite should throw IOException for invalid paths. Contributed by Brahma Reddy Battula 
(cherry picked from commit fd026f535c)
 2015-10-01 12:04:27 -07:00
Karthik Kambatla db145e0c9a HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. (kasha) 2015-10-01 11:29:50 -07:00
yliu 3625222635 HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) 2015-09-30 11:04:09 +08:00
Haohui Mai baa6ef0207 HDFS-9174. Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread. Contributed by Yi Liu. 2015-09-29 14:56:13 -07:00
Colin Patrick Mccabe 171bd1cb2b HADOOP-12447. Clean up some htrace integration issues (cmccabe) 
(cherry picked from commit 850d679acb)
 2015-09-29 09:38:10 -07:00
yliu 9c47ab32b1 HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu) 2015-09-29 16:23:50 +08:00
Ming Ma ac7d85efb2 HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down. (Xiao Chen via mingma) 
(cherry picked from commit 5c3b663bf9)
 2015-09-28 18:14:29 -07:00
Kihwal Lee 95b8f1f3a6 HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 
(cherry picked from commit 3abbdc929b)
 2015-09-28 17:33:20 -05:00
Colin Patrick Mccabe 3b9d32627f HDFS-9080. Update htrace version to 4.0.1 (cmccabe) 
(cherry picked from commit 892ade689f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
        hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/BlockStorageLocationUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 2015-09-28 08:15:00 -07:00
Vinayakumar B 1c7b3b98c1 HADOOP-11984. Enable parallel JUnit tests in pre-commit (Contributed by Chris Nauroth) 
(cherry picked from commit f0f984e4e6)
 2015-09-27 14:12:34 +05:30
Vinayakumar B b46e4ceafd HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid (Contributed by nijel) 
(cherry picked from commit 861b52db24)
 2015-09-26 21:37:24 +05:30
cnauroth 85c0cb0075 HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 7fe521b1dd)
 2015-09-25 22:34:10 -07:00
Yongjun Zhang 16ae3f5d46 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 3187dbd7a8)
 2015-09-24 21:41:48 -07:00
Zhihai Xu 4ba0febd58 HADOOP-12252. LocalDirAllocator should not throw NPE with empty string configuration. Contributed by Zhihai Xu 
(cherry picked from commit 52c1f272ec)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-09-24 12:40:39 -07:00
Harsh J 9bb6fba759 HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389799 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a7e450c7cc)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-09-24 12:30:55 -07:00
Arpit Agarwal 3c06162259 HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:58 -07:00
Haohui Mai 75c70339ab HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth. 2015-09-23 19:34:19 -07:00
Vinayakumar B 017dff9877 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a2c76e5f26)
 2015-09-23 15:45:21 +05:30
Steve Loughran a38dceda66 HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) 2015-09-19 12:41:29 +01:00
Zhihai Xu 6c66dd4875 HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 
(cherry picked from commit 88d89267ff)
 2015-09-18 10:44:53 -07:00
Zhihai Xu 7c429fbaa9 Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu" 
This reverts commit 7576b4247b.
 2015-09-18 10:25:38 -07:00
Zhihai Xu 7576b4247b Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 
(cherry picked from commit e690a32e57)
 2015-09-18 08:27:58 -07:00
Wangda Tan 1f75e951f5 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda) 
(cherry picked from commit 6b97fa6652)
 2015-09-17 17:47:22 -07:00
Jason Lowe 316296e35f MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 
(cherry picked from commit 58d1a02b8d)
 2015-09-17 14:31:57 +00:00
Haohui Mai d5936aa48c HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:54 -07:00
Eric Yang b4bb8e1731 HADOOP-12374. Updated expunge command description. 
(WeiWei Yang via eyang)
 2015-09-15 20:05:01 -07:00
Akira Ajisaka e38e5b56bd HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu. 
(cherry picked from commit 77aaf4cf7d)
 2015-09-16 10:20:53 +09:00
Vinayakumar B 2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 
(cherry picked from commit ce69c9b54c)
 2015-09-16 00:18:59 +05:30
cnauroth be9354d010 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 
(cherry picked from commit b2017d9b03)
 2015-09-15 10:42:02 -07:00
Vinayakumar B aa963ab441 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a440567491)
 2015-09-15 17:33:15 +05:30
Steve Loughran c8fe31e03a HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:55:42 +01:00
Robert Kanter 764f8baa99 HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:21:22 -07:00
Steve Loughran 4073539118 HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel) 2015-09-11 15:55:14 +01:00
Vinayakumar B ddecd86818 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 
(cherry picked from commit 94cf7ab9d2)
 2015-09-09 11:06:06 +05:30
Zhihai Xu 113f778303 HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong. 
(cherry picked from commit d9c1fab2ec)
 2015-09-08 13:09:23 -07:00
Vinayakumar B a0594961de HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina) 
(cherry picked from commit 090d26652c)
 2015-09-08 19:11:46 +05:30
Andrew Wang 355398e441 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. 
(cherry picked from commit e1feaf6db0)
 2015-09-04 13:48:42 -07:00
Arpit Agarwal e1842ce678 HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:53 -07:00
Tsuyoshi Ozawa 538a4ddc7e HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 
(cherry picked from commit 0ebc658105)
 2015-09-03 23:32:59 +09:00
Jian He cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 09c64ba1ba)
 2015-09-02 17:46:04 -07:00
Akira Ajisaka 25efccba01 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 65ccf2b125)
 2015-09-02 14:30:23 +09:00
Tsuyoshi Ozawa b1499ab0fe HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun. 
(cherry picked from commit dd149adeac)
 2015-09-02 02:02:10 +09:00
Akira Ajisaka 236c4ab511 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 2e251a7674)
 2015-09-01 20:56:46 +09:00
yliu 2345627ad3 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:25:11 +08:00
Andrew Wang 8dbe2a12bb HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. 
(cherry picked from commit 7ad3556ed3)
 2015-08-31 18:19:12 -07:00
Lei Xu de42fce390 HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:58:57 -07:00
Arpit Agarwal f1d5f1417e HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:57:53 -07:00
Jing Zhao 10c4d6df61 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su. 
(cherry picked from commit f44b599003)
 2015-08-26 16:28:38 -07:00
Harsh J e993498302 HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton. 
(cherry picked from commit af78767870)
 2015-08-25 11:22:08 +05:30
Xiaoyu Yao 7a0a31586a HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer 
(cherry picked from commit 48774d0a45)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-08-24 14:33:37 -07:00
Xuan 205b98c059 YARN-221. NM should provide a way for AM to tell it not to aggregate 
logs. Contributed by Ming Ma

(cherry picked from commit 37e1c3d82a)
 2015-08-22 16:26:39 -07:00
Akira Ajisaka 5fb8ac18d1 HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 2015-08-20 11:11:12 +09:00
Robert Kanter acf241242d HADOOP-12317. Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST (adhoot via rkanter) 
(cherry picked from commit 1e06299df8)
 2015-08-19 19:01:03 -07:00
Arpit Agarwal 10a0ddbac3 HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer) 2015-08-19 09:42:48 -07:00
Tsz-Wo Nicholas Sze 7245f7fad2 HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes. 2015-08-18 19:26:58 -07:00
Chris Douglas 79af15fd37 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:33:21 -07:00
Benoy Antony d84e4a90d0 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu. 
(cherry picked from commit 71aedfabf3)
 2015-08-18 13:53:47 -07:00
Allen Wittenauer 40d8faf868 HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw) 
(cherry picked from commit 4d8fb8c19c)
 2015-08-18 12:32:09 -07:00
Arpit Agarwal 85cb596e2e HDFS-8880. NameNode metrics logging. (Arpit Agarwal) 2015-08-17 16:55:24 -07:00
Xiaoyu Yao 27ccbd51f6 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. 
(cherry picked from commit a7862d5fe4)
 2015-08-17 10:23:56 -07:00
Arpit Agarwal 25c4dab891 HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer) 2015-08-13 21:17:39 -07:00