Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,485 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

3008 Commits

Author SHA1 Message Date
Jian He 9d3ddb0b4d YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode 
(cherry picked from commit 4beff01354)
 2016-04-26 21:02:04 -07:00
Arpit Agarwal dba737f1e5 HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:46:47 -07:00
Masatake Iwasaki c12fcbde44 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang. 
(cherry picked from commit 68b4564e78)
 2016-04-27 10:48:26 +09:00
Tsz-Wo Nicholas Sze d316f44059 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-04-26 17:21:20 -07:00
Masatake Iwasaki 5bceaa9683 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims) 
(cherry picked from commit bec5b4cd8c)
 2016-04-25 22:46:50 +09:00
Ravi Prakash 88e1427a03 HDFS-9525. hadoop utilities need to support provided delegation tokens. Contributed by HeeSoo Kim 2016-04-23 20:50:56 -07:00
Akira Ajisaka 5949436010 HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor. 
(cherry picked from commit c610031cab)
 2016-04-23 06:20:44 +09:00
Kihwal Lee d0718ed466 HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 
(cherry picked from commit 9dbdc8e12d)
 2016-04-22 15:03:56 -05:00
Steve Loughran edcb2a8410 HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:24:50 +01:00
Larry McCay a0605ff002 HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers 2016-04-21 20:16:08 -07:00
Jing Zhao 5353289c8c HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. 
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
 2016-04-21 20:16:02 -07:00
Xiaoyu Yao 432531dcf7 HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou. 
(cherry picked from commit b4be288c5d)
 2016-04-21 10:19:35 -07:00
Xiaoyu Yao a2a65922dd HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 
(cherry picked from commit 5bd7b592e5)
 2016-04-20 23:11:42 -07:00
Steve Loughran 8d11a771b3 HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2016-04-15 17:43:52 +01:00
Akira Ajisaka 5ae74507c0 HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi. 
(cherry picked from commit 6e6b6dd5aa)
 2016-04-15 14:15:33 +09:00
Steve Loughran e124c3a2ae HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:45:10 +01:00
Steve Loughran a59e05ad0a HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:20 +01:00
Akira Ajisaka 03bf09865f HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor. 
(cherry picked from commit 27b131e79c)
 2016-04-14 10:57:50 +09:00
Robert Kanter d9d12b9e72 HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter) 
(cherry picked from commit 042a3ae960)
 2016-04-13 17:42:28 -07:00
Xiaoyu Yao 42040f706a HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao. 
(cherry picked from commit 8ced42daff)
 2016-04-13 16:42:55 -07:00
Colin Patrick Mccabe 2b0b332e2f HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe) 
(cherry picked from commit 35f0770555)
 2016-04-12 16:29:15 -07:00
Akira Ajisaka bb1ed426d1 HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:28:05 +09:00
Akira Ajisaka 8f968171bd HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran. 
(cherry picked from commit a409508b3f)
 2016-04-12 14:55:25 +09:00
Vinod Kumar Vavilapalli 4041d2b49e HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba. 
(cherry picked from commit 069c6c62de)
 2016-04-11 12:03:39 -07:00
Chris Nauroth 26a23eff82 HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran. 
(cherry picked from commit 843ee8d59d)
 2016-04-08 13:37:46 -07:00
Steve Loughran c8797e0e39 HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel) 2016-04-08 12:59:01 +01:00
Andrew Wang 2f983b161f HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen. 
(cherry picked from commit 594c70f779)
 2016-04-07 23:50:36 -07:00
Tsz-Wo Nicholas Sze 46352de1a2 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:49:48 +08:00
Suresh Srinivas d72db7d3aa HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
 2016-04-07 14:39:22 +08:00
Vinayakumar B aea518ef30 Addendum : HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B) 2016-04-07 14:33:48 +08:00
Vinayakumar B c2b271fe05 HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B 
This closes #91

(cherry picked from commit 8d29e2451f)
 2016-04-07 10:17:43 +05:30
Jian He 42bc565630 YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev 2016-04-06 16:14:13 -07:00
Akira Ajisaka 1371f993a9 HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer. 2016-04-06 17:43:31 +09:00
Masatake Iwasaki 2542e9bccf HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 85ec5573eb)
 2016-04-06 03:26:33 +09:00
Kihwal Lee ef3da82357 HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
 2016-04-05 09:16:05 -05:00
Arpit Agarwal 30e12edb67 HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:28 -07:00
Steve Loughran 20e808d83e HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:39:51 +01:00
Akira Ajisaka 80d122d7fe HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula. 
(cherry picked from commit a8d8b80a20)
 2016-04-01 13:59:45 +09:00
Xiaoyu Yao ab9dc84d4a HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao. 
(cherry picked from commit aac4d65bf9)
(cherry picked from commit dc78250aa4)
 2016-03-31 15:50:17 -07:00
Jian He 3afc2caec8 YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage 2016-03-31 14:31:38 -07:00
Xiaoyu Yao 6db3c9d394 HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao. 
(cherry picked from commit d95c6eb32c)
(cherry picked from commit a0c001c0b9)
 2016-03-31 09:05:37 -07:00
Akira Ajisaka b4fbc22688 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak. 
(cherry picked from commit acca149ec9)
 2016-03-31 16:05:51 +09:00
Zhe ZHang 9216993b02 HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 2016-03-30 14:14:05 -07:00
Colin Patrick Mccabe 9df2e54160 HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe) 
(cherry picked from commit e3d15a2e23)
 2016-03-29 17:14:36 -07:00
Arpit Agarwal 759d0acdd4 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:09:10 -07:00
Andrew Wang a61a90c562 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge. 
(cherry picked from commit 8bfaa80037)
 2016-03-28 14:14:05 -07:00
Robert Kanter 5a552973f4 HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter) 
(cherry picked from commit 8cac1bb09f)
 2016-03-28 10:37:58 -07:00
Junping Du ae29b1a17b MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 90fcb16c0f)
 2016-03-28 05:31:46 -07:00
Akira Ajisaka 42d312663f HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 01cfee6381)
 2016-03-28 15:58:28 +09:00
Jason Lowe 5e823d839d HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 
(cherry picked from commit 9a09200a1f)
 2016-03-25 22:59:14 +00:00
Andrew Wang c58599acba HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen. 
(cherry picked from commit d4df7849a5)
 2016-03-25 15:29:06 -07:00
Andrew Wang daf24eeb6b HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 938222b2e2)
 2016-03-23 14:57:18 -07:00
Benoy Antony 4dd02f9484 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 
(cherry picked from commit e7ed05e4f5)
 2016-03-21 13:21:54 -07:00
Andrew Wang e826d860a7 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d625)
 2016-03-21 11:39:19 -07:00
Sangjin Lee d956e0a0bb HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-21 10:56:32 -07:00
Haohui Mai 478a25b929 HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:41:20 -07:00
Chris Nauroth 283e44f978 HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison. 
(cherry picked from commit 33239c9925)
 2016-03-18 16:33:28 -07:00
Steve Loughran 186a7c6bb3 YARN-4593 Deadlock in AbstractService.getConfig() (stevel) 2016-03-16 14:35:13 +00:00
Steve Loughran 1463400aad HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel) 2016-03-16 14:31:50 +00:00
Tsz-Wo Nicholas Sze f85d979a3f HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:49:34 -07:00
Colin Patrick Mccabe b67b5b09a7 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe) 
(cherry picked from commit 6e9a582eb1)
 2016-03-11 12:27:12 -08:00
Steve Loughran 1c96fd0a23 Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit 7994ab3fa0.
 2016-03-11 16:59:42 +00:00
Masatake Iwasaki 7994ab3fa0 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 682adc6ba9)
 2016-03-11 15:05:34 +09:00
Li Lu 92125e6057 HADOOP-12906. AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException. (Steve Loughran via gtcarrera9) 
(cherry-picked from commit 9a79b738c5)
 2016-03-10 11:39:44 -08:00
Harsh J 2e32aa5475 HADOOP-11404. Clarify the "expected client Kerberos principal is null" authorization message. Contributed by Stephen Chu 
(cherry picked from commit 318c9b68b0)
 2016-03-10 17:09:56 +05:30
Allen Wittenauer 95d30a6ec6 HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 
(cherry picked from commit 55f73a1cbd)
 2016-03-09 19:39:13 -08:00
Allen Wittenauer 140a33df9b HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 
(cherry picked from commit d759b4bd74)
 2016-03-09 19:39:05 -08:00
Allen Wittenauer 9f4b3eaac0 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 45bb467918.
 2016-03-09 09:59:19 -08:00
Arpit Agarwal a06ecb085e HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:36 -08:00
Akira Ajisaka 0d8ad99e0d HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
 2016-03-09 15:33:14 +09:00
Chris Nauroth 38a031ce68 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml
 2016-03-08 21:22:57 -08:00
Andrew Wang 7e29d732ee HADOOP-12895. SSLFactory#createSSLSocketFactory exception message is wrong. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit a3cc6e2511)
 2016-03-08 13:52:01 -08:00
Akira Ajisaka 0586386472 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544)
 2016-03-08 14:29:46 +09:00
Arpit Agarwal 9d67f98e05 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:34 -08:00
Ming Ma aae39ff973 HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff0)
 2016-03-07 20:27:10 -08:00
Andrew Wang fed2339e28 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 
(cherry picked from commit 391da36d93)
 2016-03-07 14:00:08 -08:00
Chris Nauroth 592f161e13 HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 
(cherry picked from commit 2759689d7d)
 2016-03-04 15:30:28 -08:00
Masatake Iwasaki 722182fdfb HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a6)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md
 2016-03-04 14:12:44 +09:00
Andrew Wang 670944810c HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:58 -08:00
Allen Wittenauer b0d3b0c1f8 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 
(cherry picked from commit 8cecad2d56)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml
 2016-03-03 20:54:08 -08:00
Akira Ajisaka 899715a15e HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0a9f00af5e)
 2016-03-03 23:32:51 +09:00
Akira Ajisaka 96a0939d5b HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c3136cbd8)
 2016-03-03 23:23:12 +09:00
Akira Ajisaka 9e87f59dea HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 
(cherry picked from commit eb864d35d6)
 2016-03-03 18:51:50 +09:00
Masatake Iwasaki 69e024f8fa HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317ccc)
 2016-03-03 17:14:53 +09:00
Arpit Agarwal 7b4a1001ea HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:38 -08:00
Colin Patrick Mccabe 5998b20d63 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019)
 2016-03-02 18:18:45 -08:00
Andrew Wang 3fecfe1352 HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng. 
(cherry picked from commit 480302b4ba)
 2016-03-02 09:40:33 -08:00
Chris Nauroth bce33b5179 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f98dff329b)
 2016-03-01 13:18:57 -08:00
Akira Ajisaka 67e8489ac6 HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 2016-03-02 00:20:57 +09:00
Chris Nauroth e402371b6a HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay. 
(cherry picked from commit d251e55415)
 2016-02-29 22:00:27 -08:00
Karthik Kambatla c1855a33eb HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha) 
(cherry picked from commit 680f3fc02d)
 2016-02-29 19:00:22 -08:00
Jian He 3e842de1d5 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 2016-02-29 16:24:30 -08:00
Haohui Mai c5db4ab0b4 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:10:18 -08:00
Masatake Iwasaki 32c7791a6c HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims) 
(cherry picked from commit 809ebc0b14)
 2016-02-29 18:23:33 +09:00
Suresh Srinivas fca24fbbaa HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
 2016-02-29 11:35:19 +09:00
Chris Nauroth 2e761dabd8 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay. 
(cherry picked from commit 7634d404b7)
 2016-02-28 11:23:02 -08:00
Li Lu 090f74c741 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9) 
(cherry-picked from commit 7545ce6636)
 2016-02-27 22:03:49 -08:00
Steve Loughran 4d870b1faa HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:53 +00:00
Chris Nauroth c692d7c52f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit 798babf661)
 2016-02-26 21:59:14 -08:00
Lei Xu 49a10a3cec HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei) 
(cherry picked from commit 2093acf6b6)
 2016-02-26 10:48:35 -08:00