Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,890 Commits 326 Branches 371 Tags
Commit Graph

2863 Commits

Author SHA1 Message Date
Masatake Iwasaki
0d3272b54e HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 682adc6ba9db3bed94fd4ea3d83761db6abfe695)
 2016-03-11 15:08:23 +09:00
Allen Wittenauer
a7164e90bf HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 
(cherry picked from commit 55f73a1cbd45a62774e471b7a8a1e0cc40eecdd4)
(cherry picked from commit 95d30a6ec6648ec3a3ee602d9a8e60fc6001c20e)
 2016-03-09 19:39:31 -08:00
Allen Wittenauer
095b485e48 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 
(cherry picked from commit d759b4bd74ae3d530f8091fa5765664fc850530b)
(cherry picked from commit 140a33df9b8e3ce2dd4b1cb5c765c8e3c4780ee1)
 2016-03-09 19:39:28 -08:00
Colin Patrick Mccabe
56ab796094 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019cf483f7532609711812150b8c44742)
(cherry picked from commit 5998b20d63fae09b08bd8bad1aca98551c0ac65a)
 2016-03-09 16:38:15 -08:00
Allen Wittenauer
8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 81a7ad45c9b3f38a4b99e897bb304c362fb1bdf5.
 2016-03-09 09:59:33 -08:00
Arpit Agarwal
0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Akira Ajisaka
65769fbf3c HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d551d4426201b1290cfa1da8e7b2ab2)
 2016-03-09 15:33:25 +09:00
Chris Nauroth
a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68c65956b3dd69b6a93baab1be2beac7)
 2016-03-08 21:23:07 -08:00
Akira Ajisaka
2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544dcb34ee3c9336fad584309e886dbed)
(cherry picked from commit 0586386472dddf68826a8d2b6aa647c86d1f18ad)
 2016-03-08 14:30:01 +09:00
Arpit Agarwal
a63f1039f9 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:42 -08:00
Ming Ma
47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff02ea61764f416f0e2ddf81370aec5fb)
 2016-03-07 20:32:32 -08:00
Andrew Wang
352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 
(cherry picked from commit 391da36d93358038c50c15d91543f6c765fa0471)
(cherry picked from commit fed2339e285e84a40514f877703b2712a2305a6f)
 2016-03-07 14:00:15 -08:00
Chris Nauroth
d5134dadbc HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 
(cherry picked from commit 2759689d7d23001f007cb0dbe2521de90734dd5c)
(cherry picked from commit 592f161e13be9577c2a4e8a53887e71af6ab5c4c)
 2016-03-04 15:30:37 -08:00
Masatake Iwasaki
9d551a3adf HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

(cherry picked from commit 722182fdfbb654be655fbca42f34bba5a05c2f6d)
 2016-03-04 14:13:30 +09:00
Andrew Wang
c6e37f6782 HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:03:13 -08:00
Allen Wittenauer
a9f041d694 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 
(cherry picked from commit 8cecad2d564d89d0f56e98de80a6f9b0bcb39d7a)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml

(cherry picked from commit b0d3b0c1f86469d1f16a79a2b06f060c3e6f1c26)
 2016-03-03 20:58:56 -08:00
Akira Ajisaka
833d84ab58 HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0a9f00af5e11913935ebf426d9da74278dd011af)
(cherry picked from commit 899715a15efb7646d2da5f6bd881c903b9a6e56e)
 2016-03-03 23:33:01 +09:00
Akira Ajisaka
b4710b5052 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c3136cbd8ff5f4eaf9c2c0145975439d0249db3)
(cherry picked from commit 96a0939d5bc26ff42262d9057f9e53c22d090e1d)
 2016-03-03 23:23:27 +09:00
Akira Ajisaka
85a62dcb5b HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 
(cherry picked from commit eb864d35d6c5f0c0af67032d5f6925aa123273af)
(cherry picked from commit 9e87f59dea25ebb90e7bc3ae640da25c4b8e9a82)
 2016-03-03 18:52:05 +09:00
Masatake Iwasaki
64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317cccf14185cc24ea3cb57ffc63b00158cc)
 2016-03-03 17:15:09 +09:00
Chris Nauroth
f563c53535 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)
(cherry picked from commit bce33b51790b90f0655e36df3a0394f5691f8d6e)
 2016-03-01 13:19:03 -08:00
Akira Ajisaka
aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 
(cherry picked from commit 67e8489ac6df70e07d530017bb7ddee017e57e5b)
 2016-03-02 00:22:29 +09:00
Chris Nauroth
f1236c5d7c HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay. 
(cherry picked from commit d251e55415f1fab085159b9eb3b43214d100b6a8)
(cherry picked from commit e402371b6a0854a89e7bd573b04e43fed5e3e9cf)
 2016-02-29 22:00:41 -08:00
Jian He
07623aa941 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 
(cherry picked from commit d8f390d015510950ccf78174af8891cd613d4438)
 2016-02-29 16:25:00 -08:00
Haohui Mai
69b195d619 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 14:15:25 -08:00
Masatake Iwasaki
c7824e8e9e HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims) 
(cherry picked from commit 809ebc0b146135d86433e9c7bfa17e294b7928f2)
 2016-02-29 18:26:09 +09:00
Suresh Srinivas
2cb1fd3bd3 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeeadd1f248b6961078303d75d41f241919)
(cherry picked from commit fca24fbbaa1f8dd13514084f6cdee6a111b31765)
 2016-02-29 11:36:18 +09:00
Chris Nauroth
60611c9c75 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay. 
(cherry picked from commit 7634d404b750eafa135a37fa275325d0398255fb)
(cherry picked from commit 2e761dabd8b0458bb324a32b28c4a8daf31a69b5)
 2016-02-28 11:23:09 -08:00
Li Lu
8324199e5c HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9) 
(cherry-picked from commit 7545ce6636066a05763744a817878e03ee87f456)
 2016-02-27 22:04:23 -08:00
Steve Loughran
6218008591 HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:05:35 +00:00
Chris Nauroth
d55863de0f HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu. 
(cherry picked from commit 798babf661311264fa895c89a33d0f2da927da33)
(cherry picked from commit c692d7c52fa83da28ae69da164b4177456e21d76)
 2016-02-26 21:59:20 -08:00
Suresh Srinivas
cf8bcc73c2 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd122f87b2b041d670b9b59e27da5439c)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
 2016-02-27 01:26:31 +09:00
Masatake Iwasaki
7140a02122 HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit b0091338f2ffea0fb16fed01c44f911490d94c70)
 2016-02-26 15:33:21 +09:00
Xiaoyu Yao
6e9a4c598d HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:49:26 -08:00
cnauroth
d4bbdd9d28 HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao. 
(cherry picked from commit d6b181c6faa56e43c9f05d2cc860a0aeb940fd90)
(cherry picked from commit ef9131fbcddc01a9d8cb3dfd0a729ed9d17d788e)
 2016-02-24 13:56:12 -08:00
cnauroth
8ad907f06a HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty. 
(cherry picked from commit 3369a4f6916f12e9d6b97072badd1b176be443bd)
(cherry picked from commit 9ea19a861f10ca6281eaed2ee5032af21eaa53b3)
 2016-02-23 21:38:01 -08:00
cnauroth
606547dbd2 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 
(cherry picked from commit 27b77751c1163ab4a1ce081a426e5190d1b8aff4)
(cherry picked from commit a5511debdb63770b58e406926343a1a189225d78)
 2016-02-22 17:30:53 -08:00
Zhe Zhang
6d4a4e785b HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
 2016-02-22 14:15:11 -08:00
cnauroth
746d669847 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki. 
(cherry picked from commit d4f5fc23b208635e8f9a14c375d4101141aefa4a)
(cherry picked from commit 3f14eed58055d30b7c2dcb9240355920ff48af7e)
 2016-02-22 13:39:57 -08:00
Junping Du
e3ed99cfe0 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala. 
(cherry picked from commit 18f9b77a321b225677ce23c503b41d21478fc4a7)
(cherry picked from commit e38c2ef6c54521a74cc2b787d78211f629aa07d8)
(cherry picked from commit 78a4c348940cd98548650c0a5adb981895cef201)
 2016-02-19 14:34:56 -08:00
Yongjun Zhang
62ba1e415a HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit a963baba10648859ad88d4ed9a4325b66b1af0d5)
 2016-02-19 09:58:09 -08:00
cnauroth
49602ef580 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 
(cherry picked from commit 8ab7658025616d154decd97578de3327ec6f9109)
(cherry picked from commit b4c4f30fa4fdb3bd9adcf669932b8633ab11fd25)
 2016-02-18 14:07:15 -08:00
Tsz-Wo Nicholas Sze
207ed9601f HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:59:58 -08:00
cnauroth
e5c8a34446 HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 
(cherry picked from commit 5d1889a66d91608d34ca9411fb6e9161e637e9d3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit 779a69e28dfb6e520e7ebe08cfa76f2b03a0cee7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
 2016-02-18 10:16:06 -08:00
cnauroth
2e047429be HADOOP-12691. Move files to correct location. 
(cherry picked from commit da77f423d142c4dda8810d4668edde3c7d2999e8)
(cherry picked from commit 2b9ea68ef8fbca524571eae27672323b4910464f)
 2016-02-18 10:15:31 -08:00
Xiaoyu Yao
5ff2012f64 HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 
(cherry picked from commit fe5624b85d71720ae9da90a01cad9a3d1ea41160)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/DatanodeHttpServer.java

(cherry picked from commit ad4fcd1f9f84cfef8dc8bb48ef7fbdd5c7c20c6a)
 2016-02-17 16:05:24 -08:00
Zhe Zhang
64d39b83cc HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz) 
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
 2016-02-17 13:32:18 -08:00
cnauroth
26ce37a1a6 HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay. 
(cherry picked from commit 76fab26c5c02cef38924d04136407489fd9457d9)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java

(cherry picked from commit 6731bb468dab743e0546e8e0fbbefaf46a1729c2)
 2016-02-17 12:20:49 -08:00
Xiaoyu Yao
5953421544 HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao. 
(cherry picked from commit fd1befb6ba450e45b1fcb3fb28b0da6c48daf6b3)
 2016-02-17 08:47:30 -08:00
Vinayakumar B
e88c01fa58 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea3094315bb1e1a5e268e3817c7fdedc3e9462)
(cherry picked from commit 2bf5a005fab287689a148c1928f3b04c0a8dcedf)
 2016-02-17 10:15:43 +05:30