Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,757 Commits 326 Branches 371 Tags
Commit Graph

2213 Commits

Author SHA1 Message Date
Akira Ajisaka
7d6c3c6dbe HADOOP-11586. Update use of Iterator to Iterable in AbstractMetricsContext.java. Contributed by Ray Chiang. 
(cherry picked from commit 11d8934463fca00db225a1c7660e0815832352d8)
 2015-02-12 14:42:10 -08:00
Colin Patrick Mccabe
e35788aa5a HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 
(cherry picked from commit 6b39ad0865cb2a7960dd59d68178f0bf28865ce2)
 2015-02-12 10:42:14 -08:00
Haohui Mai
92f52e8962 HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao. 2015-02-12 10:31:04 -08:00
Jing Zhao
2156e38d5e HDFS-3689. Add support for variable length block. Contributed by Jing Zhao. 
(cherry picked from commit 2848db814a98b83e7546f65a2751e56fb5b2dbe0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirConcatOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-02-12 10:23:13 -08:00
Tsuyoshi Ozawa
c9c1d9a5a6 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-12 19:03:24 +09:00
cnauroth
c9266132ee HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R. 
(cherry picked from commit 67efab935e0366ff783cf2bbd2363da4ebb02772)
 2015-02-11 16:36:18 -08:00
Konstantin V Shvachko
ada7791ef4 HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko. 2015-02-11 10:03:54 -08:00
Steve Loughran
a8eaec396f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:22 +00:00
Colin Patrick Mccabe
5e7deba1f4 HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe) 
(cherry picked from commit 6338ce3ae8870548cac5abe2f685748b5efb13c1)
 2015-02-10 13:30:49 -08:00
Harsh J
442bc776db HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:52:41 +05:30
yliu
ae316705bb HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:43:08 +08:00
Arpit Agarwal
ff900eb64a HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:53 -08:00
Steve Loughran
af7368cf03 HADOOP-11520. Clean incomplete multi-part uploads in S3A tests. (Thomas Demoor via stevel) 2015-02-06 20:59:56 +00:00
Steve Loughran
d827f02bcd HADOOP-11535 TableMapping related tests failed due to 'successful' resolving of invalid test hostname 2015-02-06 13:03:30 +00:00
Gera Shegalov
3d36d4737c HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera) 
(cherry picked from commit 644548f201743408904dfe24b9f5b515b2c96713)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
 2015-02-06 01:44:14 -08:00
yliu
e2803f5a51 HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:29:52 +08:00
Tsuyoshi Ozawa
995f9809c0 Revert "HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula." 
This reverts commit 366a12c3b9402f3c05522179c26f1972bfce8143.
 2015-02-06 13:49:58 +09:00
Tsuyoshi Ozawa
366a12c3b9 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-06 13:34:48 +09:00
cnauroth
a9ea7cff31 HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. Contributed by Anu Engineer. 
(cherry picked from commit 6583ad148be5447eb2f086a2c6c7006631dff4da)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-02-05 16:56:16 -08:00
yliu
3ffe5a1ed2 HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:48:55 +08:00
Steve Loughran
4cd9657b71 HADOOP-11463 Replace method-local TransferManager object with S3AFileSystem#transfers. (Ted Yu via stevel) 2015-02-05 12:19:49 +00:00
Junping Du
f59b698fc9 HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results. (Contributed by Sangjin Lee) 
(cherry picked from commit 0b567f424673b5cea1c3bc23b2bd268ef6b7625f)
 2015-02-04 19:12:21 -08:00
Akira Ajisaka
17797c73c2 HADOOP-11549. flaky test detection tool failed to handle special control characters in test result. Contributed by Yongjun Zhang. 
(cherry picked from commit 5f4ef2d13fa3fa3d4d315902e55c7775ef08b3d2)
 2015-02-04 14:18:31 -08:00
Karthik Kambatla
fcf3dc5977 HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and Karthik Kambatla via kasha) 
(cherry picked from commit 55235d28c3641ff5f1c05c53dd7271cafc131926)
 2015-02-04 14:00:44 -08:00
cnauroth
196443318f HADOOP-11547. hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. Contributed by Chris Nauroth. 
(cherry picked from commit a35e86c6701ffec263966bab31bd9368923c7e80)
 2015-02-04 12:07:13 -08:00
Andrew Wang
696266e99c HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 
(cherry picked from commit 9175105eeaecf0a1d60b57989b73ce45cee4689b)
 2015-02-04 11:31:49 -08:00
cnauroth
85b2739508 HADOOP-11548. checknative should display a nicer error message when openssl support is not compiled in. Contributed by Anu Engineer. 
(cherry picked from commit 064e0770a0f32e7f32a7ba16c71394d7e75a3eb3)
 2015-02-04 10:01:39 -08:00
Tsuyoshi Ozawa
f92d4fa20f HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa) 
(cherry picked from commit ba58da29f49da15f7eb6300f996e0ae7ba9d0d1e)
 2015-02-05 00:51:40 +09:00
Akira Ajisaka
5c5139d35f HADOOP-11544. Remove unused configuration keys for tracing. Contributed by Masatake Iwasaki. 
(cherry picked from commit 42548f4dc2b2e8ace891b970c2c6712c02bb43ea)
 2015-02-04 04:20:08 -08:00
Haohui Mai
6c5ae1571c HADOOP-11529. Fix findbugs warnings in hadoop-archives. Contributed by Masatake Iwasaki. 2015-02-03 10:53:26 -08:00
Robert Kanter
410830fe8c YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 
(cherry picked from commit f7a77819a1e4ff394e110941c1f8dd80f47dd38f)
 2015-02-03 10:39:51 -08:00
Tsuyoshi Ozawa
b396d2e8d8 HADOOP-11045. Introducing a tool to detect flaky tests of hadoop jenkins testing job. Contributed by Yongjun Zhang and Todd Lipcon. 
(cherry picked from commit 80705e034b7fc7ad384f1aa0bd15fc254ea06cf0)
 2015-02-04 01:26:44 +09:00
cnauroth
dedfb982f1 HADOOP-11442. hadoop-azure: Create test jar. Contributed by Shashank Khandelwal. 
(cherry picked from commit 1c09ca2ba4d97d827cc6e86ef6bd2930bc77b5ae)
 2015-02-02 11:51:01 -08:00
cnauroth
aee297ccea HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson. 
(cherry picked from commit 8004a002307940176cc188657c68e85171a5b5a8)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/ganglia/GangliaContext.java
 2015-02-02 11:16:13 -08:00
Benoy Antony
f3ed5b68ca HADOOP-11494. Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread. Contributed by Ted Yu. 
(cherry picked from commit 3472e3bd6c50558870b86c9ccfea5072385fa991)
 2015-02-02 10:46:54 -08:00
Harsh J
648510e031 HADOOP-11488. Difference in default connection timeout for S3A FS. Contributed by Daisuke Kobayashi. 
(cherry picked from commit ffc75d6ebe4912f20f4f4870d2a50abbe4557bfa)
 2015-02-01 00:17:24 +05:30
Gera Shegalov
151e147e64 HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. (Liang Xie via gera) 
(cherry picked from commit 26c2de36e2dd1b2ddedc155e49fb2ec31366d5f8)
 2015-01-30 18:47:03 -08:00
Colin Patrick Mccabe
80381b62aa HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 09ad9a868a89922e9b55b3e7c5b9f41fa54d3770)
 2015-01-30 16:02:36 -08:00
Kihwal Lee
3a01984bda HADOOP-9137. Support connection limiting in IPC server. Contributed by Kihwal Lee. 
(cherry picked from commit 8dc59cb9e0f8d300991a437c1b42f1e4e495cfe4)
 2015-01-30 17:22:48 -06:00
cnauroth
4607ca2854 HADOOP-11523. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit f2c91098c400da6db0f5e8e49e9bf0e6444af531)
 2015-01-29 17:02:48 -08:00
Colin Patrick Mccabe
e8d154baea HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe) 
(cherry picked from commit e36ef3b4022a8527cdfa937c4ffc9d46e71cfe28)
 2015-01-29 15:48:59 -08:00
cnauroth
fa2378d866 HADOOP-11441. Hadoop-azure: Change few methods scope to public. Contributed by Shashank Khandelwal. 
(cherry picked from commit ad55083f75cb920fde58302d7bc8857086c1978c)
 2015-01-29 13:07:59 -08:00
Akira Ajisaka
1081b4c4a7 HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka) 
(cherry picked from commit 342efa110af9989829b8a8caa699658a2ba01607)
 2015-01-30 02:50:46 +09:00
Akira Ajisaka
7411c74b11 HADOOP-10574. Bump the maven plugin versions too -moving the numbers into properties. (aajisaka) 
(cherry picked from commit 57b8950f37f74fc4a046c598c710b19b50ccef1f)

Conflicts:
	pom.xml
 2015-01-30 02:27:36 +09:00
Akira Ajisaka
71c60af84e HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties (aajisaka) 
(cherry picked from commit 03a5e04d5b6ec89219769868466e3b4913b0fff6)
 2015-01-29 16:18:07 +09:00
Tsuyoshi Ozawa
71db37266b HADOOP-11316. "mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters. (ozawa) 
(cherry picked from commit 9850e1584b7bb47c39d777d6fc4931dd54fbaea7)
 2015-01-28 22:01:38 +09:00
Tsuyoshi Ozawa
235a77fe1c HADOOP-11317. Increment SLF4J version to 1.7.10. Contributed by Tim Robertson. 
(cherry picked from commit 20a4768397a36a21a6e6d9b27b5a81898a5889d9)
 2015-01-28 21:55:33 +09:00
yliu
3ac8f88989 HADOOP-11469. KMS should skip default.key.acl and whitelist.key.acl when loading key acl. (Dian Fu via yliu) 2015-01-27 23:55:52 +08:00
Aaron T. Myers
3c8d3816c6 HADOOP-10626. Limit Returning Attributes for LDAP search. Contributed by Jason Hubbard. 
(cherry picked from commit 8709751e1ee9a2c5553823dcd715bd077052ad7f)
 2015-01-27 13:51:19 -08:00
Haohui Mai
3d6318b51b HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:06:15 -08:00