2234 Commits

Author SHA1 Message Date
Akira Ajisaka
10da1bfce2 HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes. Contributed by Kengo Seki.
(cherry picked from commit 18fb421fab73789a9b692f21a99d619b5dc5c9ff)
2015-02-18 17:56:02 -08:00
Akira Ajisaka
5a1531fff6 HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider". Contributed by Brahma Reddy Battula.
(cherry picked from commit 17146099197000d85b3aedc84a672111f2c7908a)
2015-02-18 11:18:21 -08:00
Tsuyoshi Ozawa
f10335b08d HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. Contributed by zhihai xu.
(cherry picked from commit 3f56a4cb0c57583e285e85a4d0c1584c4de9f1f1)
2015-02-18 18:00:18 +09:00
Kihwal Lee
6c01e58619 HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma.
(cherry picked from commit 685af8a3d0504724fe588daf3722519fedc45b01)
2015-02-18 17:44:11 +09:00
Steve Loughran
411c8a7cda HADOOP-11521. Make connection timeout configurable in s3a. (Thomas Demoor via stevel) 2015-02-17 20:00:00 +00:00
Steve Loughran
f52fcdc2e0 HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel) 2015-02-17 18:14:31 +00:00
Steve Loughran
701b96ca8e HADOOP-11570. S3AInputStream.close() downloads the remaining bytes of the object from S3. (Dan Hecht via stevel). 2015-02-17 16:36:32 +00:00
Tsuyoshi Ozawa
00fb0710b6 HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa)
(cherry picked from commit 2f0f756b26ea83e142a5b9379fa75862c2fc6ad5)
2015-02-17 21:57:58 +09:00
Vinayakumar B
005e1df540 HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING (Contributed by Ming Ma)
(cherry picked from commit cf4b7f506dd338ecf2ed4c643b6a6a334e070fca)
2015-02-17 15:19:44 +05:30
Tsuyoshi Ozawa
b7836c18e4 HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R.
(cherry picked from commit ef950ea1c08f5a95137a95df6d4c90241a25b70e)
2015-02-15 00:31:33 +09:00
Tsuyoshi Ozawa
481124bd61 Revert "HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R."
This reverts commit e082992e2a238543bf3caf22df133869df108409.
2015-02-15 00:31:15 +09:00
Tsuyoshi Ozawa
e082992e2a HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R.
(cherry picked from commit 965ce9e24ed051c6705defc0f85dcfaa4fc9a3ef)
2015-02-15 00:13:38 +09:00
Robert Kanter
ebf6499498 HADOOP-11467. KerberosAuthenticator can connect to a non-secure cluster. (yzhangal via rkanter)
(cherry picked from commit 875256834b892b574499d5fe68f95a9aed244f7d)

Conflicts:
	hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/server/TestAuthenticationToken.java
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-02-13 14:12:38 -08:00
Xuan
3c4b5606dc YARN-3164. RMAdmin command usage prints incorrect command name.
Contributed by Bibin A Chundatt

(cherry picked from commit 253035491ce208a8c9b50a20da91f5b8e679eebf)
2015-02-12 21:40:42 -08:00
Tsuyoshi Ozawa
46ad4c9098 HADOOP-11497. Fix typo in ClusterSetup.html#Hadoop_Startup. Contributed by Christian Winkler. 2015-02-13 12:34:27 +09:00
Akira Ajisaka
4d0e792a82 HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use getTrimmed(). Contributed by Tsuyoshi Ozawa.
(cherry picked from commit 9395c7669714845a51e464ab7a2214168bf03a36)
2015-02-12 15:52:27 -08:00
Akira Ajisaka
7d6c3c6dbe HADOOP-11586. Update use of Iterator to Iterable in AbstractMetricsContext.java. Contributed by Ray Chiang.
(cherry picked from commit 11d8934463fca00db225a1c7660e0815832352d8)
2015-02-12 14:42:10 -08:00
Colin Patrick Mccabe
e35788aa5a HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe)
(cherry picked from commit 6b39ad0865cb2a7960dd59d68178f0bf28865ce2)
2015-02-12 10:42:14 -08:00
Haohui Mai
92f52e8962 HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao. 2015-02-12 10:31:04 -08:00
Jing Zhao
2156e38d5e HDFS-3689. Add support for variable length block. Contributed by Jing Zhao.
(cherry picked from commit 2848db814a98b83e7546f65a2751e56fb5b2dbe0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirConcatOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
2015-02-12 10:23:13 -08:00
Tsuyoshi Ozawa
c9c1d9a5a6 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-12 19:03:24 +09:00
cnauroth
c9266132ee HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R.
(cherry picked from commit 67efab935e0366ff783cf2bbd2363da4ebb02772)
2015-02-11 16:36:18 -08:00
Konstantin V Shvachko
ada7791ef4 HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko. 2015-02-11 10:03:54 -08:00
Steve Loughran
a8eaec396f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:22 +00:00
Colin Patrick Mccabe
5e7deba1f4 HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe)
(cherry picked from commit 6338ce3ae8870548cac5abe2f685748b5efb13c1)
2015-02-10 13:30:49 -08:00
Harsh J
442bc776db HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:52:41 +05:30
yliu
ae316705bb HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:43:08 +08:00
Arpit Agarwal
ff900eb64a HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:53 -08:00
Steve Loughran
af7368cf03 HADOOP-11520. Clean incomplete multi-part uploads in S3A tests. (Thomas Demoor via stevel) 2015-02-06 20:59:56 +00:00
Steve Loughran
d827f02bcd HADOOP-11535 TableMapping related tests failed due to 'successful' resolving of invalid test hostname 2015-02-06 13:03:30 +00:00
Gera Shegalov
3d36d4737c HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera)
(cherry picked from commit 644548f201743408904dfe24b9f5b515b2c96713)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
2015-02-06 01:44:14 -08:00
yliu
e2803f5a51 HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:29:52 +08:00
Tsuyoshi Ozawa
995f9809c0 Revert "HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula."
This reverts commit 366a12c3b9402f3c05522179c26f1972bfce8143.
2015-02-06 13:49:58 +09:00
Tsuyoshi Ozawa
366a12c3b9 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-06 13:34:48 +09:00
cnauroth
a9ea7cff31 HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. Contributed by Anu Engineer.
(cherry picked from commit 6583ad148be5447eb2f086a2c6c7006631dff4da)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-02-05 16:56:16 -08:00
yliu
3ffe5a1ed2 HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:48:55 +08:00
Steve Loughran
4cd9657b71 HADOOP-11463 Replace method-local TransferManager object with S3AFileSystem#transfers. (Ted Yu via stevel) 2015-02-05 12:19:49 +00:00
Junping Du
f59b698fc9 HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results. (Contributed by Sangjin Lee)
(cherry picked from commit 0b567f424673b5cea1c3bc23b2bd268ef6b7625f)
2015-02-04 19:12:21 -08:00
Akira Ajisaka
17797c73c2 HADOOP-11549. flaky test detection tool failed to handle special control characters in test result. Contributed by Yongjun Zhang.
(cherry picked from commit 5f4ef2d13fa3fa3d4d315902e55c7775ef08b3d2)
2015-02-04 14:18:31 -08:00
Karthik Kambatla
fcf3dc5977 HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and Karthik Kambatla via kasha)
(cherry picked from commit 55235d28c3641ff5f1c05c53dd7271cafc131926)
2015-02-04 14:00:44 -08:00
cnauroth
196443318f HADOOP-11547. hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. Contributed by Chris Nauroth.
(cherry picked from commit a35e86c6701ffec263966bab31bd9368923c7e80)
2015-02-04 12:07:13 -08:00
Andrew Wang
696266e99c HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu.
(cherry picked from commit 9175105eeaecf0a1d60b57989b73ce45cee4689b)
2015-02-04 11:31:49 -08:00
cnauroth
85b2739508 HADOOP-11548. checknative should display a nicer error message when openssl support is not compiled in. Contributed by Anu Engineer.
(cherry picked from commit 064e0770a0f32e7f32a7ba16c71394d7e75a3eb3)
2015-02-04 10:01:39 -08:00
Tsuyoshi Ozawa
f92d4fa20f HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa)
(cherry picked from commit ba58da29f49da15f7eb6300f996e0ae7ba9d0d1e)
2015-02-05 00:51:40 +09:00
Akira Ajisaka
5c5139d35f HADOOP-11544. Remove unused configuration keys for tracing. Contributed by Masatake Iwasaki.
(cherry picked from commit 42548f4dc2b2e8ace891b970c2c6712c02bb43ea)
2015-02-04 04:20:08 -08:00
Haohui Mai
6c5ae1571c HADOOP-11529. Fix findbugs warnings in hadoop-archives. Contributed by Masatake Iwasaki. 2015-02-03 10:53:26 -08:00
Robert Kanter
410830fe8c YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter)
(cherry picked from commit f7a77819a1e4ff394e110941c1f8dd80f47dd38f)
2015-02-03 10:39:51 -08:00
Tsuyoshi Ozawa
b396d2e8d8 HADOOP-11045. Introducing a tool to detect flaky tests of hadoop jenkins testing job. Contributed by Yongjun Zhang and Todd Lipcon.
(cherry picked from commit 80705e034b7fc7ad384f1aa0bd15fc254ea06cf0)
2015-02-04 01:26:44 +09:00
cnauroth
dedfb982f1 HADOOP-11442. hadoop-azure: Create test jar. Contributed by Shashank Khandelwal.
(cherry picked from commit 1c09ca2ba4d97d827cc6e86ef6bd2930bc77b5ae)
2015-02-02 11:51:01 -08:00
cnauroth
aee297ccea HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson.
(cherry picked from commit 8004a002307940176cc188657c68e85171a5b5a8)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/ganglia/GangliaContext.java
2015-02-02 11:16:13 -08:00