Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,344 Commits 326 Branches 371 Tags
Commit Graph

1615 Commits

Author SHA1 Message Date
Jing Zhao
2156e38d5e HDFS-3689. Add support for variable length block. Contributed by Jing Zhao. 
(cherry picked from commit 2848db814a98b83e7546f65a2751e56fb5b2dbe0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirConcatOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLogLoader.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-02-12 10:23:13 -08:00
Tsuyoshi Ozawa
c9c1d9a5a6 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-12 19:03:24 +09:00
cnauroth
c9266132ee HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R. 
(cherry picked from commit 67efab935e0366ff783cf2bbd2363da4ebb02772)
 2015-02-11 16:36:18 -08:00
Konstantin V Shvachko
ada7791ef4 HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko. 2015-02-11 10:03:54 -08:00
Steve Loughran
a8eaec396f YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel) 2015-02-11 14:26:22 +00:00
Colin Patrick Mccabe
5e7deba1f4 HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe) 
(cherry picked from commit 6338ce3ae8870548cac5abe2f685748b5efb13c1)
 2015-02-10 13:30:49 -08:00
Harsh J
442bc776db HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P. 2015-02-10 12:52:41 +05:30
yliu
ae316705bb HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:43:08 +08:00
Arpit Agarwal
ff900eb64a HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:53 -08:00
Steve Loughran
d827f02bcd HADOOP-11535 TableMapping related tests failed due to 'successful' resolving of invalid test hostname 2015-02-06 13:03:30 +00:00
Gera Shegalov
3d36d4737c HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Shegalov via gera) 
(cherry picked from commit 644548f201743408904dfe24b9f5b515b2c96713)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestConfiguration.java
 2015-02-06 01:44:14 -08:00
yliu
e2803f5a51 HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:29:52 +08:00
Tsuyoshi Ozawa
995f9809c0 Revert "HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula." 
This reverts commit 366a12c3b9402f3c05522179c26f1972bfce8143.
 2015-02-06 13:49:58 +09:00
Tsuyoshi Ozawa
366a12c3b9 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-06 13:34:48 +09:00
cnauroth
a9ea7cff31 HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. Contributed by Anu Engineer. 
(cherry picked from commit 6583ad148be5447eb2f086a2c6c7006631dff4da)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-02-05 16:56:16 -08:00
yliu
3ffe5a1ed2 HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:48:55 +08:00
Junping Du
f59b698fc9 HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results. (Contributed by Sangjin Lee) 
(cherry picked from commit 0b567f424673b5cea1c3bc23b2bd268ef6b7625f)
 2015-02-04 19:12:21 -08:00
Karthik Kambatla
fcf3dc5977 HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and Karthik Kambatla via kasha) 
(cherry picked from commit 55235d28c3641ff5f1c05c53dd7271cafc131926)
 2015-02-04 14:00:44 -08:00
cnauroth
196443318f HADOOP-11547. hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. Contributed by Chris Nauroth. 
(cherry picked from commit a35e86c6701ffec263966bab31bd9368923c7e80)
 2015-02-04 12:07:13 -08:00
Andrew Wang
696266e99c HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 
(cherry picked from commit 9175105eeaecf0a1d60b57989b73ce45cee4689b)
 2015-02-04 11:31:49 -08:00
cnauroth
85b2739508 HADOOP-11548. checknative should display a nicer error message when openssl support is not compiled in. Contributed by Anu Engineer. 
(cherry picked from commit 064e0770a0f32e7f32a7ba16c71394d7e75a3eb3)
 2015-02-04 10:01:39 -08:00
Akira Ajisaka
5c5139d35f HADOOP-11544. Remove unused configuration keys for tracing. Contributed by Masatake Iwasaki. 
(cherry picked from commit 42548f4dc2b2e8ace891b970c2c6712c02bb43ea)
 2015-02-04 04:20:08 -08:00
Robert Kanter
410830fe8c YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 
(cherry picked from commit f7a77819a1e4ff394e110941c1f8dd80f47dd38f)
 2015-02-03 10:39:51 -08:00
cnauroth
aee297ccea HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson. 
(cherry picked from commit 8004a002307940176cc188657c68e85171a5b5a8)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/ganglia/GangliaContext.java
 2015-02-02 11:16:13 -08:00
Benoy Antony
f3ed5b68ca HADOOP-11494. Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread. Contributed by Ted Yu. 
(cherry picked from commit 3472e3bd6c50558870b86c9ccfea5072385fa991)
 2015-02-02 10:46:54 -08:00
Harsh J
648510e031 HADOOP-11488. Difference in default connection timeout for S3A FS. Contributed by Daisuke Kobayashi. 
(cherry picked from commit ffc75d6ebe4912f20f4f4870d2a50abbe4557bfa)
 2015-02-01 00:17:24 +05:30
Gera Shegalov
151e147e64 HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. (Liang Xie via gera) 
(cherry picked from commit 26c2de36e2dd1b2ddedc155e49fb2ec31366d5f8)
 2015-01-30 18:47:03 -08:00
Colin Patrick Mccabe
80381b62aa HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 09ad9a868a89922e9b55b3e7c5b9f41fa54d3770)
 2015-01-30 16:02:36 -08:00
Kihwal Lee
3a01984bda HADOOP-9137. Support connection limiting in IPC server. Contributed by Kihwal Lee. 
(cherry picked from commit 8dc59cb9e0f8d300991a437c1b42f1e4e495cfe4)
 2015-01-30 17:22:48 -06:00
Colin Patrick Mccabe
e8d154baea HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe) 
(cherry picked from commit e36ef3b4022a8527cdfa937c4ffc9d46e71cfe28)
 2015-01-29 15:48:59 -08:00
Akira Ajisaka
71c60af84e HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties (aajisaka) 
(cherry picked from commit 03a5e04d5b6ec89219769868466e3b4913b0fff6)
 2015-01-29 16:18:07 +09:00
Tsuyoshi Ozawa
71db37266b HADOOP-11316. "mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters. (ozawa) 
(cherry picked from commit 9850e1584b7bb47c39d777d6fc4931dd54fbaea7)
 2015-01-28 22:01:38 +09:00
Aaron T. Myers
3c8d3816c6 HADOOP-10626. Limit Returning Attributes for LDAP search. Contributed by Jason Hubbard. 
(cherry picked from commit 8709751e1ee9a2c5553823dcd715bd077052ad7f)
 2015-01-27 13:51:19 -08:00
Haohui Mai
3d6318b51b HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:06:15 -08:00
Xuan
f93fa39384 HADOOP-11509. Change parsing sequence in GenericOptionsParser to parse 
-D parameters before -files. Contributed by Xuan Gong

(cherry picked from commit 0bf333911c950f22ec0f784bf465306e20b0d507)
 2015-01-26 15:37:14 -08:00
Steve Loughran
0ada35c912 HADOOP-6221 RPC Client operations cannot be interrupted (stevel) 2015-01-26 22:04:45 +00:00
Jason Lowe
a389056afa HADOOP-11499. Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition. Contributed by Ted Yu 
(cherry picked from commit 7574df1bba33919348d3009f2578d6a81b5818e6)
 2015-01-26 16:57:12 +00:00
Konstantin V Shvachko
de66227a57 HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. 2015-01-24 17:28:34 -08:00
Andrew Wang
7b69719455 HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh. 
(cherry picked from commit 4b00935643f6c3656ccbd7eeb54884738bc12c2e)
 2015-01-23 12:11:29 -08:00
Steve Loughran
28d165d9a5 HADOOP-11507 Hadoop RPC Authentication problem with different user locale. (Talat UYARER via stevel) 2015-01-23 19:36:37 +00:00
Allen Wittenauer
03ee9e344f HADOOP-11008. Remove duplicated description about proxy-user in site documents (Masatake Iwasaki via aw) 2015-01-22 14:30:35 -08:00
Tsuyoshi Ozawa
7191efe25f HADOOP-11500. InputStream is left unclosed in ApplicationClassLoader. Contributed by Ted Yu. 
(cherry picked from commit 825923f7b9a8771ff5b3f08646e96304d1acc367)
 2015-01-23 00:50:43 +09:00
Tsuyoshi Ozawa
1435b2002b HADOOP-11209. Configuration#updatingResource/finalParameters are not thread-safe. Contributed by Varun Saxena. 
(cherry picked from commit 786dbdfad8991a99d71bdd861e0b5014669a422c)
 2015-01-22 14:16:52 +09:00
Colin Patrick Mccabe
2c69f8cf81 HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe) 
(cherry picked from commit ee7d22e90ce67de3e7ee92f309c048a1d4be0bbe)
 2015-01-21 17:06:38 -08:00
cnauroth
2a69775610 HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 
(cherry picked from commit 925c9fed3311ea1fd8f5ed1cb6b1c0abc5c90425)
 2015-01-21 11:53:02 -08:00
Jason Lowe
57a53acad4 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne 
(cherry picked from commit 07b08060369caf34f248745a10bda61fb0a3ef23)
 2015-01-21 19:07:26 +00:00
yliu
3f37354daa HDFS-7623. Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace. (yliu) 2015-01-21 00:57:51 +08:00
cnauroth
a70e2c15be HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 
(cherry picked from commit 7fc1f2f5cf4312d72aeffb1a9cef497d00c60adb)
 2015-01-19 11:28:42 -08:00
Karthik Kambatla
4d8fa9615f YARN-2984. Metrics for container's actual memory usage. (kasha) 
(cherry picked from commit 84198564ba6028d51c1fcf9cdcb87f6ae6e08513)
 2015-01-17 06:26:47 +05:30
Arpit Agarwal
f72e2bfedd HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-16 09:37:54 -08:00