Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,243 Commits 326 Branches 371 Tags
Commit Graph

8243 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Haohui Mai
b3a63fa8a2 HDFS-7683. Combine usages and percent stats in NameNode UI. Contributed by Vinayakumar B. 2015-01-27 11:09:42 -08:00
Haohui Mai
3d6318b51b HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:06:15 -08:00
Tsuyoshi Ozawa
04ad500fac YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger. 
(cherry picked from commit f56da3ce040b16582ce8153df0d7cea00becd843)
 2015-01-28 00:16:07 +09:00
Steve Loughran
aa16173a0d HDFS-49. MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found. (stevel) 2015-01-27 11:10:46 +00:00
Jian He
61b4116b4b YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan 
(cherry picked from commit 6f9fe76918bbc79109653edc6cde85df05148ba3)
 2015-01-26 15:38:27 -08:00
Xuan
f93fa39384 HADOOP-11509. Change parsing sequence in GenericOptionsParser to parse 
-D parameters before -files. Contributed by Xuan Gong

(cherry picked from commit 0bf333911c950f22ec0f784bf465306e20b0d507)
 2015-01-26 15:37:14 -08:00
Steve Loughran
0ada35c912 HADOOP-6221 RPC Client operations cannot be interrupted (stevel) 2015-01-26 22:04:45 +00:00
Colin Patrick Mccabe
7f1441291d HADOOP-11466: move to 2.6.1 2015-01-26 11:28:02 -08:00
Jason Lowe
a389056afa HADOOP-11499. Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisition. Contributed by Ted Yu 
(cherry picked from commit 7574df1bba33919348d3009f2578d6a81b5818e6)
 2015-01-26 16:57:12 +00:00
Jason Lowe
2cf58ca5a6 MAPREDUCE-6141. History server leveldb recovery store. Contributed by Jason Lowe 
(cherry picked from commit 56b7ec71a69820ae12b4b9e2eb04b7368f721dbf)
 2015-01-26 16:30:10 +00:00
Jason Lowe
07fe6a36cb YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne 
(cherry picked from commit 902c6ea7e4d3b49e49d9ce51ae9d12694ecfcf89)
 2015-01-26 15:41:23 +00:00
Kihwal Lee
c081fa6ae8 HDFS-7224. Allow reuse of NN connections via webhdfs. Contributed by Eric Payne 
(cherry picked from commit 2b0fa20f69417326a92beac10ffa072db2616e73)
 2015-01-26 08:15:37 -06:00
Tsuyoshi Ozawa
2551cc6e6f HADOOP-11450. Cleanup DistCpV1 not to use deprecated methods and fix javadocs. Contributed by Varun Saxena. 
(cherry picked from commit 7b82c4ab4e84256bcdee6256564f394dcc4e81ab)
 2015-01-26 13:02:00 +09:00
Xuan
a7696b3fbf YARN-3024. LocalizerRunner should give DIE action when all resources are 
localized. Contributed by Chengbing Liu

(cherry picked from commit 0d6bd62102f94c55d59f7a0a86a684e99d746127)
 2015-01-25 19:39:52 -08:00
Steve Loughran
d46738ca5c HADOOP-11419 improve hadoop-maven-plugins. (Hervé Boutemy via stevel) 2015-01-25 16:12:58 +00:00
Konstantin V Shvachko
24f0d56afb HDFS-7676. Fix TestFileTruncate to avoid bug of HDFS-7611. Contributed by Konstantin Shvachko. 2015-01-24 18:07:56 -08:00
yliu
5f70b7ecf0 HDFS-7659. truncate should check negative value of the new length. Contributed by Yi Liu. 2015-01-24 17:28:36 -08:00
Konstantin V Shvachko
de66227a57 HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. 2015-01-24 17:28:34 -08:00
Konstantin V Shvachko
6b22170bee HDFS-7643. Test case to ensure lazy persist files cannot be truncated. (Contributed by Yi Liu) 2015-01-24 17:28:32 -08:00
yliu
8adffbb2c8 HDFS-7634. Disallow truncation of Lazy persist files. (Contributed by Yi Liu) 2015-01-24 16:34:08 -08:00
yliu
0fdd09a895 HDFS-7638. Small fix and few refinements for FSN#truncate. (yliu) 2015-01-24 16:29:50 -08:00
Konstantin V Shvachko
a116e1fe9e HDFS-7606. Fix potential NPE in INodeFile.getBlocks(). Contributed by Byron Wong. 2015-01-24 16:16:58 -08:00
Konstantin V Shvachko
00a7ebab22 HDFS-7056. Snapshot support for truncate. Contributed by Konstantin Shvachko and Plamen Jeliazkov. 2015-01-24 16:06:41 -08:00
Plamen Jeliazkov
6ff9bde714 HDFS-3107. Introduce truncate. Contributed by Plamen Jeliazkov. 2015-01-24 16:01:07 -08:00
Allen Wittenauer
6f89692dc9 HDFS-7644. minor typo in HttpFS doc (Charles Lamb via aw) 2015-01-23 13:47:11 -08:00
Andrew Wang
7b69719455 HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contributed by Arun Suresh. 
(cherry picked from commit 4b00935643f6c3656ccbd7eeb54884738bc12c2e)
 2015-01-23 12:11:29 -08:00
Steve Loughran
28d165d9a5 HADOOP-11507 Hadoop RPC Authentication problem with different user locale. (Talat UYARER via stevel) 2015-01-23 19:36:37 +00:00
Tsuyoshi Ozawa
25f2cf8a4e YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan. 
(cherry picked from commit 24aa462673d392fed859f8088acf9679ae62a129)
 2015-01-23 20:37:26 +09:00
Tsuyoshi Ozawa
ff627d94e7 YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot. 
(cherry picked from commit 3aab354e664a3ce09e0d638bf0c1e7d273d40579)
 2015-01-23 16:05:05 +09:00
Akira Ajisaka
13067cf4b1 HADOOP-11493. Fix some typos in kms-acls.xml description. (Contributed by Charles Lamb) 
(cherry picked from commit aee4500612e9d7da5a7a46e407f9f5dc6c22508b)
 2015-01-23 11:49:37 +09:00
cnauroth
639c7b0ddc HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. 2015-01-22 16:03:17 -08:00
Arpit Agarwal
dcd14db1a8 HDFS-7575. Fix CHANGES.txt 2015-01-22 14:37:43 -08:00
Allen Wittenauer
03ee9e344f HADOOP-11008. Remove duplicated description about proxy-user in site documents (Masatake Iwasaki via aw) 2015-01-22 14:30:35 -08:00
Arpit Agarwal
1d9d166c0b HDFS-7575. Upgrade should generate a unique storage ID for each volume. (Contributed by Arpit Agarwal) 2015-01-22 14:12:56 -08:00
Tsuyoshi Ozawa
7191efe25f HADOOP-11500. InputStream is left unclosed in ApplicationClassLoader. Contributed by Ted Yu. 
(cherry picked from commit 825923f7b9a8771ff5b3f08646e96304d1acc367)
 2015-01-23 00:50:43 +09:00
Tsuyoshi Ozawa
1435b2002b HADOOP-11209. Configuration#updatingResource/finalParameters are not thread-safe. Contributed by Varun Saxena. 
(cherry picked from commit 786dbdfad8991a99d71bdd861e0b5014669a422c)
 2015-01-22 14:16:52 +09:00
Tsuyoshi Ozawa
316eedb55f YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'. Contributed by Sam Liu. 
(cherry picked from commit 5712c9f96a2cf4ff63d36906ab3876444c0cddec)
 2015-01-22 12:25:29 +09:00
Colin Patrick Mccabe
2c69f8cf81 HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe) 
(cherry picked from commit ee7d22e90ce67de3e7ee92f309c048a1d4be0bbe)
 2015-01-21 17:06:38 -08:00
cnauroth
60dc848f23 MAPREDUCE-3283. mapred classpath CLI does not display the complete classpath. Contributed by Varun Saxena. 2015-01-21 13:52:09 -08:00
Kihwal Lee
95858db0c1 HDFS-7548. Corrupt block reporting delayed until datablock scanner thread detects it. Contributed by Rushabh Shah. 2015-01-21 14:42:45 -06:00
cnauroth
2a69775610 HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 
(cherry picked from commit 925c9fed3311ea1fd8f5ed1cb6b1c0abc5c90425)
 2015-01-21 11:53:02 -08:00
Colin Patrick Mccabe
5ec2b6caa9 HDFS-7496. Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry-picked from commit a17584936cc5141e3f5612ac3ecf35e27968e439)
 2015-01-21 11:43:42 -08:00
Tsz-Wo Nicholas Sze
1dc5483054 HDFS-3443. Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer. Contributed by Vinayakumar B 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
 2015-01-21 11:37:58 -08:00
Jason Lowe
57a53acad4 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne 
(cherry picked from commit 07b08060369caf34f248745a10bda61fb0a3ef23)
 2015-01-21 19:07:26 +00:00
Allen Wittenauer
683cc18bba HADOOP-11256. Some site docs have inconsistent appearance (Masatake Iwasaki via aw) 2015-01-21 08:46:19 -08:00
Colin Patrick Mccabe
7779f38e68 HDFS-7610. Fix removal of dynamically added DN volumes (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit a17584936cc5141e3f5612ac3ecf35e27968e439)
 2015-01-20 20:15:33 -08:00
yliu
7b5aea8175 HDFS-7641. Update archival storage user doc for list/set/get block storage policies. (yliu) 2015-01-21 02:04:03 +08:00
yliu
3f37354daa HDFS-7623. Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace. (yliu) 2015-01-21 00:57:51 +08:00
Wangda Tan
610aa71a10 YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino) 
(cherry picked from commit f250ad1773b19713d6aea81ae290ebb4c90fd44b)
 2015-01-20 14:49:06 -08:00
Tsuyoshi Ozawa
09eee9bbc1 HADOOP-11489. Dropping dependency on io.netty from hadoop-nfs' pom.xml. Contributed by Ted Yu. 
(cherry picked from commit c94c0d2c5663c38fc7b306368b54153bcfcb6c74)
 2015-01-20 15:27:41 +09:00