Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,258 Commits 326 Branches 371 Tags
Commit Graph

8258 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsuyoshi Ozawa
1435b2002b HADOOP-11209. Configuration#updatingResource/finalParameters are not thread-safe. Contributed by Varun Saxena. 
(cherry picked from commit 786dbdfad8991a99d71bdd861e0b5014669a422c)
 2015-01-22 14:16:52 +09:00
Tsuyoshi Ozawa
316eedb55f YARN-3078. LogCLIHelpers lacks of a blank space before string 'does not exist'. Contributed by Sam Liu. 
(cherry picked from commit 5712c9f96a2cf4ff63d36906ab3876444c0cddec)
 2015-01-22 12:25:29 +09:00
Colin Patrick Mccabe
2c69f8cf81 HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe) 
(cherry picked from commit ee7d22e90ce67de3e7ee92f309c048a1d4be0bbe)
 2015-01-21 17:06:38 -08:00
cnauroth
60dc848f23 MAPREDUCE-3283. mapred classpath CLI does not display the complete classpath. Contributed by Varun Saxena. 2015-01-21 13:52:09 -08:00
Kihwal Lee
95858db0c1 HDFS-7548. Corrupt block reporting delayed until datablock scanner thread detects it. Contributed by Rushabh Shah. 2015-01-21 14:42:45 -06:00
cnauroth
2a69775610 HADOOP-10668. Addendum patch to fix TestZKFailoverController. Contributed by Ming Ma. 
(cherry picked from commit 925c9fed3311ea1fd8f5ed1cb6b1c0abc5c90425)
 2015-01-21 11:53:02 -08:00
Colin Patrick Mccabe
5ec2b6caa9 HDFS-7496. Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry-picked from commit a17584936cc5141e3f5612ac3ecf35e27968e439)
 2015-01-21 11:43:42 -08:00
Tsz-Wo Nicholas Sze
1dc5483054 HDFS-3443. Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer. Contributed by Vinayakumar B 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
 2015-01-21 11:37:58 -08:00
Jason Lowe
57a53acad4 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne 
(cherry picked from commit 07b08060369caf34f248745a10bda61fb0a3ef23)
 2015-01-21 19:07:26 +00:00
Allen Wittenauer
683cc18bba HADOOP-11256. Some site docs have inconsistent appearance (Masatake Iwasaki via aw) 2015-01-21 08:46:19 -08:00
Colin Patrick Mccabe
7779f38e68 HDFS-7610. Fix removal of dynamically added DN volumes (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit a17584936cc5141e3f5612ac3ecf35e27968e439)
 2015-01-20 20:15:33 -08:00
yliu
7b5aea8175 HDFS-7641. Update archival storage user doc for list/set/get block storage policies. (yliu) 2015-01-21 02:04:03 +08:00
yliu
3f37354daa HDFS-7623. Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace. (yliu) 2015-01-21 00:57:51 +08:00
Wangda Tan
610aa71a10 YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino) 
(cherry picked from commit f250ad1773b19713d6aea81ae290ebb4c90fd44b)
 2015-01-20 14:49:06 -08:00
Tsuyoshi Ozawa
09eee9bbc1 HADOOP-11489. Dropping dependency on io.netty from hadoop-nfs' pom.xml. Contributed by Ted Yu. 
(cherry picked from commit c94c0d2c5663c38fc7b306368b54153bcfcb6c74)
 2015-01-20 15:27:41 +09:00
Haohui Mai
755731a6c1 HDFS-7640. print NFS Client in the NFS log. Contributed by Brandon Li. 2015-01-19 17:29:57 -08:00
Wangda Tan
ef6fc24dfb YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal 
(cherry picked from commit 0a2d3e717d9c42090a32ff177991a222a1e34132)
 2015-01-19 16:57:17 -08:00
cnauroth
2c4abe9208 YARN-3015. yarn classpath command should support same options as hadoop classpath. Contributed by Varun Saxena. 2015-01-19 15:54:41 -08:00
cnauroth
a70e2c15be HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma. 
(cherry picked from commit 7fc1f2f5cf4312d72aeffb1a9cef497d00c60adb)
 2015-01-19 11:28:42 -08:00
Jing Zhao
5da33c5b5d HDFS-7637. Fix the check condition for reserved path. Contributed by Yi Liu. 
(cherry picked from commit e843a0a8cee5c704a5d28cf14b5a4050094d341b)
 2015-01-19 10:29:02 -08:00
Akira Ajisaka
401c7d72f5 YARN-3071. Remove invalid char from sample conf in doc of FairScheduler. (Contributed by Masatake Iwasaki) 
(cherry picked from commit 4a5c3a4cfee6b8008a722801821e64850582a985)
 2015-01-19 21:22:48 +09:00
Junping Du
ef4d7b73b9 YARN-3070. TestRMAdminCLI#testHelp fails for transitionToActive command. (Contributed by Junping Du) 
(cherry picked from commit 19cbce3898aeee7dd3b46e2c2ffeae25ff6ba88f)
 2015-01-18 23:09:24 -08:00
Haohui Mai
29551e19ef HDFS-7573. Consolidate the implementation of delete() into a single class. Contributed by Haohui Mai. 2015-01-17 12:56:44 -08:00
Steve Loughran
15865587ec HADOOP-11171 Enable using a proxy server to connect to S3a. (Thomas Demoor via stevel) 2015-01-17 18:40:30 +00:00
Steve Loughran
ed2f8a1ba0 HADOOP-10542 Potential null pointer dereference in Jets3tFileSystemStore retrieveBlock(). (Ted Yu via stevel) 2015-01-17 18:26:03 +00:00
Karthik Kambatla
4d8fa9615f YARN-2984. Metrics for container's actual memory usage. (kasha) 
(cherry picked from commit 84198564ba6028d51c1fcf9cdcb87f6ae6e08513)
 2015-01-17 06:26:47 +05:30
Zhijie Shen
dcd6eed13a YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu. 
(cherry picked from commit 43302f6f44f97d67069eefdda986b6da2933393e)
 2015-01-16 16:38:36 -08:00
cnauroth
8e765b8513 HDFS-7632. MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. Contributed by Chris Nauroth. 
(cherry picked from commit ec4389cf7270cff4cc96313b4190422ea7c70ced)
 2015-01-16 10:52:13 -08:00
cnauroth
b3d03980c4 HDFS-7635. Remove TestCorruptFilesJsp from branch-2. Contributed by Chris Nauroth. 2015-01-16 10:40:38 -08:00
Arpit Agarwal
f72e2bfedd HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-16 09:37:54 -08:00
Steve Loughran
651c7debe4 HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) 2015-01-16 10:15:22 +00:00
Junping Du
7cddec31d7 YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He) 
(cherry picked from commit 5d1cca34fa14706586f8bbe7f2a2264757fdcc11)
 2015-01-16 00:10:36 -08:00
yliu
bdbf13ac46 HDFS-7189. Add trace spans for DFSClient metadata operations. (Colin P. McCabe via yliu) 2015-01-16 00:21:38 +08:00
Haohui Mai
2e4df87104 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:22:20 -08:00
Kihwal Lee
6f792fc198 HDFS-7457. DatanodeID generates excessive garbage. Contributed by Daryn Sharp. 
(cherry picked from commit 780a6bf14562fd9d1070a7c8e756fa1c3bc65d32)
 2015-01-15 16:45:06 -06:00
Kihwal Lee
0090157fff HDFS-7615. Remove longReadLock. Contributed by Kihwal Lee. 
(cherry picked from commit 44eed6cbc97649c15177f9b36f6b119cc1900f7a)
 2015-01-15 16:40:18 -06:00
Allen Wittenauer
450561a934 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) (missed some files) 2015-01-15 11:57:48 -08:00
Allen Wittenauer
c060d60a40 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2015-01-15 11:56:16 -08:00
Robert Kanter
24a8b8e5a7 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) 
(cherry picked from commit b6ff9c03a4f8aba945e562a7ff60b0fc6a1cd040)
 2015-01-15 11:42:15 -08:00
Jian He
ed5a0d0aa8 YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen 
(cherry picked from commit 9e33116d1d8944a393937337b3963e192b9c74d1)
 2015-01-15 11:08:19 -08:00
Akira Ajisaka
8682382c16 HADOOP-11318. Update the document for hadoop fs -stat 
(cherry picked from commit ce29074685abaa88ae9586fe8277aca23f9d54d6)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
 2015-01-16 01:09:37 +09:00
Akira Ajisaka
b349cd9d0b YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki) 
(cherry picked from commit 533e551eb42af188535aeb0ab35f8ebf150a0da1)
 2015-01-15 21:30:26 +09:00
Akira Ajisaka
0f33d45948 HADOOP-11483. HardLink.java should use the jdk7 createLink method 
(cherry picked from commit db51548f706ccd2d0200745ab89e27610c6d10bc)
 2015-01-15 21:01:59 +09:00
Karthik Kambatla
d98b8f4bd3 YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha) 
(cherry picked from commit ba5116ec8e0c075096c6f84a8c8a1c6ce8297cf2)
 2015-01-15 14:32:35 +05:30
Colin Patrick Mccabe
e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit a5a033c7ca130528f8c509b035fc090ad4eb981a)
 2015-01-14 18:04:32 -08:00
Tsz-Wo Nicholas Sze
80f2c41ea4 HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter. 2015-01-14 11:32:38 -08:00
Xuan
79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of 
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c7ae22d5d60d8cba16cba565e8e8b20)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
 2015-01-14 11:18:10 -08:00
Colin Patrick Mccabe
0578df3baa HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCabe) 
(cherry picked from commit 446545c496fdab75e76c8124c98324e37150b5dc)
 2015-01-14 11:14:16 -08:00
Akira Ajisaka
2e5eef9da2 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo) 
(cherry picked from commit d336d136785ef1e49e0a110a1b9f0d1824829877)
 2015-01-14 17:43:25 +09:00
Junping Du
0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He) 
(cherry picked from commit f92e5038000a012229c304bc6e5281411eff2883)
 2015-01-13 18:23:32 -08:00