Commit Graph

8702 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 5ec2b6caa9 HDFS-7496. Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances (Lei (Eddy) Xu via Colin P. McCabe)
(cherry-picked from commit a17584936c)
2015-01-21 11:43:42 -08:00
Tsz-Wo Nicholas Sze 1dc5483054 HDFS-3443. Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer. Contributed by Vinayakumar B
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
2015-01-21 11:37:58 -08:00
Jason Lowe 57a53acad4 HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an incorrect filter. Contributed by Eric Payne
(cherry picked from commit 07b0806036)
2015-01-21 19:07:26 +00:00
Allen Wittenauer 683cc18bba HADOOP-11256. Some site docs have inconsistent appearance (Masatake Iwasaki via aw) 2015-01-21 08:46:19 -08:00
Colin Patrick Mccabe 7779f38e68 HDFS-7610. Fix removal of dynamically added DN volumes (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit a17584936c)
2015-01-20 20:15:33 -08:00
yliu 7b5aea8175 HDFS-7641. Update archival storage user doc for list/set/get block storage policies. (yliu) 2015-01-21 02:04:03 +08:00
yliu 3f37354daa HDFS-7623. Add htrace configuration properties to core-default.xml and update user doc about how to enable htrace. (yliu) 2015-01-21 00:57:51 +08:00
Wangda Tan 610aa71a10 YARN-2731. Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilder. (Contributed by Carlo Curino)
(cherry picked from commit f250ad1773)
2015-01-20 14:49:06 -08:00
Tsuyoshi Ozawa 09eee9bbc1 HADOOP-11489. Dropping dependency on io.netty from hadoop-nfs' pom.xml. Contributed by Ted Yu.
(cherry picked from commit c94c0d2c56)
2015-01-20 15:27:41 +09:00
Haohui Mai 755731a6c1 HDFS-7640. print NFS Client in the NFS log. Contributed by Brandon Li. 2015-01-19 17:29:57 -08:00
Wangda Tan ef6fc24dfb YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal
(cherry picked from commit 0a2d3e717d)
2015-01-19 16:57:17 -08:00
cnauroth 2c4abe9208 YARN-3015. yarn classpath command should support same options as hadoop classpath. Contributed by Varun Saxena. 2015-01-19 15:54:41 -08:00
cnauroth a70e2c15be HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails. Contributed by Ming Ma.
(cherry picked from commit 7fc1f2f5cf)
2015-01-19 11:28:42 -08:00
Jing Zhao 5da33c5b5d HDFS-7637. Fix the check condition for reserved path. Contributed by Yi Liu.
(cherry picked from commit e843a0a8ce)
2015-01-19 10:29:02 -08:00
Akira Ajisaka 401c7d72f5 YARN-3071. Remove invalid char from sample conf in doc of FairScheduler. (Contributed by Masatake Iwasaki)
(cherry picked from commit 4a5c3a4cfe)
2015-01-19 21:22:48 +09:00
Junping Du ef4d7b73b9 YARN-3070. TestRMAdminCLI#testHelp fails for transitionToActive command. (Contributed by Junping Du)
(cherry picked from commit 19cbce3898)
2015-01-18 23:09:24 -08:00
Haohui Mai 29551e19ef HDFS-7573. Consolidate the implementation of delete() into a single class. Contributed by Haohui Mai. 2015-01-17 12:56:44 -08:00
Steve Loughran 15865587ec HADOOP-11171 Enable using a proxy server to connect to S3a. (Thomas Demoor via stevel) 2015-01-17 18:40:30 +00:00
Steve Loughran ed2f8a1ba0 HADOOP-10542 Potential null pointer dereference in Jets3tFileSystemStore retrieveBlock(). (Ted Yu via stevel) 2015-01-17 18:26:03 +00:00
Karthik Kambatla 4d8fa9615f YARN-2984. Metrics for container's actual memory usage. (kasha)
(cherry picked from commit 84198564ba)
2015-01-17 06:26:47 +05:30
Zhijie Shen dcd6eed13a YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu.
(cherry picked from commit 43302f6f44)
2015-01-16 16:38:36 -08:00
cnauroth 8e765b8513 HDFS-7632. MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. Contributed by Chris Nauroth.
(cherry picked from commit ec4389cf72)
2015-01-16 10:52:13 -08:00
cnauroth b3d03980c4 HDFS-7635. Remove TestCorruptFilesJsp from branch-2. Contributed by Chris Nauroth. 2015-01-16 10:40:38 -08:00
Arpit Agarwal f72e2bfedd HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-16 09:37:54 -08:00
Steve Loughran 651c7debe4 HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) 2015-01-16 10:15:22 +00:00
Junping Du 7cddec31d7 YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He)
(cherry picked from commit 5d1cca34fa)
2015-01-16 00:10:36 -08:00
yliu bdbf13ac46 HDFS-7189. Add trace spans for DFSClient metadata operations. (Colin P. McCabe via yliu) 2015-01-16 00:21:38 +08:00
Haohui Mai 2e4df87104 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:22:20 -08:00
Kihwal Lee 6f792fc198 HDFS-7457. DatanodeID generates excessive garbage. Contributed by Daryn Sharp.
(cherry picked from commit 780a6bf145)
2015-01-15 16:45:06 -06:00
Kihwal Lee 0090157fff HDFS-7615. Remove longReadLock. Contributed by Kihwal Lee.
(cherry picked from commit 44eed6cbc9)
2015-01-15 16:40:18 -06:00
Allen Wittenauer 450561a934 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) (missed some files) 2015-01-15 11:57:48 -08:00
Allen Wittenauer c060d60a40 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2015-01-15 11:56:16 -08:00
Robert Kanter 24a8b8e5a7 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter)
(cherry picked from commit b6ff9c03a4)
2015-01-15 11:42:15 -08:00
Jian He ed5a0d0aa8 YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen
(cherry picked from commit 9e33116d1d)
2015-01-15 11:08:19 -08:00
Akira Ajisaka 8682382c16 HADOOP-11318. Update the document for hadoop fs -stat
(cherry picked from commit ce29074685)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
2015-01-16 01:09:37 +09:00
Akira Ajisaka b349cd9d0b YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki)
(cherry picked from commit 533e551eb4)
2015-01-15 21:30:26 +09:00
Akira Ajisaka 0f33d45948 HADOOP-11483. HardLink.java should use the jdk7 createLink method
(cherry picked from commit db51548f70)
2015-01-15 21:01:59 +09:00
Karthik Kambatla d98b8f4bd3 YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha)
(cherry picked from commit ba5116ec8e)
2015-01-15 14:32:35 +05:30
Colin Patrick Mccabe e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe)
(cherry picked from commit a5a033c7ca)
2015-01-14 18:04:32 -08:00
Tsz-Wo Nicholas Sze 80f2c41ea4 HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter. 2015-01-14 11:32:38 -08:00
Xuan 79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
2015-01-14 11:18:10 -08:00
Colin Patrick Mccabe 0578df3baa HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCabe)
(cherry picked from commit 446545c496)
2015-01-14 11:14:16 -08:00
Akira Ajisaka 2e5eef9da2 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo)
(cherry picked from commit d336d13678)
2015-01-14 17:43:25 +09:00
Junping Du 0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He)
(cherry picked from commit f92e503800)
2015-01-13 18:23:32 -08:00
Jian He 4931600030 YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch
(cherry picked from commit c53420f583)
2015-01-13 17:32:36 -08:00
cnauroth 27eecaef10 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong.
(cherry picked from commit 85aec75ce5)
2015-01-13 16:10:40 -08:00
Xuan 0562f382fa MAPREDUCE-6173. Document the configuration of deploying MR over
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.

(cherry picked from commit 10ac5abb86)
2015-01-13 10:08:24 -08:00
Arpit Agarwal 7a75f4eed9 HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:23:13 -08:00
Robert Kanter 13cdcf28e0 YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter)
(cherry picked from commit 51881535e6)
2015-01-12 17:51:45 -08:00
Jing Zhao 6e2eb9d5cf HDFS-7600. Refine hdfs admin classes to reuse common code. Contributed by Jing Zhao. 2015-01-12 17:35:44 -08:00