Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,138 Commits 326 Branches 371 Tags
Commit Graph

8138 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
401c7d72f5 YARN-3071. Remove invalid char from sample conf in doc of FairScheduler. (Contributed by Masatake Iwasaki) 
(cherry picked from commit 4a5c3a4cfee6b8008a722801821e64850582a985)
 2015-01-19 21:22:48 +09:00
Junping Du
ef4d7b73b9 YARN-3070. TestRMAdminCLI#testHelp fails for transitionToActive command. (Contributed by Junping Du) 
(cherry picked from commit 19cbce3898aeee7dd3b46e2c2ffeae25ff6ba88f)
 2015-01-18 23:09:24 -08:00
Haohui Mai
29551e19ef HDFS-7573. Consolidate the implementation of delete() into a single class. Contributed by Haohui Mai. 2015-01-17 12:56:44 -08:00
Steve Loughran
15865587ec HADOOP-11171 Enable using a proxy server to connect to S3a. (Thomas Demoor via stevel) 2015-01-17 18:40:30 +00:00
Steve Loughran
ed2f8a1ba0 HADOOP-10542 Potential null pointer dereference in Jets3tFileSystemStore retrieveBlock(). (Ted Yu via stevel) 2015-01-17 18:26:03 +00:00
Karthik Kambatla
4d8fa9615f YARN-2984. Metrics for container's actual memory usage. (kasha) 
(cherry picked from commit 84198564ba6028d51c1fcf9cdcb87f6ae6e08513)
 2015-01-17 06:26:47 +05:30
Zhijie Shen
dcd6eed13a YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu. 
(cherry picked from commit 43302f6f44f97d67069eefdda986b6da2933393e)
 2015-01-16 16:38:36 -08:00
cnauroth
8e765b8513 HDFS-7632. MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. Contributed by Chris Nauroth. 
(cherry picked from commit ec4389cf7270cff4cc96313b4190422ea7c70ced)
 2015-01-16 10:52:13 -08:00
cnauroth
b3d03980c4 HDFS-7635. Remove TestCorruptFilesJsp from branch-2. Contributed by Chris Nauroth. 2015-01-16 10:40:38 -08:00
Arpit Agarwal
f72e2bfedd HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-16 09:37:54 -08:00
Steve Loughran
651c7debe4 HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) 2015-01-16 10:15:22 +00:00
Junping Du
7cddec31d7 YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He) 
(cherry picked from commit 5d1cca34fa14706586f8bbe7f2a2264757fdcc11)
 2015-01-16 00:10:36 -08:00
yliu
bdbf13ac46 HDFS-7189. Add trace spans for DFSClient metadata operations. (Colin P. McCabe via yliu) 2015-01-16 00:21:38 +08:00
Haohui Mai
2e4df87104 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:22:20 -08:00
Kihwal Lee
6f792fc198 HDFS-7457. DatanodeID generates excessive garbage. Contributed by Daryn Sharp. 
(cherry picked from commit 780a6bf14562fd9d1070a7c8e756fa1c3bc65d32)
 2015-01-15 16:45:06 -06:00
Kihwal Lee
0090157fff HDFS-7615. Remove longReadLock. Contributed by Kihwal Lee. 
(cherry picked from commit 44eed6cbc97649c15177f9b36f6b119cc1900f7a)
 2015-01-15 16:40:18 -06:00
Allen Wittenauer
450561a934 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) (missed some files) 2015-01-15 11:57:48 -08:00
Allen Wittenauer
c060d60a40 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2015-01-15 11:56:16 -08:00
Robert Kanter
24a8b8e5a7 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) 
(cherry picked from commit b6ff9c03a4f8aba945e562a7ff60b0fc6a1cd040)
 2015-01-15 11:42:15 -08:00
Jian He
ed5a0d0aa8 YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen 
(cherry picked from commit 9e33116d1d8944a393937337b3963e192b9c74d1)
 2015-01-15 11:08:19 -08:00
Akira Ajisaka
8682382c16 HADOOP-11318. Update the document for hadoop fs -stat 
(cherry picked from commit ce29074685abaa88ae9586fe8277aca23f9d54d6)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
 2015-01-16 01:09:37 +09:00
Akira Ajisaka
b349cd9d0b YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki) 
(cherry picked from commit 533e551eb42af188535aeb0ab35f8ebf150a0da1)
 2015-01-15 21:30:26 +09:00
Akira Ajisaka
0f33d45948 HADOOP-11483. HardLink.java should use the jdk7 createLink method 
(cherry picked from commit db51548f706ccd2d0200745ab89e27610c6d10bc)
 2015-01-15 21:01:59 +09:00
Karthik Kambatla
d98b8f4bd3 YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha) 
(cherry picked from commit ba5116ec8e0c075096c6f84a8c8a1c6ce8297cf2)
 2015-01-15 14:32:35 +05:30
Colin Patrick Mccabe
e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit a5a033c7ca130528f8c509b035fc090ad4eb981a)
 2015-01-14 18:04:32 -08:00
Tsz-Wo Nicholas Sze
80f2c41ea4 HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter. 2015-01-14 11:32:38 -08:00
Xuan
79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of 
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c7ae22d5d60d8cba16cba565e8e8b20)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
 2015-01-14 11:18:10 -08:00
Colin Patrick Mccabe
0578df3baa HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCabe) 
(cherry picked from commit 446545c496fdab75e76c8124c98324e37150b5dc)
 2015-01-14 11:14:16 -08:00
Akira Ajisaka
2e5eef9da2 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo) 
(cherry picked from commit d336d136785ef1e49e0a110a1b9f0d1824829877)
 2015-01-14 17:43:25 +09:00
Junping Du
0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He) 
(cherry picked from commit f92e5038000a012229c304bc6e5281411eff2883)
 2015-01-13 18:23:32 -08:00
Jian He
4931600030 YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch 
(cherry picked from commit c53420f58364b11fbda1dace7679d45534533382)
 2015-01-13 17:32:36 -08:00
cnauroth
27eecaef10 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong. 
(cherry picked from commit 85aec75ce53445e1abf840076d2e10f1e3c6d69b)
 2015-01-13 16:10:40 -08:00
Xuan
0562f382fa MAPREDUCE-6173. Document the configuration of deploying MR over 
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.

(cherry picked from commit 10ac5abb867ead7131f3c76b27e48f7908b1d7f1)
 2015-01-13 10:08:24 -08:00
Arpit Agarwal
7a75f4eed9 HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:23:13 -08:00
Robert Kanter
13cdcf28e0 YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter) 
(cherry picked from commit 51881535e659940b1b332d0c5952ee1f9958cc7f)
 2015-01-12 17:51:45 -08:00
Jing Zhao
6e2eb9d5cf HDFS-7600. Refine hdfs admin classes to reuse common code. Contributed by Jing Zhao. 2015-01-12 17:35:44 -08:00
Colin Patrick Mccabe
a6ebe7a76b HDFS-5445. PacketReceiver populates the packetLen field in PacketHeader incorrectly (Jonathan Mace via Colin P. McCabe) 
(cherry picked from commit f761bd8fe472c311bdff7c9d469f2805b867855a)
 2015-01-12 17:11:34 -08:00
Colin Patrick Mccabe
dde774f2a4 HDFS-7598. Remove dependency on old version of Guava in TestDFSClientCache#testEviction (Sangjin Lee via Colin P. McCabe) 
(cherry picked from commit b3ddd7ee39c92d2df8661ce5834a2831020cecb2)
 2015-01-12 17:08:08 -08:00
Kihwal Lee
33534a0c9a HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Contributed by Eric Payne. 
(cherry picked from commit 6bbf9fdd041d2413dd78e2bce51abae15f3334c2)
 2015-01-12 15:38:17 -06:00
Colin Patrick Mccabe
e4bb94b0b8 HDFS-7326. Add documentation for hdfs debug commands (Vijay Bhat via Colin P. McCabe) 
(cherry picked from commit b78b4a1536b6d47a37ff7c309857a628a864c957)
 2015-01-12 12:17:37 -08:00
Robert Kanter
7c4e5ff660 YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter) 
(cherry picked from commit f45163191583eadcfbe0df233a3185fd1b2b78f3)
 2015-01-12 12:00:52 -08:00
Robert Kanter
e5059b91bb YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter) 
(cherry picked from commit ae7bf31fe1c63f323ba5271e50fd0e4425a7510f)
 2015-01-12 10:48:45 -08:00
yliu
cce7ab4721 HDFS-7323. Move the get/setStoragePolicy commands out from dfsadmin. (jing9 via yliu) 2015-01-12 00:45:27 +08:00
cnauroth
75e4e55e12 HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarwal. 
(cherry picked from commit ef3c3a832c2f0c1e5ccdda2ff8ef84902912955f)
 2015-01-10 09:18:41 -08:00
Ravi Prakash
619fbf1fa4 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' 
(Kamil Gorlo via raviprak)

(cherry picked from commit 4d2914210053f28c95094aa59e48f8e84c55a2c7)
 2015-01-10 08:37:35 -08:00
Jian He
36b3dcaab2 YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan 
(cherry picked from commit a2604062681230442eefae79815db5d77ccc4c2e)
 2015-01-09 17:50:18 -08:00
Jian He
68709cb9be YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki 
(cherry picked from commit 27a489cba63d9473e4cbcaef018b66108fb6c122)
 2015-01-09 17:47:00 -08:00
Jing Zhao
4b589e7cfa HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma. 2015-01-09 17:36:30 -08:00
Brandon Li
d847363821 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia 
(cherry picked from commit 09d31bc63035a71620657ab3f787047799bdcd14)
 2015-01-09 17:25:19 -08:00
cnauroth
9a7c763b3f HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:33 -08:00