Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,329 Commits 326 Branches 371 Tags
Commit Graph

8329 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arpit Agarwal
f72e2bfedd HDFS-7591. hdfs classpath command should support same options as hadoop classpath. (Contributed by Varun Saxena) 2015-01-16 09:37:54 -08:00
Steve Loughran
651c7debe4 HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) 2015-01-16 10:15:22 +00:00
Junping Du
7cddec31d7 YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He) 
(cherry picked from commit 5d1cca34fa14706586f8bbe7f2a2264757fdcc11)
 2015-01-16 00:10:36 -08:00
yliu
bdbf13ac46 HDFS-7189. Add trace spans for DFSClient metadata operations. (Colin P. McCabe via yliu) 2015-01-16 00:21:38 +08:00
Haohui Mai
2e4df87104 HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. Contributed by Benoy Antony. 2015-01-15 16:22:20 -08:00
Kihwal Lee
6f792fc198 HDFS-7457. DatanodeID generates excessive garbage. Contributed by Daryn Sharp. 
(cherry picked from commit 780a6bf14562fd9d1070a7c8e756fa1c3bc65d32)
 2015-01-15 16:45:06 -06:00
Kihwal Lee
0090157fff HDFS-7615. Remove longReadLock. Contributed by Kihwal Lee. 
(cherry picked from commit 44eed6cbc97649c15177f9b36f6b119cc1900f7a)
 2015-01-15 16:40:18 -06:00
Allen Wittenauer
450561a934 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) (missed some files) 2015-01-15 11:57:48 -08:00
Allen Wittenauer
c060d60a40 HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) 2015-01-15 11:56:16 -08:00
Robert Kanter
24a8b8e5a7 HADOOP-8757. Metrics should disallow names with invalid characters (rchiang via rkanter) 
(cherry picked from commit b6ff9c03a4f8aba945e562a7ff60b0fc6a1cd040)
 2015-01-15 11:42:15 -08:00
Jian He
ed5a0d0aa8 YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen 
(cherry picked from commit 9e33116d1d8944a393937337b3963e192b9c74d1)
 2015-01-15 11:08:19 -08:00
Akira Ajisaka
8682382c16 HADOOP-11318. Update the document for hadoop fs -stat 
(cherry picked from commit ce29074685abaa88ae9586fe8277aca23f9d54d6)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
 2015-01-16 01:09:37 +09:00
Akira Ajisaka
b349cd9d0b YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki) 
(cherry picked from commit 533e551eb42af188535aeb0ab35f8ebf150a0da1)
 2015-01-15 21:30:26 +09:00
Akira Ajisaka
0f33d45948 HADOOP-11483. HardLink.java should use the jdk7 createLink method 
(cherry picked from commit db51548f706ccd2d0200745ab89e27610c6d10bc)
 2015-01-15 21:01:59 +09:00
Karthik Kambatla
d98b8f4bd3 YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha) 
(cherry picked from commit ba5116ec8e0c075096c6f84a8c8a1c6ce8297cf2)
 2015-01-15 14:32:35 +05:30
Colin Patrick Mccabe
e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit a5a033c7ca130528f8c509b035fc090ad4eb981a)
 2015-01-14 18:04:32 -08:00
Tsz-Wo Nicholas Sze
80f2c41ea4 HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter. 2015-01-14 11:32:38 -08:00
Xuan
79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of 
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c7ae22d5d60d8cba16cba565e8e8b20)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
 2015-01-14 11:18:10 -08:00
Colin Patrick Mccabe
0578df3baa HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCabe) 
(cherry picked from commit 446545c496fdab75e76c8124c98324e37150b5dc)
 2015-01-14 11:14:16 -08:00
Akira Ajisaka
2e5eef9da2 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo) 
(cherry picked from commit d336d136785ef1e49e0a110a1b9f0d1824829877)
 2015-01-14 17:43:25 +09:00
Junping Du
0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He) 
(cherry picked from commit f92e5038000a012229c304bc6e5281411eff2883)
 2015-01-13 18:23:32 -08:00
Jian He
4931600030 YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch 
(cherry picked from commit c53420f58364b11fbda1dace7679d45534533382)
 2015-01-13 17:32:36 -08:00
cnauroth
27eecaef10 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong. 
(cherry picked from commit 85aec75ce53445e1abf840076d2e10f1e3c6d69b)
 2015-01-13 16:10:40 -08:00
Xuan
0562f382fa MAPREDUCE-6173. Document the configuration of deploying MR over 
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.

(cherry picked from commit 10ac5abb867ead7131f3c76b27e48f7908b1d7f1)
 2015-01-13 10:08:24 -08:00
Arpit Agarwal
7a75f4eed9 HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:23:13 -08:00
Robert Kanter
13cdcf28e0 YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter) 
(cherry picked from commit 51881535e659940b1b332d0c5952ee1f9958cc7f)
 2015-01-12 17:51:45 -08:00
Jing Zhao
6e2eb9d5cf HDFS-7600. Refine hdfs admin classes to reuse common code. Contributed by Jing Zhao. 2015-01-12 17:35:44 -08:00
Colin Patrick Mccabe
a6ebe7a76b HDFS-5445. PacketReceiver populates the packetLen field in PacketHeader incorrectly (Jonathan Mace via Colin P. McCabe) 
(cherry picked from commit f761bd8fe472c311bdff7c9d469f2805b867855a)
 2015-01-12 17:11:34 -08:00
Colin Patrick Mccabe
dde774f2a4 HDFS-7598. Remove dependency on old version of Guava in TestDFSClientCache#testEviction (Sangjin Lee via Colin P. McCabe) 
(cherry picked from commit b3ddd7ee39c92d2df8661ce5834a2831020cecb2)
 2015-01-12 17:08:08 -08:00
Kihwal Lee
33534a0c9a HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Contributed by Eric Payne. 
(cherry picked from commit 6bbf9fdd041d2413dd78e2bce51abae15f3334c2)
 2015-01-12 15:38:17 -06:00
Colin Patrick Mccabe
e4bb94b0b8 HDFS-7326. Add documentation for hdfs debug commands (Vijay Bhat via Colin P. McCabe) 
(cherry picked from commit b78b4a1536b6d47a37ff7c309857a628a864c957)
 2015-01-12 12:17:37 -08:00
Robert Kanter
7c4e5ff660 YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter) 
(cherry picked from commit f45163191583eadcfbe0df233a3185fd1b2b78f3)
 2015-01-12 12:00:52 -08:00
Robert Kanter
e5059b91bb YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter) 
(cherry picked from commit ae7bf31fe1c63f323ba5271e50fd0e4425a7510f)
 2015-01-12 10:48:45 -08:00
yliu
cce7ab4721 HDFS-7323. Move the get/setStoragePolicy commands out from dfsadmin. (jing9 via yliu) 2015-01-12 00:45:27 +08:00
cnauroth
75e4e55e12 HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarwal. 
(cherry picked from commit ef3c3a832c2f0c1e5ccdda2ff8ef84902912955f)
 2015-01-10 09:18:41 -08:00
Ravi Prakash
619fbf1fa4 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' 
(Kamil Gorlo via raviprak)

(cherry picked from commit 4d2914210053f28c95094aa59e48f8e84c55a2c7)
 2015-01-10 08:37:35 -08:00
Jian He
36b3dcaab2 YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan 
(cherry picked from commit a2604062681230442eefae79815db5d77ccc4c2e)
 2015-01-09 17:50:18 -08:00
Jian He
68709cb9be YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki 
(cherry picked from commit 27a489cba63d9473e4cbcaef018b66108fb6c122)
 2015-01-09 17:47:00 -08:00
Jing Zhao
4b589e7cfa HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma. 2015-01-09 17:36:30 -08:00
Brandon Li
d847363821 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia 
(cherry picked from commit 09d31bc63035a71620657ab3f787047799bdcd14)
 2015-01-09 17:25:19 -08:00
cnauroth
9a7c763b3f HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:33 -08:00
Colin Patrick Mccabe
a663faf741 HADOOP-11470. Remove some uses of obsolete guava APIs from the hadoop codebase (Sangjin Lee via Colin P. McCabe) 
(cherry picked from commit ae91b13a4b1896b893268253104f935c3078d345)
 2015-01-08 16:26:11 -08:00
cnauroth
f0acb7c2a2 HDFS-7579. Improve log reporting during block report rpc failure. Contributed by Charles Lamb. 
(cherry picked from commit 7e2d9a32426d04b5f08c2835f61882b053612a20)
 2015-01-08 15:13:05 -08:00
Jian He
e7e6173049 YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu 
(cherry picked from commit cc2a745f7e82c9fa6de03242952347c54c52dccc)
 2015-01-08 11:28:24 -08:00
cnauroth
501246e24a HDFS-7589. Break the dependency between libnative_mini_dfs and libhdfs. Contributed by Zhanwei Wang. 
(cherry picked from commit 708b1aa074d98df7d8abdc805818c787ce5779b8)
 2015-01-08 10:23:53 -08:00
Benoy Antony
832ae27f83 HADOOP-10651. Add ability to restrict service access using IP addresses and hostnames. (Benoy Antony) 
(cherry picked from commit 20625c8f048701c9516da159b24c0b33983e4bb7)
 2015-01-08 10:09:55 -08:00
Zhijie Shen
d2fbba790a YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu. 
(cherry picked from commit dc2eaa26b20cfbbcdd5784bb8761d08a42f29605)
 2015-01-08 09:49:27 -08:00
Tsuyoshi Ozawa
132fd6ba58 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 
(cherry picked from commit a6ed4894b518351bf1b3290e725a475570a21296)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/test/java/org/apache/hadoop/mapred/nativetask/kvtest/KVJob.java
 2015-01-08 15:00:02 +09:00
Jian He
9eb7611e81 Moved YARN-2880 to improvement section in CHANGES.txt 
(cherry picked from commit ef237bd52fc570292a7e608b373b51dd6d1590b8)
 2015-01-07 16:21:12 -08:00
Jian He
fe664b8b8d YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena 
(cherry picked from commit 2638f4d0f0da375b0dd08f3188057637ed0f32d5)
 2015-01-07 16:15:03 -08:00