Commit Graph

8119 Commits

Author SHA1 Message Date
Jian He ed5a0d0aa8 YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen
(cherry picked from commit 9e33116d1d)
2015-01-15 11:08:19 -08:00
Akira Ajisaka 8682382c16 HADOOP-11318. Update the document for hadoop fs -stat
(cherry picked from commit ce29074685)

Conflicts:
	hadoop-common-project/hadoop-common/src/site/apt/FileSystemShell.apt.vm
2015-01-16 01:09:37 +09:00
Akira Ajisaka b349cd9d0b YARN-3005. [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java (Contributed by Kengo Seki)
(cherry picked from commit 533e551eb4)
2015-01-15 21:30:26 +09:00
Akira Ajisaka 0f33d45948 HADOOP-11483. HardLink.java should use the jdk7 createLink method
(cherry picked from commit db51548f70)
2015-01-15 21:01:59 +09:00
Karthik Kambatla d98b8f4bd3 YARN-2217. [YARN-1492] Shared cache client side changes. (Chris Trezzo via kasha)
(cherry picked from commit ba5116ec8e)
2015-01-15 14:32:35 +05:30
Colin Patrick Mccabe e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe)
(cherry picked from commit a5a033c7ca)
2015-01-14 18:04:32 -08:00
Tsz-Wo Nicholas Sze 80f2c41ea4 HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter. 2015-01-14 11:32:38 -08:00
Xuan 79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
2015-01-14 11:18:10 -08:00
Colin Patrick Mccabe 0578df3baa HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCabe)
(cherry picked from commit 446545c496)
2015-01-14 11:14:16 -08:00
Akira Ajisaka 2e5eef9da2 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo)
(cherry picked from commit d336d13678)
2015-01-14 17:43:25 +09:00
Junping Du 0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He)
(cherry picked from commit f92e503800)
2015-01-13 18:23:32 -08:00
Jian He 4931600030 YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch
(cherry picked from commit c53420f583)
2015-01-13 17:32:36 -08:00
cnauroth 27eecaef10 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong.
(cherry picked from commit 85aec75ce5)
2015-01-13 16:10:40 -08:00
Xuan 0562f382fa MAPREDUCE-6173. Document the configuration of deploying MR over
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.

(cherry picked from commit 10ac5abb86)
2015-01-13 10:08:24 -08:00
Arpit Agarwal 7a75f4eed9 HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:23:13 -08:00
Robert Kanter 13cdcf28e0 YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter)
(cherry picked from commit 51881535e6)
2015-01-12 17:51:45 -08:00
Jing Zhao 6e2eb9d5cf HDFS-7600. Refine hdfs admin classes to reuse common code. Contributed by Jing Zhao. 2015-01-12 17:35:44 -08:00
Colin Patrick Mccabe a6ebe7a76b HDFS-5445. PacketReceiver populates the packetLen field in PacketHeader incorrectly (Jonathan Mace via Colin P. McCabe)
(cherry picked from commit f761bd8fe4)
2015-01-12 17:11:34 -08:00
Colin Patrick Mccabe dde774f2a4 HDFS-7598. Remove dependency on old version of Guava in TestDFSClientCache#testEviction (Sangjin Lee via Colin P. McCabe)
(cherry picked from commit b3ddd7ee39)
2015-01-12 17:08:08 -08:00
Kihwal Lee 33534a0c9a HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Contributed by Eric Payne.
(cherry picked from commit 6bbf9fdd04)
2015-01-12 15:38:17 -06:00
Colin Patrick Mccabe e4bb94b0b8 HDFS-7326. Add documentation for hdfs debug commands (Vijay Bhat via Colin P. McCabe)
(cherry picked from commit b78b4a1536)
2015-01-12 12:17:37 -08:00
Robert Kanter 7c4e5ff660 YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter)
(cherry picked from commit f451631915)
2015-01-12 12:00:52 -08:00
Robert Kanter e5059b91bb YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter)
(cherry picked from commit ae7bf31fe1)
2015-01-12 10:48:45 -08:00
yliu cce7ab4721 HDFS-7323. Move the get/setStoragePolicy commands out from dfsadmin. (jing9 via yliu) 2015-01-12 00:45:27 +08:00
cnauroth 75e4e55e12 HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarwal.
(cherry picked from commit ef3c3a832c)
2015-01-10 09:18:41 -08:00
Ravi Prakash 619fbf1fa4 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe'
(Kamil Gorlo via raviprak)

(cherry picked from commit 4d29142100)
2015-01-10 08:37:35 -08:00
Jian He 36b3dcaab2 YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan
(cherry picked from commit a260406268)
2015-01-09 17:50:18 -08:00
Jian He 68709cb9be YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki
(cherry picked from commit 27a489cba6)
2015-01-09 17:47:00 -08:00
Jing Zhao 4b589e7cfa HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma. 2015-01-09 17:36:30 -08:00
Brandon Li d847363821 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia
(cherry picked from commit 09d31bc630)
2015-01-09 17:25:19 -08:00
cnauroth 9a7c763b3f HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:33 -08:00
Colin Patrick Mccabe a663faf741 HADOOP-11470. Remove some uses of obsolete guava APIs from the hadoop codebase (Sangjin Lee via Colin P. McCabe)
(cherry picked from commit ae91b13a4b)
2015-01-08 16:26:11 -08:00
cnauroth f0acb7c2a2 HDFS-7579. Improve log reporting during block report rpc failure. Contributed by Charles Lamb.
(cherry picked from commit 7e2d9a3242)
2015-01-08 15:13:05 -08:00
Jian He e7e6173049 YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu
(cherry picked from commit cc2a745f7e)
2015-01-08 11:28:24 -08:00
cnauroth 501246e24a HDFS-7589. Break the dependency between libnative_mini_dfs and libhdfs. Contributed by Zhanwei Wang.
(cherry picked from commit 708b1aa074)
2015-01-08 10:23:53 -08:00
Benoy Antony 832ae27f83 HADOOP-10651. Add ability to restrict service access using IP addresses and hostnames. (Benoy Antony)
(cherry picked from commit 20625c8f04)
2015-01-08 10:09:55 -08:00
Zhijie Shen d2fbba790a YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu.
(cherry picked from commit dc2eaa26b2)
2015-01-08 09:49:27 -08:00
Tsuyoshi Ozawa 132fd6ba58 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)
(cherry picked from commit a6ed4894b5)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/test/java/org/apache/hadoop/mapred/nativetask/kvtest/KVJob.java
2015-01-08 15:00:02 +09:00
Jian He 9eb7611e81 Moved YARN-2880 to improvement section in CHANGES.txt
(cherry picked from commit ef237bd52f)
2015-01-07 16:21:12 -08:00
Jian He fe664b8b8d YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena
(cherry picked from commit 2638f4d0f0)
2015-01-07 16:15:03 -08:00
Konstantin V Shvachko c3c3bb2b02 HDFS-7561. TestFetchImage should write fetched-image-dir under target. Contributed by Liang Xie. 2015-01-07 16:07:16 -08:00
Jian He d3b26454e4 YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu
(cherry picked from commit e13a484a2b)
2015-01-07 14:12:54 -08:00
cnauroth adf49e4b94 HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. Contributed by Ayappan.
(cherry picked from commit 3ed0aed3cc)
2015-01-07 12:24:25 -08:00
Jian He 492717cbf5 YARN-2230. Fixed few configs description in yarn-default.xml. Contributed by Vijay Bhat
(cherry picked from commit fe8d2bd741)
2015-01-07 10:57:41 -08:00
Brandon Li 36367209a1 HDFS-7564. NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map. Contributed by Yongjun Zhang
(cherry picked from commit 788ee35e2b)
2015-01-06 16:20:39 -08:00
Jason Lowe c22c27068e MAPREDUCE-6206. TestAggregatedTransferRate fails on non-US systems. Contributed by Jens Rabe
(cherry picked from commit a0aeed100b)
2015-01-06 23:40:42 +00:00
Zhijie Shen 8a81312062 YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev.
(cherry picked from commit 60103fca04)
2015-01-06 14:39:44 -08:00
Jian He c61e8a7bfa YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena
(cherry picked from commit dd57c2047b)
2015-01-06 14:16:43 -08:00
Jason Lowe 2b408d8dc7 HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj
(cherry picked from commit d02fb53750)
2015-01-06 21:20:31 +00:00
Vinayakumar B 53ecb63587 HDFS-7583. Fix findbug in TransferFsImage.java (Contributed by Vinayakumar B)
(cherry picked from commit 4cd66f7fb2)
2015-01-06 09:32:56 +05:30