Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,114 Commits 326 Branches 371 Tags
Commit Graph

8114 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
e6a251ff68 HDFS-7067. ClassCastException while using a key created by keytool to create encryption zone. (Charles Lamb via Colin P. McCabe) 
(cherry picked from commit a5a033c7ca130528f8c509b035fc090ad4eb981a)
 2015-01-14 18:04:32 -08:00
Tsz-Wo Nicholas Sze
80f2c41ea4 HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter. 2015-01-14 11:32:38 -08:00
Xuan
79c8f4dcba YARN-2807. Option "--forceactive" not works as described in usage of 
"yarn rmadmin -transitionToActive". Contributed by Masatake Iwasaki

(cherry picked from commit d15cbae73c7ae22d5d60d8cba16cba565e8e8b20)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/YarnCommands.apt.vm
 2015-01-14 11:18:10 -08:00
Colin Patrick Mccabe
0578df3baa HDFS-7585. Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096 (Sam Liu via Colin P. McCabe) 
(cherry picked from commit 446545c496fdab75e76c8124c98324e37150b5dc)
 2015-01-14 11:14:16 -08:00
Akira Ajisaka
2e5eef9da2 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo) 
(cherry picked from commit d336d136785ef1e49e0a110a1b9f0d1824829877)
 2015-01-14 17:43:25 +09:00
Junping Du
0119e717ae YARN-3019. Make work-preserving-recovery the default mechanism for RM recovery. (Contributed by Jian He) 
(cherry picked from commit f92e5038000a012229c304bc6e5281411eff2883)
 2015-01-13 18:23:32 -08:00
Jian He
4931600030 YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch 
(cherry picked from commit c53420f58364b11fbda1dace7679d45534533382)
 2015-01-13 17:32:36 -08:00
cnauroth
27eecaef10 HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong. 
(cherry picked from commit 85aec75ce53445e1abf840076d2e10f1e3c6d69b)
 2015-01-13 16:10:40 -08:00
Xuan
0562f382fa MAPREDUCE-6173. Document the configuration of deploying MR over 
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.

(cherry picked from commit 10ac5abb867ead7131f3c76b27e48f7908b1d7f1)
 2015-01-13 10:08:24 -08:00
Arpit Agarwal
7a75f4eed9 HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Contributed by Varun Saxena) 2015-01-12 21:23:13 -08:00
Robert Kanter
13cdcf28e0 YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter) 
(cherry picked from commit 51881535e659940b1b332d0c5952ee1f9958cc7f)
 2015-01-12 17:51:45 -08:00
Jing Zhao
6e2eb9d5cf HDFS-7600. Refine hdfs admin classes to reuse common code. Contributed by Jing Zhao. 2015-01-12 17:35:44 -08:00
Colin Patrick Mccabe
a6ebe7a76b HDFS-5445. PacketReceiver populates the packetLen field in PacketHeader incorrectly (Jonathan Mace via Colin P. McCabe) 
(cherry picked from commit f761bd8fe472c311bdff7c9d469f2805b867855a)
 2015-01-12 17:11:34 -08:00
Colin Patrick Mccabe
dde774f2a4 HDFS-7598. Remove dependency on old version of Guava in TestDFSClientCache#testEviction (Sangjin Lee via Colin P. McCabe) 
(cherry picked from commit b3ddd7ee39c92d2df8661ce5834a2831020cecb2)
 2015-01-12 17:08:08 -08:00
Kihwal Lee
33534a0c9a HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Contributed by Eric Payne. 
(cherry picked from commit 6bbf9fdd041d2413dd78e2bce51abae15f3334c2)
 2015-01-12 15:38:17 -06:00
Colin Patrick Mccabe
e4bb94b0b8 HDFS-7326. Add documentation for hdfs debug commands (Vijay Bhat via Colin P. McCabe) 
(cherry picked from commit b78b4a1536b6d47a37ff7c309857a628a864c957)
 2015-01-12 12:17:37 -08:00
Robert Kanter
7c4e5ff660 YARN-2957. Create unit test to automatically compare YarnConfiguration and yarn-default.xml. (rchiang via rkanter) 
(cherry picked from commit f45163191583eadcfbe0df233a3185fd1b2b78f3)
 2015-01-12 12:00:52 -08:00
Robert Kanter
e5059b91bb YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter) 
(cherry picked from commit ae7bf31fe1c63f323ba5271e50fd0e4425a7510f)
 2015-01-12 10:48:45 -08:00
yliu
cce7ab4721 HDFS-7323. Move the get/setStoragePolicy commands out from dfsadmin. (jing9 via yliu) 2015-01-12 00:45:27 +08:00
cnauroth
75e4e55e12 HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarwal. 
(cherry picked from commit ef3c3a832c2f0c1e5ccdda2ff8ef84902912955f)
 2015-01-10 09:18:41 -08:00
Ravi Prakash
619fbf1fa4 HADOOP-11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' 
(Kamil Gorlo via raviprak)

(cherry picked from commit 4d2914210053f28c95094aa59e48f8e84c55a2c7)
 2015-01-10 08:37:35 -08:00
Jian He
36b3dcaab2 YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan 
(cherry picked from commit a2604062681230442eefae79815db5d77ccc4c2e)
 2015-01-09 17:50:18 -08:00
Jian He
68709cb9be YARN-2956. Added missing links in YARN documentation. Contributed by Masatake Iwasaki 
(cherry picked from commit 27a489cba63d9473e4cbcaef018b66108fb6c122)
 2015-01-09 17:47:00 -08:00
Jing Zhao
4b589e7cfa HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma. 2015-01-09 17:36:30 -08:00
Brandon Li
d847363821 HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job. Contributed by Akshay Radia 
(cherry picked from commit 09d31bc63035a71620657ab3f787047799bdcd14)
 2015-01-09 17:25:19 -08:00
cnauroth
9a7c763b3f HADOOP-11464. Reinstate support for launching Hadoop processes on Windows using Cygwin. Contributed by Chris Nauroth. 2015-01-09 15:01:33 -08:00
Colin Patrick Mccabe
a663faf741 HADOOP-11470. Remove some uses of obsolete guava APIs from the hadoop codebase (Sangjin Lee via Colin P. McCabe) 
(cherry picked from commit ae91b13a4b1896b893268253104f935c3078d345)
 2015-01-08 16:26:11 -08:00
cnauroth
f0acb7c2a2 HDFS-7579. Improve log reporting during block report rpc failure. Contributed by Charles Lamb. 
(cherry picked from commit 7e2d9a32426d04b5f08c2835f61882b053612a20)
 2015-01-08 15:13:05 -08:00
Jian He
e7e6173049 YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu 
(cherry picked from commit cc2a745f7e82c9fa6de03242952347c54c52dccc)
 2015-01-08 11:28:24 -08:00
cnauroth
501246e24a HDFS-7589. Break the dependency between libnative_mini_dfs and libhdfs. Contributed by Zhanwei Wang. 
(cherry picked from commit 708b1aa074d98df7d8abdc805818c787ce5779b8)
 2015-01-08 10:23:53 -08:00
Benoy Antony
832ae27f83 HADOOP-10651. Add ability to restrict service access using IP addresses and hostnames. (Benoy Antony) 
(cherry picked from commit 20625c8f048701c9516da159b24c0b33983e4bb7)
 2015-01-08 10:09:55 -08:00
Zhijie Shen
d2fbba790a YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu. 
(cherry picked from commit dc2eaa26b20cfbbcdd5784bb8761d08a42f29605)
 2015-01-08 09:49:27 -08:00
Tsuyoshi Ozawa
132fd6ba58 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 
(cherry picked from commit a6ed4894b518351bf1b3290e725a475570a21296)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/test/java/org/apache/hadoop/mapred/nativetask/kvtest/KVJob.java
 2015-01-08 15:00:02 +09:00
Jian He
9eb7611e81 Moved YARN-2880 to improvement section in CHANGES.txt 
(cherry picked from commit ef237bd52fc570292a7e608b373b51dd6d1590b8)
 2015-01-07 16:21:12 -08:00
Jian He
fe664b8b8d YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena 
(cherry picked from commit 2638f4d0f0da375b0dd08f3188057637ed0f32d5)
 2015-01-07 16:15:03 -08:00
Konstantin V Shvachko
c3c3bb2b02 HDFS-7561. TestFetchImage should write fetched-image-dir under target. Contributed by Liang Xie. 2015-01-07 16:07:16 -08:00
Jian He
d3b26454e4 YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu 
(cherry picked from commit e13a484a2be64fb781c5eca5ae7056cbe194ac5e)
 2015-01-07 14:12:54 -08:00
cnauroth
adf49e4b94 HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. Contributed by Ayappan. 
(cherry picked from commit 3ed0aed3cc4c2c7f96d3c5dd95d8dcd4eb8e888a)
 2015-01-07 12:24:25 -08:00
Jian He
492717cbf5 YARN-2230. Fixed few configs description in yarn-default.xml. Contributed by Vijay Bhat 
(cherry picked from commit fe8d2bd74175e7ad521bc310c41a367c0946d6ec)
 2015-01-07 10:57:41 -08:00
Brandon Li
36367209a1 HDFS-7564. NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map. Contributed by Yongjun Zhang 
(cherry picked from commit 788ee35e2bf0f3d445e03e6ea9bd02c40c8fdfe3)
 2015-01-06 16:20:39 -08:00
Jason Lowe
c22c27068e MAPREDUCE-6206. TestAggregatedTransferRate fails on non-US systems. Contributed by Jens Rabe 
(cherry picked from commit a0aeed100b839d5c122974bd0ea12f9168ee36a5)
 2015-01-06 23:40:42 +00:00
Zhijie Shen
8a81312062 YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev. 
(cherry picked from commit 60103fca04dc713183e4ec9e12f961642e7d1001)
 2015-01-06 14:39:44 -08:00
Jian He
c61e8a7bfa YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena 
(cherry picked from commit dd57c2047bfd21910acc38c98153eedf1db75169)
 2015-01-06 14:16:43 -08:00
Jason Lowe
2b408d8dc7 HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj 
(cherry picked from commit d02fb53750bc592c23ba470ae82eb6f47d9a00ec)
 2015-01-06 21:20:31 +00:00
Vinayakumar B
53ecb63587 HDFS-7583. Fix findbug in TransferFsImage.java (Contributed by Vinayakumar B) 
(cherry picked from commit 4cd66f7fb280e53e2d398a62e922a8d68d150679)
 2015-01-06 09:32:56 +05:30
Vinayakumar B
383e1c5f73 HADOOP-11459. Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping (Contributed by Vinayakumar B) 
(cherry picked from commit 9803ae374f69942aec82ec6eeeb9722523a1ade0)
 2015-01-06 09:16:44 +05:30
Karthik Kambatla
7adffad2bb YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler. (Anubhav Dhoot via kasha) 
(cherry picked from commit 0c4b11267717eb451fa6ed4c586317f2db32fbd5)
 2015-01-06 04:42:55 +05:30
Benoy Antony
0c2d996c2c HADOOP-11402. Negative user-to-group cache entries are never cleared for never-again-accessed users. Contributed by Varun Saxena. 
(cherry picked from commit 53caeaa16b1450b54e994c77f5d0c8a767b88d57)
 2015-01-05 15:09:19 -08:00
Karthik Kambatla
d070597a0e YARN-2360. Fair Scheduler: Display dynamic fair share for queues on the scheduler page. (Ashwin Shankar and Wei Yan via kasha) 
(cherry picked from commit 270a271f53f52a1f33e63a0520ae6032536dd4c6)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-01-06 03:28:48 +05:30
Zhijie Shen
c6cf748985 YARN-2958. Made RMStateStore not update the last sequence number when updating the delegation token. Contributed by Varun Saxena. 
(cherry picked from commit 562a701945be3a672f9cb5a52cc6db2c1589ba2b)
 2015-01-05 13:35:09 -08:00