Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,186 Commits 326 Branches 371 Tags
Commit Graph

8186 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jian He
e7e6173049 YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu 
(cherry picked from commit cc2a745f7e82c9fa6de03242952347c54c52dccc)
 2015-01-08 11:28:24 -08:00
cnauroth
501246e24a HDFS-7589. Break the dependency between libnative_mini_dfs and libhdfs. Contributed by Zhanwei Wang. 
(cherry picked from commit 708b1aa074d98df7d8abdc805818c787ce5779b8)
 2015-01-08 10:23:53 -08:00
Benoy Antony
832ae27f83 HADOOP-10651. Add ability to restrict service access using IP addresses and hostnames. (Benoy Antony) 
(cherry picked from commit 20625c8f048701c9516da159b24c0b33983e4bb7)
 2015-01-08 10:09:55 -08:00
Zhijie Shen
d2fbba790a YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu. 
(cherry picked from commit dc2eaa26b20cfbbcdd5784bb8761d08a42f29605)
 2015-01-08 09:49:27 -08:00
Tsuyoshi Ozawa
132fd6ba58 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 
(cherry picked from commit a6ed4894b518351bf1b3290e725a475570a21296)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/test/java/org/apache/hadoop/mapred/nativetask/kvtest/KVJob.java
 2015-01-08 15:00:02 +09:00
Jian He
9eb7611e81 Moved YARN-2880 to improvement section in CHANGES.txt 
(cherry picked from commit ef237bd52fc570292a7e608b373b51dd6d1590b8)
 2015-01-07 16:21:12 -08:00
Jian He
fe664b8b8d YARN-2936. Changed YARNDelegationTokenIdentifier to set proto fields on getProto method. Contributed by Varun Saxena 
(cherry picked from commit 2638f4d0f0da375b0dd08f3188057637ed0f32d5)
 2015-01-07 16:15:03 -08:00
Konstantin V Shvachko
c3c3bb2b02 HDFS-7561. TestFetchImage should write fetched-image-dir under target. Contributed by Liang Xie. 2015-01-07 16:07:16 -08:00
Jian He
d3b26454e4 YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu 
(cherry picked from commit e13a484a2be64fb781c5eca5ae7056cbe194ac5e)
 2015-01-07 14:12:54 -08:00
cnauroth
adf49e4b94 HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. Contributed by Ayappan. 
(cherry picked from commit 3ed0aed3cc4c2c7f96d3c5dd95d8dcd4eb8e888a)
 2015-01-07 12:24:25 -08:00
Jian He
492717cbf5 YARN-2230. Fixed few configs description in yarn-default.xml. Contributed by Vijay Bhat 
(cherry picked from commit fe8d2bd74175e7ad521bc310c41a367c0946d6ec)
 2015-01-07 10:57:41 -08:00
Brandon Li
36367209a1 HDFS-7564. NFS gateway dynamically reload UID/GID mapping file /etc/nfs.map. Contributed by Yongjun Zhang 
(cherry picked from commit 788ee35e2bf0f3d445e03e6ea9bd02c40c8fdfe3)
 2015-01-06 16:20:39 -08:00
Jason Lowe
c22c27068e MAPREDUCE-6206. TestAggregatedTransferRate fails on non-US systems. Contributed by Jens Rabe 
(cherry picked from commit a0aeed100b839d5c122974bd0ea12f9168ee36a5)
 2015-01-06 23:40:42 +00:00
Zhijie Shen
8a81312062 YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev. 
(cherry picked from commit 60103fca04dc713183e4ec9e12f961642e7d1001)
 2015-01-06 14:39:44 -08:00
Jian He
c61e8a7bfa YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena 
(cherry picked from commit dd57c2047bfd21910acc38c98153eedf1db75169)
 2015-01-06 14:16:43 -08:00
Jason Lowe
2b408d8dc7 HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj 
(cherry picked from commit d02fb53750bc592c23ba470ae82eb6f47d9a00ec)
 2015-01-06 21:20:31 +00:00
Vinayakumar B
53ecb63587 HDFS-7583. Fix findbug in TransferFsImage.java (Contributed by Vinayakumar B) 
(cherry picked from commit 4cd66f7fb280e53e2d398a62e922a8d68d150679)
 2015-01-06 09:32:56 +05:30
Vinayakumar B
383e1c5f73 HADOOP-11459. Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMapping (Contributed by Vinayakumar B) 
(cherry picked from commit 9803ae374f69942aec82ec6eeeb9722523a1ade0)
 2015-01-06 09:16:44 +05:30
Karthik Kambatla
7adffad2bb YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler. (Anubhav Dhoot via kasha) 
(cherry picked from commit 0c4b11267717eb451fa6ed4c586317f2db32fbd5)
 2015-01-06 04:42:55 +05:30
Benoy Antony
0c2d996c2c HADOOP-11402. Negative user-to-group cache entries are never cleared for never-again-accessed users. Contributed by Varun Saxena. 
(cherry picked from commit 53caeaa16b1450b54e994c77f5d0c8a767b88d57)
 2015-01-05 15:09:19 -08:00
Karthik Kambatla
d070597a0e YARN-2360. Fair Scheduler: Display dynamic fair share for queues on the scheduler page. (Ashwin Shankar and Wei Yan via kasha) 
(cherry picked from commit 270a271f53f52a1f33e63a0520ae6032536dd4c6)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-01-06 03:28:48 +05:30
Zhijie Shen
c6cf748985 YARN-2958. Made RMStateStore not update the last sequence number when updating the delegation token. Contributed by Varun Saxena. 
(cherry picked from commit 562a701945be3a672f9cb5a52cc6db2c1589ba2b)
 2015-01-05 13:35:09 -08:00
cnauroth
60418c9b2d HDFS-7572. TestLazyPersistFiles#testDnRestartWithSavedReplicas is flaky on Windows. Contributed by Arpit Agarwal. 
(cherry picked from commit dfd2589bcb0e83f073eab30e32badcf2e9f75a62)
 2015-01-05 10:39:38 -08:00
Steve Loughran
4446512e9e HADOOP-11390 Metrics 2 ganglia provider to include hostname in unresolved address problems. (Varun Saxena via stevel) 2015-01-05 16:09:25 +00:00
Steve Loughran
2800e73c27 HADOOP-11446 S3AOutputStream should use shared thread pool to avoid OutOfMemoryError 2015-01-05 12:59:48 +00:00
yliu
5782f9e392 HADOOP-11455. KMS and Credential CLI should request confirmation for deletion by default. (Charles Lamb via yliu) 2015-01-05 06:51:23 +08:00
Tsuyoshi Ozawa
c116743bdd YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed by Rohith Sharmaks. 
(cherry picked from commit ddc5be48fc35868abf7f59088f747c636e76a42a)
 2015-01-05 00:11:01 +09:00
Zhijie Shen
efe6260762 YARN-2991. Fixed DrainDispatcher to reuse the draining code path in AsyncDispatcher. Contributed by Rohith Sharmaks. 
(cherry picked from commit 947578c1c1413f9043ceb1e87df6a97df048e854)
 2015-01-02 11:10:46 -08:00
Brandon Li
05df432fab HDFS-7563. NFS gateway parseStaticMap NumberFormatException. Contributed by Yongjun Zhang 
(cherry picked from commit 892b1bb746116e547fb07d46cf1d284e3219d06d)
 2015-01-02 10:50:51 -08:00
Karthik Kambatla
798ab51289 YARN-2998. Abstract out scheduler independent PlanFollower components. (Anubhav Dhoot via kasha) 
(cherry picked from commit e7257acd8a7adb74d81cd1d009d4a99f023ed844)
 2014-12-30 19:55:50 -08:00
Jian He
cde5bfe3ec YARN-2987. Fixed ClientRMService#getQueueInfo to check against queue and app ACLs. Contributed by Varun Saxena 
(cherry picked from commit e2351c7ae24cea9b217af4174512d279c55e8efd)
 2014-12-30 17:16:05 -08:00
Jian He
143e48c25a YARN-2493. Added node-labels page on RM web UI. Contributed by Wangda Tan 
(cherry picked from commit b7442bf92eb6e1ae64a0f9644ffc2eee4597aad5)
 2014-12-30 16:49:59 -08:00
Harsh J
6d65e74670 MAPREDUCE-6149. Document override log4j.properties in MR job. Contributed by Junping Du. 
(cherry picked from commit 6621c3598e22279cde11eca73cfb5619a8bc8dee)
 2014-12-30 23:13:19 +05:30
Colin Patrick Mccabe
e25b789b19 HADOOP-11039. ByteBufferReadable API doc is inconsistent with the implementations. (Yi Liu via Colin P. McCabe) 
(cherry picked from commit 249cc905017948d64aab3d14d7a64df3b7b35a13)
 2014-12-29 13:38:20 -08:00
Zhijie Shen
e5cb52ec1f YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice. Contributed by Varun Saxena. 
(cherry picked from commit 241d3b3a50c6af92f023d8b2c24598f4813f4674)
 2014-12-29 10:07:54 -08:00
Jian He
ca0349b87a YARN-2992. ZKRMStateStore crashes due to session expiry. Contributed by Karthik Kambatla 
(cherry picked from commit 1454efe5d4fe4214ec5ef9142d55dbeca7dab953)
 2014-12-26 18:00:32 -08:00
Junping Du
fc3e810a19 YARN-2993. Several fixes (missing acl check, error log msg ...) and some refinement in AdminService. (Contributed by Yi Liu) 
(cherry picked from commit 40ee4bff65b2bfdabfd16ee7d9be3382a0476565)
 2014-12-26 07:01:44 -08:00
Tsuyoshi Ozawa
1e0cfb9278 HADOOP-11448. Fix findbugs warnings in FileBasedIPList. (ozawa) 
(cherry picked from commit 399d25884a99f3e0b2ef65eaf9f3149d0d523f13)
 2014-12-26 15:23:28 +09:00
Tsuyoshi Ozawa
7739f819a6 HADOOP-11283. SequenceFile.Writer can leak file descriptors in DistCpV1#setup(). (Contributed by Varun Saxena via ozawa) 
(cherry picked from commit a164ce2ac985ecac957362fc717640ad45449371)
 2014-12-25 23:32:34 +09:00
Tsuyoshi Ozawa
4ca49c8634 YARN-2988. Graph#save() may leak file descriptors. (Ted Yu via ozawa) 2014-12-25 13:09:51 +09:00
Jian He
60530a6c4f YARN-2946. Fixed potential deadlock in RMStateStore. Contributed by Rohith Sharmaks 
(cherry picked from commit 4f18018b7abb405f38d269da096ec9fd80c81d9a)
 2014-12-23 22:15:28 -08:00
Zhijie Shen
f02bd6683a YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena. 
(cherry picked from commit 41a548a916d4248164cb9495320f123ec215d70e)
 2014-12-23 20:35:32 -08:00
Junping Du
361fab14be YARN-2940. Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu) 
(cherry picked from commit d468c9aaf15e977f12e6214b47996412c907e069)
 2014-12-23 20:06:53 -08:00
Jian He
e3a54b1b8b YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen 
(cherry picked from commit 149512a83743715bb100feb6747b7e88301018ab)
 2014-12-23 18:26:37 -08:00
Junping Du
ae3faab13e YARN-2970. NodeLabel operations in RMAdmin CLI get missing in help command. (Contributed by Varun Saxena) 
(cherry picked from commit e1ee0d45ea3315e7fbe1d28a7a35a0ce0c54483b)
 2014-12-23 18:24:45 -08:00
Robert Kanter
653b3fada2 HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter) 
(cherry picked from commit 66cfe1dc73af1f8e3accebb1fa4c1bde19c78b0e)
 2014-12-23 14:31:07 -08:00
Jing Zhao
9aa9455dab HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao. 2014-12-22 23:20:18 -08:00
Vinayakumar B
cd8e78d50f HDFS-7456. De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode (Contributed by Vinayakumar B) 
(cherry picked from commit 50ae1a6664a92619aa683d2a864d0da9fb4af026)
 2014-12-23 12:37:16 +05:30
Jian He
8b398a66ca YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharmaks 
(cherry picked from commit 0d89859b51157078cc504ac81dc8aa75ce6b1782)
 2014-12-22 21:55:06 -08:00
Jian He
411836b74c YARN-2920. Changed CapacityScheduler to kill containers on nodes where node labels are changed. Contributed by Wangda Tan 
(cherry picked from commit fdf042dfffa4d2474e3cac86cfb8fe9ee4648beb)
 2014-12-22 16:52:15 -08:00