Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,733 Commits 326 Branches 371 Tags
Commit Graph

8733 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsuyoshi Ozawa
366a12c3b9 HADOOP-11543. Improve help message for hadoop/yarn command. Contributed by Brahma Reddy Battula. 2015-02-06 13:34:48 +09:00
cnauroth
a9ea7cff31 HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. Contributed by Anu Engineer. 
(cherry picked from commit 6583ad148be5447eb2f086a2c6c7006631dff4da)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-02-05 16:56:16 -08:00
yliu
44d800b353 HDFS-7698. Fix locking on HDFS read statistics and add a method for clearing them. (Colin P. McCabe via yliu) 2015-02-05 23:57:36 +08:00
yliu
3ffe5a1ed2 HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:48:55 +08:00
Jian He
b109051145 YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 4641196fe02af5cab3d56a9f3c78875c495dbe03)
 2015-02-05 16:13:23 -08:00
Xuan
096ba583fa YARN-3149. Fix typo in message for invalid application id. Contributed 
by Bibin A Chundatt.

(cherry picked from commit b77ff37686e01b7497d3869fbc62789a5b123c0a)
 2015-02-05 15:15:29 -08:00
Robert Kanter
46a2027226 MAPREDUCE-6233. org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunk (zxu via rkanter) 
(cherry picked from commit e2ee2ff7d7ca429487d7e3883daedffbb269ebd4)
 2015-02-05 14:31:44 -08:00
Jason Lowe
eb927a1d6b MAPREDUCE-6186. Redundant call to requireJob() while displaying the conf page. Contributed by Rohit Agarwal 
(cherry picked from commit e1990ab4275b9092cae3573334791f7b2f8df7e5)
 2015-02-05 20:14:13 +00:00
Jason Lowe
ebdd88ec81 YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per queue. Contributed by Thomas Graves 
(cherry picked from commit 69c8a7f45be5c0aa6787b07f328d74f1e2ba5628)
 2015-02-05 19:30:06 +00:00
Haohui Mai
67002a5fc0 HDFS-7270. Add congestion signaling capability to DataNode write protocol. Contributed by Haohui Mai. 2015-02-05 11:03:43 -08:00
Sandy Ryza
84df660af4 YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding max share (Anubhav Dhoot via Sandy Ryza) 2015-02-05 09:45:17 -08:00
Jason Lowe
2dc4af2b93 MAPREDUCE-6059. Speed up history server startup time (Siqi Li via aw) 
(cherry picked from commit fd57ab2002f97dcc83d455a5e0c770c8efde77a4)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2015-02-05 16:40:09 +00:00
Steve Loughran
4cd9657b71 HADOOP-11463 Replace method-local TransferManager object with S3AFileSystem#transfers. (Ted Yu via stevel) 2015-02-05 12:19:49 +00:00
Tsuyoshi Ozawa
970fdc3ad9 HDFS-7709. Fix findbug warnings in httpfs. Contributed by Rakesh R. 
(cherry picked from commit 20660b7a67b7f2815b1e27b98dce2b2682399505)
 2015-02-05 19:57:40 +09:00
Junping Du
f59b698fc9 HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect results. (Contributed by Sangjin Lee) 
(cherry picked from commit 0b567f424673b5cea1c3bc23b2bd268ef6b7625f)
 2015-02-04 19:12:21 -08:00
Akira Ajisaka
ad4b243586 MAPREDUCE-5988. Fix dead links to the javadocs in mapreduce project. (aajisaka) 
(cherry picked from commit cc6bbfceae1cddfae6a3892cb7e7104531a689be)
 2015-02-04 17:46:39 -08:00
Arpit Agarwal
5807afed0a HDFS-7733. NFS: readdir/readdirplus return null directory attribute on failure. (Contributed by Arpit Agarwal) 2015-02-04 16:25:40 -08:00
Zhijie Shen
2db56a4932 YARN-3123. Made YARN CLI show a single completed container even if the app is running. Contributed by Naganarasimha G R. 
(cherry picked from commit 30510cff75d3bf4c030c215318b5611600a5b4ee)
 2015-02-04 16:07:24 -08:00
Akira Ajisaka
17797c73c2 HADOOP-11549. flaky test detection tool failed to handle special control characters in test result. Contributed by Yongjun Zhang. 
(cherry picked from commit 5f4ef2d13fa3fa3d4d315902e55c7775ef08b3d2)
 2015-02-04 14:18:31 -08:00
Karthik Kambatla
fcf3dc5977 HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and Karthik Kambatla via kasha) 
(cherry picked from commit 55235d28c3641ff5f1c05c53dd7271cafc131926)
 2015-02-04 14:00:44 -08:00
Siddharth Seth
c330bca833 YARN-1723. AMRMClientAsync missing blacklist addition and removal 
functionality. Contributed by Bartosz Ługowski.
(cherry picked from commit e04e8fa8103fb58c2e449d78af6cbf5b552279f4)
 2015-02-04 12:53:31 -08:00
Colin Patrick Mccabe
76c0757c6e HDFS-7719. BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes. (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit 40a415799b1ff3602fbb461765f8b36f1133bda2)
 2015-02-04 12:46:39 -08:00
cnauroth
196443318f HADOOP-11547. hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration. Contributed by Chris Nauroth. 
(cherry picked from commit a35e86c6701ffec263966bab31bd9368923c7e80)
 2015-02-04 12:07:13 -08:00
Andrew Wang
696266e99c HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 
(cherry picked from commit 9175105eeaecf0a1d60b57989b73ce45cee4689b)
 2015-02-04 11:31:49 -08:00
cnauroth
85b2739508 HADOOP-11548. checknative should display a nicer error message when openssl support is not compiled in. Contributed by Anu Engineer. 
(cherry picked from commit 064e0770a0f32e7f32a7ba16c71394d7e75a3eb3)
 2015-02-04 10:01:39 -08:00
Akira Ajisaka
0a030871dd MAPREDUCE-6243. Fix findbugs warnings in hadoop-rumen. Contributed by Masatake Iwasaki. 
(cherry picked from commit 34fe11c987730932f99dec6eb458a22624eb075b)
 2015-02-04 09:27:01 -08:00
Tsuyoshi Ozawa
f92d4fa20f HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa) 
(cherry picked from commit ba58da29f49da15f7eb6300f996e0ae7ba9d0d1e)
 2015-02-05 00:51:40 +09:00
Akira Ajisaka
5c5139d35f HADOOP-11544. Remove unused configuration keys for tracing. Contributed by Masatake Iwasaki. 
(cherry picked from commit 42548f4dc2b2e8ace891b970c2c6712c02bb43ea)
 2015-02-04 04:20:08 -08:00
Tsuyoshi Ozawa
cdd76d5922 YARN-3058. Fix error message of tokens' activation delay configuration. Contributed by Yi Liu. 
(cherry picked from commit 26dee1486b70237a2a47f910472e9aa81ffad349)
 2015-02-04 11:41:48 +09:00
Zhijie Shen
3ab3caa9ea YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R. 
(cherry picked from commit e5b56e2af6b48cbc8501f624ae4b4f9d13eccacf)
 2015-02-03 17:35:40 -08:00
Xuan
c22dcdd191 YARN-3056. Add verification for containerLaunchDuration in 
TestNodeManagerMetrics. Contributed by zhihai Xu

(cherry picked from commit b73e776abc3e2479e397729c2bab9668f469e593)
 2015-02-03 15:14:23 -08:00
Andrew Wang
debd63f0b0 HDFS-7712. Switch blockStateChangeLog to use slf4j. 
(cherry picked from commit 3ae38ec7dfa1aaf451cf889cec6cf862379af32a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestFileAppend3.java
 2015-02-03 15:04:16 -08:00
Akira Ajisaka
8d98e5c960 MAPREDUCE-5800. Use Job#getInstance instead of deprecated constructors. (aajisaka) 
(cherry picked from commit bd69fb2d44403e930d1fc0868ed1dd2a49dd9659)

Conflicts:
	hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/mapreduce/TestStreamXmlRecordReader.java
 2015-02-03 14:35:15 -08:00
Karthik Kambatla
c981b040ba YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha) 
(cherry picked from commit c559df2219f4049f2412fba8ad031c434d9e82b6)
 2015-02-03 13:20:57 -08:00
Wangda Tan
205e15c4a3 YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda) 
(cherry picked from commit 5bd984691b3e3df5d8aac910295138996e7a5839)
 2015-02-03 12:55:25 -08:00
Kihwal Lee
c428d303f6 HDFS-7707. Edit log corruption due to delayed block removal again. Contributed by Yongjun Zhang 
(cherry picked from commit 843806d03ab1a24f191782f42eb817505228eb9f)
 2015-02-03 14:46:24 -06:00
Jian He
c0b1311a93 YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan 
(cherry picked from commit 21d80b3dd90a8e33e51701887c8d9369ed4ab17d)
 2015-02-03 11:43:40 -08:00
Haohui Mai
6c5ae1571c HADOOP-11529. Fix findbugs warnings in hadoop-archives. Contributed by Masatake Iwasaki. 2015-02-03 10:53:26 -08:00
Robert Kanter
410830fe8c YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter) 
(cherry picked from commit f7a77819a1e4ff394e110941c1f8dd80f47dd38f)
 2015-02-03 10:39:51 -08:00
Tsuyoshi Ozawa
b396d2e8d8 HADOOP-11045. Introducing a tool to detect flaky tests of hadoop jenkins testing job. Contributed by Yongjun Zhang and Todd Lipcon. 
(cherry picked from commit 80705e034b7fc7ad384f1aa0bd15fc254ea06cf0)
 2015-02-04 01:26:44 +09:00
Jason Lowe
3828fb5fab YARN-3085. Application summary should include the application type. Contributed by Rohith 
(cherry picked from commit a761bf8726cb6285a505f1773ea3403eb985a65f)
 2015-02-03 14:57:25 +00:00
Haohui Mai
7cb70d3447 HDFS-6651. Deletion failure can leak inodes permanently. Contributed by Jing Zhao. 2015-02-02 16:32:56 -08:00
Robert Kanter
a3a7efe748 MAPREDUCE-6143. add configuration for mapreduce speculative execution in MR2 (zxu via rkanter) 
(cherry picked from commit 8acc5e9b4b3fea8b418b3526c15022c8a9fedd56)
 2015-02-02 13:52:29 -08:00
Tsz-Wo Nicholas Sze
8426c7d806 HDFS-7696. In FsDatasetImpl, the getBlockInputStream(..) and getTmpInputStreams(..) methods may leak file descriptors. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2015-02-02 13:42:15 -08:00
Tsz-Wo Nicholas Sze
a5568a276d HDFS-7681. Change ReplicaInputStreams constructor to take InputStream(s) instead of FileDescriptor(s). Contributed by Joe Pallas 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-02-02 13:30:07 -08:00
Tsz-Wo Nicholas Sze
2ecfd018f4 HDFS-5782. Change BlockListAsLongs constructor to take Replica as parameter type instead of concrete classes Block and ReplicaInfo. Contributed by David Powell and Joe Pallas 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-02-02 13:24:02 -08:00
Tsz-Wo Nicholas Sze
e43b1428b4 HDFS-5631. Change BlockMetadataHeader.readHeader(..), ChunkChecksum class and constructor to public; and fix FsDatasetSpi to use generic type instead of FsVolumeImpl. Contributed by David Powell and Joe Pallas 2015-02-02 12:59:22 -08:00
Zhijie Shen
ebaf6220fe YARN-2216. Fixed the change log. 
(cherry picked from commit 5f9a0dd8d959e6c03f611c6f073b27a8d73ad418)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-02-02 12:16:07 -08:00
Zhijie Shen
b51c0288de YARN-2808. Made YARN CLI list attempt’s finished containers of a running application. Contributed by Naganarasimha G R. 
(cherry picked from commit c0ec4f4cc12208342d45236b8841887a20f7f88a)
 2015-02-02 12:05:05 -08:00
cnauroth
dedfb982f1 HADOOP-11442. hadoop-azure: Create test jar. Contributed by Shashank Khandelwal. 
(cherry picked from commit 1c09ca2ba4d97d827cc6e86ef6bd2930bc77b5ae)
 2015-02-02 11:51:01 -08:00