Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,119 Commits 326 Branches 371 Tags
Commit Graph

10119 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
cnauroth
aab1c14df6 HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R. 
(cherry picked from commit a26cc66f38daec2342215a66b599bf59cee1112c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-07-21 14:13:15 -07:00
cnauroth
57d55d40dd HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 
(cherry picked from commit cb03768b1b2250b9b5a7944cf6ef918e8a974e20)
 2015-07-21 13:56:07 -07:00
Ravi Prakash
b728edce0f Revert "HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak)" 
This reverts commit 3d58c7a7006991b46efe8a8f60b244f4f85b481a.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-07-21 11:30:41 -07:00
Wangda Tan
3dd113fa7c YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda) 
(cherry picked from commit c39ca541f498712133890961598bbff50d89d68b)
 2015-07-21 09:57:53 -07:00
Vinayakumar B
cd3692fe4b HDFS-7582. Enforce maximum number of ACL entries separately per access and default. (Contributed by Vinayakumar B) 
(cherry picked from commit 29cf887b226f4ab3c336a6e681db5e8e70699d66)
 2015-07-21 15:17:26 +05:30
Vinayakumar B
8ef3821356 HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B) 
(cherry picked from commit 87f29c6b8acc07cc011713a79554d51945e265ac)
 2015-07-21 13:13:31 +05:30
Haohui Mai
4283831348 HDFS-7483. Display information per tier on the Namenode UI. Contributed by Benoy Antony and Haohui Mai. 2015-07-20 20:13:16 -07:00
Akira Ajisaka
e78ee18642 Move HDFS-6945 to 2.7.2 section in CHANGES.txt. 
(cherry picked from commit a628f675900d2533ddf86fb3d3e601238ecd68c3)
 2015-07-21 11:45:53 +09:00
Akira Ajisaka
d591f2af5d HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. (aajisaka) 
(cherry picked from commit 773c670943757681feeafb227a2d0c29d48f38f1)
 2015-07-21 11:22:36 +09:00
yliu
cadd02ad1d HDFS-8794. Improve CorruptReplicasMap#corruptReplicasMap. (yliu) 2015-07-21 09:18:43 +08:00
Ravi Prakash
3d58c7a700 HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak) 
(cherry picked from commit e4f756260f16156179ba4adad974ec92279c2fac)
 2015-07-20 14:04:28 -07:00
Steve Loughran
d3c23c7b18 HADOOP-11893. Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) 2015-07-20 13:22:03 +01:00
Steve Loughran
577acf89f8 HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage() in logging/span events. (Varun Saxena via stevel) 2015-07-20 13:13:09 +01:00
Steve Loughran
d68b044f0f HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). (Brahma Reddy Battula via stevel) 2015-07-20 13:02:51 +01:00
Steve Loughran
208b9eed9e HADOOP-12209 Comparable type should be in FileStatus. (Yong Zhang via stevel) 2015-07-20 12:32:32 +01:00
Steve Loughran
f3296a1984 HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel) 2015-07-20 11:22:22 +01:00
Arun Suresh
eddb326669 Pulling in YARN-3535 to branch 2.7.x 
(cherry picked from commit 176131f12bc0d467e9caaa6a94b4ba96e09a4539)
 2015-07-18 10:11:29 -07:00
Colin Patrick Mccabe
aff955a14a YARN-3844. Make hadoop-yarn-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 419c51d233bd124eadb38ff013693576ec02c4f1)
 2015-07-17 12:05:24 -07:00
Jonathan Eagles
b289939514 YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles) 
(cherry picked from commit 7faae0e6fe027a3886d9f4e290b6a488a2c55b3a)
 2015-07-17 11:03:34 -05:00
Arun Suresh
8018041b49 YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh) 
(cherry picked from commit 9b272ccae78918e7d756d84920a9322187d61eed)
 2015-07-17 04:33:04 -07:00
Wangda Tan
a7de3cde13 YARN-3885. ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level. (Ajith S via wangda) 
(cherry picked from commit 3540d5fe4b1da942ea80c9e7ca1126b1abb8a68a)
 2015-07-16 16:14:07 -07:00
Wangda Tan
7b2540770e YARN-3930. FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown. (Dian Fu via wangda) 
(cherry picked from commit fa2b63ed162410ba05eadf211a1da068351b293a)
 2015-07-16 16:08:04 -07:00
Haohui Mai
391d2d88f2 HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. Contributed by kanaka kumar avvaru. 2015-07-16 15:22:11 -07:00
Ming Ma
516bbf1c20 HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma) 
(cherry picked from commit fbd88f1062f3c4b208724d208e3f501eb196dfab)
 2015-07-16 12:55:29 -07:00
Tsuyoshi Ozawa
e97a14ae6f YARN-3805. Update the documentation of Disk Checker based on YARN-90. Contributed by Masatake Iwasaki. 
(cherry picked from commit 1ba2986dee4bbb64d67ada005f8f132e69575274)
 2015-07-16 17:52:58 +09:00
Tsuyoshi Ozawa
90c5bf0605 HADOOP-12240. Fix tests requiring native library to be skipped in non-native profile. Contributed by Masatake Iwasaki. 
(cherry picked from commit 90bda9c6110f0344104b8ae96ea6999770ebb391)
 2015-07-16 16:05:11 +09:00
Tsuyoshi Ozawa
f95e3c3091 YARN-3174. Consolidate the NodeManager and NodeManagerRestart documentation into one. Contributed by Masatake Iwasaki. 
(cherry picked from commit f02dd146f58bcfa0595eec7f2433bafdd857630f)
 2015-07-16 15:22:57 +09:00
Tsuyoshi Ozawa
f3f7872fbf HADOOP-10615. FileInputStream in JenkinsHash#main() is never closed. Contributed by Chen He. 
(cherry picked from commit 111e6a3fdf613767782817836c42810bf2bda5e8)
 2015-07-16 14:09:22 +09:00
Arpit Agarwal
dc211ca658 HDFS-8778. TestBlockReportRateLimiting#testLeaseExpiration can deadlock. (Contributed by Arpit Agarwal) 2015-07-15 14:09:06 -07:00
Akira Ajisaka
4da8ff60ef MAPREDUCE-5762. Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka) 2015-07-16 03:43:49 +09:00
Tsuyoshi Ozawa
bfbc805a13 YARN-3170. YARN architecture document needs updating. Contirubted by Brahma Reddy Battula. 
(cherry picked from commit edcaae44c10b7e88e68fa97afd32e4da4a9d8df7)
 2015-07-15 15:43:09 +09:00
Tsuyoshi Ozawa
59ba845a2f HADOOP-12153. ByteBufferReadable doesn't declare @InterfaceAudience and @InterfaceStability. Contributed by Brahma Reddy Battula. 
(cherry picked from commit cec1d43db026e66a9e84b5c3e8476dfd33f17ecb)
 2015-07-15 14:19:29 +09:00
cnauroth
5e8c01e7a2 HADOOP-12232. Upgrade Tomcat dependency to 6.0.44. Contributed by Chris Nauroth. 
(cherry picked from commit 6b56f05b9ea3ee45abd5d00b14fab93a353b1332)
 2015-07-14 15:22:39 -07:00
Chris Douglas
2a0e551cd8 MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang 2015-07-14 14:56:21 -07:00
Akira Ajisaka
bad5d288ac HDFS-8742. Inotify: Support event for OP_TRUNCATE. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 979c9ca2ca89e99dc7165abfa29c78d66de43d9a)
 2015-07-15 04:43:03 +09:00
Kihwal Lee
b0a2dc9c84 HDFS-8722. Optimize datanode writes for small writes and flushes. Contributed by Kihwal Lee 
(cherry picked from commit 59388a801514d6af64ef27fbf246d8054f1dcc74)
 2015-07-14 14:07:38 -05:00
Colin Patrick Mccabe
471037883f HDFS-7608: hdfs dfsclient newConnectedPeer has no write timeout (Xiaoyu Yao via Colin P. McCabe) 
(cherry picked from commit 1d74ccececaefffaa90c0c18b40a3645dbc819d9)
 2015-07-14 11:00:45 -07:00
Tsuyoshi Ozawa
64059d8884 HADOOP-12191. Bzip2Factory is not thread safe. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 4084eaf94347042d9b8cb1e86ba831036621dfdd)
 2015-07-14 19:15:36 +09:00
Arun Suresh
5f58be7dd4 YARN-3453. Ensure preemption logic in FairScheduler uses DominantResourceCalculator in DRF queues to prevent unnecessary thrashing. (asuresh) 
(cherry picked from commit ac94ba3e185115b83351e35c610c2b8ff91b1ebc)
 2015-07-14 00:25:57 -07:00
Chris Douglas
c6b0bbabc7 HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl 
(cherry picked from commit a431ed9075cf6f467be5ff10f4ffb131cb1d3216)
 2015-07-13 15:36:25 -07:00
Tsz-Wo Nicholas Sze
d8d6d69b09 HDFS-8541. Mover should exit with NO_MOVE_PROGRESS if there is no move progress. Contributed by Surendra Singh Lilhore 2015-07-13 15:13:14 -07:00
Tsz-Wo Nicholas Sze
2e455d4d8b Add HDFS-8143 to CHANGES.txt. 2015-07-13 15:07:28 -07:00
Jian He
27366dd7c3 Revert "YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. (Varun Saxena via kasha)" 
This reverts commit aa067c6aa47b4c79577096817acc00ad6421180c.
(cherry picked from commit 2466460d4cd13ad5837c044476b26e63082c1d37)
 2015-07-13 14:31:55 -07:00
Akira Ajisaka
0ba2defb9e YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 19295b36d90e26616accee73b1f7743aab5df692)
 2015-07-13 17:53:27 +09:00
Akira Ajisaka
0e4d251fb2 MAPREDUCE-6421. Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression. Contributed by Brahma Reddy Battula. 
(cherry picked from commit e04faf8e462a24a3ddfd8f22050e74eda4aa19ff)
 2015-07-13 14:29:39 +09:00
Wangda Tan
87360be089 YARN-3894. RM startup should fail for wrong CS xml NodeLabel capacity configuration. (Bibin A Chundatt via wangda) 
(cherry picked from commit 5ed1fead6b5ec24bb0ce1a3db033c2ee1ede4bb4)
 2015-07-12 21:53:08 -07:00
Akira Ajisaka
ad6787aa43 YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang. 
(cherry picked from commit d6675606dc5f141c9af4f76a37128f8de4cfedad)
 2015-07-13 12:57:29 +09:00
Gera Shegalov
896b8c6551 YARN-3917. getResourceCalculatorPlugin for the default should intercept all exceptions. (gera) 
(cherry picked from commit d7319dee37ea93f1a1ba4153ea63ea8010ba2441)
 2015-07-11 22:41:04 -07:00
Wangda Tan
c36090fd3f YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda) 
(cherry picked from commit 1df39c1efc9ed26d3f1a5887c31c38c873e0b784)
 2015-07-11 10:27:58 -07:00
Zhijie Shen
37a93c2d78 YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 1ea36299a47af302379ae0750b571ec021eb54ad)
 2015-07-10 19:02:13 -07:00