Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,895 Commits 326 Branches 371 Tags
Commit Graph

9895 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Allen Wittenauer
2a0688fdb8 HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) 
(cherry picked from commit 8d3c0f601d549a22648050bcc9a0e4acf37edc81)
 2015-07-24 11:55:56 -07:00
Karthik Kambatla
d2ee02940a YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha) 
(cherry picked from commit d19d18775368f5aaa254881165acc1299837072b)
 2015-07-24 11:49:46 -07:00
Akira Ajisaka
7bdd32ce3c HDFS-8735. Inotify: All events classes should implement toString() API. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit f8f60918230dd466ae8dda1fbc28878e19273232)
 2015-07-25 02:57:33 +09:00
Xuan
98ed4bca3b YARN-3967. Fetch the application report from the AHS if the RM does not 
know about it. Contributed by Mit Desai

(cherry picked from commit fbd6063269221ec25834684477f434e19f0b66af)
 2015-07-24 10:17:05 -07:00
Robert Kanter
731ed9cad8 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
 2015-07-24 09:42:04 -07:00
carlo curino
6a71a0a230 YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) 
(cherry picked from commit 0fcb4a8cf2add3f112907ff4e833e2f04947b53e)
 2015-07-23 19:36:54 -07:00
Akira Ajisaka
b2a532f61c HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang. 
(cherry picked from commit 206d4933a567147b62f463c2daa3d063ad40822b)
 2015-07-24 18:29:24 +09:00
Rohith Sharma K S
9d15860e6d YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan) 2015-07-24 12:54:07 +05:30
Akira Ajisaka
17319c4a65 HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) 
(cherry picked from commit 02c01815eca656814febcdaca6115e5f53b9c746)
 2015-07-24 11:39:16 +09:00
Robert Kanter
ba3b40ae79 YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter) 
(cherry picked from commit 1d3026e7b3cf2f3a8a544b66ff14783cc590bdac)
 2015-07-23 14:47:28 -07:00
Andrew Wang
cf258b6d98 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu. 
(cherry picked from commit 6736a1ab7033523ed5f304fdfed46d7f348665b4)
 2015-07-23 14:42:44 -07:00
Allen Wittenauer
a37285620d HADOOP-11731. Rework the changelog and releasenotes (aw) 
(cherry picked from commit f383fd9b6caf4557613250c5c218b1a1b65a212b)

 Conflicts:
	hadoop-project/src/site/site.xml
 2015-07-23 14:08:10 -07:00
Haohui Mai
d3e6b40b44 HDFS-8730. Clean up the import statements in ClientProtocol. Contributed by Takanobu Asanuma. 2015-07-23 10:30:43 -07:00
Arpit Agarwal
601b503895 HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) 2015-07-23 10:14:01 -07:00
Wangda Tan
6baebcaedc YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda) 
(cherry picked from commit 3bba1800513b38a4827f7552f348db87dc47c783)
 2015-07-23 10:08:30 -07:00
Jing Zhao
71764a92c6 HDFS-8797. WebHdfsFileSystem creates too many connections for pread. Contributed by Jing Zhao. 
(cherry picked from commit e91ccfad07ec5b5674a84009772dd31a82b4e4de)
 2015-07-22 18:03:45 -07:00
Junping Du
6772c3f4dd YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He. 
(cherry picked from commit ee98d6354bbbcd0832d3e539ee097f837e5d0e31)
 2015-07-22 17:57:16 -07:00
rohithsharmaks
be2334ba3a YARN-3954. Fix TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml. (varun saxena via rohithsharmaks) 2015-07-23 02:10:45 +05:30
Wangda Tan
3800e25d6e YARN-3956. Fix TestNodeManagerHardwareUtils fails on Mac (Varun Vasudev via wangda) 
(cherry picked from commit 06e5dd2c84c49460884757b56980b1b9c58af996)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-07-22 12:03:14 -07:00
Wangda Tan
3576b0ac5e YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda) 
(cherry picked from commit 76ec26de8099dc48ce3812c595b7ab857a600442)
 2015-07-22 11:54:38 -07:00
Colin Patrick Mccabe
d9876e69ee HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin Walsh via Colin P. McCabe) 
(cherry picked from commit 1b3bceb58c8e536a75fa3f99cc3ceeaba91a07de)
 2015-07-22 11:35:14 -07:00
cnauroth
bb080b32d4 HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit efa97243ecb84b3b468e732897cd685e3869f480)
 2015-07-22 11:17:00 -07:00
yliu
930e344d78 HDFS-8795. Improve InvalidateBlocks#node2blocks. (yliu) 2015-07-22 15:15:08 +08:00
Vinayakumar B
03d68b5575 HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt) 
(cherry picked from commit 94c6a4aa85e7d98e9b532b330f30783315f4334b)
 2015-07-22 10:27:03 +05:30
Haohui Mai
53ed25c3d1 HDFS-8495. Consolidate append() related implementation into a single class. Contributed by Rakesh R. 2015-07-21 17:28:28 -07:00
Jian He
11cb00f7a0 YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena 
(cherry picked from commit 393fe71771e3ac6bc0efe59d9aaf19d3576411b3)
 2015-07-21 15:06:16 -07:00
cnauroth
aab1c14df6 HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R. 
(cherry picked from commit a26cc66f38daec2342215a66b599bf59cee1112c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-07-21 14:13:15 -07:00
cnauroth
57d55d40dd HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 
(cherry picked from commit cb03768b1b2250b9b5a7944cf6ef918e8a974e20)
 2015-07-21 13:56:07 -07:00
Ravi Prakash
b728edce0f Revert "HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak)" 
This reverts commit 3d58c7a7006991b46efe8a8f60b244f4f85b481a.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-07-21 11:30:41 -07:00
Wangda Tan
3dd113fa7c YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda) 
(cherry picked from commit c39ca541f498712133890961598bbff50d89d68b)
 2015-07-21 09:57:53 -07:00
Vinayakumar B
cd3692fe4b HDFS-7582. Enforce maximum number of ACL entries separately per access and default. (Contributed by Vinayakumar B) 
(cherry picked from commit 29cf887b226f4ab3c336a6e681db5e8e70699d66)
 2015-07-21 15:17:26 +05:30
Vinayakumar B
8ef3821356 HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B) 
(cherry picked from commit 87f29c6b8acc07cc011713a79554d51945e265ac)
 2015-07-21 13:13:31 +05:30
Haohui Mai
4283831348 HDFS-7483. Display information per tier on the Namenode UI. Contributed by Benoy Antony and Haohui Mai. 2015-07-20 20:13:16 -07:00
Akira Ajisaka
e78ee18642 Move HDFS-6945 to 2.7.2 section in CHANGES.txt. 
(cherry picked from commit a628f675900d2533ddf86fb3d3e601238ecd68c3)
 2015-07-21 11:45:53 +09:00
Akira Ajisaka
d591f2af5d HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. (aajisaka) 
(cherry picked from commit 773c670943757681feeafb227a2d0c29d48f38f1)
 2015-07-21 11:22:36 +09:00
yliu
cadd02ad1d HDFS-8794. Improve CorruptReplicasMap#corruptReplicasMap. (yliu) 2015-07-21 09:18:43 +08:00
Ravi Prakash
3d58c7a700 HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak) 
(cherry picked from commit e4f756260f16156179ba4adad974ec92279c2fac)
 2015-07-20 14:04:28 -07:00
Steve Loughran
d3c23c7b18 HADOOP-11893. Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) 2015-07-20 13:22:03 +01:00
Steve Loughran
577acf89f8 HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage() in logging/span events. (Varun Saxena via stevel) 2015-07-20 13:13:09 +01:00
Steve Loughran
d68b044f0f HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). (Brahma Reddy Battula via stevel) 2015-07-20 13:02:51 +01:00
Steve Loughran
208b9eed9e HADOOP-12209 Comparable type should be in FileStatus. (Yong Zhang via stevel) 2015-07-20 12:32:32 +01:00
Steve Loughran
f3296a1984 HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel) 2015-07-20 11:22:22 +01:00
Arun Suresh
eddb326669 Pulling in YARN-3535 to branch 2.7.x 
(cherry picked from commit 176131f12bc0d467e9caaa6a94b4ba96e09a4539)
 2015-07-18 10:11:29 -07:00
Colin Patrick Mccabe
aff955a14a YARN-3844. Make hadoop-yarn-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 419c51d233bd124eadb38ff013693576ec02c4f1)
 2015-07-17 12:05:24 -07:00
Jonathan Eagles
b289939514 YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles) 
(cherry picked from commit 7faae0e6fe027a3886d9f4e290b6a488a2c55b3a)
 2015-07-17 11:03:34 -05:00
Arun Suresh
8018041b49 YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh) 
(cherry picked from commit 9b272ccae78918e7d756d84920a9322187d61eed)
 2015-07-17 04:33:04 -07:00
Wangda Tan
a7de3cde13 YARN-3885. ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level. (Ajith S via wangda) 
(cherry picked from commit 3540d5fe4b1da942ea80c9e7ca1126b1abb8a68a)
 2015-07-16 16:14:07 -07:00
Wangda Tan
7b2540770e YARN-3930. FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown. (Dian Fu via wangda) 
(cherry picked from commit fa2b63ed162410ba05eadf211a1da068351b293a)
 2015-07-16 16:08:04 -07:00
Haohui Mai
391d2d88f2 HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. Contributed by kanaka kumar avvaru. 2015-07-16 15:22:11 -07:00
Ming Ma
516bbf1c20 HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma) 
(cherry picked from commit fbd88f1062f3c4b208724d208e3f501eb196dfab)
 2015-07-16 12:55:29 -07:00