Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,656 Commits 326 Branches 371 Tags
Commit Graph

9656 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
ccurino
26ea045814 YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino) 
(cherry picked from commit 156f24ead00436faad5d4aeef327a546392cd265)
 2015-07-25 07:47:11 -07:00
Allen Wittenauer
621203bf44 HADOOP-12237. releasedocmaker.py doesn't work behind a proxy (Tsuyoshi Ozawa via aw) 
(cherry picked from commit b41fe3111ae37478cbace2a07e6ac35a676ef978)
(cherry picked from commit adcf5dd94052481f66deaf402ac4ace1ffc06f49)
 2015-07-24 18:32:18 -07:00
Allen Wittenauer
f54862ff15 HADOOP-12202. releasedocmaker drops missing component and assignee entries (aw) 
(cherry picked from commit adbacf7010373dbe6df239688b4cebd4a93a69e4)
(cherry picked from commit d7697831e3b24bec149990feed819e7d96f78184)
 2015-07-24 18:32:13 -07:00
Allen Wittenauer
a6cad7d856 HADOOP-12135. cleanup releasedocmaker 
(cherry picked from commit 3fee9f8d18dd60d83da674b3cfbefe666915fad8)
(cherry picked from commit e8b62d11d460e9706e48df92a0b0a72f4a02d3f5)
 2015-07-24 18:32:10 -07:00
Allen Wittenauer
cf348f2eb8 HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) 
(cherry picked from commit 8e657fba2fd33f7550597ea9c4c6e9a87aa1ef1c)
(cherry picked from commit 098ba450cc98475b84d60bb5ac3bd7b558b2a67c)
 2015-07-24 18:32:05 -07:00
Wangda Tan
4ba2e1ae95 YARN-3973. Recent changes to application priority management break reservation system from YARN-1051 (Carlo Curino via wangda) 
(cherry picked from commit a3bd7b4a59b3664273dc424f240356838213d4e7)
 2015-07-24 16:45:06 -07:00
Jason Lowe
2cf714123a YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu 
(cherry picked from commit ff9c13e0a739bb13115167dc661b6a16b2ed2c04)
 2015-07-24 22:15:44 +00:00
Jian He
3233284e87 YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan 
(cherry picked from commit 83fe34ac0896cee0918bbfad7bd51231e4aec39b)
 2015-07-24 14:01:36 -07:00
carlo curino
bddc48ed86 YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed 
(cherry picked from commit fc42fa8ae3bc9d6d055090a7bb5e6f0c5972fcff)
 2015-07-24 13:40:14 -07:00
Colin Patrick Mccabe
2419711369 HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit e4b0c74434b82c25256a59b03d62b1a66bb8ac69)
 2015-07-24 13:23:51 -07:00
Allen Wittenauer
fed9f767b1 HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw) 
(cherry picked from commit f325522c1423f89dced999a16d49a004b2879743)
 2015-07-24 11:55:57 -07:00
Allen Wittenauer
2a0688fdb8 HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) 
(cherry picked from commit 8d3c0f601d549a22648050bcc9a0e4acf37edc81)
 2015-07-24 11:55:56 -07:00
Karthik Kambatla
d2ee02940a YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha) 
(cherry picked from commit d19d18775368f5aaa254881165acc1299837072b)
 2015-07-24 11:49:46 -07:00
Akira Ajisaka
7bdd32ce3c HDFS-8735. Inotify: All events classes should implement toString() API. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit f8f60918230dd466ae8dda1fbc28878e19273232)
 2015-07-25 02:57:33 +09:00
Xuan
98ed4bca3b YARN-3967. Fetch the application report from the AHS if the RM does not 
know about it. Contributed by Mit Desai

(cherry picked from commit fbd6063269221ec25834684477f434e19f0b66af)
 2015-07-24 10:17:05 -07:00
Robert Kanter
731ed9cad8 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
 2015-07-24 09:42:04 -07:00
carlo curino
6a71a0a230 YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) 
(cherry picked from commit 0fcb4a8cf2add3f112907ff4e833e2f04947b53e)
 2015-07-23 19:36:54 -07:00
Akira Ajisaka
b2a532f61c HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang. 
(cherry picked from commit 206d4933a567147b62f463c2daa3d063ad40822b)
 2015-07-24 18:29:24 +09:00
Rohith Sharma K S
9d15860e6d YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan) 2015-07-24 12:54:07 +05:30
Akira Ajisaka
17319c4a65 HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) 
(cherry picked from commit 02c01815eca656814febcdaca6115e5f53b9c746)
 2015-07-24 11:39:16 +09:00
Robert Kanter
ba3b40ae79 YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter) 
(cherry picked from commit 1d3026e7b3cf2f3a8a544b66ff14783cc590bdac)
 2015-07-23 14:47:28 -07:00
Andrew Wang
cf258b6d98 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu. 
(cherry picked from commit 6736a1ab7033523ed5f304fdfed46d7f348665b4)
 2015-07-23 14:42:44 -07:00
Allen Wittenauer
a37285620d HADOOP-11731. Rework the changelog and releasenotes (aw) 
(cherry picked from commit f383fd9b6caf4557613250c5c218b1a1b65a212b)

 Conflicts:
	hadoop-project/src/site/site.xml
 2015-07-23 14:08:10 -07:00
Haohui Mai
d3e6b40b44 HDFS-8730. Clean up the import statements in ClientProtocol. Contributed by Takanobu Asanuma. 2015-07-23 10:30:43 -07:00
Arpit Agarwal
601b503895 HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) 2015-07-23 10:14:01 -07:00
Wangda Tan
6baebcaedc YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda) 
(cherry picked from commit 3bba1800513b38a4827f7552f348db87dc47c783)
 2015-07-23 10:08:30 -07:00
Jing Zhao
71764a92c6 HDFS-8797. WebHdfsFileSystem creates too many connections for pread. Contributed by Jing Zhao. 
(cherry picked from commit e91ccfad07ec5b5674a84009772dd31a82b4e4de)
 2015-07-22 18:03:45 -07:00
Junping Du
6772c3f4dd YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He. 
(cherry picked from commit ee98d6354bbbcd0832d3e539ee097f837e5d0e31)
 2015-07-22 17:57:16 -07:00
rohithsharmaks
be2334ba3a YARN-3954. Fix TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml. (varun saxena via rohithsharmaks) 2015-07-23 02:10:45 +05:30
Wangda Tan
3800e25d6e YARN-3956. Fix TestNodeManagerHardwareUtils fails on Mac (Varun Vasudev via wangda) 
(cherry picked from commit 06e5dd2c84c49460884757b56980b1b9c58af996)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-07-22 12:03:14 -07:00
Wangda Tan
3576b0ac5e YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda) 
(cherry picked from commit 76ec26de8099dc48ce3812c595b7ab857a600442)
 2015-07-22 11:54:38 -07:00
Colin Patrick Mccabe
d9876e69ee HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin Walsh via Colin P. McCabe) 
(cherry picked from commit 1b3bceb58c8e536a75fa3f99cc3ceeaba91a07de)
 2015-07-22 11:35:14 -07:00
cnauroth
bb080b32d4 HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit efa97243ecb84b3b468e732897cd685e3869f480)
 2015-07-22 11:17:00 -07:00
yliu
930e344d78 HDFS-8795. Improve InvalidateBlocks#node2blocks. (yliu) 2015-07-22 15:15:08 +08:00
Vinayakumar B
03d68b5575 HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt) 
(cherry picked from commit 94c6a4aa85e7d98e9b532b330f30783315f4334b)
 2015-07-22 10:27:03 +05:30
Haohui Mai
53ed25c3d1 HDFS-8495. Consolidate append() related implementation into a single class. Contributed by Rakesh R. 2015-07-21 17:28:28 -07:00
Jian He
11cb00f7a0 YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena 
(cherry picked from commit 393fe71771e3ac6bc0efe59d9aaf19d3576411b3)
 2015-07-21 15:06:16 -07:00
cnauroth
aab1c14df6 HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R. 
(cherry picked from commit a26cc66f38daec2342215a66b599bf59cee1112c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-07-21 14:13:15 -07:00
cnauroth
57d55d40dd HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R. 
(cherry picked from commit cb03768b1b2250b9b5a7944cf6ef918e8a974e20)
 2015-07-21 13:56:07 -07:00
Ravi Prakash
b728edce0f Revert "HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak)" 
This reverts commit 3d58c7a7006991b46efe8a8f60b244f4f85b481a.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-07-21 11:30:41 -07:00
Wangda Tan
3dd113fa7c YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda) 
(cherry picked from commit c39ca541f498712133890961598bbff50d89d68b)
 2015-07-21 09:57:53 -07:00
Vinayakumar B
cd3692fe4b HDFS-7582. Enforce maximum number of ACL entries separately per access and default. (Contributed by Vinayakumar B) 
(cherry picked from commit 29cf887b226f4ab3c336a6e681db5e8e70699d66)
 2015-07-21 15:17:26 +05:30
Vinayakumar B
8ef3821356 HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B) 
(cherry picked from commit 87f29c6b8acc07cc011713a79554d51945e265ac)
 2015-07-21 13:13:31 +05:30
Haohui Mai
4283831348 HDFS-7483. Display information per tier on the Namenode UI. Contributed by Benoy Antony and Haohui Mai. 2015-07-20 20:13:16 -07:00
Akira Ajisaka
e78ee18642 Move HDFS-6945 to 2.7.2 section in CHANGES.txt. 
(cherry picked from commit a628f675900d2533ddf86fb3d3e601238ecd68c3)
 2015-07-21 11:45:53 +09:00
Akira Ajisaka
d591f2af5d HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. (aajisaka) 
(cherry picked from commit 773c670943757681feeafb227a2d0c29d48f38f1)
 2015-07-21 11:22:36 +09:00
yliu
cadd02ad1d HDFS-8794. Improve CorruptReplicasMap#corruptReplicasMap. (yliu) 2015-07-21 09:18:43 +08:00
Ravi Prakash
3d58c7a700 HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak) 
(cherry picked from commit e4f756260f16156179ba4adad974ec92279c2fac)
 2015-07-20 14:04:28 -07:00
Steve Loughran
d3c23c7b18 HADOOP-11893. Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) 2015-07-20 13:22:03 +01:00
Steve Loughran
577acf89f8 HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage() in logging/span events. (Varun Saxena via stevel) 2015-07-20 13:13:09 +01:00