Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,368 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

7368 Commits

Author SHA1 Message Date
Chris Douglas 0b2dedc42d YARN-1051. Add a system for creating reservations of cluster capacity. 
Contributed by Subru Krishnan and Carlo Curino.
(cherry picked from commit c8212bacb1)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
(cherry picked from commit ebf4aae60f7a641ac7406e27d43528cace20d4ff)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-10-06 10:30:04 -07:00
subru 114f09226e YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched for branch YARN-1051. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit c47464aba4)
(cherry picked from commit a2986234be)
(cherry picked from commit fb5e9df7fd)
 2014-10-06 10:29:14 -07:00
subru bf4394e160 YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit 90ac0be86b)
(cherry picked from commit 5e10a13bb4)
(cherry picked from commit ae0f16ccc8)
 2014-10-06 10:29:14 -07:00
subru 256a951049 MAPREDUCE-6103.Adding reservation APIs to MR resource manager delegate. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit aa92dd45f2)
(cherry picked from commit 3f282762d1)
(cherry picked from commit 30a370e705)
 2014-10-06 10:29:13 -07:00
subru d244b2ae3a YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit 8baeaead85)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
(cherry picked from commit 6261f7cc69)
(cherry picked from commit cbfbdf60d6)
 2014-10-06 10:29:13 -07:00
subru 8e92b3ec9d YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit 169085319b)
(cherry picked from commit 3418c56bcf)
(cherry picked from commit fec639cda1)
 2014-10-06 10:29:13 -07:00
carlo curino 56972123ff YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. 
(cherry picked from commit c4918cb4cb)
(cherry picked from commit b6df0dddcd)
(cherry picked from commit 6bfdaf06c4)
 2014-10-06 10:29:13 -07:00
carlo curino 4ee027b9d6 YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. 
(cherry picked from commit aef7928899)
(cherry picked from commit f66ffcf832)
(cherry picked from commit 6a3c167175)
 2014-10-06 10:29:13 -07:00
subru 056b7f5799 YARN-1709. In-memory data structures used to track resources over time to enable reservations. 
(cherry picked from commit 0d8b2cd88b)
(cherry picked from commit cf4b34282a)
(cherry picked from commit 63250ef9d6)
 2014-10-06 10:29:13 -07:00
subru f4522fd987 YARN-1708. Public YARN APIs for creating/updating/deleting reservations. 
(cherry picked from commit 3f2e3b275b)
(cherry picked from commit c9266df404)
(cherry picked from commit 3a167056d1)
 2014-10-06 10:29:13 -07:00
carlo curino 950da32b4c YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. 
(cherry picked from commit f83a07f266)
(cherry picked from commit 1c6950354f)
(cherry picked from commit b81f571e60)
 2014-10-06 10:29:12 -07:00
carlo curino 5ac08c5398 YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan 
(cherry picked from commit aac47fda7f)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
(cherry picked from commit eb3e40b833)
(cherry picked from commit cf5ef00b96)
 2014-10-06 10:29:12 -07:00
cnauroth 08ccd30063 HADOOP-11163. Correct CHANGES.txt. 
(cherry picked from commit bbb3b1acc0)
(cherry picked from commit 1329d1e701)
 2014-10-06 09:16:31 -07:00
cnauroth 29c203585e HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu. 
(cherry picked from commit 69c9af9103)
(cherry picked from commit a828ef15b0)
 2014-10-06 09:16:22 -07:00
Haohui Mai f567f3c833 HDFS-7172. Test data files may be checked out of git with incorrect line endings, causing test failures in TestHDFSCLI. Contributed by Chris Nauroth. 
(cherry picked from commit 5db04a5a1a)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-06 09:15:41 -07:00
Arun C. Murthy e65d8b750d HADOOP-10731. Sync-ing CHANGES.txt across branches. 
(cherry picked from commit c5828c624f)
 2014-10-05 07:51:56 -07:00
Arun C. Murthy c39f74d041 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan. 
(cherry picked from commit 8f9ab998e2)
 2014-10-05 07:47:28 -07:00
Vinod Kumar Vavilapalli 3542eef75b YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for use by long running services. Contributed by Xuan Gong. 
(cherry picked from commit 34cdcaad71)
 2014-10-03 12:17:38 -07:00
Jian He f97252e7e5 YARN-2562. Changed ContainerId#toString() to be more readable. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit eb6ce5e97c)
 2014-10-03 11:05:17 -07:00
Andrew Wang ac510c3610 HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh. 
(cherry picked from commit 2d8e6e2c4a)
(cherry picked from commit 9ebff016c2)
 2014-10-02 20:00:22 -07:00
Jian He 65cf007ab9 YARN-2628. Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free. Contributed by Varun Vasudev 
(cherry picked from commit 054f285526)
 2014-10-02 15:16:47 -07:00
Zhijie Shen 20fb25cde2 YARN-2527. Fixed the potential NPE in ApplicationACLsManager and added test cases for it. Contributed by Benoy Antony. 
(cherry picked from commit 1c93025a1b)
 2014-10-02 14:58:32 -07:00
Haohui Mai cfc5f8f684 HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb. 2014-10-02 14:27:33 -07:00
Colin Patrick Mccabe cf025cc39b HDFS-7176. The namenode usage message doesn't include "-rollingupgrade started" (cmccabe) 
(cherry picked from commit dd1b8f2ed8)
(cherry picked from commit 1725d56132)
 2014-10-02 14:08:15 -07:00
Colin Patrick Mccabe 94277a7d21 HDFS-7162. Wrong path when deleting through fuse-dfs a file which already exists in trash (cmccabe) 
(cherry picked from commit 03db9cc839)
(cherry picked from commit ab1afc4e1c)
 2014-10-02 14:07:44 -07:00
Andrew Wang dea3f133ff HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 
(cherry picked from commit 6ac10516e7)
(cherry picked from commit 6dbba19469)
 2014-10-02 14:01:30 -07:00
Andrew Wang 59e9858181 HDFS-7179. DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension. (wang) 
(cherry picked from commit d2d5a0ea03)
(cherry picked from commit 6ddd9eff78)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-02 14:01:20 -07:00
Jason Lowe 95757899d4 YARN-2624. Resource Localization fails on a cluster due to existing cache directories. Contributed by Anubhav Dhoot 
(cherry picked from commit 29f520052e)
 2014-10-02 17:45:12 +00:00
Jian He 116eb0bdc3 YARN-2617. Fixed NM to not send duplicate container status whose app is not running. Contributed by Jun Gong 
(cherry picked from commit 3ef1cf187f)
 2014-10-02 10:06:58 -07:00
arp 39bad4a4c8 HDFS-7178. Additional unit test for replica write with full disk. (Arpit Agarwal) 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-02 09:29:44 -07:00
Vinod Kumar Vavilapalli ae7a3235be YARN-2446. Augmented Timeline service APIs to start taking in domains as a parameter while posting entities and events. Contributed by Zhijie Shen. 
(cherry picked from commit 9e40de6af7)
 2014-10-01 18:02:03 -07:00
junping_du 8871bf37fe YARN-2613. Support retry in NMClient for rolling-upgrades. (Contributed by Jian He) 2014-10-01 17:11:59 -07:00
Haohui Mai 364c110c2b Addendum patch for HDFS-7172. Contributed by Chris Nauroth. 2014-10-01 16:11:02 -07:00
Zhijie Shen 8531f93d2d YARN-2630. Prevented previous AM container status from being acquired by the current restarted AM. Contributed by Jian He. 
(cherry picked from commit 52bbe0f11b)
 2014-10-01 15:41:12 -07:00
Haohui Mai 5d2f325483 HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:22:12 -07:00
Haohui Mai 0eec4c187c HDFS-7158. Reduce the memory usage of WebImageViewer. Contributed by Haohui Mai. 2014-10-01 13:22:07 -07:00
Kihwal Lee bd69f86668 HDFS-6754. TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retry. Contributed by Mit Desai. 
(cherry picked from commit 3f25d916d5)
 2014-10-01 14:44:30 -05:00
arp 0abbfcf2d0 HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal) 2014-09-30 23:34:11 -07:00
Steve Loughran a19efe3b13 HADOOP-11117 UGI HadoopLoginModule doesn't catch & wrap all kerberos-related exceptions (stevel) 2014-09-30 17:40:53 -07:00
Andrew Wang e2351e8512 HADOOP-11113. Namenode not able to reconnect to KMS after KMS restart. (Arun Suresh via wang) 
(cherry picked from commit e25a25c5343c889d8c9e45b65082ddb55cf36d52)
 2014-09-30 16:48:27 -07:00
Jian He 8c13a7484c YARN-2602. Fixed possible NPE in ApplicationHistoryManagerOnTimelineStore. Contributed by Zhijie Shen 
(cherry picked from commit bbff96be48)
 2014-09-30 16:45:30 -07:00
Karthik Kambatla 785e672e0b YARN-2594. Potential deadlock in RM when querying ApplicationResourceUsageReport. (Wangda Tan via kasha) 
(cherry picked from commit 14d60dadc2)
 2014-09-30 16:19:38 -07:00
Karthik Kambatla c206265b7e YARN-2610. Hamlet should close table tags. (Ray Chiang via kasha) 
(cherry picked from commit f7743dd07d)
 2014-09-30 15:50:13 -07:00
Jason Lowe ab3cab0b53 YARN-2387. Resource Manager crashes with NPE due to lack of synchronization. Contributed by Mit Desai 
(cherry picked from commit feaf139b4f)
 2014-09-30 22:42:53 +00:00
Zhijie Shen b19f668f5d YARN-2627. Added the info logs of attemptFailuresValidityInterval and number of previous failed attempts. Contributed by Xuan Gong. 
(cherry picked from commit 9582a50176)
 2014-09-30 13:01:13 -07:00
Jing Zhao 62d47e3965 HDFS-7167. NPE while running Mover if the given path is for a file. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-09-30 11:23:45 -07:00
Arun C. Murthy d3e61c96b5 Branching for hadoop-2.6 2014-09-30 10:38:47 -07:00
Arun C. Murthy 6a60fa279a Preparing to branch hadoop-2.6 2014-09-30 10:37:03 -07:00
cnauroth 57b145c3ab HADOOP-11145. TestFairCallQueue fails. Contributed by Akira AJISAKA. 
(cherry picked from commit b9158697a4)
 2014-09-30 08:58:39 -07:00
cnauroth 781833f553 HADOOP-11154. Update BUILDING.txt to state that CMake 3.0 or newer is required on Mac. Contributed by Chris Nauroth. 
(cherry picked from commit 8dc4e9408f)
 2014-09-30 08:35:35 -07:00