Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,494 Commits 326 Branches 371 Tags
Commit Graph

7494 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
6546c59745 Fixup for CHANGES.txt 
(cherry picked from commit 0263656247f31a67347bea4b702869ddce21e7c4)
 2014-10-07 14:59:17 -07:00
Andrew Wang
52c8ac90ea HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang) 
(cherry picked from commit 4b2834898cbcc66ffbf01b2fb10375e79a50d538)
 2014-10-07 14:57:09 -07:00
Andrew Wang
3e897da5fc HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang) 
(cherry picked from commit b2f619752355d4ef6733935c020f57c8a26d82e1)
 2014-10-07 14:47:14 -07:00
Kihwal Lee
8cf5f9eede Fix version in the pom.xml from HADOOP-11007 for branch-2. 2014-10-07 16:42:35 -05:00
Kihwal Lee
318f0e1e0c Missing files from the previous commit of HADOOP-11007 2014-10-07 16:32:17 -05:00
Kihwal Lee
7910c6d035 HADOOP-11007. Reinstate building of ant tasks support. Contributed by 
Jason Lowe.
(cherry picked from commit 99d7a452be91b3aefe9bcde9b51893ff6719742e)
 2014-10-07 16:23:52 -05:00
Jian He
9ff7c0c96c YARN-1857. CapacityScheduler headroom doesn't account for other AM's running. Contributed by Chen He and Craig Welch 
(cherry picked from commit 30d56fdbb40d06c4e267d6c314c8c767a7adc6a3)
 2014-10-07 13:48:03 -07:00
Colin Patrick Mccabe
2a8f824fb7 HDFS-7186. Document the "hadoop trace" command. (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 9196db9a080b96b9022c424d70f59811e67570a6)
 2014-10-07 11:57:09 -07:00
Jason Lowe
979b915ecc MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai 
(cherry picked from commit 2e789eb2261fa607489d8ae630fb77e8147d0266)
 2014-10-07 14:11:48 +00:00
Haohui Mai
70c8cb5614 HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu. 2014-10-06 22:07:29 -06:00
Jian He
5c33e91229 YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch 
(cherry picked from commit 519e5a7dd2bd540105434ec3c8939b68f6c024f8)
 2014-10-06 15:51:38 -07:00
Colin Patrick Mccabe
eeb39dc218 HDFS-7194 Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH (yzhang via cmccabe) 
(cherry picked from commit 8dc6abf2f4218b2d84b2c2dc7d18623d897c362d)
 2014-10-06 15:29:45 -07:00
Colin Patrick Mccabe
b5158c8d24 HADOOP-10404. Commit correct version of patch (cmccabe) 
(cherry picked from commit 687d83c9e10a4432c8d54c2cd406c7ccb4392187)
 2014-10-06 14:45:04 -07:00
Colin Patrick Mccabe
c97134d054 HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe) 
(cherry picked from commit 8099de259fb91a29674bf17cb1382c038b707a90)
 2014-10-06 14:41:14 -07:00
Tsz-Wo Nicholas Sze
e5e9cf219a HDFS-7169. Add SE_BAD_FIELD to findbugsExcludeFile.xml. 2014-10-06 13:31:46 -07:00
Jian He
43358be60b YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier to use protobuf as payload. Contributed by Junping Du 
(cherry picked from commit ea26cc0b4ac02b8af686dfda80f540e5aa70c358)
 2014-10-06 10:48:27 -07:00
Chris Douglas
4ba102bdc3 YARN-1051. Add a system for creating reservations of cluster capacity. 
Contributed by Subru Krishnan and Carlo Curino.
(cherry picked from commit c8212bacb1b2a7e6ee83cc56f72297465ce99390)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2014-10-06 10:30:53 -07:00
subru
fb5e9df7fd YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched for branch YARN-1051. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit c47464aba407d1dafe10be23fe454f0489cc4367)
(cherry picked from commit a2986234be4e02f9ccb589f9ff5f7ffb28bc6400)
 2014-10-06 10:21:07 -07:00
subru
ae0f16ccc8 YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit 90ac0be86b898aefec5471db4027554c8e1b310c)
(cherry picked from commit 5e10a13bb4759984494c6a870c7f08fb6693c9c0)
 2014-10-06 10:21:06 -07:00
subru
30a370e705 MAPREDUCE-6103.Adding reservation APIs to MR resource manager delegate. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit aa92dd45f2d8c89a8a17ad2e4449aa3ff08bc53a)
(cherry picked from commit 3f282762d1afc916de9207d3adeda852ca344853)
 2014-10-06 10:21:06 -07:00
subru
cbfbdf60d6 YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit 8baeaead8532898163f1006276b731a237b1a559)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
(cherry picked from commit 6261f7cc69a0eb3eebc9898c7599c7c20f432b4e)
 2014-10-06 10:21:06 -07:00
subru
fec639cda1 YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino. 
(cherry picked from commit 169085319b8b76641f8b9f6840a3fef06d221e2b)
(cherry picked from commit 3418c56bcf4bbddaf483bdaa1a15a8bbc4039bfe)
 2014-10-06 10:21:06 -07:00
carlo curino
6bfdaf06c4 YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. 
(cherry picked from commit c4918cb4cb5a267a8cfd6eace28fcfe7ad6174e8)
(cherry picked from commit b6df0dddcdafd7ec67c76ea92aea3ff3e94db247)
 2014-10-06 10:21:05 -07:00
carlo curino
6a3c167175 YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. 
(cherry picked from commit aef7928899b37262773f3dc117157bb746bf8918)
(cherry picked from commit f66ffcf832235e0da0bb050fff08e248b547c360)
 2014-10-06 10:21:05 -07:00
subru
63250ef9d6 YARN-1709. In-memory data structures used to track resources over time to enable reservations. 
(cherry picked from commit 0d8b2cd88b958b1e602fd4ea4078ef8d4742a7c3)
(cherry picked from commit cf4b34282aafee9f6b09d3433c4de1ae4b359168)
 2014-10-06 10:21:05 -07:00
subru
3a167056d1 YARN-1708. Public YARN APIs for creating/updating/deleting reservations. 
(cherry picked from commit 3f2e3b275bcf29264a112c5d2f4eae289fe7f52c)
(cherry picked from commit c9266df40434fdde05bd3a4c75f7a6bc29db760f)
 2014-10-06 10:21:05 -07:00
carlo curino
b81f571e60 YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. 
(cherry picked from commit f83a07f266f2c5e6eead554d8a331ed7e75e10d5)
(cherry picked from commit 1c6950354f3c35a7824770dc251d5aec3be4876a)
 2014-10-06 10:21:05 -07:00
carlo curino
cf5ef00b96 YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan 
(cherry picked from commit aac47fda7fecda9fc18ade34d633eca895865a70)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
(cherry picked from commit eb3e40b833b9d82c1556843f960194dc42e482f3)
 2014-10-06 10:21:04 -07:00
Vinayakumar B
5f58886770 HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb) 
(cherry picked from commit ed841dd9a96e54cb84d9cae5507e47ff1c8cdf6e)
 2014-10-06 14:32:06 +05:30
Arun C. Murthy
c5828c624f HADOOP-10731. Sync-ing CHANGES.txt across branches. 2014-10-05 07:51:27 -07:00
Arun C. Murthy
7dd508b880 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan. 
(cherry picked from commit 8f9ab998e273259c1e7a3ed53ba37d767e02b6bb)
 2014-10-05 07:42:10 -07:00
cnauroth
1329d1e701 HADOOP-11163. Correct CHANGES.txt. 
(cherry picked from commit bbb3b1acc0e8ce10b8689ded2be73b0965f09e52)
 2014-10-03 21:07:40 -07:00
cnauroth
a828ef15b0 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu. 
(cherry picked from commit 69c9af91031f345d9511618877646b8756b17863)
 2014-10-03 21:05:05 -07:00
Colin Patrick Mccabe
b335df9a9b HDFS-7055. Add tracing to DFSInputStream (cmccabe) 
(cherry picked from commit 7f6ed7fe365166e8075359f1d0ad035fa876c70f)
 2014-10-03 13:38:15 -07:00
Vinod Kumar Vavilapalli
7ed61e150c YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for use by long running services. Contributed by Xuan Gong. 
(cherry picked from commit 34cdcaad71cad76c0874a4e5266b4074009d2ffc)
 2014-10-03 12:17:03 -07:00
Karthik Kambatla
b6ce0a1f69 YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha) 
(cherry picked from commit 80d11eb68e60f88e16d7d41edecbddfc935a6b10)
 2014-10-03 11:52:05 -07:00
Jian He
1c58ab9206 YARN-2562. Changed ContainerId#toString() to be more readable. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit eb6ce5e97c6a379caf9de0b34cc7770c4447bb1a)
 2014-10-03 11:04:46 -07:00
Andrew Wang
9ebff016c2 HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh. 
(cherry picked from commit 2d8e6e2c4a52a4ba815b23d6d1ac21be4df23d9e)
 2014-10-02 19:59:56 -07:00
Jian He
6f4c77409b YARN-2628. Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free. Contributed by Varun Vasudev 
(cherry picked from commit 054f28552687e9b9859c0126e16a2066e20ead3f)
 2014-10-02 15:16:07 -07:00
Zhijie Shen
ecaae67ab3 YARN-2527. Fixed the potential NPE in ApplicationACLsManager and added test cases for it. Contributed by Benoy Antony. 
(cherry picked from commit 1c93025a1b370db46e345161dbc15e03f829823f)
 2014-10-02 14:57:27 -07:00
Haohui Mai
ebeb9da80c HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb. 2014-10-02 14:08:01 -07:00
Andrew Wang
6dbba19469 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang) 
(cherry picked from commit 6ac10516e7fa28384b6d3c2670f6621e2666ffdb)
 2014-10-02 13:54:56 -07:00
Andrew Wang
6ddd9eff78 HDFS-7179. DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension. (wang) 
(cherry picked from commit d2d5a0ea03b0d461a4d376c7b9de8cd5c147effa)
 2014-10-02 13:54:50 -07:00
Colin Patrick Mccabe
fb0107ef0d HDFS-7162. Fix CHANGES.txt (should have Chenging Liu's name) 2014-10-02 12:44:23 -07:00
Colin Patrick Mccabe
ab1afc4e1c HDFS-7162. Wrong path when deleting through fuse-dfs a file which already exists in trash (cmccabe) 
(cherry picked from commit 03db9cc839663cad387db7df8e4f60b312058f18)
 2014-10-02 12:42:47 -07:00
Jason Lowe
531c1fd00a YARN-2624. Resource Localization fails on a cluster due to existing cache directories. Contributed by Anubhav Dhoot 
(cherry picked from commit 29f520052e2b02f44979980e446acc0dccd96d54)
 2014-10-02 17:40:44 +00:00
Karthik Kambatla
b6f4d1ef42 YARN-2254. TestRMWebServicesAppsModification should run against both CS and FS. (Zhihai Xu via kasha) 
(cherry picked from commit 5e0b49da9caa53814581508e589f3704592cf335)
 2014-10-02 10:15:41 -07:00
Jian He
61c7ceaf82 YARN-2617. Fixed NM to not send duplicate container status whose app is not running. Contributed by Jun Gong 
(cherry picked from commit 3ef1cf187faeb530e74606dd7113fd1ba08140d7)
 2014-10-02 10:04:42 -07:00
arp
d8e6481395 HDFS-7178. Additional unit test for replica write with full disk. (Arpit Agarwal) 2014-10-02 09:28:41 -07:00
junping_du
6483342a61 YARN-1979. TestDirectoryCollection fails when the umask is unusual. (Contributed by Vinod Kumar Vavilapalli and Tsuyoshi OZAWA) 
(cherry picked from commit c7cee9b4551918d5d35bf4e9dc73982a050c73ba)
 2014-10-02 08:04:25 -07:00