Uma Maheswara Rao G
157f86fca5
HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh)
...
(cherry picked from commit 8d7c54967d
)
2014-10-10 23:04:12 -07:00
Vinod Kumar Vavilapalli
8dacf89b3e
YARN-2501. Enhanced AMRMClient library to support requests against node labels. Contributed by Wangda Tan.
...
(cherry picked from commit a5ec3d0809
)
2014-10-10 19:59:30 -07:00
Vinod Kumar Vavilapalli
bb6c79f76c
YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.
...
(cherry picked from commit db7f165319
)
2014-10-10 11:46:10 -07:00
Zhijie Shen
16d7144337
YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.
...
(cherry picked from commit cb81bac002
)
2014-10-10 00:18:24 -07:00
cnauroth
281041a57e
YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth.
...
(cherry picked from commit d3afd730ac
)
(cherry picked from commit b81641a310
)
2014-10-09 22:49:00 -07:00
cnauroth
308e336853
MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth.
...
(cherry picked from commit 777877d079
)
(cherry picked from commit f6278cbac5
)
2014-10-09 22:40:34 -07:00
cnauroth
4573bbe33d
MAPREDUCE-6122. Fix CHANGES.txt.
...
(cherry picked from commit 2f0166db56
)
(cherry picked from commit 61be28f501
)
2014-10-09 22:33:54 -07:00
cnauroth
3fe4e0d3df
MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth.
...
(cherry picked from commit 684170d5ef
)
(cherry picked from commit 85a2b90740
)
2014-10-09 22:30:25 -07:00
Zhijie Shen
ce704583a7
YARN-2671. Fix the Jira number in the change log.
...
(cherry picked from commit 5b12df6587
)
2014-10-09 21:00:38 -07:00
Zhijie Shen
647874206c
YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan.
...
(cherry picked from commit e532ed8faa
)
2014-10-09 18:01:13 -07:00
Colin Patrick Mccabe
14080ea3d2
HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe)
...
(cherry picked from commit d8d628d1e0
)
(cherry picked from commit 8addbe2b8e
)
2014-10-09 17:12:48 -07:00
Vinod Kumar Vavilapalli
967c758373
YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan.
...
(cherry picked from commit 596702a025
)
2014-10-09 15:47:51 -07:00
Andrew Wang
2ff182c890
HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang)
...
(cherry picked from commit 8d94114495
)
2014-10-09 13:21:34 -07:00
Zhijie Shen
a4522e90f6
YARN-2629. Made the distributed shell use the domain-based timeline ACLs. Contributed by Zhijie Shen.
...
(cherry picked from commit 1d4612f5ad
)
2014-10-09 13:03:03 -07:00
Andrew Wang
e7b215dfa7
HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang)
...
(cherry picked from commit d7b647f0ee
)
2014-10-09 11:59:15 -07:00
cnauroth
754718aed5
HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
...
(cherry picked from commit 4e544c84e9
)
2014-10-09 11:57:00 -07:00
Mayank Bansal
cf0ad82c5a
YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank)
2014-10-09 11:39:25 -07:00
Vinod Kumar Vavilapalli
ad7baad21e
YARN-2493. Added user-APIs for using node-labels. Contributed by Wangda Tan.
...
(cherry picked from commit 180afa2f86
)
2014-10-09 11:27:49 -07:00
cnauroth
cf7eaf28e9
HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu.
...
(cherry picked from commit 1123a06e36
)
(cherry picked from commit 5af4c021cc
)
2014-10-09 11:12:58 -07:00
Kihwal Lee
0280e9aee0
HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee.
...
(cherry picked from commit db71bb54bc
)
2014-10-09 12:11:42 -05:00
Aaron T. Myers
f86c9c6c71
HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh.
...
(cherry picked from commit d9556e873ef4d3e68c4f0c991f856d1faa747f07)
(cherry picked from commit 3a2565c7be80cf6e9cdfec0f5460ed8ed2252768)
2014-10-08 18:00:37 -07:00
Zhijie Shen
ab448565c9
HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch.
...
(cherry picked from commit a169051931
)
2014-10-08 15:39:30 -07:00
Colin Patrick Mccabe
204148f0d4
HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe)
2014-10-08 13:58:28 -07:00
Kihwal Lee
522b6505f4
HDFS-7203. Concurrent appending to the same file can cause data
...
corruption. Contributed by Kihwal Lee.
(cherry picked from commit 853cb704ed
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-10-08 15:10:03 -05:00
Steve Loughran
088ae9c5bf
YARN-913 service registry: YARN-2652 add hadoop-yarn-registry package under hadoop-yarn
2014-10-08 12:54:37 -07:00
Jian He
7ec65c8617
YARN-2649. Fixed TestAMRMRPCNodeUpdates test failure. Contributed by Ming Ma
...
(cherry picked from commit e16e25ab1b
)
2014-10-08 11:03:28 -07:00
Andrew Wang
2c27b7b26f
HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang)
...
(cherry picked from commit b2f6197523
)
2014-10-07 14:51:52 -07:00
Kihwal Lee
06587e4876
Fix version in pom.xml from HADOOP-11007 in branch-2.6
2014-10-07 16:40:01 -05:00
Kihwal Lee
0a36b6808f
Missing files from the previous commit of HADOOP-11007
2014-10-07 16:32:55 -05:00
Kihwal Lee
3f200fddfd
HADOOP-11007. Reinstate building of ant tasks support. Contributed by
...
Jason Lowe.
(cherry picked from commit 99d7a452be
)
2014-10-07 16:24:23 -05:00
Jian He
5ff984f33f
YARN-1857. CapacityScheduler headroom doesn't account for other AM's running. Contributed by Chen He and Craig Welch
...
(cherry picked from commit 30d56fdbb4
)
2014-10-07 13:48:46 -07:00
Jason Lowe
e835cb5c86
MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai
...
(cherry picked from commit 2e789eb226
)
2014-10-07 14:13:12 +00:00
Haohui Mai
1bd45fa165
HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu.
2014-10-06 22:08:01 -06:00
Jian He
efc482d1f7
YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch
...
(cherry picked from commit 519e5a7dd2
)
2014-10-06 15:52:05 -07:00
Jian He
73a1b77223
YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier to use protobuf as payload. Contributed by Junping Du
...
(cherry picked from commit ea26cc0b4a
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestClientToAMTokens.java
2014-10-06 10:52:20 -07:00
Chris Douglas
0b2dedc42d
YARN-1051. Add a system for creating reservations of cluster capacity.
...
Contributed by Subru Krishnan and Carlo Curino.
(cherry picked from commit c8212bacb1
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
(cherry picked from commit ebf4aae60f7a641ac7406e27d43528cace20d4ff)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2014-10-06 10:30:04 -07:00
subru
114f09226e
YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched for branch YARN-1051. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit c47464aba4
)
(cherry picked from commit a2986234be
)
(cherry picked from commit fb5e9df7fd
)
2014-10-06 10:29:14 -07:00
subru
bf4394e160
YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit 90ac0be86b
)
(cherry picked from commit 5e10a13bb4
)
(cherry picked from commit ae0f16ccc8
)
2014-10-06 10:29:14 -07:00
subru
256a951049
MAPREDUCE-6103.Adding reservation APIs to MR resource manager delegate. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit aa92dd45f2
)
(cherry picked from commit 3f282762d1
)
(cherry picked from commit 30a370e705
)
2014-10-06 10:29:13 -07:00
subru
d244b2ae3a
YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit 8baeaead85
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
(cherry picked from commit 6261f7cc69
)
(cherry picked from commit cbfbdf60d6
)
2014-10-06 10:29:13 -07:00
subru
8e92b3ec9d
YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit 169085319b
)
(cherry picked from commit 3418c56bcf
)
(cherry picked from commit fec639cda1
)
2014-10-06 10:29:13 -07:00
carlo curino
56972123ff
YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan.
...
(cherry picked from commit c4918cb4cb
)
(cherry picked from commit b6df0dddcd
)
(cherry picked from commit 6bfdaf06c4
)
2014-10-06 10:29:13 -07:00
carlo curino
4ee027b9d6
YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan.
...
(cherry picked from commit aef7928899
)
(cherry picked from commit f66ffcf832
)
(cherry picked from commit 6a3c167175
)
2014-10-06 10:29:13 -07:00
subru
056b7f5799
YARN-1709. In-memory data structures used to track resources over time to enable reservations.
...
(cherry picked from commit 0d8b2cd88b
)
(cherry picked from commit cf4b34282a
)
(cherry picked from commit 63250ef9d6
)
2014-10-06 10:29:13 -07:00
subru
f4522fd987
YARN-1708. Public YARN APIs for creating/updating/deleting reservations.
...
(cherry picked from commit 3f2e3b275b
)
(cherry picked from commit c9266df404
)
(cherry picked from commit 3a167056d1
)
2014-10-06 10:29:13 -07:00
carlo curino
950da32b4c
YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan.
...
(cherry picked from commit f83a07f266
)
(cherry picked from commit 1c6950354f
)
(cherry picked from commit b81f571e60
)
2014-10-06 10:29:12 -07:00
carlo curino
5ac08c5398
YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan
...
(cherry picked from commit aac47fda7f
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java
(cherry picked from commit eb3e40b833
)
(cherry picked from commit cf5ef00b96
)
2014-10-06 10:29:12 -07:00
cnauroth
08ccd30063
HADOOP-11163. Correct CHANGES.txt.
...
(cherry picked from commit bbb3b1acc0
)
(cherry picked from commit 1329d1e701
)
2014-10-06 09:16:31 -07:00
cnauroth
29c203585e
HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu.
...
(cherry picked from commit 69c9af9103
)
(cherry picked from commit a828ef15b0
)
2014-10-06 09:16:22 -07:00
Haohui Mai
f567f3c833
HDFS-7172. Test data files may be checked out of git with incorrect line endings, causing test failures in TestHDFSCLI. Contributed by Chris Nauroth.
...
(cherry picked from commit 5db04a5a1a
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-10-06 09:15:41 -07:00