7432 Commits

Author SHA1 Message Date
Karthik Kambatla
7bfd9e068d MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)
(cherry picked from commit ed0e0ef9748ce5b231de677ab41c3035137bbde4)
2014-10-11 22:49:46 -07:00
Steve Loughran
38dedc2f07 YARN-2668 yarn-registry JAR won't link against ZK 3.4.5. (stevel) 2014-10-11 18:33:29 -07:00
Haohui Mai
16710758f1 HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao. 2014-10-10 23:02:41 -07:00
Vinod Kumar Vavilapalli
fff6a1f77e YARN-2501. Enhanced AMRMClient library to support requests against node labels. Contributed by Wangda Tan.
(cherry picked from commit a5ec3d080978a67837946a991843a081ea712539)
2014-10-10 19:58:42 -07:00
Haohui Mai
059f774f90 HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B. 2014-10-10 17:27:30 -07:00
Haohui Mai
f11c8eb096 HDFS-6252. Phase out the old web UI in HDFS. Contributed by Haohui Mai. 2014-10-10 17:10:54 -07:00
Andrew Wang
217c0405d9 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang)
(cherry picked from commit d3d3d47202a18749eeebec22db759c19dd3e232c)
2014-10-10 13:40:53 -07:00
Colin Patrick Mccabe
4c0bc45978 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe)
(cherry picked from commit 1ceb3269337e321e352b7cd9f946c5c52dcfddfa)
2014-10-10 13:04:16 -07:00
Vinod Kumar Vavilapalli
8ef83a9480 YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.
(cherry picked from commit db7f1653198b950e89567c06898d64f6b930a0ee)
2014-10-10 11:45:15 -07:00
Zhijie Shen
1e6d81a886 YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.
(cherry picked from commit cb81bac0029fce3a9726df3523f0b692cd3375b8)
2014-10-10 00:16:34 -07:00
cnauroth
b81641a310 YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth.
(cherry picked from commit d3afd730acfa380ab5032be5ee296c5d73744518)
2014-10-09 22:47:04 -07:00
cnauroth
f6278cbac5 MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth.
(cherry picked from commit 777877d079ecb025c293deac741800800e413179)
2014-10-09 22:38:25 -07:00
cnauroth
61be28f501 MAPREDUCE-6122. Fix CHANGES.txt.
(cherry picked from commit 2f0166db560b180e8d07c10ba9ad4bfaf2aa7b36)
2014-10-09 22:32:38 -07:00
cnauroth
85a2b90740 MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth.
(cherry picked from commit 684170d5efdc11bcd9967168f44a428d1a72af3c)
2014-10-09 22:27:40 -07:00
Zhijie Shen
79204dced9 YARN-2671. Fix the Jira number in the change log.
(cherry picked from commit 5b12df6587eb4f37d09c9ffc35a0ea59694df831)
2014-10-09 20:59:37 -07:00
Aaron T. Myers
8cbacb37e9 HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang.
(cherry picked from commit cbd21fd13b321d042faeff00fa71c9becc0d6087)
2014-10-09 18:53:03 -07:00
Zhijie Shen
ad47a27dbf YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan.
(cherry picked from commit e532ed8faa8db4b008a5b8d3f82b48a1b314fa6c)
2014-10-09 18:00:01 -07:00
Karthik Kambatla
7e20187f91 YARN-2180. [YARN-1492] In-memory backing store for cache manager. (Chris Trezzo via kasha)
(cherry picked from commit 4f426fe2232ed90d8fdf8619fbdeae28d788b5c8)
2014-10-09 17:16:45 -07:00
Colin Patrick Mccabe
8addbe2b8e HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe)
(cherry picked from commit d8d628d1e0c42a32e2079ed430e8817996bbe4c4)
2014-10-09 17:12:24 -07:00
Vinod Kumar Vavilapalli
d3125f3de5 YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan.
(cherry picked from commit 596702a02501e9cb09aabced168027189eaf02ba)
2014-10-09 15:47:20 -07:00
Mayank Bansal
c1a86d105e YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank) 2014-10-09 13:43:36 -07:00
Andrew Wang
6cc8ec980c HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang)
(cherry picked from commit 8d941144952a77a714cd4368cba21b01904926e9)
2014-10-09 13:21:32 -07:00
Zhijie Shen
4d170d3db6 YARN-2629. Made the distributed shell use the domain-based timeline ACLs. Contributed by Zhijie Shen.
(cherry picked from commit 1d4612f5ad9678c952b416e798dccd20c88f96ef)
2014-10-09 13:01:44 -07:00
Andrew Wang
971eb31d28 HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang)
(cherry picked from commit d7b647f0ee2c918143ff71abd9ce8b89717b2fc5)
2014-10-09 11:58:51 -07:00
cnauroth
4e544c84e9 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 2014-10-09 11:55:59 -07:00
Vinod Kumar Vavilapalli
b42cd54d7a YARN-2493. Added user-APIs for using node-labels. Contributed by Wangda Tan.
(cherry picked from commit 180afa2f86f9854c536c3d4ff7476880e41ac48d)
2014-10-09 11:27:17 -07:00
cnauroth
5af4c021cc HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu.
(cherry picked from commit 1123a06e3658f26228f1eedaed796aca8efc7bad)
2014-10-09 11:11:13 -07:00
Kihwal Lee
7056e50c21 HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee.
(cherry picked from commit db71bb54bcc75b71c5841b25ceb03fb0218c6d4f)
2014-10-09 12:09:11 -05:00
Uma Maheswara Rao G
7d63b4f273 HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh)
(cherry picked from commit 8d7c54967d5a08cdff75a782998ee89e7537b5c4)
2014-10-09 20:20:27 +05:30
Aaron T. Myers
afaadd6535 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh.
(cherry picked from commit d9556e873ef4d3e68c4f0c991f856d1faa747f07)
2014-10-08 18:02:00 -07:00
Colin Patrick Mccabe
f1feaae1dd HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe)
(cherry picked from commit d996235285e5047f731e3d3fc4c6e6214caa10aa)
2014-10-08 18:01:22 -07:00
Zhijie Shen
f27a88562e HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch.
(cherry picked from commit a1690519317068d9855174752d22ff45f0e4c962)
2014-10-08 15:37:57 -07:00
Colin Patrick Mccabe
19c307f36a CHANGES.txt: move HADOOP-10404 underneath branch 2.6 2014-10-08 14:01:50 -07:00
Kihwal Lee
b39c8c3128 HDFS-7203. Concurrent appending to the same file can cause data
corruption. Contributed by Kihwal Lee.
2014-10-08 15:07:12 -05:00
Steve Loughran
d218ab58fc YARN-913 service registry: YARN-2652 add hadoop-yarn-registry package under hadoop-yarn 2014-10-08 12:55:47 -07:00
Jian He
5e6f86e3aa YARN-2649. Fixed TestAMRMRPCNodeUpdates test failure. Contributed by Ming Ma
(cherry picked from commit e16e25ab1beac89c8d8be4e9f2a7fbefe81d35f3)
2014-10-08 11:03:00 -07:00
Andrew Wang
d9aa0f8333 HADOOP-11166. Remove ulimit from test-patch.sh.
(cherry picked from commit 60f0f6fcde406ed15e9079e0ff34df744b09a844)
2014-10-07 17:30:16 -07:00
cnauroth
7e949744b1 HDFS-7128. Decommission slows way down when it gets towards the end. Contributed by Ming Ma.
(cherry picked from commit 80cb472620f0a7889e311ca32212a42b95c6794e)
2014-10-07 15:01:54 -07:00
Andrew Wang
6546c59745 Fixup for CHANGES.txt
(cherry picked from commit 0263656247f31a67347bea4b702869ddce21e7c4)
2014-10-07 14:59:17 -07:00
Andrew Wang
52c8ac90ea HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang)
(cherry picked from commit 4b2834898cbcc66ffbf01b2fb10375e79a50d538)
2014-10-07 14:57:09 -07:00
Andrew Wang
3e897da5fc HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang)
(cherry picked from commit b2f619752355d4ef6733935c020f57c8a26d82e1)
2014-10-07 14:47:14 -07:00
Kihwal Lee
8cf5f9eede Fix version in the pom.xml from HADOOP-11007 for branch-2. 2014-10-07 16:42:35 -05:00
Kihwal Lee
318f0e1e0c Missing files from the previous commit of HADOOP-11007 2014-10-07 16:32:17 -05:00
Kihwal Lee
7910c6d035 HADOOP-11007. Reinstate building of ant tasks support. Contributed by
Jason Lowe.
(cherry picked from commit 99d7a452be91b3aefe9bcde9b51893ff6719742e)
2014-10-07 16:23:52 -05:00
Jian He
9ff7c0c96c YARN-1857. CapacityScheduler headroom doesn't account for other AM's running. Contributed by Chen He and Craig Welch
(cherry picked from commit 30d56fdbb40d06c4e267d6c314c8c767a7adc6a3)
2014-10-07 13:48:03 -07:00
Colin Patrick Mccabe
2a8f824fb7 HDFS-7186. Document the "hadoop trace" command. (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 9196db9a080b96b9022c424d70f59811e67570a6)
2014-10-07 11:57:09 -07:00
Jason Lowe
979b915ecc MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai
(cherry picked from commit 2e789eb2261fa607489d8ae630fb77e8147d0266)
2014-10-07 14:11:48 +00:00
Haohui Mai
70c8cb5614 HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu. 2014-10-06 22:07:29 -06:00
Jian He
5c33e91229 YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch
(cherry picked from commit 519e5a7dd2bd540105434ec3c8939b68f6c024f8)
2014-10-06 15:51:38 -07:00
Colin Patrick Mccabe
eeb39dc218 HDFS-7194 Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH (yzhang via cmccabe)
(cherry picked from commit 8dc6abf2f4218b2d84b2c2dc7d18623d897c362d)
2014-10-06 15:29:45 -07:00