Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,864 Commits 326 Branches 371 Tags
Commit Graph

7864 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jian He
d208c90148 YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe 
(cherry picked from commit a7fba0bc28764e0fb36c335ea60cc58079fe007f)
 2014-12-01 16:45:17 -08:00
Jason Lowe
b6d7b789bd MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol interface implementation. Contributed by Rohith 
(cherry picked from commit 0c588904f8b68cad219d2bd8e33081d5cae656e5)
 2014-12-01 22:40:38 +00:00
Jason Lowe
38ea1419f6 YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena 
(cherry picked from commit 0f9528b99addbb0fd9a19d84db22a8c8e934b05f)
 2014-12-01 22:30:20 +00:00
Jason Lowe
2bdef5697b MAPREDUCE-6172. TestDbClasses timeouts are too aggressive. Contributed by Varun Saxena 
(cherry picked from commit 2b30fb1053e70c128b98013fb63cf9a095623be6)
 2014-12-01 21:52:51 +00:00
Colin Patrick Mccabe
f6d1bf5ed1 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
(cherry picked from commit 86e3993def01223f92b8d1dd35f6c1f8ab6033f5)
 2014-12-01 11:48:53 -08:00
Junping Du
c7bd22974a YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith) 
(cherry picked from commit c732ed760e115192652280cd4b5799d49e62db7e)
 2014-12-01 05:41:56 -08:00
Uma Maheswara Rao G
f4ab306347 HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh) 
(cherry picked from commit 1556f86a31a54733d6550363aa0e027acca7823b)
 2014-11-28 21:13:17 +05:30
Colin Patrick Mccabe
8f98225418 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 13:42:07 -08:00
Zhijie Shen
a9adc1295c YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ. 
(cherry picked from commit 8f1454cc6d46afa057770a39aecc151c5f048b57)
 2014-11-26 12:12:42 -08:00
Haohui Mai
ae04ce29e5 HDFS-7444. convertToBlockUnderConstruction should preserve BlockCollection. Contributed by Haohui Mai. 2014-11-26 10:37:54 -08:00
Uma Maheswara Rao G
6545342a6d HDFS-7310. Mover can give first priority to local DN if it has target storage type available in local DN. (Vinayakumar B via umamahesh) 
(cherry picked from commit 058af60c56207907f2bedf76df4284e86d923e0c)
 2014-11-26 23:34:21 +05:30
Steve Loughran
6a01497d7c HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:43:46 +00:00
Haohui Mai
0c8a8ba86e HDFS-7440. Update CHANGES.txt for HDFS-7440. 2014-11-25 21:05:21 -08:00
Haohui Mai
3e011f1ec2 HDFS-7440. Consolidate snapshot related operations in a single class. Contributed by Haohui Mai. 2014-11-25 21:03:57 -08:00
Karthik Kambatla
3d4536af82 YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha) 
(cherry picked from commit 834b3b98e7ecc4bfe93c7dd1a9e928e9653cf138)
 2014-11-25 16:22:14 -08:00
Jian He
ae35b0e14d YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe 
(cherry picked from commit 8a7ca13b13c0c3f008a6490cc96d4d48a051d1f7)
 2014-11-25 16:18:02 -08:00
Andrew Wang
8018d1af58 HADOOP-11173. Improve error messages for some KeyShell commands. 
(cherry picked from commit fae266bbf19e44a2595fa62366d9b65e7c996df8)
 2014-11-25 16:13:37 -08:00
Andrew Wang
915176c4e7 HDFS-7097. Allow block reports to be processed during checkpointing on standby name node. (kihwal via wang) 
(cherry picked from commit f43a20c529ac3f104add95b222de6580757b3763)
 2014-11-25 15:37:21 -08:00
Andrew Wang
aad16f8f5c HADOOP-11300. KMS startup scripts must not display the keystore / truststore passwords. Contributed by Arun Suresh. 
(cherry picked from commit 56f3eecc129486d3297d082d9b97f26b40d0a2c6)
 2014-11-25 15:12:09 -08:00
Jian He
80e9be2d95 MAPREDUCE-5568. Fixed CompletedJob in JHS to show progress percentage correctly in case the number of mappers or reducers is zero. Contributed by MinJi Kim 
(cherry picked from commit 78f7cdbfd6e2b9fac51c369c748ae93d12ef065a)
 2014-11-25 13:03:40 -08:00
Jian He
2863056530 YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit 5805a81efbc024024d8172489dfdc6cf77879416)
 2014-11-25 12:51:03 -08:00
yliu
4b62d6d2fd HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) 2014-11-25 01:12:31 +08:00
Haohui Mai
57a76f71bd HDFS-7303. NN UI fails to distinguish datanodes on the same host. Contributed by Benoy Antony. 2014-11-24 17:46:46 -08:00
Haohui Mai
9d462fb60c HDFS-7436. Consolidate implementation of concat(). Contributed by Haohui Mai. 2014-11-24 15:42:54 -08:00
Zhijie Shen
57d62d4ded YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang. 
(cherry picked from commit e37a4ff0c1712a1cb80e0412ec53a5d10b8d30f9)
 2014-11-24 15:06:44 -08:00
Jason Lowe
89ef49fb08 YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena 
(cherry picked from commit 1ce4d33c2dc86d711b227a04d2f9a2ab696a24a1)
 2014-11-24 22:38:09 +00:00
Colin Patrick Mccabe
69df08aada CHANGES.txt: add HDFS-7419 2014-11-24 11:50:23 -08:00
Colin Patrick Mccabe
640fd43075 CHANGES.txt: add HDFS-4882 2014-11-24 11:43:47 -08:00
Haohui Mai
9db888b896 HDFS-7412. Move RetryCache to NameNodeRpcServer. Contributed by Haohui Mai. 2014-11-24 11:11:35 -08:00
Colin Patrick Mccabe
4435ac9af5 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe) 
(cherry picked from commit f636f9d9439742d7ebaaf21f7e22652403572c61)
 2014-11-24 10:58:05 -08:00
Colin Patrick Mccabe
946df98dce HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi Prakash via Colin P. McCabe) 
(cherry picked from commit daacbc18d739d030822df0b75205eeb067f89850)
 2014-11-24 10:55:34 -08:00
yliu
7df0c4722d HDFS-7403. Inaccurate javadoc of BlockUCState#COMPLETE state. (Yongjun Zhang via yliu) 2014-11-24 04:34:13 +08:00
cnauroth
8d8eb8dcec HDFS-7425. NameNode block deletion logging uses incorrect appender. Contributed by Chris Nauroth. 
(cherry picked from commit b8c094b0754099f13d668081b4afcf0644e325c3)
 2014-11-21 16:56:17 -08:00
Aaron T. Myers
3de3640e4c HDFS-7331. Add Datanode network counts to datanode jmx page. Contributed by Charles Lamb. 
(cherry picked from commit ffa8c1a1b437cf0dc6d98a9b29161d12919e5afa)
 2014-11-21 16:34:41 -08:00
Sandy Ryza
3e2e8eac22 YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) 2014-11-21 16:08:22 -08:00
Karthik Kambatla
e0df934ed1 Update release date for 2.5.2 
(cherry picked from commit 1e9a3f42ff49be788ac99e5f06a7984d1d0638cc)
 2014-11-21 14:34:47 -08:00
Karthik Kambatla
af0b54a4ee YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha) 
(cherry picked from commit 233b61e495e136a843dabb7315bbb9ea37e7adce)
 2014-11-21 14:22:53 -08:00
Haohui Mai
b395f58e85 HDFS-7420. Delegate permission checks to FSDirectory. Contributed by Haohui Mai. 2014-11-21 11:01:34 -08:00
Karthik Kambatla
e9db0aa35c YARN-2604. Scheduler should consider max-allocation-* in conjunction with the largest node. (Robert Kanter via kasha) 
(cherry picked from commit 3114d4731dcca7cb6c16aaa7c7a6550b7dd7dccb)
 2014-11-21 10:42:47 -08:00
Jonathan Eagles
6570f7fd72 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles) 
(cherry picked from commit c298a9a845f89317eb9efad332e6657c56736a4d)
 2014-11-20 23:40:26 -06:00
Haohui Mai
2a5ae0ce1f HDFS-7415. Addendum patch to update CHANGES.txt for HDFS-7415. 2014-11-20 19:22:37 -08:00
Haohui Mai
7f8d5dc802 HDFS-7415. Move FSNameSystem.resolvePath() to FSDirectory. Contributed by Haohui Mai. 2014-11-20 19:21:35 -08:00
Karthik Kambatla
3a4211ec2c MAPREDUCE-6169. MergeQueue should release reference to the current item from key and value at the end of the iteration to save memory. (Zhihai Xu via kasha) 
(cherry picked from commit 90194ca1cbd695d48c3705121c2ac9a8554578a2)
 2014-11-20 15:37:18 -08:00
Andrew Wang
85bdc3a013 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit eb4045e7652be6ceaf9dfd33e9139d67774b99ab)
 2014-11-20 11:05:50 -08:00
Haohui Mai
4b99bde929 HDFS-7413. Some unit tests should use NameNodeProtocols instead of FSNameSystem. Contributed by Haohui Mai. 2014-11-20 10:28:03 -08:00
Karthik Kambatla
7ba5bb0c5b YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha) 
(cherry picked from commit a9a0cc3679432774154a07d3157ffa0a43e0bf01)
 2014-11-19 20:19:54 -08:00
Karthik Kambatla
564deb75a8 YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha) 
(cherry picked from commit f9f8e750edbe6db453f0a845e2ed49ede66e0e8a)
 2014-11-19 19:50:35 -08:00
Jian He
db31ef7e7f YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks 
(cherry picked from commit 9cb8b75ba57f18639492bfa3b7e7c11c00bb3d3b)
 2014-11-19 19:49:44 -08:00
Andrew Wang
988682ac29 HDFS-7409. Allow dead nodes to finish decommissioning if all files are fully replicated. 
(cherry picked from commit 765aecb4e127ebaf6c7b060a8b5cd40c6428e296)
 2014-11-19 17:53:25 -08:00
Jian He
c359e2a6a4 YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. Contributed by Abin Shahab 
(cherry picked from commit bc4ee5e06f89b2037e0967f8ba91089ced4b7f0e)
 2014-11-19 14:45:01 -08:00