Commit Graph

8014 Commits

Author SHA1 Message Date
Jian He d208c90148 YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe
(cherry picked from commit a7fba0bc28)
2014-12-01 16:45:17 -08:00
Jason Lowe b6d7b789bd MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol interface implementation. Contributed by Rohith
(cherry picked from commit 0c588904f8)
2014-12-01 22:40:38 +00:00
Jason Lowe 38ea1419f6 YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena
(cherry picked from commit 0f9528b99a)
2014-12-01 22:30:20 +00:00
Jason Lowe 2bdef5697b MAPREDUCE-6172. TestDbClasses timeouts are too aggressive. Contributed by Varun Saxena
(cherry picked from commit 2b30fb1053)
2014-12-01 21:52:51 +00:00
Colin Patrick Mccabe f6d1bf5ed1 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
(cherry picked from commit 86e3993def)
2014-12-01 11:48:53 -08:00
Junping Du c7bd22974a YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith)
(cherry picked from commit c732ed760e)
2014-12-01 05:41:56 -08:00
Uma Maheswara Rao G f4ab306347 HDFS-7210. Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient. (Vinayakumar B via umamahesh)
(cherry picked from commit 1556f86a31)
2014-11-28 21:13:17 +05:30
Colin Patrick Mccabe 8f98225418 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 2014-11-26 13:42:07 -08:00
Zhijie Shen a9adc1295c YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ.
(cherry picked from commit 8f1454cc6d)
2014-11-26 12:12:42 -08:00
Haohui Mai ae04ce29e5 HDFS-7444. convertToBlockUnderConstruction should preserve BlockCollection. Contributed by Haohui Mai. 2014-11-26 10:37:54 -08:00
Uma Maheswara Rao G 6545342a6d HDFS-7310. Mover can give first priority to local DN if it has target storage type available in local DN. (Vinayakumar B via umamahesh)
(cherry picked from commit 058af60c56)
2014-11-26 23:34:21 +05:30
Steve Loughran 6a01497d7c HDFS-6803 Document DFSClient#DFSInputStream expectations reading and preading in concurrent context. (stack via stevel) 2014-11-26 11:43:46 +00:00
Haohui Mai 0c8a8ba86e HDFS-7440. Update CHANGES.txt for HDFS-7440. 2014-11-25 21:05:21 -08:00
Haohui Mai 3e011f1ec2 HDFS-7440. Consolidate snapshot related operations in a single class. Contributed by Haohui Mai. 2014-11-25 21:03:57 -08:00
Karthik Kambatla 3d4536af82 YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
(cherry picked from commit 834b3b98e7ecc4bfe93c7dd1a9e928e9653cf138)
2014-11-25 16:22:14 -08:00
Jian He ae35b0e14d YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe
(cherry picked from commit 8a7ca13b13)
2014-11-25 16:18:02 -08:00
Andrew Wang 8018d1af58 HADOOP-11173. Improve error messages for some KeyShell commands.
(cherry picked from commit fae266bbf1)
2014-11-25 16:13:37 -08:00
Andrew Wang 915176c4e7 HDFS-7097. Allow block reports to be processed during checkpointing on standby name node. (kihwal via wang)
(cherry picked from commit f43a20c529)
2014-11-25 15:37:21 -08:00
Andrew Wang aad16f8f5c HADOOP-11300. KMS startup scripts must not display the keystore / truststore passwords. Contributed by Arun Suresh.
(cherry picked from commit 56f3eecc12)
2014-11-25 15:12:09 -08:00
Jian He 80e9be2d95 MAPREDUCE-5568. Fixed CompletedJob in JHS to show progress percentage correctly in case the number of mappers or reducers is zero. Contributed by MinJi Kim
(cherry picked from commit 78f7cdbfd6)
2014-11-25 13:03:40 -08:00
Jian He 2863056530 YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA
(cherry picked from commit 5805a81efb)
2014-11-25 12:51:03 -08:00
yliu 4b62d6d2fd HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) 2014-11-25 01:12:31 +08:00
Haohui Mai 57a76f71bd HDFS-7303. NN UI fails to distinguish datanodes on the same host. Contributed by Benoy Antony. 2014-11-24 17:46:46 -08:00
Haohui Mai 9d462fb60c HDFS-7436. Consolidate implementation of concat(). Contributed by Haohui Mai. 2014-11-24 15:42:54 -08:00
Zhijie Shen 57d62d4ded YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang.
(cherry picked from commit e37a4ff0c1)
2014-11-24 15:06:44 -08:00
Jason Lowe 89ef49fb08 YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena
(cherry picked from commit 1ce4d33c2d)
2014-11-24 22:38:09 +00:00
Colin Patrick Mccabe 69df08aada CHANGES.txt: add HDFS-7419 2014-11-24 11:50:23 -08:00
Colin Patrick Mccabe 640fd43075 CHANGES.txt: add HDFS-4882 2014-11-24 11:43:47 -08:00
Haohui Mai 9db888b896 HDFS-7412. Move RetryCache to NameNodeRpcServer. Contributed by Haohui Mai. 2014-11-24 11:11:35 -08:00
Colin Patrick Mccabe 4435ac9af5 HDFS-7419. Improve error messages for DataNode hot swap drive feature (Lei Xu via Colin P. Mccabe)
(cherry picked from commit f636f9d943)
2014-11-24 10:58:05 -08:00
Colin Patrick Mccabe 946df98dce HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi Prakash via Colin P. McCabe)
(cherry picked from commit daacbc18d7)
2014-11-24 10:55:34 -08:00
yliu 7df0c4722d HDFS-7403. Inaccurate javadoc of BlockUCState#COMPLETE state. (Yongjun Zhang via yliu) 2014-11-24 04:34:13 +08:00
cnauroth 8d8eb8dcec HDFS-7425. NameNode block deletion logging uses incorrect appender. Contributed by Chris Nauroth.
(cherry picked from commit b8c094b075)
2014-11-21 16:56:17 -08:00
Aaron T. Myers 3de3640e4c HDFS-7331. Add Datanode network counts to datanode jmx page. Contributed by Charles Lamb.
(cherry picked from commit ffa8c1a1b437cf0dc6d98a9b29161d12919e5afa)
2014-11-21 16:34:41 -08:00
Sandy Ryza 3e2e8eac22 YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza) 2014-11-21 16:08:22 -08:00
Karthik Kambatla e0df934ed1 Update release date for 2.5.2
(cherry picked from commit 1e9a3f42ff)
2014-11-21 14:34:47 -08:00
Karthik Kambatla af0b54a4ee YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha)
(cherry picked from commit 233b61e495)
2014-11-21 14:22:53 -08:00
Haohui Mai b395f58e85 HDFS-7420. Delegate permission checks to FSDirectory. Contributed by Haohui Mai. 2014-11-21 11:01:34 -08:00
Karthik Kambatla e9db0aa35c YARN-2604. Scheduler should consider max-allocation-* in conjunction with the largest node. (Robert Kanter via kasha)
(cherry picked from commit 3114d4731d)
2014-11-21 10:42:47 -08:00
Jonathan Eagles 6570f7fd72 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles)
(cherry picked from commit c298a9a845)
2014-11-20 23:40:26 -06:00
Haohui Mai 2a5ae0ce1f HDFS-7415. Addendum patch to update CHANGES.txt for HDFS-7415. 2014-11-20 19:22:37 -08:00
Haohui Mai 7f8d5dc802 HDFS-7415. Move FSNameSystem.resolvePath() to FSDirectory. Contributed by Haohui Mai. 2014-11-20 19:21:35 -08:00
Karthik Kambatla 3a4211ec2c MAPREDUCE-6169. MergeQueue should release reference to the current item from key and value at the end of the iteration to save memory. (Zhihai Xu via kasha)
(cherry picked from commit 90194ca1cb)
2014-11-20 15:37:18 -08:00
Andrew Wang 85bdc3a013 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg.
(cherry picked from commit eb4045e765)
2014-11-20 11:05:50 -08:00
Haohui Mai 4b99bde929 HDFS-7413. Some unit tests should use NameNodeProtocols instead of FSNameSystem. Contributed by Haohui Mai. 2014-11-20 10:28:03 -08:00
Karthik Kambatla 7ba5bb0c5b YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha)
(cherry picked from commit a9a0cc3679)
2014-11-19 20:19:54 -08:00
Karthik Kambatla 564deb75a8 YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha)
(cherry picked from commit f9f8e750edbe6db453f0a845e2ed49ede66e0e8a)
2014-11-19 19:50:35 -08:00
Jian He db31ef7e7f YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks
(cherry picked from commit 9cb8b75ba5)
2014-11-19 19:49:44 -08:00
Andrew Wang 988682ac29 HDFS-7409. Allow dead nodes to finish decommissioning if all files are fully replicated.
(cherry picked from commit 765aecb4e1)
2014-11-19 17:53:25 -08:00
Jian He c359e2a6a4 YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. Contributed by Abin Shahab
(cherry picked from commit bc4ee5e06f)
2014-11-19 14:45:01 -08:00