Commit Graph

9965 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 2596695654 HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe)
(cherry picked from commit 53bad4eb00)
2015-09-14 15:52:39 -07:00
Steve Loughran c951d56556 HDFS-9069. TestNameNodeMetricsLogger failing -port in use. (stevel) 2015-09-14 10:36:34 +01:00
Jian He b705d9d0ac YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt
(cherry picked from commit e1b1d7e4ae)
2015-09-14 14:15:04 +08:00
Karthik Kambatla 1f9f219062 YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)
(cherry picked from commit 332b520a48)
2015-09-13 18:08:03 -07:00
Karthik Kambatla 11e2fa151c YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)
(cherry picked from commit 81df7b586a)
2015-09-13 17:06:04 -07:00
Steve Loughran 988749e6ea HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:06 +01:00
Haohui Mai 323821b174 HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-12 11:02:27 -07:00
Steve Loughran c8fe31e03a HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:55:42 +01:00
Steve Loughran c4128165b5 syncing branch-2 and trunk CHANGES.TXT to be closer together 2015-09-12 18:52:04 +01:00
Vinayakumar B 7545488b12 HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina)
(cherry picked from commit c715650385)
2015-09-12 17:40:41 +05:30
Vinayakumar B 1857621671 HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina)
(cherry picked from commit d8455479b8)
2015-09-12 12:36:37 +05:30
Robert Kanter 764f8baa99 HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:21:22 -07:00
Kihwal Lee 50a367da20 Fix up CHANGES.txt 2015-09-11 16:02:05 -05:00
Robert Kanter 43f051a09a YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)
(cherry picked from commit ea4bb2749f)
2015-09-11 11:46:35 -07:00
Robert Kanter d07eef8c87 YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter)
(cherry picked from commit b84fb41bb6)
2015-09-11 11:46:35 -07:00
Arpit Agarwal d732c7b9de HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu) 2015-09-11 10:12:02 -07:00
Steve Loughran 4073539118 HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel) 2015-09-11 15:55:14 +01:00
Varun Vasudev a4288f1262 YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt.
(cherry picked from commit 486d5cb803)
2015-09-11 14:39:01 +05:30
Vinod Kumar Vavilapalli d5823452b9 HDFS-7314. Moving to 2.6.1 CHANGES.txt section.
(cherry picked from commit f103a70af5)
2015-09-10 16:47:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 2b447a38ab Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1. Contd..
2015-09-10 14:07:55 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) cbf90f93f9 Updating all CHANGES.txt files to move entires from future releases into 2.6.1
section given the large number of backports to 2.6.1.

(cherry picked from commit fbbb7ff1ed)
2015-09-10 14:01:15 -07:00
Wangda Tan 5decd8f9f7 YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda)
(cherry picked from commit 77666105b4)
2015-09-10 09:30:34 -07:00
Jason Lowe 7909462c3a MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla
(cherry picked from commit 8e615588d5)
2015-09-10 16:01:27 +00:00
Kihwal Lee 633344aa57 HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee
(cherry picked from commit a40342b0da)
2015-09-10 09:18:10 -05:00
Akira Ajisaka c260a8aa93 HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki. 2015-09-10 16:50:57 +09:00
Robert Kanter b539bb41bb removing accidental file in MAPREDUCE-6415 2015-09-09 18:17:15 -07:00
Robert Kanter ea64a9b277 YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter)
(cherry picked from commit 6dd6ca442a)
2015-09-09 18:03:47 -07:00
Karthik Kambatla 999aa22509 MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha) 2015-09-09 17:49:23 -07:00
Vinayakumar B cd256c1fda HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina)
(cherry picked from commit 4014ce5990)
2015-09-10 00:09:27 +05:30
Vinayakumar B 03f50de48d HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R)
(cherry picked from commit 0f0e897bf1)
2015-09-09 22:59:55 +05:30
Kihwal Lee d003797098 HDFS-8716. Introduce a new config specifically for safe mode block count. Contributed by Chang Li.
(cherry picked from commit 4d13335fc9)
2015-09-09 11:10:02 -05:00
Akira Ajisaka eb9e06f8e3 HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0113e4528d)
2015-09-09 17:21:22 +09:00
Vinayakumar B ddecd86818 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore)
(cherry picked from commit 94cf7ab9d2)
2015-09-09 11:06:06 +05:30
Colin Patrick Mccabe b9bf1a9391 HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit a153b9601a)
2015-09-08 18:37:42 -07:00
Zhihai Xu 113f778303 HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong.
(cherry picked from commit d9c1fab2ec)
2015-09-08 13:09:23 -07:00
Zhihai Xu 214338bd68 YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.
(cherry picked from commit 16b9037dc1)
2015-09-08 12:33:29 -07:00
Xiaoyu Yao b2465690a1 HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao.
(cherry picked from commit 970daaa5e4)
2015-09-08 09:58:29 -07:00
Vinayakumar B a0594961de HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina)
(cherry picked from commit 090d26652c)
2015-09-08 19:11:46 +05:30
Varun Vasudev 1c53cd2b0d YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki.
(cherry picked from commit 435f935ba7)
2015-09-08 12:39:39 +05:30
Jian He f23be93dd1 YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil
(cherry picked from commit 6f72f1e600)
2015-09-08 11:24:07 +08:00
Xuan a0b7ef15d0 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d)
2015-09-07 17:46:48 -07:00
Xuan d983e55714 Modify the CHANGES.txt to move YARN-2019 Commit log from branch 2.8 to
branch 2.7.2

(cherry picked from commit 6a50689705)
2015-09-07 17:30:25 -07:00
Varun Vasudev 70575286b7 YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir.
(cherry picked from commit 1dbd8e34a7)
2015-09-07 11:34:14 +05:30
Tsuyoshi Ozawa 8bf5362014 MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li.
(cherry picked from commit 9b685773ec)
2015-09-05 11:21:35 +09:00
Wangda Tan 9f97b86816 YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)
(cherry picked from commit bcc85e3bab)
2015-09-04 15:14:34 -07:00
Andrew Wang 355398e441 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
(cherry picked from commit e1feaf6db0)
2015-09-04 13:48:42 -07:00
Haohui Mai 67bce1e827 HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-09-04 11:45:01 -07:00
Jing Zhao 21178f0b1b HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao.
(cherry picked from commit 8928729c80)
2015-09-04 11:42:53 -07:00
Haohui Mai 8f712dd2f0 HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-09-04 10:41:28 -07:00
Jason Lowe 6a5220cab3 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
(cherry picked from commit 6eaca2e363)
2015-09-04 15:31:37 +00:00