Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,915 Commits 326 Branches 371 Tags
Commit Graph

9915 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
2596695654 HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 53bad4eb008ec553dcdbe01e7ae975dcecde6590)
 2015-09-14 15:52:39 -07:00
Steve Loughran
c951d56556 HDFS-9069. TestNameNodeMetricsLogger failing -port in use. (stevel) 2015-09-14 10:36:34 +01:00
Jian He
b705d9d0ac YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt 
(cherry picked from commit e1b1d7e4aebfed0dec4d7df21561ab37f73ef1d7)
 2015-09-14 14:15:04 +08:00
Karthik Kambatla
1f9f219062 YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha) 
(cherry picked from commit 332b520a480994b7bd56c135f7941aad30b05e9c)
 2015-09-13 18:08:03 -07:00
Karthik Kambatla
11e2fa151c YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha) 
(cherry picked from commit 81df7b586a16f8226c7b01c139c1c70c060399c3)
 2015-09-13 17:06:04 -07:00
Steve Loughran
988749e6ea HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:06 +01:00
Haohui Mai
323821b174 HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-12 11:02:27 -07:00
Steve Loughran
c8fe31e03a HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:55:42 +01:00
Steve Loughran
c4128165b5 syncing branch-2 and trunk CHANGES.TXT to be closer together 2015-09-12 18:52:04 +01:00
Vinayakumar B
7545488b12 HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina) 
(cherry picked from commit c7156503856e24faf844c5c647157b310d8b537f)
 2015-09-12 17:40:41 +05:30
Vinayakumar B
1857621671 HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina) 
(cherry picked from commit d8455479b83e369fe9b5fe305c7beece93722fed)
 2015-09-12 12:36:37 +05:30
Robert Kanter
764f8baa99 HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:21:22 -07:00
Kihwal Lee
50a367da20 Fix up CHANGES.txt 2015-09-11 16:02:05 -05:00
Robert Kanter
43f051a09a YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter) 
(cherry picked from commit ea4bb2749f966a5eaf712d1dbb2c845df0f5ca67)
 2015-09-11 11:46:35 -07:00
Robert Kanter
d07eef8c87 YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter) 
(cherry picked from commit b84fb41bb6ca2d69153cf5bd61f88492538ee713)
 2015-09-11 11:46:35 -07:00
Arpit Agarwal
d732c7b9de HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu) 2015-09-11 10:12:02 -07:00
Steve Loughran
4073539118 HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel) 2015-09-11 15:55:14 +01:00
Varun Vasudev
a4288f1262 YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt. 
(cherry picked from commit 486d5cb803efec7b4db445ee65a3df83392940a3)
 2015-09-11 14:39:01 +05:30
Vinod Kumar Vavilapalli
d5823452b9 HDFS-7314. Moving to 2.6.1 CHANGES.txt section. 
(cherry picked from commit f103a70af5c5b01931b5cd2e5782eac5aeeb31cd)
 2015-09-10 16:47:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
2b447a38ab Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1. Contd..
 2015-09-10 14:07:55 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
cbf90f93f9 Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.

(cherry picked from commit fbbb7ff1ed111884d0375c177239073153139848)
 2015-09-10 14:01:15 -07:00
Wangda Tan
5decd8f9f7 YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) 
(cherry picked from commit 77666105b4557d5706e5844a4ca286917d966c5f)
 2015-09-10 09:30:34 -07:00
Jason Lowe
7909462c3a MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla 
(cherry picked from commit 8e615588d5216394d0251a9c97bd706537856c6d)
 2015-09-10 16:01:27 +00:00
Kihwal Lee
633344aa57 HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee 
(cherry picked from commit a40342b0dab1f9137ae4b3679a5aca7f2a57d23d)
 2015-09-10 09:18:10 -05:00
Akira Ajisaka
c260a8aa93 HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki. 2015-09-10 16:50:57 +09:00
Robert Kanter
b539bb41bb removing accidental file in MAPREDUCE-6415 2015-09-09 18:17:15 -07:00
Robert Kanter
ea64a9b277 YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter) 
(cherry picked from commit 6dd6ca442aba8612c3780399a42bb473e4483021)
 2015-09-09 18:03:47 -07:00
Karthik Kambatla
999aa22509 MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha) 2015-09-09 17:49:23 -07:00
Vinayakumar B
cd256c1fda HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990bff9b0ecb3d38a633d40eaf6cf07a7)
 2015-09-10 00:09:27 +05:30
Vinayakumar B
03f50de48d HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R) 
(cherry picked from commit 0f0e897bf1ff8383f3f524ba83161969531b0772)
 2015-09-09 22:59:55 +05:30
Kihwal Lee
d003797098 HDFS-8716. Introduce a new config specifically for safe mode block count. Contributed by Chang Li. 
(cherry picked from commit 4d13335fc93780126bab35de92a640fa31b204d9)
 2015-09-09 11:10:02 -05:00
Akira Ajisaka
eb9e06f8e3 HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0113e4528deda7563b62a29745fbf209ab31b81a)
 2015-09-09 17:21:22 +09:00
Vinayakumar B
ddecd86818 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 
(cherry picked from commit 94cf7ab9d28a885181afeb2c181dfe857d158254)
 2015-09-09 11:06:06 +05:30
Colin Patrick Mccabe
b9bf1a9391 HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit a153b9601ad8628fdd608d8696310ca8c1f58ff0)
 2015-09-08 18:37:42 -07:00
Zhihai Xu
113f778303 HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong. 
(cherry picked from commit d9c1fab2ec2930a011b7cca4a393881d39b8f6ec)
 2015-09-08 13:09:23 -07:00
Zhihai Xu
214338bd68 YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe. 
(cherry picked from commit 16b9037dc1300b8bdbe54ba7cd47c53fe16e93d8)
 2015-09-08 12:33:29 -07:00
Xiaoyu Yao
b2465690a1 HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. 
(cherry picked from commit 970daaa5e44d3c09afd46d1c8e923a5096708c44)
 2015-09-08 09:58:29 -07:00
Vinayakumar B
a0594961de HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina) 
(cherry picked from commit 090d26652c04916a1ede4ca55e7f2ca4fc5f6249)
 2015-09-08 19:11:46 +05:30
Varun Vasudev
1c53cd2b0d YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki. 
(cherry picked from commit 435f935ba7d8abb1a35796b72d1de906ded80592)
 2015-09-08 12:39:39 +05:30
Jian He
f23be93dd1 YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil 
(cherry picked from commit 6f72f1e6003ab11679bebeb96f27f1f62b3b3e02)
 2015-09-08 11:24:07 +08:00
Xuan
a0b7ef15d0 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when 
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d8c117c1e909df414f20d9db56efe4b)
 2015-09-07 17:46:48 -07:00
Xuan
d983e55714 Modify the CHANGES.txt to move YARN-2019 Commit log from branch 2.8 to 
branch 2.7.2

(cherry picked from commit 6a5068970567817af78d6ec2dfe474b09533a8d2)
 2015-09-07 17:30:25 -07:00
Varun Vasudev
70575286b7 YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir. 
(cherry picked from commit 1dbd8e34a7d97c4d8586da79c980d8f2e0aad61d)
 2015-09-07 11:34:14 +05:30
Tsuyoshi Ozawa
8bf5362014 MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li. 
(cherry picked from commit 9b685773ec1031e90cc2b8aedb42670721757e22)
 2015-09-05 11:21:35 +09:00
Wangda Tan
9f97b86816 YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda) 
(cherry picked from commit bcc85e3bab78bcacd430eac23141774465b96ef9)
 2015-09-04 15:14:34 -07:00
Andrew Wang
355398e441 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. 
(cherry picked from commit e1feaf6db03451068c660a863926032b35a569f8)
 2015-09-04 13:48:42 -07:00
Haohui Mai
67bce1e827 HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-09-04 11:45:01 -07:00
Jing Zhao
21178f0b1b HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 
(cherry picked from commit 8928729c80af0a154524e06fb13ed9b191986a78)
 2015-09-04 11:42:53 -07:00
Haohui Mai
8f712dd2f0 HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-09-04 10:41:28 -07:00
Jason Lowe
6a5220cab3 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 
(cherry picked from commit 6eaca2e3634a88dc55689e8960352d6248c424d9)
 2015-09-04 15:31:37 +00:00