Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,894 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9894 Commits

Author SHA1 Message Date
Wangda Tan 5decd8f9f7 YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) 
(cherry picked from commit 77666105b4)
 2015-09-10 09:30:34 -07:00
Jason Lowe 7909462c3a MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla 
(cherry picked from commit 8e615588d5)
 2015-09-10 16:01:27 +00:00
Kihwal Lee 633344aa57 HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee 
(cherry picked from commit a40342b0da)
 2015-09-10 09:18:10 -05:00
Akira Ajisaka c260a8aa93 HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki. 2015-09-10 16:50:57 +09:00
Robert Kanter b539bb41bb removing accidental file in MAPREDUCE-6415 2015-09-09 18:17:15 -07:00
Robert Kanter ea64a9b277 YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter) 
(cherry picked from commit 6dd6ca442a)
 2015-09-09 18:03:47 -07:00
Karthik Kambatla 999aa22509 MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha) 2015-09-09 17:49:23 -07:00
Vinayakumar B cd256c1fda HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990)
 2015-09-10 00:09:27 +05:30
Vinayakumar B 03f50de48d HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R) 
(cherry picked from commit 0f0e897bf1)
 2015-09-09 22:59:55 +05:30
Kihwal Lee d003797098 HDFS-8716. Introduce a new config specifically for safe mode block count. Contributed by Chang Li. 
(cherry picked from commit 4d13335fc9)
 2015-09-09 11:10:02 -05:00
Akira Ajisaka eb9e06f8e3 HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0113e4528d)
 2015-09-09 17:21:22 +09:00
Vinayakumar B ddecd86818 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 
(cherry picked from commit 94cf7ab9d2)
 2015-09-09 11:06:06 +05:30
Colin Patrick Mccabe b9bf1a9391 HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit a153b9601a)
 2015-09-08 18:37:42 -07:00
Zhihai Xu 113f778303 HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong. 
(cherry picked from commit d9c1fab2ec)
 2015-09-08 13:09:23 -07:00
Zhihai Xu 214338bd68 YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe. 
(cherry picked from commit 16b9037dc1)
 2015-09-08 12:33:29 -07:00
Xiaoyu Yao b2465690a1 HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. 
(cherry picked from commit 970daaa5e4)
 2015-09-08 09:58:29 -07:00
Vinayakumar B a0594961de HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina) 
(cherry picked from commit 090d26652c)
 2015-09-08 19:11:46 +05:30
Varun Vasudev 1c53cd2b0d YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki. 
(cherry picked from commit 435f935ba7)
 2015-09-08 12:39:39 +05:30
Jian He f23be93dd1 YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil 
(cherry picked from commit 6f72f1e600)
 2015-09-08 11:24:07 +08:00
Xuan a0b7ef15d0 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when 
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d)
 2015-09-07 17:46:48 -07:00
Xuan d983e55714 Modify the CHANGES.txt to move YARN-2019 Commit log from branch 2.8 to 
branch 2.7.2

(cherry picked from commit 6a50689705)
 2015-09-07 17:30:25 -07:00
Varun Vasudev 70575286b7 YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir. 
(cherry picked from commit 1dbd8e34a7)
 2015-09-07 11:34:14 +05:30
Tsuyoshi Ozawa 8bf5362014 MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li. 
(cherry picked from commit 9b685773ec)
 2015-09-05 11:21:35 +09:00
Wangda Tan 9f97b86816 YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda) 
(cherry picked from commit bcc85e3bab)
 2015-09-04 15:14:34 -07:00
Andrew Wang 355398e441 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. 
(cherry picked from commit e1feaf6db0)
 2015-09-04 13:48:42 -07:00
Haohui Mai 67bce1e827 HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-09-04 11:45:01 -07:00
Jing Zhao 21178f0b1b HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 
(cherry picked from commit 8928729c80)
 2015-09-04 11:42:53 -07:00
Haohui Mai 8f712dd2f0 HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-09-04 10:41:28 -07:00
Jason Lowe 6a5220cab3 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 
(cherry picked from commit 6eaca2e363)
 2015-09-04 15:31:37 +00:00
Varun Vasudev 64c2e8011e YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles. 
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
 2015-09-04 14:32:07 +05:30
Andrew Wang 267bb22aaa HDFS-9021. Use a yellow elephant rather than a blue one in diagram. 
(cherry picked from commit c83d13c649)
 2015-09-03 16:27:23 -07:00
Haohui Mai d99018d6bc HDFS-9002. Move o.a.h.hdfs.net/*Peer classes to hdfs-client. Contributed by Mingliang Liu. 2015-09-03 15:33:22 -07:00
Jakob Homan 9871f57d41 HDFS-8939. Test(S)WebHdfsFileContextMainOperations failing on branch-2. Contributed by Chris Nauroth. 2015-09-03 13:25:53 -07:00
Colin Patrick Mccabe 9310745d22 HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 53c38cc89a)
 2015-09-03 11:25:33 -07:00
Arpit Agarwal e1842ce678 HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:53 -07:00
Tsuyoshi Ozawa 538a4ddc7e HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 
(cherry picked from commit 0ebc658105)
 2015-09-03 23:32:59 +09:00
Tsuyoshi Ozawa 7f1abf0b27 HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan. 
(cherry picked from commit 355eaaa33d)
 2015-09-03 22:49:12 +09:00
Tsuyoshi Ozawa f4ee0bf19f HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. 
(cherry picked from commit 9a87f81ce6)
 2015-09-03 22:34:40 +09:00
Varun Vasudev a53054c853 YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R. 
(cherry picked from commit 223a306da925ad031bc398f2ea5e56f0e6521edf)
 2015-09-03 16:40:42 +05:30
Akira Ajisaka 772fe0f478 HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar. 
(cherry picked from commit c92e31bd65)
 2015-09-03 19:41:36 +09:00
Jian He cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 09c64ba1ba)
 2015-09-02 17:46:04 -07:00
Ming Ma f81d12668f HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) 
(cherry picked from commit d31a41c359)
 2015-09-02 15:57:55 -07:00
Jing Zhao 1d56325a80 HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee. 
(cherry picked from commit de928d566a)
 2015-09-02 15:19:29 -07:00
Andrew Wang e1943e4471 HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton. 
(cherry picked from commit afc88b396f)
 2015-09-02 13:49:23 -07:00
Colin Patrick Mccabe 5e4bc2640d HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe) 
(cherry picked from commit c006c3a1e6)
 2015-09-02 12:47:00 -07:00
Rohith Sharma K S 6e41aa64a5 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 7d6687fe76)
 2015-09-02 15:27:33 +05:30
Rohith Sharma K S 7ecdf51441 YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 095ab9ab5f)
 2015-09-02 14:28:50 +05:30
Akira Ajisaka 25efccba01 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 65ccf2b125)
 2015-09-02 14:30:23 +09:00
Akira Ajisaka a61c0f5ca1 Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula." 
This reverts commit 98446ee695.
 2015-09-02 12:26:25 +09:00
yliu 0fb6b68101 HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 09:01:31 +08:00