Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,876 Commits 326 Branches 371 Tags
Commit Graph

9876 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jian He
f23be93dd1 YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil 
(cherry picked from commit 6f72f1e6003ab11679bebeb96f27f1f62b3b3e02)
 2015-09-08 11:24:07 +08:00
Xuan
a0b7ef15d0 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when 
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d8c117c1e909df414f20d9db56efe4b)
 2015-09-07 17:46:48 -07:00
Xuan
d983e55714 Modify the CHANGES.txt to move YARN-2019 Commit log from branch 2.8 to 
branch 2.7.2

(cherry picked from commit 6a5068970567817af78d6ec2dfe474b09533a8d2)
 2015-09-07 17:30:25 -07:00
Varun Vasudev
70575286b7 YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir. 
(cherry picked from commit 1dbd8e34a7d97c4d8586da79c980d8f2e0aad61d)
 2015-09-07 11:34:14 +05:30
Tsuyoshi Ozawa
8bf5362014 MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li. 
(cherry picked from commit 9b685773ec1031e90cc2b8aedb42670721757e22)
 2015-09-05 11:21:35 +09:00
Wangda Tan
9f97b86816 YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda) 
(cherry picked from commit bcc85e3bab78bcacd430eac23141774465b96ef9)
 2015-09-04 15:14:34 -07:00
Andrew Wang
355398e441 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. 
(cherry picked from commit e1feaf6db03451068c660a863926032b35a569f8)
 2015-09-04 13:48:42 -07:00
Haohui Mai
67bce1e827 HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-09-04 11:45:01 -07:00
Jing Zhao
21178f0b1b HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 
(cherry picked from commit 8928729c80af0a154524e06fb13ed9b191986a78)
 2015-09-04 11:42:53 -07:00
Haohui Mai
8f712dd2f0 HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-09-04 10:41:28 -07:00
Jason Lowe
6a5220cab3 YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 
(cherry picked from commit 6eaca2e3634a88dc55689e8960352d6248c424d9)
 2015-09-04 15:31:37 +00:00
Varun Vasudev
64c2e8011e YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles. 
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
 2015-09-04 14:32:07 +05:30
Andrew Wang
267bb22aaa HDFS-9021. Use a yellow elephant rather than a blue one in diagram. 
(cherry picked from commit c83d13c64993c3a7f0f35142cddac19e1074976e)
 2015-09-03 16:27:23 -07:00
Haohui Mai
d99018d6bc HDFS-9002. Move o.a.h.hdfs.net/*Peer classes to hdfs-client. Contributed by Mingliang Liu. 2015-09-03 15:33:22 -07:00
Jakob Homan
9871f57d41 HDFS-8939. Test(S)WebHdfsFileContextMainOperations failing on branch-2. Contributed by Chris Nauroth. 2015-09-03 13:25:53 -07:00
Colin Patrick Mccabe
9310745d22 HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 53c38cc89ab979ec47557dcfa7affbad20578c0a)
 2015-09-03 11:25:33 -07:00
Arpit Agarwal
e1842ce678 HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:53 -07:00
Tsuyoshi Ozawa
538a4ddc7e HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 
(cherry picked from commit 0ebc658105336cfe3e1a248b411de60f1d380928)
 2015-09-03 23:32:59 +09:00
Tsuyoshi Ozawa
7f1abf0b27 HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan. 
(cherry picked from commit 355eaaa33d01f06e9efe960b8888fb925e03ffb9)
 2015-09-03 22:49:12 +09:00
Tsuyoshi Ozawa
f4ee0bf19f HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. 
(cherry picked from commit 9a87f81ce6839d1b5ab3d663c1e82c7e572bdeb8)
 2015-09-03 22:34:40 +09:00
Varun Vasudev
a53054c853 YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R. 
(cherry picked from commit 223a306da925ad031bc398f2ea5e56f0e6521edf)
 2015-09-03 16:40:42 +05:30
Akira Ajisaka
772fe0f478 HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar. 
(cherry picked from commit c92e31bd659e95c8baa0f3b2bf0cd7f6f72278e6)
 2015-09-03 19:41:36 +09:00
Jian He
cd82fa2f83 YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 09c64ba1ba8be7a2ac31f4e42efb8c99b682399f)
 2015-09-02 17:46:04 -07:00
Ming Ma
f81d12668f HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) 
(cherry picked from commit d31a41c35927f02f2fb40d19380b5df4bb2b6d57)
 2015-09-02 15:57:55 -07:00
Jing Zhao
1d56325a80 HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee. 
(cherry picked from commit de928d566a119f0b7fa5f171719642cd86be0af7)
 2015-09-02 15:19:29 -07:00
Andrew Wang
e1943e4471 HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton. 
(cherry picked from commit afc88b396f06488c331564e0f6987013bb920d3e)
 2015-09-02 13:49:23 -07:00
Colin Patrick Mccabe
5e4bc2640d HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe) 
(cherry picked from commit c006c3a1e6d3631c5724e1eb0a0b620d9f7c8dcc)
 2015-09-02 12:47:00 -07:00
Rohith Sharma K S
6e41aa64a5 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 7d6687fe76f6152a577ff2298c358dd30fce41fb)
 2015-09-02 15:27:33 +05:30
Rohith Sharma K S
7ecdf51441 YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 095ab9ab5fa5f415fba41fee81b6008cf0455af8)
 2015-09-02 14:28:50 +05:30
Akira Ajisaka
25efccba01 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 65ccf2b1252a5c83755fa24a93cf1d30ee59b2c3)
 2015-09-02 14:30:23 +09:00
Akira Ajisaka
a61c0f5ca1 Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula." 
This reverts commit 98446ee695f922ab079654bbc6d613ab334e371f.
 2015-09-02 12:26:25 +09:00
yliu
0fb6b68101 HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 09:01:31 +08:00
Vinod Kumar Vavilapalli
acb3000187 YARN-3222. Added the missing CHANGES.txt entry. 
(cherry picked from commit 4620767156ecc43424bc6c7c4d50519e2563cc69)
 2015-09-01 13:44:10 -07:00
Andrew Wang
7d833a3058 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder. 
(cherry picked from commit 0eb9b1932590ba6c60ac996d03269dffb4e095cc)
 2015-09-01 10:59:39 -07:00
Tsuyoshi Ozawa
b1499ab0fe HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun. 
(cherry picked from commit dd149adeace8727864371c5a1484c6534f8b450b)
 2015-09-02 02:02:10 +09:00
Akira Ajisaka
236c4ab511 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 2e251a767427a38ecb6c309ad979feecb29a09f4)
 2015-09-01 20:56:46 +09:00
Tsuyoshi Ozawa
d3d65f62b3 YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R. 
(cherry picked from commit faa38e1aa49907254bf981662a8aeb5dc52e75e3)
 2015-09-01 17:55:53 +09:00
Varun Vasudev
855e0f8b00 YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan. 
(cherry picked from commit bf669b6d9f8ba165e30b8823218d625a49958925)
 2015-09-01 14:20:54 +05:30
yliu
2345627ad3 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:25:11 +08:00
Andrew Wang
8dbe2a12bb HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. 
(cherry picked from commit 7ad3556ed38560585579172aa68356f37b2288c8)
 2015-08-31 18:19:12 -07:00
Colin Patrick Mccabe
b52ae6140b HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe) 
(cherry picked from commit 24f6a7c9563757234f53ca23e12f9c9208b53082)
 2015-08-31 18:06:48 -07:00
yliu
d852ec1f77 HDFS-8946. Improve choosing datanode storage for block placement. (yliu) 2015-09-01 08:51:32 +08:00
Jian He
21b478e1bf Move YARN-4092 to 2.7.2 
(cherry picked from commit 4eaa7fd3eae4412ac0b964c617b1bbb17a39d8be)
 2015-08-31 17:44:04 -07:00
Jian He
48f5161cd5 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 
(cherry picked from commit a3fd2ccc869dfc1f04d1cf0a8678d4d90a43a80f)
 2015-08-31 17:34:49 -07:00
Haohui Mai
94ab3b9e8f HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu. 2015-08-31 13:54:42 -07:00
Jing Zhao
f39c749f2a HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao. 
(cherry picked from commit caa04de149030691b7bc952b534c6128db217ed2)
 2015-08-31 11:48:32 -07:00
Vinod Kumar Vavilapalli
0191dae2ec YARN-2945. Fixing the CHANGES.txt to have the right JIRA number. 
(cherry picked from commit cf831565e8344523e1bd0eaf686ed56a2b48b920)
 2015-08-30 20:02:36 -07:00
Jakob Homan
94944ba4f6 HDFS-8155. Support OAuth2 in WebHDFS. 
(cherry picked from commit 837fb75e8e03b2f016bcea2f4605106a5022491c)
 2015-08-29 18:38:21 -07:00
Lei Xu
de42fce390 HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:58:57 -07:00
Arpit Agarwal
f1d5f1417e HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:57:53 -07:00