Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,851 Commits 326 Branches 371 Tags
Commit Graph

9851 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
e1943e4471 HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton. 
(cherry picked from commit afc88b396f06488c331564e0f6987013bb920d3e)
 2015-09-02 13:49:23 -07:00
Colin Patrick Mccabe
5e4bc2640d HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe) 
(cherry picked from commit c006c3a1e6d3631c5724e1eb0a0b620d9f7c8dcc)
 2015-09-02 12:47:00 -07:00
Rohith Sharma K S
6e41aa64a5 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 7d6687fe76f6152a577ff2298c358dd30fce41fb)
 2015-09-02 15:27:33 +05:30
Rohith Sharma K S
7ecdf51441 YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 095ab9ab5fa5f415fba41fee81b6008cf0455af8)
 2015-09-02 14:28:50 +05:30
Akira Ajisaka
25efccba01 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 65ccf2b1252a5c83755fa24a93cf1d30ee59b2c3)
 2015-09-02 14:30:23 +09:00
Akira Ajisaka
a61c0f5ca1 Revert "MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula." 
This reverts commit 98446ee695f922ab079654bbc6d613ab334e371f.
 2015-09-02 12:26:25 +09:00
yliu
0fb6b68101 HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 09:01:31 +08:00
Vinod Kumar Vavilapalli
acb3000187 YARN-3222. Added the missing CHANGES.txt entry. 
(cherry picked from commit 4620767156ecc43424bc6c7c4d50519e2563cc69)
 2015-09-01 13:44:10 -07:00
Andrew Wang
7d833a3058 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder. 
(cherry picked from commit 0eb9b1932590ba6c60ac996d03269dffb4e095cc)
 2015-09-01 10:59:39 -07:00
Tsuyoshi Ozawa
b1499ab0fe HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun. 
(cherry picked from commit dd149adeace8727864371c5a1484c6534f8b450b)
 2015-09-02 02:02:10 +09:00
Akira Ajisaka
236c4ab511 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 2e251a767427a38ecb6c309ad979feecb29a09f4)
 2015-09-01 20:56:46 +09:00
Tsuyoshi Ozawa
d3d65f62b3 YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R. 
(cherry picked from commit faa38e1aa49907254bf981662a8aeb5dc52e75e3)
 2015-09-01 17:55:53 +09:00
Varun Vasudev
855e0f8b00 YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan. 
(cherry picked from commit bf669b6d9f8ba165e30b8823218d625a49958925)
 2015-09-01 14:20:54 +05:30
yliu
2345627ad3 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:25:11 +08:00
Andrew Wang
8dbe2a12bb HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. 
(cherry picked from commit 7ad3556ed38560585579172aa68356f37b2288c8)
 2015-08-31 18:19:12 -07:00
Colin Patrick Mccabe
b52ae6140b HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe) 
(cherry picked from commit 24f6a7c9563757234f53ca23e12f9c9208b53082)
 2015-08-31 18:06:48 -07:00
yliu
d852ec1f77 HDFS-8946. Improve choosing datanode storage for block placement. (yliu) 2015-09-01 08:51:32 +08:00
Jian He
21b478e1bf Move YARN-4092 to 2.7.2 
(cherry picked from commit 4eaa7fd3eae4412ac0b964c617b1bbb17a39d8be)
 2015-08-31 17:44:04 -07:00
Jian He
48f5161cd5 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 
(cherry picked from commit a3fd2ccc869dfc1f04d1cf0a8678d4d90a43a80f)
 2015-08-31 17:34:49 -07:00
Haohui Mai
94ab3b9e8f HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu. 2015-08-31 13:54:42 -07:00
Jing Zhao
f39c749f2a HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao. 
(cherry picked from commit caa04de149030691b7bc952b534c6128db217ed2)
 2015-08-31 11:48:32 -07:00
Vinod Kumar Vavilapalli
0191dae2ec YARN-2945. Fixing the CHANGES.txt to have the right JIRA number. 
(cherry picked from commit cf831565e8344523e1bd0eaf686ed56a2b48b920)
 2015-08-30 20:02:36 -07:00
Jakob Homan
94944ba4f6 HDFS-8155. Support OAuth2 in WebHDFS. 
(cherry picked from commit 837fb75e8e03b2f016bcea2f4605106a5022491c)
 2015-08-29 18:38:21 -07:00
Lei Xu
de42fce390 HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:58:57 -07:00
Arpit Agarwal
f1d5f1417e HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:57:53 -07:00
Haohui Mai
a3d0534558 HDFS-8925. Move BlockReaderLocal to hdfs-client. Contributed by Mingliang Liu. 2015-08-28 14:38:23 -07:00
Colin Patrick Mccabe
159969f658 HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list (Daniel Templeton) 
(cherry picked from commit b94b56806d3d6e04984e229b479f7ac15b62bbfa)
 2015-08-28 14:22:05 -07:00
Haohui Mai
dea531a3d5 HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu. 2015-08-28 14:13:59 -07:00
Zhihai Xu
297bda600e MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu 
(cherry picked from commit cbb249534aa72ff6c290c4f99766415aeea9d6f5)
 2015-08-28 12:20:49 -07:00
Kihwal Lee
5184779418 HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee. 
(cherry picked from commit b6ceee9bf42eec15891f60a014bbfa47e03f563c)
 2015-08-28 13:19:28 -05:00
Junping Du
792b9c0eaf YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang. 
(cherry picked from commit beb65c9465806114237aa271b07b31ff3c1f4404)
 2015-08-28 05:58:45 -07:00
yliu
5f9b323eb0 HDFS-8963. Fix incorrect sign extension of xattr length in HDFS-8900. (Colin Patrick McCabe via yliu) 2015-08-28 10:53:53 +08:00
Haohui Mai
07a19325c4 Revert "HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu." 
This reverts commit 0ae19f76f428264285073b151bf1e340a5d253ef.
 2015-08-27 16:09:51 -07:00
Haohui Mai
0ae19f76f4 HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu. 2015-08-27 15:49:26 -07:00
Jian He
306c535395 YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit a9c8ea71aa427ff5f25caec98be15bc880e578a7)
 2015-08-27 13:27:34 -07:00
Haohui Mai
1b01d163a2 HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer. 2015-08-27 13:03:29 -07:00
Andrew Wang
7a668981f5 HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin. 
(cherry picked from commit 90fe7bcc3b30f8497d7a5124c91c5aea28f2fccb)
 2015-08-27 10:17:04 -07:00
Haohui Mai
f4b2348503 HDFS-8961. Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager. Contributed by Mingliang Liu. 2015-08-27 09:13:37 -07:00
Haohui Mai
af1e2993c7 HDFS-8962. Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf. Contributed by Mingliang Liu. 2015-08-27 09:05:28 -07:00
Harsh J
574f3a98ce HDFS-2390. dfsadmin -setBalancerBandwidth does not validate -ve value. Contributed by Gautam Gopalakrishnan. 
(cherry picked from commit 0bf285413f8fcaadbb2d5817fe8090f5fb0d37d9)
 2015-08-27 16:23:22 +05:30
Vinayakumar B
d63122979f HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina) 
(cherry picked from commit fdb56f74f38cabb0f94e0781fcedb1594904c026)
 2015-08-27 13:07:35 +05:30
Haohui Mai
2f3faf39ef HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai. 2015-08-26 18:14:49 -07:00
Jing Zhao
10c4d6df61 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su. 
(cherry picked from commit f44b599003bb79b1ec9b92e7546546523ec01676)
 2015-08-26 16:28:38 -07:00
Haohui Mai
f0f6f1c7e9 HDFS-8951. Move the shortcircuit package to hdfs-client. Contributed by Mingliang Liu. 2015-08-26 14:22:33 -07:00
Colin Patrick Mccabe
9264b7e119 HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit a4d9acc51d1a977bc333da17780c00c72e8546f1)
 2015-08-25 14:30:15 -07:00
yliu
df5dbf317d HDFS-8900. Compact XAttrs to optimize memory footprint. (yliu) 2015-08-25 16:14:11 +08:00
Harsh J
e993498302 HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton. 
(cherry picked from commit af78767870b8296886c03f8be24cf13a4e2bd4b0)
 2015-08-25 11:22:08 +05:30
Jian He
387076894f YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit 57c7ae1affb2e1821fbdc3f47738d7e6fd83c7c1)
 2015-08-24 20:37:18 -07:00
Xiaoyu Yao
137bde0755 HDFS-8932. NPE thrown in NameNode when try to get TotalSyncCount metric before editLogStream initialization. Contributed by Surendra Singh Lilhore 
(cherry picked from commit 3b00eaea256d252be3361a7d9106b88756fcb9ba)
 2015-08-24 16:57:02 -07:00
Haohui Mai
ef8437a382 HDFS-8948. Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure. Contributed by Mingliang Liu. 2015-08-24 16:16:33 -07:00