Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,088 Commits 326 Branches 371 Tags
Commit Graph

10088 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yliu
2345627ad3 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:25:11 +08:00
Andrew Wang
8dbe2a12bb HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. 
(cherry picked from commit 7ad3556ed38560585579172aa68356f37b2288c8)
 2015-08-31 18:19:12 -07:00
Colin Patrick Mccabe
b52ae6140b HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe) 
(cherry picked from commit 24f6a7c9563757234f53ca23e12f9c9208b53082)
 2015-08-31 18:06:48 -07:00
yliu
d852ec1f77 HDFS-8946. Improve choosing datanode storage for block placement. (yliu) 2015-09-01 08:51:32 +08:00
Jian He
21b478e1bf Move YARN-4092 to 2.7.2 
(cherry picked from commit 4eaa7fd3eae4412ac0b964c617b1bbb17a39d8be)
 2015-08-31 17:44:04 -07:00
Jian He
48f5161cd5 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 
(cherry picked from commit a3fd2ccc869dfc1f04d1cf0a8678d4d90a43a80f)
 2015-08-31 17:34:49 -07:00
Haohui Mai
94ab3b9e8f HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu. 2015-08-31 13:54:42 -07:00
Jing Zhao
f39c749f2a HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao. 
(cherry picked from commit caa04de149030691b7bc952b534c6128db217ed2)
 2015-08-31 11:48:32 -07:00
Vinod Kumar Vavilapalli
0191dae2ec YARN-2945. Fixing the CHANGES.txt to have the right JIRA number. 
(cherry picked from commit cf831565e8344523e1bd0eaf686ed56a2b48b920)
 2015-08-30 20:02:36 -07:00
Jakob Homan
94944ba4f6 HDFS-8155. Support OAuth2 in WebHDFS. 
(cherry picked from commit 837fb75e8e03b2f016bcea2f4605106a5022491c)
 2015-08-29 18:38:21 -07:00
Lei Xu
de42fce390 HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:58:57 -07:00
Arpit Agarwal
f1d5f1417e HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:57:53 -07:00
Haohui Mai
a3d0534558 HDFS-8925. Move BlockReaderLocal to hdfs-client. Contributed by Mingliang Liu. 2015-08-28 14:38:23 -07:00
Colin Patrick Mccabe
159969f658 HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list (Daniel Templeton) 
(cherry picked from commit b94b56806d3d6e04984e229b479f7ac15b62bbfa)
 2015-08-28 14:22:05 -07:00
Haohui Mai
dea531a3d5 HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu. 2015-08-28 14:13:59 -07:00
Zhihai Xu
297bda600e MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. Contributed by Zhihai Xu 
(cherry picked from commit cbb249534aa72ff6c290c4f99766415aeea9d6f5)
 2015-08-28 12:20:49 -07:00
Kihwal Lee
5184779418 HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee. 
(cherry picked from commit b6ceee9bf42eec15891f60a014bbfa47e03f563c)
 2015-08-28 13:19:28 -05:00
Junping Du
792b9c0eaf YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang. 
(cherry picked from commit beb65c9465806114237aa271b07b31ff3c1f4404)
 2015-08-28 05:58:45 -07:00
yliu
5f9b323eb0 HDFS-8963. Fix incorrect sign extension of xattr length in HDFS-8900. (Colin Patrick McCabe via yliu) 2015-08-28 10:53:53 +08:00
Haohui Mai
07a19325c4 Revert "HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu." 
This reverts commit 0ae19f76f428264285073b151bf1e340a5d253ef.
 2015-08-27 16:09:51 -07:00
Haohui Mai
0ae19f76f4 HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu. 2015-08-27 15:49:26 -07:00
Jian He
306c535395 YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit a9c8ea71aa427ff5f25caec98be15bc880e578a7)
 2015-08-27 13:27:34 -07:00
Haohui Mai
1b01d163a2 HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer. 2015-08-27 13:03:29 -07:00
Andrew Wang
7a668981f5 HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin. 
(cherry picked from commit 90fe7bcc3b30f8497d7a5124c91c5aea28f2fccb)
 2015-08-27 10:17:04 -07:00
Haohui Mai
f4b2348503 HDFS-8961. Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager. Contributed by Mingliang Liu. 2015-08-27 09:13:37 -07:00
Haohui Mai
af1e2993c7 HDFS-8962. Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf. Contributed by Mingliang Liu. 2015-08-27 09:05:28 -07:00
Harsh J
574f3a98ce HDFS-2390. dfsadmin -setBalancerBandwidth does not validate -ve value. Contributed by Gautam Gopalakrishnan. 
(cherry picked from commit 0bf285413f8fcaadbb2d5817fe8090f5fb0d37d9)
 2015-08-27 16:23:22 +05:30
Vinayakumar B
d63122979f HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina) 
(cherry picked from commit fdb56f74f38cabb0f94e0781fcedb1594904c026)
 2015-08-27 13:07:35 +05:30
Haohui Mai
2f3faf39ef HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai. 2015-08-26 18:14:49 -07:00
Jing Zhao
10c4d6df61 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su. 
(cherry picked from commit f44b599003bb79b1ec9b92e7546546523ec01676)
 2015-08-26 16:28:38 -07:00
Haohui Mai
f0f6f1c7e9 HDFS-8951. Move the shortcircuit package to hdfs-client. Contributed by Mingliang Liu. 2015-08-26 14:22:33 -07:00
Colin Patrick Mccabe
9264b7e119 HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit a4d9acc51d1a977bc333da17780c00c72e8546f1)
 2015-08-25 14:30:15 -07:00
yliu
df5dbf317d HDFS-8900. Compact XAttrs to optimize memory footprint. (yliu) 2015-08-25 16:14:11 +08:00
Harsh J
e993498302 HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton. 
(cherry picked from commit af78767870b8296886c03f8be24cf13a4e2bd4b0)
 2015-08-25 11:22:08 +05:30
Jian He
387076894f YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S 
(cherry picked from commit 57c7ae1affb2e1821fbdc3f47738d7e6fd83c7c1)
 2015-08-24 20:37:18 -07:00
Xiaoyu Yao
137bde0755 HDFS-8932. NPE thrown in NameNode when try to get TotalSyncCount metric before editLogStream initialization. Contributed by Surendra Singh Lilhore 
(cherry picked from commit 3b00eaea256d252be3361a7d9106b88756fcb9ba)
 2015-08-24 16:57:02 -07:00
Haohui Mai
ef8437a382 HDFS-8948. Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure. Contributed by Mingliang Liu. 2015-08-24 16:16:33 -07:00
Jing Zhao
eefc1c174b HDFS-8928. Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array. Contributed by Jing Zhao. 
(cherry picked from commit bdd79388f39f4f35af7decd5703eff587b0ddfb7)
 2015-08-24 15:55:58 -07:00
Xiaoyu Yao
7a0a31586a HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer 
(cherry picked from commit 48774d0a45d95557affbd6bbaf8035cc9575ef36)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-08-24 14:33:37 -07:00
Haohui Mai
95f8e93691 HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu. 2015-08-24 13:40:30 -07:00
Andrew Wang
a727c6db05 Revert "HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu." 
This reverts commit 8e4afa3a671583c95263218b85cf6bfbc1e43635.
 2015-08-24 11:51:46 -07:00
Colin Patrick Mccabe
87d0133703 HDFS-8930. Block report lease may leak if the 2nd full block report comes when NN is still in safemode (Colin P. McCabe via Jing Zhao) 
(cherry picked from commit b5ce87f84d9de0a5347ab38c0567a5a70d1fbfd7)
 2015-08-24 11:33:21 -07:00
Rohith Sharma K S
6dc732f2f7 YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks) 
(cherry picked from commit feaf0349949e831ce3f25814c1bbff52f17bfe8f)
 2015-08-24 11:30:46 +05:30
Akira Ajisaka
f7ee225052 HDFS-8942. Update hyperlink to rack awareness page in HDFS Architecture documentation. Contributed by Masatake Iwasaki. 
(cherry picked from commit bcaf83902aa4d1e3e2cd26442df0a253eae7f633)
 2015-08-24 13:53:22 +09:00
Xuan
85363ea4bd YARN-221. Addendum patch to compilation issue which is caused by missing 
AllContainerLogAggregationPolicy. Contributed by Xuan Gong

(cherry picked from commit b71c6006f579ac6f0755975a9b908b0062618b46)
 2015-08-23 16:50:02 -07:00
Xuan
205b98c059 YARN-221. NM should provide a way for AM to tell it not to aggregate 
logs. Contributed by Ming Ma

(cherry picked from commit 37e1c3d82a96d781e1c9982988b7de4aa5242d0c)
 2015-08-22 16:26:39 -07:00
Haohui Mai
8e4afa3a67 HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu. 2015-08-22 13:30:48 -07:00
Haohui Mai
8c205267c8 HDFS-8823. Move replication factor into individual blocks. Contributed by Haohui Mai. 2015-08-22 00:09:59 -07:00
Lei Xu
3a4d614f68 HDFS-8924. Add pluggable interface for reading replicas in DFSClient. (Colin Patrick McCabe via Lei Xu) 
(cherry picked from 7087e700e032dabc174ecc12b62c12e7d49b995f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java
 2015-08-21 17:17:19 -07:00
Xiaoyu Yao
a7e5a88b59 HADOOP-12347. Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives. Contributed by Xiaoyu Yao 
(cherry picked from commit caa636bf10d96ca2d4e151225fb46134ce99f9cf)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-08-21 16:41:34 -07:00