Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,285 Commits 326 Branches 371 Tags
Commit Graph

3184 Commits

Author SHA1 Message Date
Yongjun Zhang
9859fd006b HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang) 2015-09-18 07:29:51 -07:00
Haohui Mai
cadde8c1e5 HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu. 2015-09-17 14:17:30 -07:00
Haohui Mai
a343aa928a HDFS-7995. Implement chmod in the HDFS Web UI. Contributed by Ravi Prakash and Haohui Mai. 2015-09-16 11:50:45 -07:00
Steve Loughran
9a8d09dada HDFS-9073. Fix failures in TestLazyPersistLockedMemory testReleaseOnEviction(). (J.Andreina via stevel) 2015-09-16 10:11:59 +01:00
Steve Loughran
1f28703d93 HDFS-9072. Fix random failures in TestJMXGet. (J.Andreina via stevel) 2015-09-16 10:08:18 +01:00
Haohui Mai
08c2c402cf HDFS-7986. Allow files / directories to be deleted from the NameNode UI. Contributed by Ravi Prakash. 2015-09-15 16:48:33 -07:00
cnauroth
b297a9c95c HDFS-9082. Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG. Contributed by Santhosh Nayak. 
(cherry picked from commit 559c09dc0eba28666c4b16435512cc2d35e31683)
 2015-09-15 15:13:56 -07:00
Vinayakumar B
2b78714c68 HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 
(cherry picked from commit ce69c9b54c642cfbe789fc661cfc7dcbb07b4ac5)
 2015-09-16 00:18:59 +05:30
Ming Ma
3531823fcc HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma) 
(cherry picked from commit 083b44c136ea5aba660fcd1dddbb2d21513b4456)
 2015-09-15 10:18:44 -07:00
Vinayakumar B
aa963ab441 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit a4405674919d14be89bc4da22db2f417b5ae6ac3)
 2015-09-15 17:33:15 +05:30
Haohui Mai
df9bb7449c HDFS-9065. Include commas on # of files, blocks, total filesystem objects in NN Web UI. Contributed by Daniel Templeton. 2015-09-14 20:27:24 -07:00
Haohui Mai
5546df0020 HDFS-9010. Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key. Contributed by Mingliang Liu. 2015-09-14 18:23:10 -07:00
Colin Patrick Mccabe
149d731559 HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe) 
Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78
(cherry picked from commit 7b5cf5352efedc7d7ebdbb6b58f1b9a688812e75)
 2015-09-14 16:02:26 -07:00
Colin Patrick Mccabe
2596695654 HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 53bad4eb008ec553dcdbe01e7ae975dcecde6590)
 2015-09-14 15:52:39 -07:00
Steve Loughran
c951d56556 HDFS-9069. TestNameNodeMetricsLogger failing -port in use. (stevel) 2015-09-14 10:36:34 +01:00
Haohui Mai
323821b174 HDFS-9041. Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client. Contributed by Mingliang Liu. 2015-09-12 11:02:27 -07:00
Vinayakumar B
7545488b12 HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina) 
(cherry picked from commit c7156503856e24faf844c5c647157b310d8b537f)
 2015-09-12 17:40:41 +05:30
Vinayakumar B
1857621671 HDFS-9042. Update document for the Storage policy name (Contributed by J.Andreina) 
(cherry picked from commit d8455479b83e369fe9b5fe305c7beece93722fed)
 2015-09-12 12:36:37 +05:30
Kihwal Lee
50a367da20 Fix up CHANGES.txt 2015-09-11 16:02:05 -05:00
Arpit Agarwal
d732c7b9de HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu) 2015-09-11 10:12:02 -07:00
Vinod Kumar Vavilapalli
d5823452b9 HDFS-7314. Moving to 2.6.1 CHANGES.txt section. 
(cherry picked from commit f103a70af5c5b01931b5cd2e5782eac5aeeb31cd)
 2015-09-10 16:47:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
cbf90f93f9 Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.

(cherry picked from commit fbbb7ff1ed111884d0375c177239073153139848)
 2015-09-10 14:01:15 -07:00
Kihwal Lee
633344aa57 HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee 
(cherry picked from commit a40342b0dab1f9137ae4b3679a5aca7f2a57d23d)
 2015-09-10 09:18:10 -05:00
Akira Ajisaka
c260a8aa93 HDFS-8974. Convert docs in xdoc format to markdown. Contributed by Masatake Iwasaki. 2015-09-10 16:50:57 +09:00
Vinayakumar B
cd256c1fda HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina) 
(cherry picked from commit 4014ce5990bff9b0ecb3d38a633d40eaf6cf07a7)
 2015-09-10 00:09:27 +05:30
Vinayakumar B
03f50de48d HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R) 
(cherry picked from commit 0f0e897bf1ff8383f3f524ba83161969531b0772)
 2015-09-09 22:59:55 +05:30
Kihwal Lee
d003797098 HDFS-8716. Introduce a new config specifically for safe mode block count. Contributed by Chang Li. 
(cherry picked from commit 4d13335fc93780126bab35de92a640fa31b204d9)
 2015-09-09 11:10:02 -05:00
Akira Ajisaka
eb9e06f8e3 HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0113e4528deda7563b62a29745fbf209ab31b81a)
 2015-09-09 17:21:22 +09:00
Vinayakumar B
ddecd86818 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 
(cherry picked from commit 94cf7ab9d28a885181afeb2c181dfe857d158254)
 2015-09-09 11:06:06 +05:30
Colin Patrick Mccabe
b9bf1a9391 HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe) 
(cherry picked from commit a153b9601ad8628fdd608d8696310ca8c1f58ff0)
 2015-09-08 18:37:42 -07:00
Xiaoyu Yao
b2465690a1 HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao. 
(cherry picked from commit 970daaa5e44d3c09afd46d1c8e923a5096708c44)
 2015-09-08 09:58:29 -07:00
Haohui Mai
67bce1e827 HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-09-04 11:45:01 -07:00
Jing Zhao
21178f0b1b HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 
(cherry picked from commit 8928729c80af0a154524e06fb13ed9b191986a78)
 2015-09-04 11:42:53 -07:00
Haohui Mai
8f712dd2f0 HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-09-04 10:41:28 -07:00
Andrew Wang
267bb22aaa HDFS-9021. Use a yellow elephant rather than a blue one in diagram. 
(cherry picked from commit c83d13c64993c3a7f0f35142cddac19e1074976e)
 2015-09-03 16:27:23 -07:00
Haohui Mai
d99018d6bc HDFS-9002. Move o.a.h.hdfs.net/*Peer classes to hdfs-client. Contributed by Mingliang Liu. 2015-09-03 15:33:22 -07:00
Jakob Homan
9871f57d41 HDFS-8939. Test(S)WebHdfsFileContextMainOperations failing on branch-2. Contributed by Chris Nauroth. 2015-09-03 13:25:53 -07:00
Colin Patrick Mccabe
9310745d22 HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 53c38cc89ab979ec47557dcfa7affbad20578c0a)
 2015-09-03 11:25:33 -07:00
Arpit Agarwal
e1842ce678 HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:53 -07:00
Tsuyoshi Ozawa
f4ee0bf19f HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. 
(cherry picked from commit 9a87f81ce6839d1b5ab3d663c1e82c7e572bdeb8)
 2015-09-03 22:34:40 +09:00
Akira Ajisaka
772fe0f478 HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar. 
(cherry picked from commit c92e31bd659e95c8baa0f3b2bf0cd7f6f72278e6)
 2015-09-03 19:41:36 +09:00
Ming Ma
f81d12668f HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) 
(cherry picked from commit d31a41c35927f02f2fb40d19380b5df4bb2b6d57)
 2015-09-02 15:57:55 -07:00
Jing Zhao
1d56325a80 HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee. 
(cherry picked from commit de928d566a119f0b7fa5f171719642cd86be0af7)
 2015-09-02 15:19:29 -07:00
Andrew Wang
e1943e4471 HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton. 
(cherry picked from commit afc88b396f06488c331564e0f6987013bb920d3e)
 2015-09-02 13:49:23 -07:00
Colin Patrick Mccabe
5e4bc2640d HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe) 
(cherry picked from commit c006c3a1e6d3631c5724e1eb0a0b620d9f7c8dcc)
 2015-09-02 12:47:00 -07:00
Akira Ajisaka
25efccba01 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 65ccf2b1252a5c83755fa24a93cf1d30ee59b2c3)
 2015-09-02 14:30:23 +09:00
yliu
0fb6b68101 HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 09:01:31 +08:00
Colin Patrick Mccabe
b52ae6140b HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe) 
(cherry picked from commit 24f6a7c9563757234f53ca23e12f9c9208b53082)
 2015-08-31 18:06:48 -07:00
yliu
d852ec1f77 HDFS-8946. Improve choosing datanode storage for block placement. (yliu) 2015-09-01 08:51:32 +08:00
Haohui Mai
94ab3b9e8f HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu. 2015-08-31 13:54:42 -07:00