Commit Graph

3927 Commits

Author SHA1 Message Date
yliu 7b10ef0c3b HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu) 2015-02-06 06:31:03 +08:00
yliu 45ea53f938 HDFS-7698. Fix locking on HDFS read statistics and add a method for clearing them. (Colin P. McCabe via yliu) 2015-02-05 23:56:29 +08:00
yliu 03f7ed382b HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:45:06 +08:00
Haohui Mai c4980a2f34 HDFS-7270. Add congestion signaling capability to DataNode write protocol. Contributed by Haohui Mai. 2015-02-05 10:58:58 -08:00
Allen Wittenauer fb06c00837 HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-02-05 07:44:49 -08:00
Tsuyoshi Ozawa 20660b7a67 HDFS-7709. Fix findbug warnings in httpfs. Contributed by Rakesh R. 2015-02-05 19:57:07 +09:00
Allen Wittenauer 43d5caef5e HADOOP-11460. Deprecate shell vars (John Smith via aw) 2015-02-04 16:35:50 -08:00
Arpit Agarwal c6f20007eb HDFS-7733. NFS: readdir/readdirplus return null directory attribute on failure. (Contributed by Arpit Agarwal) 2015-02-04 16:25:31 -08:00
Colin Patrick Mccabe 40a415799b HDFS-7719. BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes. (Lei (Eddy) Xu via Colin P. McCabe) 2015-02-04 12:10:00 -08:00
Andrew Wang 9175105eea HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu. 2015-02-04 11:31:38 -08:00
Tsuyoshi Ozawa ba58da29f4 HADOOP-11546. Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheck. (ozawa) 2015-02-05 00:42:14 +09:00
Andrew Wang 3ae38ec7df HDFS-7712. Switch blockStateChangeLog to use slf4j. 2015-02-03 15:01:16 -08:00
Kihwal Lee 843806d03a HDFS-7707. Edit log corruption due to delayed block removal again. Contributed by Yongjun Zhang 2015-02-03 14:45:15 -06:00
Colin Patrick Mccabe 115428176e HDFS-7721. The HDFS BlockScanner may run fast during the first hour (cmccabe) 2015-02-03 11:05:31 -08:00
Haohui Mai 8cb473124c HDFS-6651. Deletion failure can leak inodes permanently. Contributed by Jing Zhao. 2015-02-02 16:32:38 -08:00
Tsz-Wo Nicholas Sze d085eb15d7 HDFS-7696. In FsDatasetImpl, the getBlockInputStream(..) and getTmpInputStreams(..) methods may leak file descriptors. 2015-02-02 13:38:36 -08:00
Tsz-Wo Nicholas Sze df01337b80 Move HDFS-5631, HDFS-5782 and HDFS-7681 to branch-2. 2015-02-02 13:34:12 -08:00
Colin Patrick Mccabe 09ad9a868a HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-01-30 16:01:59 -08:00
Andrew Wang 951b3608a8 HDFS-7706. Switch BlockManager logging to use slf4j. 2015-01-30 11:33:03 -08:00
Colin Patrick Mccabe e36ef3b402 HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe) 2015-01-29 15:43:57 -08:00
Kihwal Lee 89b07490f8 HDFS-7603. The background replication queue initialization may not let others run. Contributed by Kihwal Lee. 2015-01-29 12:36:22 -06:00
yliu f37849188b HDFS-7423. various typos and message formatting fixes in nfs daemon and doc. (Charles Lamb via yliu) 2015-01-29 04:56:04 +08:00
Tsz-Wo Nicholas Sze 5a0051f4da HDFS-7681. Change ReplicaInputStreams constructor to take InputStream(s) instead of FileDescriptor(s). Contributed by Joe Pallas 2015-01-28 16:00:47 -08:00
Jing Zhao d244574d03 HDFS-7611. deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. Contributed by Jing Zhao and Byron Wong. 2015-01-28 15:25:03 -08:00
Andrew Wang caf7298e49 HDFS-6673. Add delimited format support to PB OIV tool. Contributed by Eddy Xu. 2015-01-28 12:36:29 -08:00
Colin Patrick Mccabe d12dd47f45 HDFS-7675. Remove unused member DFSClient.spanReceiverHost (cmccabe) 2015-01-27 20:52:02 -08:00
yliu 9ca565e970 HDFS-7677. DistributedFileSystem#truncate should resolve symlinks. (yliu) 2015-01-27 23:50:11 +08:00
Allen Wittenauer 0a05ae1782 HDFS-7566. Remove obsolete entries from hdfs-default.xml (Ray Chiang via aw) 2015-01-27 14:31:27 -08:00
Jing Zhao 2848db814a HDFS-3689. Add support for variable length block. Contributed by Jing Zhao. 2015-01-27 12:58:10 -08:00
Haohui Mai 1e2d98a394 HDFS-7683. Combine usages and percent stats in NameNode UI. Contributed by Vinayakumar B. 2015-01-27 11:09:29 -08:00
Steve Loughran 0da53a37ec HDFS-49. MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found. (stevel) 2015-01-27 11:11:00 +00:00
Kihwal Lee 2b0fa20f69 HDFS-7224. Allow reuse of NN connections via webhdfs. Contributed by Eric Payne 2015-01-26 08:14:30 -06:00
Konstantin V Shvachko 370396509d HDFS-7676. Fix TestFileTruncate to avoid bug of HDFS-7611. Contributed by Konstantin Shvachko. 2015-01-24 18:03:11 -08:00
Konstantin V Shvachko 3ea353e7b9 Move truncate related messages in CHANGES.txt to branch 2 section. (shv) 2015-01-24 17:49:22 -08:00
yliu e9fd46ddbf HDFS-7659. truncate should check negative value of the new length. Contributed by Yi Liu. 2015-01-24 15:44:07 -08:00
Allen Wittenauer 8f26d5a8a1 HDFS-7320. The appearance of hadoop-hdfs-httpfs site docs is inconsistent (Masatake Iwasaki via aw) 2015-01-23 14:21:55 -08:00
Allen Wittenauer 6c3fec5ec2 HDFS-3750. API docs don't include HDFS (Jolly Chen via aw) 2015-01-23 14:10:44 -08:00
Allen Wittenauer 5c93ca2f3c HDFS-7644. minor typo in HttpFS doc (Charles Lamb via aw) 2015-01-23 13:46:31 -08:00
Allen Wittenauer d411460e0d HDFS-7667. Various typos and improvements to HDFS Federation doc (Charles Lamb via aw) 2015-01-23 13:37:52 -08:00
yliu 5f124efb3e HDFS-7660. BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly. (Lei Xu via yliu) 2015-01-23 02:37:44 +08:00
cnauroth d3268c4b10 HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. 2015-01-22 16:26:21 -08:00
Arpit Agarwal 792b7d337a HDFS-7575. Fix CHANGES.txt 2015-01-22 14:37:16 -08:00
Arpit Agarwal d34074e237 HDFS-7575. Upgrade should generate a unique storage ID for each volume. (Contributed by Arpit Agarwal) 2015-01-22 14:08:20 -08:00
Colin Patrick Mccabe 6e62a1a672 HDFS-7430. Refactor the BlockScanner to use O(1) memory and use multiple threads (cmccabe) 2015-01-21 19:00:53 -08:00
Konstantin V Shvachko a0521bc83a HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. 2015-01-21 16:00:49 -08:00
Kihwal Lee c0af72c7f7 HDFS-7548. Corrupt block reporting delayed until datablock scanner thread detects it. Contributed by Rushabh Shah. 2015-01-21 14:41:31 -06:00
Tsz-Wo Nicholas Sze db334bb862 HDFS-3443. Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer. Contributed by Vinayakumar B 2015-01-21 11:33:55 -08:00
Colin Patrick Mccabe 39c1bcf7d9 HADOOP-11484: move CHANGES.txt entry to 3.0 2015-01-21 11:32:31 -08:00
Colin Patrick Mccabe 220a49de47 HADOOP-11484. hadoop-mapreduce-client-nativetask fails to build on ARM AARCH64 due to x86 asm statements (Edward Nevill via Colin P. McCabe) 2015-01-21 11:24:09 -08:00
Arpit Agarwal 6b17eb9eac HDFS-7643. Test case to ensure lazy persist files cannot be truncated. (Contributed by Yi Liu) 2015-01-20 21:58:38 -08:00