Colin Patrick Mccabe
|
53c38cc89a
|
HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe)
|
2015-09-03 11:22:47 -07:00 |
Arpit Agarwal
|
524ba8708b
|
HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal)
|
2015-09-03 11:14:47 -07:00 |
Tsuyoshi Ozawa
|
9a87f81ce6
|
HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang.
|
2015-09-03 22:34:25 +09:00 |
Akira Ajisaka
|
c92e31bd65
|
HDFS-8885. ByteRangeInputStream used in webhdfs does not override available(). Contributed by Shradha Revankar.
|
2015-09-03 19:40:34 +09:00 |
Ming Ma
|
d31a41c359
|
HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma)
|
2015-09-02 15:55:42 -07:00 |
Jing Zhao
|
de928d566a
|
HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee.
|
2015-09-02 15:19:04 -07:00 |
Andrew Wang
|
afc88b396f
|
HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton.
|
2015-09-02 13:46:00 -07:00 |
|
Colin Patrick Mccabe
|
c006c3a1e6
|
HDFS-2070. Add more unit tests for FsShell getmerge (Daniel Templeton via Colin P. McCabe)
|
2015-09-02 12:36:14 -07:00 |
|
Akira Ajisaka
|
65ccf2b125
|
HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore.
|
2015-09-02 14:28:38 +09:00 |
yliu
|
5652131d2e
|
HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu)
|
2015-09-02 08:58:51 +08:00 |
|
Colin Patrick Mccabe
|
24f6a7c956
|
HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe)
|
2015-08-31 18:06:30 -07:00 |
|
yliu
|
8fa41d9dd4
|
HDFS-8946. Improve choosing datanode storage for block placement. (yliu)
|
2015-09-01 08:52:50 +08:00 |
Haohui Mai
|
826ae1c26d
|
HDFS-8990. Move RemoteBlockReader to hdfs-client module. Contributed by Mingliang Liu.
|
2015-08-31 13:54:14 -07:00 |
|
Jing Zhao
|
caa04de149
|
HDFS-8980. Remove unnecessary block replacement in INodeFile. Contributed by Jing Zhao.
|
2015-08-31 11:48:09 -07:00 |
Jakob Homan
|
837fb75e8e
|
HDFS-8155. Support OAuth2 in WebHDFS.
|
2015-08-29 18:37:05 -07:00 |
|
Arpit Agarwal
|
bdbe53c676
|
HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal)
|
2015-08-29 09:52:37 -07:00 |
|
Haohui Mai
|
e2c9b288b2
|
HDFS-8925. Move BlockReaderLocal to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-28 14:38:36 -07:00 |
|
Colin Patrick Mccabe
|
b94b56806d
|
HDFS-8950. NameNode refresh doesn't remove DataNodes that are no longer in the allowed list (Daniel Templeton)
|
2015-08-28 14:21:46 -07:00 |
|
Haohui Mai
|
6d12cd8d60
|
HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu.
|
2015-08-28 14:14:32 -07:00 |
Kihwal Lee
|
b6ceee9bf4
|
HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee.
|
2015-08-28 13:14:35 -05:00 |
|
yliu
|
e166c038c0
|
HDFS-8963. Fix incorrect sign extension of xattr length in HDFS-8900. (Colin Patrick McCabe via yliu)
|
2015-08-28 10:54:55 +08:00 |
|
Haohui Mai
|
035ed26147
|
Revert "HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu."
This reverts commit 4e9307f26d.
|
2015-08-27 16:09:35 -07:00 |
|
Haohui Mai
|
4e9307f26d
|
HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu.
|
2015-08-27 15:36:44 -07:00 |
|
Haohui Mai
|
f97a0f8c2c
|
HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer.
|
2015-08-27 13:03:16 -07:00 |
|
Haohui Mai
|
1e5f69e85c
|
HDFS-8961. Investigate lock issue in o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager. Contributed by Mingliang Liu.
|
2015-08-27 09:13:20 -07:00 |
|
Haohui Mai
|
7e971b7315
|
HDFS-8962. Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf. Contributed by Mingliang Liu.
|
2015-08-27 09:02:34 -07:00 |
Harsh J
|
0bf285413f
|
HDFS-2390. dfsadmin -setBalancerBandwidth does not validate -ve value. Contributed by Gautam Gopalakrishnan.
|
2015-08-27 16:22:48 +05:30 |
Vinayakumar B
|
fdb56f74f3
|
HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina)
|
2015-08-27 13:06:43 +05:30 |
|
Haohui Mai
|
4cbbfa2220
|
HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai.
|
2015-08-26 18:14:29 -07:00 |
|
Jing Zhao
|
f44b599003
|
HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su.
|
2015-08-26 16:27:34 -07:00 |
|
Haohui Mai
|
c992bcf9c1
|
HDFS-8951. Move the shortcircuit package to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-26 14:02:48 -07:00 |
|
Colin Patrick Mccabe
|
a4d9acc51d
|
HDFS-8846. Add a unit test for INotify functionality across a layout version upgrade (Zhe Zhang via Colin P. McCabe)
|
2015-08-25 14:29:53 -07:00 |
|
yliu
|
eee0d4563c
|
HDFS-8900. Compact XAttrs to optimize memory footprint. (yliu)
|
2015-08-25 16:16:09 +08:00 |
Xiaoyu Yao
|
3b00eaea25
|
HDFS-8932. NPE thrown in NameNode when try to get TotalSyncCount metric before editLogStream initialization. Contributed by Surendra Singh Lilhore
|
2015-08-24 16:56:24 -07:00 |
|
Haohui Mai
|
66d0c81d8f
|
HDFS-8948. Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure. Contributed by Mingliang Liu.
|
2015-08-24 16:18:15 -07:00 |
|
Jing Zhao
|
bdd79388f3
|
HDFS-8928. Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array. Contributed by Jing Zhao.
|
2015-08-24 15:53:34 -07:00 |
|
Colin Patrick Mccabe
|
b5ce87f84d
|
HDFS-8930. Block report lease may leak if the 2nd full block report comes when NN is still in safemode (Colin P. McCabe via Jing Zhao)
|
2015-08-24 11:31:56 -07:00 |
|
Akira Ajisaka
|
bcaf83902a
|
HDFS-8942. Update hyperlink to rack awareness page in HDFS Architecture documentation. Contributed by Masatake Iwasaki.
|
2015-08-24 13:52:49 +09:00 |
|
Haohui Mai
|
490bb5ebd6
|
HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-22 13:31:03 -07:00 |
|
Haohui Mai
|
745d04be59
|
HDFS-8823. Move replication factor into individual blocks. Contributed by Haohui Mai.
|
2015-08-22 00:09:40 -07:00 |
Lei Xu
|
7087e700e0
|
HDFS-8924. Add pluggable interface for reading replicas in DFSClient. (Colin Patrick McCabe via Lei Xu)
|
2015-08-21 17:02:00 -07:00 |
Chris Douglas
|
b0564c9f3c
|
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
Moved CHANGES.txt entry to 2.7.2
|
2015-08-20 20:39:06 -07:00 |
Vinod Kumar Vavilapalli
|
33474939a0
|
Creating 2.6.2 entries in CHANGES.txt files.
|
2015-08-20 17:21:06 -07:00 |
|
Jing Zhao
|
c8bca62718
|
HDFS-8809. HDFS fsck reports under construction blocks as CORRUPT. Contributed by Jing Zhao.
|
2015-08-20 16:31:24 -07:00 |
|
Colin Patrick Mccabe
|
7642f64c24
|
HDFS-8922. Link the native_mini_dfs test library with libdl, since IBM Java requires it (Ayappan via Colin P. McCabe)
|
2015-08-20 13:57:32 -07:00 |
Yongjun Zhang
|
0bc15cb6e6
|
HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp. (Yufei Gu via Yongjun Zhang)
|
2015-08-20 08:02:54 -07:00 |
|
yliu
|
5e8fe89437
|
HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu)
|
2015-08-20 20:15:03 +08:00 |
|
yliu
|
80a29906bc
|
HDFS-8884. Fail-fast check in BlockPlacementPolicyDefault#chooseTarget. (yliu)
|
2015-08-20 20:07:18 +08:00 |
|
Jing Zhao
|
4e14f7982a
|
HDFS-8917. Cleanup BlockInfoUnderConstruction from comments and tests. Contributed by Zhe Zhang.
|
2015-08-19 15:11:37 -07:00 |
|
Haohui Mai
|
3aac4758b0
|
HDFS-8803. Move DfsClientConf to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-19 11:28:05 -07:00 |
|
Jing Zhao
|
f61120d964
|
HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp.
|
2015-08-19 10:36:56 -07:00 |
|
Arpit Agarwal
|
9c3571ea60
|
HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer)
|
2015-08-19 09:42:35 -07:00 |
|
yliu
|
2da5aaab33
|
HDFS-8908. TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode. (Tsz Wo Nicholas Sze via yliu)
|
2015-08-19 21:55:43 +08:00 |
Tsz-Wo Nicholas Sze
|
7ecbfd44aa
|
HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes.
|
2015-08-18 19:25:50 -07:00 |
|
Chris Douglas
|
30e342a5d3
|
HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan
|
2015-08-18 17:32:48 -07:00 |
|
Akira Ajisaka
|
fc509f66d8
|
HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S.
|
2015-08-18 23:31:52 +09:00 |
|
yliu
|
71566e2382
|
HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu)
|
2015-08-18 09:23:06 +08:00 |
|
Tsz-Wo Nicholas Sze
|
51a00964da
|
HDFS-8278. When computing max-size-to-move in Balancer, count only the storage with remaining >= default block size.
|
2015-08-17 17:55:25 -07:00 |
|
Andrew Wang
|
eee4d716b4
|
HDFS-8895. Remove deprecated BlockStorageLocation APIs.
|
2015-08-17 17:40:37 -07:00 |
|
Arpit Agarwal
|
a88f31ebf3
|
HDFS-8880. NameNode metrics logging. (Arpit Agarwal)
|
2015-08-17 16:55:46 -07:00 |
|
Colin Patrick Mccabe
|
ec183faadc
|
HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe)
|
2015-08-17 15:25:29 -07:00 |
|
Colin Patrick Mccabe
|
c77bd6af16
|
HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe)
|
2015-08-17 12:00:45 -07:00 |
|
Haohui Mai
|
e535e0f05b
|
HDFS-8801. Convert BlockInfoUnderConstruction as a feature. Contributed by Jing Zhao.
|
2015-08-17 11:28:28 -07:00 |
|
Haohui Mai
|
456e901a4c
|
HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai.
|
2015-08-17 11:04:00 -07:00 |
|
Andrew Wang
|
2e7b7e2cda
|
HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging.
|
2015-08-17 10:17:06 -07:00 |
|
Xiaoyu Yao
|
a7862d5fe4
|
HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer.
|
2015-08-17 10:15:56 -07:00 |
|
Jing Zhao
|
dc7a061668
|
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
|
2015-08-14 14:42:43 -07:00 |
|
Tsz-Wo Nicholas Sze
|
2bc0a4f299
|
HDFS-8824. Do not use small blocks for balancing the cluster.
|
2015-08-14 13:03:19 -07:00 |
|
Xiaoyu Yao
|
1569228ec9
|
HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao)
|
2015-08-14 12:34:31 -07:00 |
|
Vinayakumar B
|
84bf71295a
|
HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina)
Moved to 2.6.1
|
2015-08-14 16:13:30 +05:30 |
|
Vinayakumar B
|
08bd4edf40
|
HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang)
Moved to 2.6.1
|
2015-08-14 12:38:00 +05:30 |
|
Vinayakumar B
|
fa2641143c
|
HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo.
Moved CHANGES.txt entry to 2.6.1
|
2015-08-14 11:45:43 +05:30 |
|
Vinayakumar B
|
f2b4bc9b6a
|
HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe)
Moved CHANGES.txt entry to 2.6.1
|
2015-08-14 11:37:39 +05:30 |
|
Vinayakumar B
|
d25cb8fe12
|
HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne.
Moved CHANGES.TXT entry to 2.6.1
|
2015-08-14 11:23:51 +05:30 |
|
Arpit Agarwal
|
ae57d60d82
|
HDFS-7649. Multihoming docs should emphasize using hostnames in configurations. (Contributed by Brahma Reddy Battula)
|
2015-08-13 14:26:40 -07:00 |
|
yliu
|
53bef9c5b9
|
HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu)
|
2015-08-13 16:45:20 +08:00 |
|
Akira Ajisaka
|
40f815131e
|
HDFS-8622. Implement GETCONTENTSUMMARY operation for WebImageViewer. Contributed by Jagadesh Kiran N.
|
2015-08-13 11:31:56 +09:00 |
cnauroth
|
6cc8e38db5
|
HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu.
|
2015-08-12 16:44:53 -07:00 |
|
Xiaoyu Yao
|
3e715a4f4c
|
HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao.
|
2015-08-12 15:20:54 -07:00 |
|
Andrew Wang
|
1ea1a8334e
|
HDFS-8887. Expose storage type and storage ID in BlockLocation.
|
2015-08-11 23:25:33 -07:00 |
|
Jing Zhao
|
1fc3c779a4
|
HDFS-8805. Archival Storage: getStoragePolicy should not need superuser privilege. Contributed by Brahma Reddy Battula.
|
2015-08-11 10:28:18 -07:00 |
|
Tsz-Wo Nicholas Sze
|
b56daff6a1
|
HDFS-8818. Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable.
|
2015-08-10 16:52:02 -07:00 |
|
Jakob Homan
|
8f73bdd06b
|
HDFS-8866. Typo in docs: Rumtime -> Runtime. Contributed by Gabor Liptak.
|
2015-08-07 11:38:31 -07:00 |
|
Andrew Wang
|
98a27d1101
|
HDFS-8772. Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails. Contributed by Walter Su.
|
2015-08-07 09:51:46 -07:00 |
|
Arpit Agarwal
|
6d4eee718a
|
HDFS-8856. Make LeaseManager#countPath O(1). (Contributed by Arpit Agarwal)
|
2015-08-06 18:51:28 -07:00 |
|
Jing Zhao
|
f4c523b69b
|
Revert "HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang."
This reverts commit c17439c2dd.
|
2015-08-06 10:21:55 -07:00 |
|
Jing Zhao
|
663eba0ab1
|
Revert "HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang."
This reverts commit de480d6c89.
|
2015-08-06 10:21:54 -07:00 |
|
Vinayakumar B
|
cc71ad80e1
|
HDFS-8815. DFS getStoragePolicy implementation using single RPC call (Contributed by Surendra Singh Lilhore)
|
2015-08-06 11:10:48 +05:30 |
|
Lei Xu
|
d5403747b5
|
HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu)
|
2015-08-04 18:51:52 -07:00 |
|
Colin Patrick Mccabe
|
c95993cbaf
|
HDFS-8844. TestHDFSCLI does not cleanup the test directory (Masatake Iwasaki via Colin P. McCabe)
|
2015-08-04 12:22:06 -07:00 |
|
yliu
|
9a08999906
|
HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks. (Colin Patrick McCabe via yliu)
|
2015-08-04 15:54:23 +08:00 |
Zhihai Xu
|
90b510405a
|
HDFS-8847. change TestHDFSContractAppend to not override testRenameFileBeingAppended method. Contributed by Zhihai Xu
|
2015-07-31 21:40:43 -07:00 |
|
Xiaoyu Yao
|
d311a38a6b
|
HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao.
|
2015-07-31 16:15:50 -07:00 |
|
Colin Patrick Mccabe
|
21d10ccc6e
|
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
|
2015-07-31 15:01:34 -07:00 |
Allen Wittenauer
|
666cafca8d
|
HADOOP-12249. pull argument parsing into a function (aw)
|
2015-07-31 14:32:21 -07:00 |
|
Harsh J
|
c5caa25b8f
|
HDFS-8821. Explain message "Operation category X is not supported in state standby". Contributed by Gautam Gopalakrishnan.
|
2015-07-31 08:58:22 +05:30 |
|
Arpit Agarwal
|
88d8736dde
|
HDFS-7192. DN should ignore lazyPersist hint if the writer is not local. (Contributed by Arpit Agarwal)
|
2015-07-30 13:16:46 -07:00 |
|
Haohui Mai
|
ddc867ceb9
|
HDFS-8816. Improve visualization for the Datanode tab in the NN UI. Contributed by Haohui Mai.
|
2015-07-29 17:14:05 -07:00 |
Jason Lowe
|
6f0a35724f
|
HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li
|
2015-07-29 15:25:10 +00:00 |
|
Vinayakumar B
|
6374ee0db4
|
HDFS-8670. Better to exclude decommissioned nodes for namenode NodeUsage JMX (Contributed by J.Andreina)
|
2015-07-29 14:47:19 +05:30 |