Yiqun Lin
|
d63e98ad5f
|
HDFS-11530. Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault. Contributed by Chen Liang.
|
2017-08-28 20:47:38 +08:00 |
|
Lei Xu
|
c22b5108df
|
HDFS-12215. DataNode.transferBlock does not create its daemon in the xceiver thread group. (Lei Xu)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
|
2017-08-25 16:06:34 -07:00 |
|
Kihwal Lee
|
5a83ffa396
|
HDFS-12299. Race Between update pipeline and DN Re-Registration. Contributed by Brahma Reddy Battula.
|
2017-08-25 14:53:53 -05:00 |
|
Arpit Agarwal
|
2cae387402
|
HDFS-12319. DirectoryScanner will throw IllegalStateException when Multiple BP's are present. Contributed by Brahma Reddy Battula.
|
2017-08-25 10:41:59 -07:00 |
|
Arpit Agarwal
|
ae69c99068
|
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
|
2017-08-24 11:17:36 -07:00 |
|
Arpit Agarwal
|
8b2d5a4faa
|
HDFS-11514. DFSTopologyNodeImpl#chooseRandom optimizations. Contributed by Chen Liang.
|
2017-08-23 12:49:13 -07:00 |
|
John Zhuge
|
c54c3500ed
|
HDFS-11738. Hedged pread takes more time when block moved from initial locations. Contributed by Vinayakumar B.
(cherry picked from commit b6bfb2fcb2391d51b8de97c01c1290880779132e)
|
2017-08-23 19:44:52 +05:30 |
|
Arpit Agarwal
|
b3ea11dfdb
|
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
|
2017-08-21 14:07:59 -07:00 |
|
Manoj Govindassamy
|
89fc7fe670
|
HDFS-11988. Verify HDFS Snapshots with open files captured are consistent across truncates and appends to current version file.
|
2017-08-21 11:14:44 -07:00 |
|
Arpit Agarwal
|
d8d2a221f8
|
HDFS-11450. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
|
2017-08-18 11:43:17 -07:00 |
|
Manoj Govindassamy
|
a5bc30170c
|
HDFS-12316. Verify HDFS snapshot deletion doesn't crash the ongoing file writes.
(cherry picked from commit 4230872dd66d748172903b1522885b03f34bbf9b)
|
2017-08-17 16:25:15 -07:00 |
|
Mingliang Liu
|
03d15fa58e
|
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
|
2017-08-16 16:06:13 -07:00 |
|
Ravi Prakash
|
895a35eac0
|
HDFS-12301. NN File Browser UI: Navigate to a path when enter is pressed
(cherry picked from commit f34646d652310442cb5339aabbbb269f10dfa838)
|
2017-08-15 15:45:37 -07:00 |
|
John Zhuge
|
ed4d6aa2c1
|
HDFS-11303. Hedged read might hang infinitely if read data from all DN failed . Contributed by Chen Zhang, Wei-chiu Chuang, and John Zhuge.
(cherry picked from commit 8b242f09a61a7536d2422546bfa6c2aaf1d57ed6)
|
2017-08-11 21:55:23 -07:00 |
|
Kihwal Lee
|
306abf4980
|
HDFS-12278. LeaseManager operations are inefficient in 2.8. Contributed by Rushabh S Shah.
(cherry picked from commit b5c02f95b5a2fcb8931d4a86f8192caa18009ea9)
|
2017-08-09 16:48:55 -05:00 |
|
Kihwal Lee
|
74bcc8d1f2
|
HDFS-12157. Do fsyncDirectory(..) outside of FSDataset lock. Contributed by Vinayakumar B.
|
2017-08-09 09:31:53 -05:00 |
|
Haohui Mai
|
3e2753daa1
|
HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran.
|
2017-08-08 16:33:54 -07:00 |
|
Haohui Mai
|
21d76f710e
|
HDFS-10326. Disable setting tcp socket send/receive buffers for write pipelines. Contributed by Daryn Sharp.
|
2017-08-08 14:58:44 -07:00 |
|
Andrew Wang
|
2da20df1dd
|
HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen.
|
2017-08-03 15:45:21 -07:00 |
|
Manoj Govindassamy
|
065a906be7
|
HDFS-9388. Decommission related code to support Maintenance State for datanodes.
|
2017-08-02 16:58:54 -07:00 |
|
Arpit Agarwal
|
45cde760b0
|
HDFS-12043. Add counters for block re-replication. Contributed by Chen Liang.
|
2017-08-02 16:45:08 -07:00 |
|
Manoj Govindassamy
|
a77ae7abdb
|
HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted.
(cherry picked from commit 52d7bafcf49916887197436ddb0f08f021d248d9)
|
2017-08-02 10:16:30 -07:00 |
|
Jason Lowe
|
f34c01b92a
|
Revert "HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted."
This reverts commit b0330c15da8483302007d1df797f4398b7129cdb.
|
2017-08-02 11:15:58 -05:00 |
|
Manoj Govindassamy
|
b0330c15da
|
HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted.
(cherry picked from commit 52d7bafcf49916887197436ddb0f08f021d248d9)
|
2017-08-01 17:15:29 -07:00 |
|
Manoj Govindassamy
|
70c511598f
|
HDFS-11402. HDFS Snapshots should capture point-in-time copies of OPEN files.
|
2017-08-01 17:11:27 -07:00 |
|
Akira Ajisaka
|
72bde1dad5
|
HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor.
(cherry picked from commit b38a1eea8e2917989d83d169a7b5773163e6832e)
|
2017-08-01 15:16:21 +09:00 |
|
Weiwei Yang
|
60ae10b14f
|
HDFS-12154. Incorrect javadoc description in StorageLocationChecker#check. Contributed by Nandakumar.
|
2017-07-31 17:02:54 -07:00 |
|
Arpit Agarwal
|
8c63580981
|
HDFS-12082. BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured. Contributed by Weiwei Yang.
|
2017-07-31 11:34:00 -07:00 |
|
Brahma Reddy Battula
|
8bfb9971ca
|
HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula.
|
2017-07-30 14:01:41 +08:00 |
|
Yongjun Zhang
|
c3e8c7d56e
|
HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang.
(cherry picked from commit c6330f22a5e5c2370bab885f9bea4bf8f5e9cf44)
|
2017-07-27 17:05:30 -07:00 |
|
Brahma Reddy Battula
|
1c5095b3cb
|
HDFS-11896. Non-dfsUsed will be doubled on dead node re-registration. Contributed by Brahma Reddy Battula.
(cherry picked from commit c4a85c694fae3f814ab4e7f3c172da1df0e0e353)
|
2017-07-27 12:30:57 -07:00 |
|
Kihwal Lee
|
3d8c7d701b
|
HDFS-12171. Reduce IIP object allocations for inode lookup. Contributed by Daryn Sharp.
|
2017-07-25 11:07:43 -05:00 |
|
Kihwal Lee
|
9fe5dd098d
|
HDFS-12143. Improve performance of getting and removing inode features. Contributed by Daryn Sharp.
(cherry picked from commit 1a79dcfc457969d6a6c08ffffe4152fd7638e48a)
|
2017-07-25 10:30:27 -05:00 |
|
Akira Ajisaka
|
c108372777
|
HDFS-12176. dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Contributed by Weiwei Yang.
(cherry picked from commit 770cc462281518545e3d1c0f8c21cf9ec9673200)
|
2017-07-24 16:24:50 +09:00 |
|
Kihwal Lee
|
c12bf9a128
|
HDFS-11742. Improve balancer usability after HDFS-8818. Contributed by Kihwal Lee
(cherry picked from commit 8e3a992eccff26a7344c3f0e719898fa97706b8c)
|
2017-07-21 09:19:01 -05:00 |
|
Konstantin V Shvachko
|
af2fb6a909
|
HDFS-11472. Fix inconsistent replica size after a data pipeline failure. Contributed by Erik Krogen and Wei-Chiu Chuang.
(cherry picked from commit 2a5a313539e211736fef12010918a60f9edad030)
|
2017-07-20 15:57:34 -07:00 |
|
Anu Engineer
|
e0297ffbc8
|
HDFS-12158. Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protection. Contributed by Mukul Kumar Singh.
(cherry picked from commit 413b23eb04eee24275257ab462133e0818f87449)
|
2017-07-19 10:42:28 -07:00 |
|
Brahma Reddy Battula
|
979d37ae21
|
HDFS-12067. Correct dfsadmin commands usage message to reflects IPC port. Contributed by steven-wugang.
(cherry picked from commit f8cd55fe33665faf2d1b14df231516fc891118fc)
|
2017-07-19 23:22:40 +08:00 |
|
Tsz-Wo Nicholas Sze
|
02627f8c5f
|
HDFS-12138. Remove redundant 'public' modifiers from BlockCollection. Contributed by Chen Liang
|
2017-07-17 13:59:52 -07:00 |
|
Brahma Reddy Battula
|
a33e89931b
|
HDFS-12112. TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE. Contributed by Wei-Chiu Chuang.
(cherry picked from commit b778887af59d96f1fac30cae14be1cabbdb74c8b)
|
2017-07-15 10:49:11 +08:00 |
|
Xiao Chen
|
5337c2511d
|
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
(cherry picked from commit aa395c1ec9a170f2da732c6e6114c60412161d40)
|
2017-07-14 22:23:07 -07:00 |
|
Tsz-Wo Nicholas Sze
|
bff39ca718
|
HDFS-12130. Optimizing permission check for getContentSummary. Contributed by Chen Liang
|
2017-07-14 14:40:11 -07:00 |
|
Tsz-Wo Nicholas Sze
|
d51395363a
|
Revert "HDFS-12130. Optimizing permission check for getContentSummary." to fix commit message.
This reverts commit 2ba41729abef22f9049fbd6260e8194ac1abf5cc.
|
2017-07-14 14:38:27 -07:00 |
|
Kihwal Lee
|
0fd86de128
|
HDFS-12140. Remove BPOfferService lock contention to get block pool id. Contributed by Daryn Sharp.
(cherry picked from commit e7d187a1b6a826edd5bd0f708184d48f3674d489)
|
2017-07-14 16:12:28 -05:00 |
|
Kihwal Lee
|
a47820d72a
|
HDFS-12137. DN dataset lock should be fair. Contributed by Daryn Sharp.
|
2017-07-14 15:45:26 -05:00 |
|
Tsz-Wo Nicholas Sze
|
2ba41729ab
|
HDFS-12130. Optimizing permission check for getContentSummary.
|
2017-07-14 13:42:02 -07:00 |
|
Xiaoyu Yao
|
af8a227a68
|
HDFS-11502. Datanode UI should display hostname based on JMX bean instead of window.location.hostname. Contributed by Jeffrey E Rodriguez and Yuanbo Liu.
(cherry picked from commit e15e2713e1e344b14d63726639d1c83451921515)
|
2017-07-12 16:38:56 -07:00 |
|
Akira Ajisaka
|
2653cf4466
|
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor.
(cherry picked from commit 9144fd9e9b5d84d71158451428341746a6567152)
|
2017-07-12 11:40:48 +09:00 |
|
Akira Ajisaka
|
063f2132ef
|
HDFS-12078. Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml. Contributed by Weiwei Yang.
(cherry picked from commit 186650d21d482e2f3bc4523ae989ebe76081b0e3)
|
2017-07-04 14:52:39 +09:00 |
|
Akira Ajisaka
|
003b4a1675
|
HDFS-12079. Description of dfs.block.invalidate.limit is incorrect in hdfs-default.xml. Contributed by Weiwei Yang.
(cherry picked from commit b0560e0624756e2b3ce7b6bc741eee3c18d2a873)
|
2017-07-04 14:03:07 +09:00 |
|