Inigo Goiri
|
23753ff3c5
|
HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri.
(cherry picked from commit fabe02c8fa )
(cherry picked from commit cc58e7a983 )
|
2017-10-19 17:39:12 -07:00 |
Inigo Goiri
|
a100f63a16
|
HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 23c4ddee11 )
(cherry picked from commit 7cb6bdf09e )
|
2017-10-19 17:39:11 -07:00 |
Inigo Goiri
|
36c3515fbb
|
HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri.
(cherry picked from commit 90ba6843fb )
(cherry picked from commit 346c9fce43 )
|
2017-10-19 17:39:08 -07:00 |
Inigo Goiri
|
0b599cdc87
|
HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri.
(cherry picked from commit ee3260211d )
(cherry picked from commit 67d10087af )
|
2017-10-19 17:38:57 -07:00 |
Inigo Goiri
|
78abcb8f52
|
HDFS-10646. Federation admin tool. Contributed by Inigo Goiri.
(cherry picked from commit ae27e31fbc )
(cherry picked from commit b3e6bd22e3 )
|
2017-10-19 17:38:54 -07:00 |
Inigo Goiri
|
cc7c12ff18
|
HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 58b97df661 )
(cherry picked from commit 6f0de27318 )
|
2017-10-19 17:38:33 -07:00 |
Inigo Goiri
|
e700db60a6
|
HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri.
(cherry picked from commit 928f8dab52 )
(cherry picked from commit d8c8107332 )
|
2017-10-19 17:38:32 -07:00 |
Inigo Goiri
|
0228ead4d1
|
HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 95cae08849 )
(cherry picked from commit 55da7fd7eb )
|
2017-10-19 17:38:30 -07:00 |
Inigo Goiri
|
a09d7219c9
|
HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri.
(cherry picked from commit 47db6e9d8e )
(cherry picked from commit 0ec82b8cdf )
|
2017-10-19 17:38:29 -07:00 |
Inigo Goiri
|
2f95eac8f6
|
HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 8a9cdebebf )
(cherry picked from commit ca4f209b49 )
|
2017-10-19 17:38:28 -07:00 |
Inigo Goiri
|
7bd91fa2ed
|
HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit c6e0bd640c )
(cherry picked from commit 4bf877b03f )
|
2017-10-19 17:38:27 -07:00 |
Inigo
|
3f6d18ddf6
|
HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 6d94c90ece )
(cherry picked from commit 2c740a684a )
|
2017-10-19 17:38:25 -07:00 |
Inigo
|
c3b8b5e49f
|
HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 0f88e04915 )
(cherry picked from commit 533b986633 )
|
2017-10-19 17:38:24 -07:00 |
Inigo
|
096e8c4f35
|
HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri.
(cherry picked from commit 6821e80172 )
(cherry picked from commit 2761bbc91a )
|
2017-10-19 17:38:21 -07:00 |
Wei-Chiu Chuang
|
ce93a2b84b
|
HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4ab0c8f96a )
|
2017-10-19 06:18:40 -07:00 |
Zhe Zhang
|
87f4407396
|
HDFS-12502. nntop should support a category based on FilesInGetListingOps.
(cherry picked from commit 60bfee270e )
(cherry picked from commit aecf6c50d3 )
|
2017-10-19 00:05:34 -07:00 |
Arpit Agarwal
|
0aa1b62b39
|
HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar.
(cherry picked from commit b6942cbe9b )
(cherry picked from commit 5897095d53 )
|
2017-10-17 23:44:13 -07:00 |
Wei-Chiu Chuang
|
a596c6f5eb
|
HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 8dbc8909c9 )
|
2017-10-16 12:59:41 -07:00 |
Xiao Chen
|
b2f27641dd
|
HDFS-12642. Log block and datanode details in BlockRecoveryWorker.
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
|
2017-10-16 10:34:24 -07:00 |
Xiao Chen
|
d82edb49c7
|
HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang.
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
|
2017-10-16 09:51:27 -07:00 |
Xiao Chen
|
4b734fe386
|
HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar.
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
|
2017-10-15 19:28:38 -07:00 |
Andrew Wang
|
1ddc49527a
|
Revert "HDFS-12603. Enable async edit logging by default."
This reverts commit 42d3229e6f .
|
2017-10-09 13:29:52 -07:00 |
Andrew Wang
|
42d3229e6f
|
HDFS-12603. Enable async edit logging by default.
|
2017-10-09 11:21:43 -07:00 |
Xiao Chen
|
dd0113d777
|
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
|
2017-10-05 19:47:04 -07:00 |
Yiqun Lin
|
2e2f8e42cf
|
HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger.
(cherry picked from commit e9b790db9d )
|
2017-09-27 10:45:44 +08:00 |
Daryn Sharp
|
7f3ed5f61e
|
[HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn)
|
2017-09-26 15:21:37 -05:00 |
Anu Engineer
|
de5744c903
|
HDFS-12531. Fix conflict in the javadoc of UnderReplicatedBlocks.java in branch-2. Contributed by Bharat Viswanadham.
|
2017-09-23 11:16:50 -07:00 |
Arpit Agarwal
|
09290659e7
|
HDFS-12530. Processor argument in Offline Image Viewer should be case insensitive. Contributed by Hanisha Koneru.
|
2017-09-22 09:48:10 -07:00 |
Arpit Agarwal
|
18e5f2068b
|
HDFS-12496. Make QuorumJournalManager timeout properties configurable. Contributed by Ajay Kumar.
|
2017-09-21 08:53:27 -07:00 |
Kihwal Lee
|
9640bfb808
|
HDFS-12371. BlockVerificationFailures and BlocksVerified show up as 0 in Datanode JMX. Contributed by Hanisha Koneru.
(cherry picked from commit 6bf921a5c3 )
|
2017-09-21 08:48:04 -05:00 |
Akira Ajisaka
|
3527327f34
|
HDFS-12526. FSDirectory should use Time.monotonicNow for durations. Contributed by Bharat Viswanadham.
(cherry picked from commit 50849ec9eb )
|
2017-09-21 19:28:49 +09:00 |
Ming Ma
|
3bb23f4be9
|
HDFS-11035. Better documentation for maintenace mode and upgrade domain.
(cherry picked from commit ce943eb17a )
|
2017-09-20 09:42:22 -07:00 |
Ming Ma
|
7dd662eafd
|
HDFS-12473. Change hosts JSON file format.
|
2017-09-20 09:08:41 -07:00 |
Brahma Reddy Battula
|
eddc581860
|
HDFS-11799. Introduce a config to allow setting up write pipeline with fewer nodes than replication factor. Contributed by Brahma Reddy Battula
(cherry picked from commit fda1221c55 )
|
2017-09-19 11:31:22 +05:30 |
Arpit Agarwal
|
f42705b957
|
HDFS-12472. Add JUNIT timeout to TestBlockStatsMXBean. Contributed by Bharat Viswanadham.
|
2017-09-16 10:14:39 -07:00 |
Erik Krogen
|
791e20c244
|
HDFS-12323. NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout. Contributed by Erik Krogen.
(cherry picked from commit 90894c7262 )
|
2017-09-15 14:03:10 -07:00 |
Nathan Roberts
|
bd14e8d8b0
|
HDFS-12441. Supress UnresolvedPathException in namenode log. Contributed by Kihwal Lee.
(cherry picked from commit de197fc156 )
|
2017-09-15 14:47:07 -05:00 |
Kihwal Lee
|
07dee7fd63
|
HDFS-12424. Datatable sorting on the Datanode Information page in the Namenode UI is broken. Contributed by Shawna Martell.
(cherry picked from commit 78bdf10ae4 )
|
2017-09-15 09:55:59 -05:00 |
John Zhuge
|
eaef8446f6
|
HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.
(cherry picked from commit 7ee02d1065 )
|
2017-09-14 11:29:34 -07:00 |
Arpit Agarwal
|
ecf352d645
|
HADOOP-14867. Update HDFS Federation setup document, for incorrect property name for secondary name node http address. Contributed by Bharat Viswanadham.
|
2017-09-13 12:54:21 -07:00 |
Xiao Chen
|
0a8ed025e4
|
Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
This reverts commit 5337c2511d .
|
2017-09-12 19:53:14 -07:00 |
Arpit Agarwal
|
ac20d7e246
|
HDFS-12407. Journal node fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start. Contributed by Ajay Kumar.
|
2017-09-12 16:18:56 -07:00 |
Manoj Govindassamy
|
796404c3ed
|
HDFS-12404. Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users.
(cherry picked from commit 3b3be355b3 )
|
2017-09-07 17:21:33 -07:00 |
Xiao Chen
|
c6a1e3facb
|
HDFS-12369. Edit log corruption due to hard lease recovery of not-closed file which has snapshots.
(cherry picked from commit 3964b131f3f0131a663377685950d1b7bd3fe63d)
(cherry picked from commit 8b7d597d3a8d728aa05302ccd769af84a1c9ec0f)
|
2017-09-07 16:30:38 -07:00 |
Yongjun Zhang
|
32e8c84614
|
HDFS-12357. Let NameNode to bypass external attribute provider for configured users. Contributed by Yongjun Zhang, Arun Suresh.
(cherry picked from commit d77ed238a9 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java
|
2017-09-07 10:22:37 -07:00 |
Wei-Chiu Chuang
|
3a2f3e78ff
|
HDFS-12182. BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks. Contributed by Wellington Chevreuil.
|
2017-09-05 14:58:08 -07:00 |
Xiao Chen
|
858715d054
|
HDFS-12336. Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory. Contributed by Wellington Chevreuil.
|
2017-08-30 09:43:12 -07:00 |
Yongjun Zhang
|
870ef0b2fd
|
HDFS-12191. Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file. Contributed by Yongjun Zhang.
(cherry picked from commit cf93d60d3f )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSDirAttrOp.java
|
2017-08-29 21:57:25 -07:00 |
Arpit Agarwal
|
e19f004f65
|
HDFS-11998. Enable DFSNetworkTopology as default. Contributed by Chen Liang.
|
2017-08-28 16:22:42 -07:00 |
Arpit Agarwal
|
98ba68b05d
|
HDFS-12293. DataNode should log file name on disk error. Contributed by Ajay Kumar.
|
2017-08-28 15:50:06 -07:00 |
Yiqun Lin
|
d63e98ad5f
|
HDFS-11530. Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault. Contributed by Chen Liang.
|
2017-08-28 20:47:38 +08:00 |
Lei Xu
|
c22b5108df
|
HDFS-12215. DataNode.transferBlock does not create its daemon in the xceiver thread group. (Lei Xu)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
|
2017-08-25 16:06:34 -07:00 |
Kihwal Lee
|
5a83ffa396
|
HDFS-12299. Race Between update pipeline and DN Re-Registration. Contributed by Brahma Reddy Battula.
|
2017-08-25 14:53:53 -05:00 |
Arpit Agarwal
|
2cae387402
|
HDFS-12319. DirectoryScanner will throw IllegalStateException when Multiple BP's are present. Contributed by Brahma Reddy Battula.
|
2017-08-25 10:41:59 -07:00 |
Arpit Agarwal
|
ae69c99068
|
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
|
2017-08-24 11:17:36 -07:00 |
Arpit Agarwal
|
8b2d5a4faa
|
HDFS-11514. DFSTopologyNodeImpl#chooseRandom optimizations. Contributed by Chen Liang.
|
2017-08-23 12:49:13 -07:00 |
John Zhuge
|
c54c3500ed
|
HDFS-11738. Hedged pread takes more time when block moved from initial locations. Contributed by Vinayakumar B.
(cherry picked from commit b6bfb2fcb2 )
|
2017-08-23 19:44:52 +05:30 |
Arpit Agarwal
|
b3ea11dfdb
|
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
|
2017-08-21 14:07:59 -07:00 |
Manoj Govindassamy
|
89fc7fe670
|
HDFS-11988. Verify HDFS Snapshots with open files captured are consistent across truncates and appends to current version file.
|
2017-08-21 11:14:44 -07:00 |
Arpit Agarwal
|
d8d2a221f8
|
HDFS-11450. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
|
2017-08-18 11:43:17 -07:00 |
Manoj Govindassamy
|
a5bc30170c
|
HDFS-12316. Verify HDFS snapshot deletion doesn't crash the ongoing file writes.
(cherry picked from commit 4230872dd6 )
|
2017-08-17 16:25:15 -07:00 |
Mingliang Liu
|
03d15fa58e
|
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
|
2017-08-16 16:06:13 -07:00 |
Ravi Prakash
|
895a35eac0
|
HDFS-12301. NN File Browser UI: Navigate to a path when enter is pressed
(cherry picked from commit f34646d652 )
|
2017-08-15 15:45:37 -07:00 |
John Zhuge
|
ed4d6aa2c1
|
HDFS-11303. Hedged read might hang infinitely if read data from all DN failed . Contributed by Chen Zhang, Wei-chiu Chuang, and John Zhuge.
(cherry picked from commit 8b242f09a6 )
|
2017-08-11 21:55:23 -07:00 |
Kihwal Lee
|
306abf4980
|
HDFS-12278. LeaseManager operations are inefficient in 2.8. Contributed by Rushabh S Shah.
(cherry picked from commit b5c02f95b5 )
|
2017-08-09 16:48:55 -05:00 |
Kihwal Lee
|
74bcc8d1f2
|
HDFS-12157. Do fsyncDirectory(..) outside of FSDataset lock. Contributed by Vinayakumar B.
|
2017-08-09 09:31:53 -05:00 |
Haohui Mai
|
3e2753daa1
|
HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran.
|
2017-08-08 16:33:54 -07:00 |
Haohui Mai
|
21d76f710e
|
HDFS-10326. Disable setting tcp socket send/receive buffers for write pipelines. Contributed by Daryn Sharp.
|
2017-08-08 14:58:44 -07:00 |
Andrew Wang
|
2da20df1dd
|
HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen.
|
2017-08-03 15:45:21 -07:00 |
Manoj Govindassamy
|
065a906be7
|
HDFS-9388. Decommission related code to support Maintenance State for datanodes.
|
2017-08-02 16:58:54 -07:00 |
Arpit Agarwal
|
45cde760b0
|
HDFS-12043. Add counters for block re-replication. Contributed by Chen Liang.
|
2017-08-02 16:45:08 -07:00 |
Manoj Govindassamy
|
a77ae7abdb
|
HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted.
(cherry picked from commit 52d7bafcf4 )
|
2017-08-02 10:16:30 -07:00 |
Jason Lowe
|
f34c01b92a
|
Revert "HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted."
This reverts commit b0330c15da .
|
2017-08-02 11:15:58 -05:00 |
Manoj Govindassamy
|
b0330c15da
|
HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted.
(cherry picked from commit 52d7bafcf4 )
|
2017-08-01 17:15:29 -07:00 |
Manoj Govindassamy
|
70c511598f
|
HDFS-11402. HDFS Snapshots should capture point-in-time copies of OPEN files.
|
2017-08-01 17:11:27 -07:00 |
Akira Ajisaka
|
72bde1dad5
|
HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor.
(cherry picked from commit b38a1eea8e )
|
2017-08-01 15:16:21 +09:00 |
Weiwei Yang
|
60ae10b14f
|
HDFS-12154. Incorrect javadoc description in StorageLocationChecker#check. Contributed by Nandakumar.
|
2017-07-31 17:02:54 -07:00 |
Arpit Agarwal
|
8c63580981
|
HDFS-12082. BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured. Contributed by Weiwei Yang.
|
2017-07-31 11:34:00 -07:00 |
Brahma Reddy Battula
|
8bfb9971ca
|
HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula.
|
2017-07-30 14:01:41 +08:00 |
Yongjun Zhang
|
c3e8c7d56e
|
HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang.
(cherry picked from commit c6330f22a5 )
|
2017-07-27 17:05:30 -07:00 |
Brahma Reddy Battula
|
1c5095b3cb
|
HDFS-11896. Non-dfsUsed will be doubled on dead node re-registration. Contributed by Brahma Reddy Battula.
(cherry picked from commit c4a85c694f )
|
2017-07-27 12:30:57 -07:00 |
Kihwal Lee
|
3d8c7d701b
|
HDFS-12171. Reduce IIP object allocations for inode lookup. Contributed by Daryn Sharp.
|
2017-07-25 11:07:43 -05:00 |
Kihwal Lee
|
9fe5dd098d
|
HDFS-12143. Improve performance of getting and removing inode features. Contributed by Daryn Sharp.
(cherry picked from commit 1a79dcfc45 )
|
2017-07-25 10:30:27 -05:00 |
Akira Ajisaka
|
c108372777
|
HDFS-12176. dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Contributed by Weiwei Yang.
(cherry picked from commit 770cc46228 )
|
2017-07-24 16:24:50 +09:00 |
Kihwal Lee
|
c12bf9a128
|
HDFS-11742. Improve balancer usability after HDFS-8818. Contributed by Kihwal Lee
(cherry picked from commit 8e3a992ecc )
|
2017-07-21 09:19:01 -05:00 |
Konstantin V Shvachko
|
af2fb6a909
|
HDFS-11472. Fix inconsistent replica size after a data pipeline failure. Contributed by Erik Krogen and Wei-Chiu Chuang.
(cherry picked from commit 2a5a313539 )
|
2017-07-20 15:57:34 -07:00 |
Anu Engineer
|
e0297ffbc8
|
HDFS-12158. Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protection. Contributed by Mukul Kumar Singh.
(cherry picked from commit 413b23eb04 )
|
2017-07-19 10:42:28 -07:00 |
Brahma Reddy Battula
|
979d37ae21
|
HDFS-12067. Correct dfsadmin commands usage message to reflects IPC port. Contributed by steven-wugang.
(cherry picked from commit f8cd55fe33 )
|
2017-07-19 23:22:40 +08:00 |
Tsz-Wo Nicholas Sze
|
02627f8c5f
|
HDFS-12138. Remove redundant 'public' modifiers from BlockCollection. Contributed by Chen Liang
|
2017-07-17 13:59:52 -07:00 |
Brahma Reddy Battula
|
a33e89931b
|
HDFS-12112. TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE. Contributed by Wei-Chiu Chuang.
(cherry picked from commit b778887af5 )
|
2017-07-15 10:49:11 +08:00 |
Xiao Chen
|
5337c2511d
|
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
(cherry picked from commit aa395c1ec9a170f2da732c6e6114c60412161d40)
|
2017-07-14 22:23:07 -07:00 |
Tsz-Wo Nicholas Sze
|
bff39ca718
|
HDFS-12130. Optimizing permission check for getContentSummary. Contributed by Chen Liang
|
2017-07-14 14:40:11 -07:00 |
Tsz-Wo Nicholas Sze
|
d51395363a
|
Revert "HDFS-12130. Optimizing permission check for getContentSummary." to fix commit message.
This reverts commit 2ba41729ab .
|
2017-07-14 14:38:27 -07:00 |
Kihwal Lee
|
0fd86de128
|
HDFS-12140. Remove BPOfferService lock contention to get block pool id. Contributed by Daryn Sharp.
(cherry picked from commit e7d187a1b6 )
|
2017-07-14 16:12:28 -05:00 |
Kihwal Lee
|
a47820d72a
|
HDFS-12137. DN dataset lock should be fair. Contributed by Daryn Sharp.
|
2017-07-14 15:45:26 -05:00 |
Tsz-Wo Nicholas Sze
|
2ba41729ab
|
HDFS-12130. Optimizing permission check for getContentSummary.
|
2017-07-14 13:42:02 -07:00 |
Xiaoyu Yao
|
af8a227a68
|
HDFS-11502. Datanode UI should display hostname based on JMX bean instead of window.location.hostname. Contributed by Jeffrey E Rodriguez and Yuanbo Liu.
(cherry picked from commit e15e2713e1 )
|
2017-07-12 16:38:56 -07:00 |
Akira Ajisaka
|
2653cf4466
|
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor.
(cherry picked from commit 9144fd9e9b )
|
2017-07-12 11:40:48 +09:00 |
Akira Ajisaka
|
063f2132ef
|
HDFS-12078. Add time unit to the description of property dfs.namenode.stale.datanode.interval in hdfs-default.xml. Contributed by Weiwei Yang.
(cherry picked from commit 186650d21d )
|
2017-07-04 14:52:39 +09:00 |
Akira Ajisaka
|
003b4a1675
|
HDFS-12079. Description of dfs.block.invalidate.limit is incorrect in hdfs-default.xml. Contributed by Weiwei Yang.
(cherry picked from commit b0560e0624 )
|
2017-07-04 14:03:07 +09:00 |
Wei-Chiu Chuang
|
94bc5cdbb3
|
HDFS-12042. Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption. Contributed by Misha Dmitriev.
(cherry picked from commit bcba844d11 )
|
2017-06-30 11:42:51 -07:00 |
Wei-Chiu Chuang
|
6917c19167
|
HDFS-11881. NameNode consumes a lot of memory for snapshot diff report generation. Contributed by Manoj Govindassamy.
(cherry picked from commit 16c8dbde57 )
|
2017-06-29 06:40:24 -07:00 |
Akira Ajisaka
|
a896c0f11e
|
HDFS-12040. TestFsDatasetImpl.testCleanShutdownOfVolume fails. Contributed by hu xiaodong.
(cherry picked from commit 07defa4c09 )
|
2017-06-27 20:49:56 +09:00 |
Akira Ajisaka
|
b59b96deee
|
HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong.
|
2017-06-27 03:28:09 +09:00 |
Kihwal Lee
|
8f533ca76b
|
HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee.
|
2017-06-20 09:16:37 -05:00 |
Brahma Reddy Battula
|
933fad2e17
|
HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han.
(cherry picked from commit 2e9daa2e27 )
|
2017-06-20 20:45:33 +08:00 |
Akira Ajisaka
|
6b3c13d543
|
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen.
(cherry picked from commit 2c769167db )
|
2017-06-20 16:36:47 +09:00 |
Akira Ajisaka
|
71626fd0b9
|
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin.
|
2017-06-20 13:55:42 +09:00 |
Masatake Iwasaki
|
b19ca498ae
|
HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar.
(cherry picked from commit d954a64730 )
|
2017-06-20 08:09:09 +09:00 |
Andrew Wang
|
1ec1aebd35
|
HDFS-10480. Add an admin command to list currently open files. Contributed by Manoj Govindassamy.
|
2017-06-19 09:52:07 -07:00 |
Lei Xu
|
33afa1fdca
|
HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 6460df21a0 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
|
2017-06-16 17:32:29 -07:00 |
Arpit Agarwal
|
9529513f18
|
HADOOP-14503. Make RollingAverages a mutable metric. Contributed by Hanisha Koneru.
|
2017-06-16 16:41:08 -07:00 |
Lei Xu
|
abac844c90
|
HADOOP-14394. Provide Builder pattern for DistributedFileSystem.create. (lei)
(cherry picked from commit 5fbec46525d6d49837d934556b59ba77bd2301a8)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/NameNodeConnector.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestErasureCodingPolicies.java
|
2017-06-15 10:59:11 -07:00 |
Akira Ajisaka
|
0fd0612896
|
Revert "HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin."
This reverts commit 88fa17c238 .
|
2017-06-16 00:21:54 +09:00 |
Akira Ajisaka
|
88fa17c238
|
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin.
(cherry picked from commit 315f07700d )
|
2017-06-15 13:47:22 +09:00 |
Tsz-Wo Nicholas Sze
|
670224ae59
|
HDFS-11947. When constructing a thread name, BPOfferService may print a bogus warning message. Contributed by Weiwei Yang
|
2017-06-13 09:47:14 +08:00 |
Arpit Agarwal
|
eda4bf5196
|
HDFS-11967. TestJMXGet fails occasionally. Contributed by Arpit Agarwal.
|
2017-06-12 16:04:08 -07:00 |
Arpit Agarwal
|
097b1f74e5
|
HDFS-11907. Add metric for time taken by NameNode resource check. Contributed by Chen Liang.
|
2017-06-12 15:22:36 -07:00 |
Mingliang Liu
|
facb6812d9
|
HDFS-11945. Internal lease recovery may not be retried for a long time. Contributed by Kihwal Lee
|
2017-06-08 14:46:31 -07:00 |
Brahma Reddy Battula
|
fca08f8362
|
HDFS-11711. DN should not delete the block On "Too many open files" Exception. Contributed by Brahma Reddy Battula.
|
2017-06-07 16:54:29 +08:00 |
Yiqun Lin
|
72f0fdfb59
|
HDFS-11929. Document missing processor of hdfs oiv_legacy command. Contributed by LiXin Ge.
(cherry picked from commit 5ec71639cf )
|
2017-06-07 13:44:33 +08:00 |
Vinayakumar B
|
9a26120809
|
HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened. Contributed by Vinayakumar B.
|
2017-06-07 10:57:47 +05:30 |
Andrew Wang
|
5c819585f2
|
HDFS-11840. Log HDFS Mover exception message of exit to its own log. Contributed by LiXin Ge.
(cherry picked from commit c31cb879a3 )
|
2017-06-06 14:57:51 -07:00 |
Arpit Agarwal
|
226688a12c
|
HDFS-11932. BPServiceActor thread name is not correctly set. Contributed by Chen Liang.
|
2017-06-06 13:51:25 -07:00 |
Yongjun Zhang
|
1e52314117
|
HDFS-11914. Add more diagnosis info for fsimage transfer failure. Contributed by Yongjun Zhang.
(cherry picked from commit 6a28a2b914 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/Util.java
|
2017-06-06 12:31:11 -07:00 |
Kihwal Lee
|
e2ea601231
|
HDFS-10816. TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor. Contributed by Eric Badger.
|
2017-06-05 15:24:54 -05:00 |
Arpit Agarwal
|
baff06f019
|
HDFS-11928. Segment overflow in FileDistributionCalculator. Contributed by LiXin Ge.
|
2017-06-05 13:21:35 -07:00 |
Yiqun Lin
|
2e8557de12
|
HDFS-11899. ASF License warnings generated intermittently in trunk. Contributed by Yiqun Lin.
(cherry picked from commit 367da9b7b8 )
|
2017-06-03 22:10:01 +08:00 |
Brahma Reddy Battula
|
8e119f1e90
|
HADOOP-14436. Remove the redundant colon in ViewFs.md. Contributed by maobaolong.
(cherry picked from commit 056cc72885 )
|
2017-06-02 22:42:23 +08:00 |
Brahma Reddy Battula
|
ac2af66e77
|
HDFS-11905. Fix license header inconsistency in hdfs. Contributed by Yeliang Cang.
|
2017-06-02 22:22:43 +08:00 |
Yiqun Lin
|
870b5e39d2
|
HDFS-11359. DFSAdmin report command supports displaying maintenance state datanodes. Contributed by Yiqun Lin.
|
2017-06-02 12:53:31 +08:00 |
Xiao Chen
|
eb98773ac8
|
HDFS-11904. Reuse iip in unprotectedRemoveXAttrs calls.
(cherry picked from commit 219f4c199e )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirErasureCodingOp.java
|
2017-06-01 14:16:58 -07:00 |
Xiao Chen
|
91b72a8aa5
|
HDFS-11741. Long running balancer may fail due to expired DataEncryptionKey. Contributed by Wei-Chiu Chuang and Xiao Chen.
(cherry picked from commit 068e23b896c63b0f817e6b91d73c994be1551eb2)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/security/token/block/BlockTokenSecretManager.java
|
2017-06-01 14:05:43 -07:00 |
Brahma Reddy Battula
|
5cbdefbcc0
|
HDFS-11893. Fix TestDFSShell.testMoveWithTargetPortEmpty failure. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0dcf843c00 )
|
2017-06-01 22:39:22 +08:00 |
Kihwal Lee
|
212a566088
|
HDFS-11856. Ability to re-add Upgrading nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B.
|
2017-05-31 12:45:33 -05:00 |
Kihwal Lee
|
5b0baeab5e
|
HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B.
|
2017-05-31 11:02:34 -05:00 |
Lei Xu
|
a3ad1a39c5
|
HDFS-11659. TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 91d6fe151f )
|
2017-05-30 11:11:00 -07:00 |
Yiqun Lin
|
d36e64b8b2
|
HDFS-11446. TestMaintenanceState#testWithNNAndDNRestart fails intermittently. Contributed by Yiqun Lin.
(cherry picked from commit 31058b243e )
|
2017-05-28 11:27:09 +08:00 |
Inigo Goiri
|
e336d92b99
|
Fix NPE in LazyPersistFileScrubber. Contributed by Inigo Goiri.
(cherry picked from commit 303c8dc9b6 )
|
2017-05-26 13:40:16 -07:00 |
Xiao Chen
|
54971c4195
|
HDFS-11421. Make WebHDFS' ACLs RegEx configurable. Contributed by Harsh J.
|
2017-05-25 21:01:39 -07:00 |
Kihwal Lee
|
2cb63433ab
|
HDFS-11817. A faulty node can cause a lease leak and NPE on accessing data. Contributed by Kihwal Lee.
|
2017-05-25 17:21:56 -05:00 |
Brahma Reddy Battula
|
7bad748091
|
HDFS-11445. FSCK shows overall health stauts as corrupt even one replica is corrupt. Contributed by Brahma Reddy Battula.
|
2017-05-25 22:38:12 +08:00 |
Yongjun Zhang
|
49dc547252
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen, Rosie Li.
|
2017-05-24 18:54:51 -07:00 |
Yongjun Zhang
|
97317b1aaa
|
Revert "HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen, Rosie Li."
This reverts commit c411adac32 .
|
2017-05-24 18:54:51 -07:00 |
Wei-Chiu Chuang
|
bd0138ea0a
|
Revert "HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory."
This reverts commit 5c96ef365d .
|
2017-05-24 18:08:30 -07:00 |
Wei-Chiu Chuang
|
fe2c28df70
|
Revert "HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang."
This reverts commit 4f1f16f1a6 .
|
2017-05-24 18:08:10 -07:00 |
Sunil G
|
ec346d6377
|
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
|
2017-05-23 07:57:36 +05:30 |
Brahma Reddy Battula
|
ec2468ced1
|
HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore.
(cherry picked from commit 9cab42cc79 )
|
2017-05-23 02:40:11 +08:00 |
Arpit Agarwal
|
3db695d400
|
HDFS-11842. TestDataNodeOutlierDetectionViaMetrics UT fails intermittently. Controbuted by Hanisha Koneru.
|
2017-05-17 19:38:54 -07:00 |
Arpit Agarwal
|
0e95ff78c3
|
HDFS-11827. NPE is thrown when log level changed in BlockPlacementPolicyDefault#chooseRandom() method. Contributed by xupeng.
|
2017-05-16 19:51:17 -07:00 |
Kihwal Lee
|
82ea3f4545
|
HDFS-11641. Reduce cost of audit logging by using FileStatus instead of HdfsFileStatus. Contributed by Daryn Sharp.
|
2017-05-16 15:45:41 -05:00 |
Akira Ajisaka
|
c17cb03a23
|
HDFS-11833. HDFS architecture documentation descibes outdated placement policy. Contributed by Chen Liang.
(cherry picked from commit 1d1c52b42f )
|
2017-05-16 11:53:55 -04:00 |
Andrew Wang
|
18b89e902b
|
HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.
|
2017-05-13 21:41:11 -07:00 |
Jason Lowe
|
aeca471ec1
|
HDFS-11818. TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently. Contributed by Nathan Roberts
|
2017-05-12 17:47:17 -05:00 |
Vinayakumar B
|
53d9f56a18
|
HDFS-11674. reserveSpaceForReplicas is not released if append request failed due to mirror down and replica recovered (Contributed by Vinayakumar B)
(cherry picked from commit 1411612aa4 )
|
2017-05-12 07:44:11 +05:30 |
Kihwal Lee
|
dfaaa14a47
|
HDFS-11755. Underconstruction blocks can be considered missing. Contributed by Nathan Roberts.
|
2017-05-10 14:20:26 -05:00 |
Jason Lowe
|
0a4021387f
|
HDFS-11745. Increase HDFS test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
(cherry picked from commit fab73748a1 )
|
2017-05-10 13:03:33 -05:00 |
Kihwal Lee
|
0d9322aa5b
|
HDFS-11702. Remove indefinite caching of key provider uri in DFSClient. Contributed by Rushabh S Shah.
(cherry picked from commit cef2815cf4 )
|
2017-05-08 08:29:03 -05:00 |
Lei Xu
|
1f30a8a105
|
HDFS-11687. Add new public encryption APIs required by Hive. (lei)
Change-Id: I4a23a00de63ad18022312ceb1f306a87d032d07c
(cherry picked from commit 25f5d9ad5e )
|
2017-05-04 12:07:29 -07:00 |
Arpit Agarwal
|
89baea96d5
|
HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru.
|
2017-05-03 16:30:01 -07:00 |
Arpit Agarwal
|
4b7d1ff326
|
Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
This reverts commit dfc6ef42c4 .
|
2017-05-03 16:29:44 -07:00 |
Arpit Agarwal
|
dfc6ef42c4
|
HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru.
|
2017-05-03 15:53:43 -07:00 |
Mingliang Liu
|
616413ecb2
|
HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran
(cherry picked from commit 83dded556d )
|
2017-05-03 11:23:15 -07:00 |
Erik Krogen
|
9d6b873d3c
|
HDFS-11717. Add unit test for HDFS-11709 StandbyCheckpointer should handle non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen.
(cherry picked from commit d9014bda93 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestStandbyCheckpoints.java
|
2017-05-02 18:39:37 -07:00 |
Xiaoyu Yao
|
3e7f97fb0b
|
HDFS-11593. Change SimpleHttpProxyHandler#exceptionCaught log level from info to debug. Contributed by Xiaobing Zhou.
(cherry picked from commit 1058b40843 )
|
2017-05-01 16:13:30 -07:00 |
Kihwal Lee
|
f77d138725
|
HDFS-11714. Newly added NN storage directory won't get initialized and cause space exhaustion. Contributed by Kihwal Lee.
|
2017-05-01 17:33:24 -05:00 |
Kihwal Lee
|
6a6d0ece99
|
HDFS-11609. Some blocks can be permanently lost if nodes are decommissioned while dead. Contributed by Kihwal Lee.
|
2017-05-01 14:20:37 -05:00 |
Zhe Zhang
|
fc46f398d9
|
HDFS-11709. StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully. Contributed by Erik Krogen.
(cherry picked from commit d8a3309830 )
|
2017-04-27 09:51:04 -07:00 |
Konstantin V Shvachko
|
4cbf5c5c41
|
HDFS-11384. Balancer disperses getBlocks calls to avoid NameNode's rpc queue saturation. Contributed by Konstantin V Shvachko.
(cherry picked from commit 28eb2aabeb )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
|
2017-04-26 19:02:48 -07:00 |
Akira Ajisaka
|
cc66153e12
|
HDFS-11417. Add datanode admin command to get the storage info. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 93fa48fcf2 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocol/ClientDatanodeProtocol.java
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientDatanodeProtocolTranslatorPB.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/ClientDatanodeProtocolServerSideTranslatorPB.java
|
2017-04-26 18:08:12 +09:00 |
Xiaoyu Yao
|
fc0e6de929
|
HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore.
(cherry picked from commit 918dee10f56861d15bb6644edcefb4246a3e00a4)
|
2017-04-25 18:49:44 -07:00 |
Jason Lowe
|
31af85c18e
|
HDFS-11691. Add a proper scheme to the datanode links in NN web UI. Contributed by Kihwal Lee
(cherry picked from commit e4321ec843 )
|
2017-04-25 17:31:31 -05:00 |
John Zhuge
|
5046a45507
|
HDFS-11685. TestDistributedFileSystem.java fails to compile. Contributed by John Zhuge.
|
2017-04-19 22:10:18 -07:00 |
Andrew Wang
|
efb790b0d6
|
HDFS-11660. TestFsDatasetCache#testPageRounder fails intermittently with AssertionError.
(cherry picked from commit 74a723852d )
|
2017-04-19 18:10:16 -07:00 |
Yiqun Lin
|
e278eb3ab5
|
HDFS-11316. TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails in trunk. Contributed by Yiqun Lin.
(cherry picked from commit 724bb86351 )
|
2017-04-19 12:15:52 -05:00 |
Arpit Agarwal
|
5c092097b6
|
HDFS-11603. Improve slow mirror/disk warnings in BlockReceiver.
|
2017-04-18 16:20:43 -07:00 |
Konstantin V Shvachko
|
c3840bde54
|
HDFS-11634. Optimize BlockIterator when interating starts in the middle. Contributed by Konstantin V Shvachko.
(cherry picked from commit 8dfcd95d58 )
|
2017-04-17 17:06:18 -07:00 |
Zhe Zhang
|
051ab77806
|
HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen.
(cherry picked from commit ad49098eb3 )
|
2017-04-17 16:28:58 -07:00 |
Yongjun Zhang
|
c411adac32
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen, Rosie Li.
|
2017-04-14 10:14:02 -07:00 |
Hanisha Koneru
|
107f685f64
|
HDFS-11630. TestThrottledAsyncCheckerTimeout fails intermittently in Jenkins builds. Contributed by Hanisha Koneru.
|
2017-04-12 17:11:36 -07:00 |
Hanisha Koneru
|
ed8bb51f59
|
HDFS-11560. Expose slow disks via NameNode JMX. Contributed by Hanisha Koneru.
|
2017-04-12 16:59:37 -07:00 |
Kihwal Lee
|
8ed230c805
|
HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp.
|
2017-04-12 13:28:26 -05:00 |
Chris Nauroth
|
d5e2bd4096
|
HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
|
2017-04-11 21:18:47 -07:00 |
Mingliang Liu
|
f1a85b2be3
|
HDFS-11558. BPServiceActor thread name is too long. Contributed by Xiaobing Zhou
|
2017-04-11 18:09:43 -07:00 |
Hanisha Koneru
|
f16bb79957
|
HDFS-11551. Support Timeout when checking single disk. Contributed by Hanisha Koneru.
|
2017-04-11 16:54:28 -07:00 |
Xiaoyu Yao
|
0391c92022
|
HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou.
(cherry picked from commit 0eacd4c13b )
|
2017-04-06 16:15:56 -07:00 |
Andrew Wang
|
ed8f738be5
|
HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah.
|
2017-04-06 14:38:22 -07:00 |
Xiaoyu Yao
|
325be6e720
|
HDFS-11362. StorageDirectory should initialize a non-null default StorageDirType. Contribute by Hanisha Koneru.
(cherry picked from commit dde3bbf351ef3121ae80a96d06668d8fe33c788f)
|
2017-04-06 14:33:30 -07:00 |
Arpit Agarwal
|
75e60b6bb7
|
HDFS-11131. TestThrottledAsyncChecker#testCancellation is flaky.
|
2017-04-05 17:54:27 -07:00 |
Xiaobing Zhou
|
9f20532ef5
|
HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou.
|
2017-04-05 15:33:19 -07:00 |
Andrew Wang
|
e154893d3b
|
HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang.
|
2017-04-05 12:52:34 -07:00 |
Hanisha Koneru
|
4cdda4ba87
|
HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeat. Contributed by Hanisha Koneru.
|
2017-04-05 07:35:09 -07:00 |
Akira Ajisaka
|
88e1799034
|
HDFS-9651. Add missing robots.txt files.
(cherry picked from commit 8cb7325527 )
|
2017-04-05 12:48:12 +09:00 |
Akira Ajisaka
|
a563fa8ee9
|
HDFS-9651. All web UIs should include a robots.txt file. Contributed by Lars Francke.
(cherry picked from commit 09e6caec3d )
|
2017-04-05 12:46:09 +09:00 |
Hanisha Koneru
|
fbe86471cf
|
HDFS-11551. Support Timeout when checking single disk. Contributed by Hanisha Koneru.
|
2017-04-04 10:49:44 -07:00 |
Wei-Chiu Chuang
|
4f1f16f1a6
|
HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang.
(cherry picked from commit bc7aff7cec )
|
2017-04-03 07:36:08 -07:00 |
Mingliang Liu
|
9e7f8cbf9a
|
HDFS-11592. Closing a file has a wasteful preconditions in NameNode. Contributed by Eric Badger
(cherry picked from commit e5f0622a6f )
|
2017-03-30 15:44:44 -07:00 |
Daniel Templeton
|
e00ad6fca5
|
HDFS-11571. Typo in DataStorage exception message (Contributed by Anna Budai via Daniel Templeton)
(cherry picked from commit 15e3873dc3 )
|
2017-03-29 10:57:52 -07:00 |
Andrew Wang
|
82b4a9c3d0
|
HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by SammiChen and Kai Zheng.
|
2017-03-28 21:40:53 -07:00 |
Masatake Iwasaki
|
b7b9d74521
|
HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin.
(cherry picked from commit 64ea62c1cc )
|
2017-03-28 09:19:42 +09:00 |
Andrew Wang
|
10deafee82
|
HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou.
|
2017-03-27 14:35:03 -07:00 |
Junping Du
|
2fefa1fa2e
|
Add HDFS jdiff for 2.8.0 release.
(cherry picked from commit d174c06b01 )
|
2017-03-25 14:33:06 -07:00 |
Hanisha Koneru
|
a79ad2d122
|
HDFS-11570. Unit test for NameNodeStatusMXBean. Contributed by Hanisha Koneru.
|
2017-03-24 14:44:33 -07:00 |
Xiaobing Zhou
|
757d9ebcc5
|
HDFS-11534. Add counters for number of blocks in pending IBR. Contributed by Xiaobing Zhou.
|
2017-03-24 14:40:00 -07:00 |
Wei-Chiu Chuang
|
14414705f7
|
HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka.
|
2017-03-24 08:43:14 -07:00 |
Chris Douglas
|
69f34e812e
|
HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri
(cherry picked from commit b104f3a282 )
|
2017-03-20 17:16:15 -07:00 |
Arpit Agarwal
|
5d7197b2e6
|
HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou.
|
2017-03-17 19:03:41 -07:00 |
Arpit Agarwal
|
2b4b85e06f
|
HDFS-11517. Include missed change in previous commit.
|
2017-03-17 16:12:53 -07:00 |
Hanisha Koneru
|
dbd673d516
|
HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru
|
2017-03-17 15:50:00 -07:00 |
Andrew Wang
|
7cc88eca43
|
HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki.
(cherry picked from commit 92ea6d74ec )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/util/ErasureCodingCliCmdExecutor.java
hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testErasureCodingConf.xml
|
2017-03-17 11:34:43 -07:00 |
Kihwal Lee
|
a264d98017
|
HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla.
(cherry picked from commit ba62b50eba )
|
2017-03-16 11:02:48 -05:00 |
Yiqun Lin
|
c0e061b410
|
HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin.
|
2017-03-15 22:37:25 +08:00 |
Yiqun Lin
|
f731013c88
|
HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin.
|
2017-03-14 17:52:31 +08:00 |
Jing Zhao
|
e03d8ff488
|
HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
(cherry picked from commit 55796a0946 )
|
2017-03-13 14:26:44 -07:00 |
Yiqun Lin
|
7a65601dd9
|
HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger.
(cherry picked from commit 79924266f8 )
|
2017-03-13 18:24:50 +08:00 |
Lei Xu
|
ee1d3105c2
|
HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei)
|
2017-03-10 14:37:58 -08:00 |
Arpit Agarwal
|
5cdcda34a2
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-09 14:34:10 -08:00 |
Arpit Agarwal
|
b6c4776911
|
HDFS-11461. DataNode Disk Outlier Detection. Contributed by Hanisha Koneru.
|
2017-03-09 12:59:48 -08:00 |
Masatake Iwasaki
|
60be2e5d8a
|
HDFS-11499. Decommissioning stuck because of failing recovery. Contributed by Lukas Majercak and Manoj Govindassamy.
(cherry picked from commit 385d2cb777 )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
|
2017-03-09 23:37:04 +09:00 |
Arpit Agarwal
|
8dc8ecbb91
|
HDFS-10838. Last full block report received time for each DN should be easily discoverable. Contributed by Surendra Singh Lilhore.
|
2017-03-06 16:40:00 -08:00 |
Andrew Wang
|
6e75c1e2f0
|
HDFS-11498. Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0.
(cherry picked from commit 5e74196ede )
|
2017-03-06 15:04:29 -08:00 |
Yiqun Lin
|
5b49a96328
|
HDFS-8741. Proper error msg to be printed when invalid operation type is given to WebHDFS operations. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 3536ce031c )
|
2017-03-06 19:05:43 +08:00 |
Yiqun Lin
|
2288857e3b
|
HDFS-11494. Log message when DN is not selected for block replication. Contributed by Yiqun Lin.
|
2017-03-04 13:41:49 +08:00 |
Jing Zhao
|
30b43a2d4e
|
HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.
(cherry picked from commit ac5ae0065a )
|
2017-03-03 13:35:13 -08:00 |
Andrew Wang
|
d737a26c5a
|
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
This reverts commit 5e760f8dc4 .
|
2017-03-02 16:21:32 -08:00 |
Arpit Agarwal
|
5e760f8dc4
|
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
|
2017-03-02 15:38:32 -08:00 |
Ming Ma
|
8ce4863103
|
HDFS-11412. Maintenance minimum replication config value allowable range should be [0, DefaultReplication]. (Manoj Govindassamy via mingma)
|
2017-03-02 11:06:48 -08:00 |
Brahma Reddy Battula
|
a545ee4d7f
|
HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
(cherry picked from commit dcd03df9f9 )
|
2017-03-01 10:47:47 +05:30 |
Zhe Zhang
|
5fb785e154
|
HDFS-11466. Change dfs.namenode.write-lock-reporting-threshold-ms default from 1000ms to 5000ms. Contributed by Andrew Wang.
(cherry picked from commit d269b488a7 )
|
2017-02-28 09:02:59 -08:00 |
Wei-Chiu Chuang
|
f3cdf29af4
|
HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao.
|
2017-02-25 21:13:51 -08:00 |
Arpit Agarwal
|
98af813098
|
HDFS-11462. Fix occasional BindException in TestNameNodeMetricsLogger.
|
2017-02-24 19:53:45 -08:00 |
Yiqun Lin
|
31f9ef2203
|
HDFS-11433. Document missing usages of OfflineEditsViewer processors. Contributed by Yiqun Lin.
(cherry picked from commit 4a58870a04 )
|
2017-02-25 10:03:02 +08:00 |
Arpit Agarwal
|
fa86ec99a1
|
HDFS-11295. Check storage remaining instead of node remaining in BlockPlacementPolicyDefault.chooseReplicaToDelete(). Contributed by Marton Elek.
|
2017-02-24 15:44:19 -08:00 |
Akira Ajisaka
|
bd3c2a2ee9
|
HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg.
|
2017-02-25 04:17:17 +09:00 |
Andrew Wang
|
6c5fd82773
|
HDFS-11438. Fix typo in error message of StoragePolicyAdmin tool. Contributed by Alison Yu.
(cherry picked from commit d150f061f4 )
|
2017-02-22 15:16:12 -08:00 |
Ming Ma
|
0add328c8c
|
HDFS-11411. Avoid OutOfMemoryError in TestMaintenanceState test runs. (Manoj Govindassamy via mingma)
(cherry picked from commit cfcd527323 )
|
2017-02-22 09:42:47 -08:00 |
Andrew Wang
|
4428c3da69
|
HDFS-11406. Remove unused getStartInstance and getFinalizeInstance in FSEditLogOp. Contributed by Alison Yu.
(cherry picked from commit 8ef7ebbc71 )
|
2017-02-21 14:54:32 -08:00 |
Eric Payne
|
41d31588d1
|
HDFS-11404. Increase timeout on TestShortCircuitLocalRead.testDeprecatedGetBlockLocalPathInfoRpc. Contributed by Eric Badger
(cherry picked from commit a07ddef101 )
|
2017-02-21 12:09:29 -06:00 |
Vinayakumar B
|
00ca9f1792
|
HDFS-11177. 'storagepolicies -getStoragePolicy' command should accept URI based path. (Contributed by Surendra Singh Lilhore)
(cherry picked from commit 4804050630 )
|
2017-02-21 18:15:03 +05:30 |
Xiao Chen
|
06386b7e78
|
HDFS-11410. Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOp.
(cherry picked from commit 02c549484a )
|
2017-02-16 18:08:16 -08:00 |
Ming Ma
|
0f8b99fd34
|
HDFS-11265. Extend visualization for Maintenance Mode under Datanode tab in the NameNode UI. (Marton Elek via mingma)
(cherry picked from commit a136936d01 )
|
2017-02-15 20:25:04 -08:00 |
Mingliang Liu
|
96be70513a
|
HDFS-11375. Display the volume storage type in datanode UI. Contributed by Surendra Singh Lilhore
(cherry picked from commit 0741dd3b9a )
|
2017-02-15 12:34:43 -08:00 |
Wei-Chiu Chuang
|
a8531d5d52
|
HDFS-11333. Print a user friendly error message when plugins are not found. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 859bd159ae )
|
2017-02-15 02:59:45 -08:00 |
Yongjun Zhang
|
eb5500f0e7
|
HDFS-11391. Numeric usernames do no work with WebHDFS FS write access. (Pierre Villard via Yongjun Zhang)
(cherry picked from commit 8e53f2b9b0 )
|
2017-02-14 14:11:45 -08:00 |
Wei-Chiu Chuang
|
8e291e1015
|
HDFS-11084. Add a regression test for sticky bit support of OIV ReverseXML processor. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 89cadb42111e4ffbd3f4bde8250013bba23eb51e)
|
2017-02-14 09:08:37 -08:00 |
Kihwal Lee
|
33c62d2d19
|
HDFS-11379. DFSInputStream may infinite loop requesting block locations. Contributed by Daryn Sharp.
|
2017-02-10 12:52:14 -06:00 |
Yiqun Lin
|
26bed5ce53
|
HDFS-11377. Balancer hung due to no available mover threads. Contributed by yunjiong zhao.
(cherry picked from commit 9cbbd1eae8 )
|
2017-02-06 13:18:14 +08:00 |
Arpit Agarwal
|
b64d9093e1
|
HDFS-11112. Journal Nodes should refuse to format non-empty directories. Contributed by Yiqun Lin.
|
2017-02-01 16:52:07 -08:00 |
Lei Xu
|
d258077bc1
|
HDFS-11335. Remove HdfsClientConfigKeys.DFS_CLIENT_SLOW_IO_WARNING_THRESHOLD_KEY usage from DNConf. (Manoj Govindassamy via lei)
(cherry picked from commit bec9b7aa1d )
|
2017-02-01 14:44:08 +08:00 |
Karthik Kambatla
|
8b01d5cbba
|
HDFS-11378. Addendum to fix branch-2 compilation. Verify multiple DataNodes can be decommissioned/maintenance at the same time. (Manoj Govindassamy via kasha)
|
2017-01-29 11:18:54 -08:00 |
Ming Ma
|
34f9ceab4a
|
HDFS-11378. Verify multiple DataNodes can be decommissioned/maintenance at the same time. (Manoj Govindassamy via mingma)
(cherry picked from commit 312b36d113 )
|
2017-01-27 16:17:51 -08:00 |
Masatake Iwasaki
|
528bff9c42
|
HDFS-9884. Use doxia macro to generate in-page TOC of HDFS site documentation. (iwasakims)
|
2017-01-28 08:11:40 +09:00 |
Anu Engineer
|
d20dc8691e
|
HDFS-9911. TestDataNodeLifeline Fails intermittently. Contributed by Yiqun Lin
(cherry picked from commit a95639068c )
|
2017-01-27 20:55:59 +00:00 |
Arpit Agarwal
|
17d4ba26fc
|
HDFS-11374. Skip FSync in CreateEditsLog to speed up edit log generation. Contributed by Hanisha Koneru.
|
2017-01-26 16:21:38 -08:00 |
Xiao Chen
|
67d2875f8f
|
Revert "HDFS-8377. Support HTTP/2 in datanode. Contributed by Duo Zhang."
This reverts commit f70b9d9241 .
|
2017-01-26 14:21:17 -08:00 |
Xiao Chen
|
827cd30923
|
HDFS-11364. Add a test to verify Audit log entries for setfacl/getfacl commands over FS shell. Contributed by Manoj Govindassamy.
(cherry picked from commit 44606aa850 )
|
2017-01-26 10:58:17 -08:00 |
Arpit Agarwal
|
deb3ef4587
|
HDFS-11369. Change exception message in StorageLocationChecker.
|
2017-01-26 09:12:46 -08:00 |
Zhe Zhang
|
558fee285a
|
HDFS-10534. NameNode WebUI should display DataNode usage histogram. Contributed by Kai Sasaki.
(cherry picked from commit 18e1d68209 )
|
2017-01-25 10:39:11 -08:00 |
Arpit Agarwal
|
b4078e1d0e
|
HDFS-11194. Maintain aggregated peer performance metrics on NameNode.
|
2017-01-24 19:34:33 -08:00 |
Ming Ma
|
bed700e98f
|
HDFS-11296. Maintenance state expiry should be an epoch time and not jvm monotonic. (Manoj Govindassamy via mingma)
(cherry picked from commit f3fb94be05 )
|
2017-01-19 22:33:43 -08:00 |
Lei Xu
|
1cc5f460ed
|
HDFS-11259. Update fsck to display maintenance state info. (Manoj Govindassamy via lei)
|
2017-01-19 16:24:58 +08:00 |
Lei Xu
|
541efe18c7
|
HDFS-11287. Storage class member storageDirs should be private to avoid unprotected access by derived classes. (Manoj Govindassamy via lei)
(cherry picked from commit 63320d1daa )
|
2017-01-19 15:38:40 +08:00 |
Vinitha Reddy Gankidi
|
e2b3eff641
|
HDFS-10733. NameNode terminated after full GC thinking QJM is unresponsive. Contributed by Vinitha Gankidi.
|
2017-01-18 12:52:58 -08:00 |
Akira Ajisaka
|
db47bd15dd
|
HDFS-11290. TestFSNameSystemMBean should wait until JMX cache is cleared. Contributed by Erik Krogen.
(cherry picked from commit b1a9ec856b )
|
2017-01-18 17:56:22 +09:00 |
Arpit Agarwal
|
42a14b6db9
|
HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou.
|
2017-01-17 15:31:18 -08:00 |
Xiaoyu Yao
|
420e4db98a
|
HDFS-11209. SNN can't checkpoint when rolling upgrade is not finalized. Contributed by Xiaoyu Yao.
(cherry picked from commit b1fce2b8b1 )
|
2017-01-17 14:36:03 -08:00 |
Xiaoyu Yao
|
eae5bde007
|
HDFS-10913. Introduce fault injectors to simulate slow mirrors. Contributed by Xiaobing Zhou.
|
2017-01-17 10:30:34 -08:00 |
Arpit Agarwal
|
be8e001f1f
|
HDFS-11339. Support File IO sampling for Datanode IO profiling hooks. Contributed by Hanisha Koneru.
|
2017-01-16 22:49:14 -08:00 |
Arpit Agarwal
|
52fdd387ec
|
HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru.
|
2017-01-16 22:42:13 -08:00 |
Arpit Agarwal
|
8ec9dca2e1
|
HDFS-11279. Cleanup unused DataNode#checkDiskErrorAsync(). Contributed by Hanisha Koneru.
|
2017-01-16 22:14:06 -08:00 |
Xiaoyu Yao
|
eafaddca1a
|
HDFS-11274. Datanode should only check the failed volume upon IO errors. Contributed by Xiaoyu Yao.
|
2017-01-16 22:14:04 -08:00 |
Arpit Agarwal
|
ec80de3ccc
|
HDFS-11182. Update DataNode to use DatasetVolumeChecker.
|
2017-01-16 22:14:00 -08:00 |
Arpit Agarwal
|
413dccaf78
|
HDFS-10959. Update DataNode to use DatasetVolumeChecker. Contributed by Xiaoyu Yao.
|
2017-01-16 22:13:58 -08:00 |
Akira Ajisaka
|
2d6be7ea23
|
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
(cherry picked from commit e407449ddb )
|
2017-01-17 10:22:29 +09:00 |
Arpit Agarwal
|
954dae26cd
|
HDFS-11337. (HDFS-10958 backport). Add instrumentation hooks around Datanode disk IO.
|
2017-01-16 13:53:30 -08:00 |
Wei-Chiu Chuang
|
914eeb997b
|
HDFS-11306. Print remaining edit logs from buffer if edit log can't be rolled. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 1cde954a4f )
|
2017-01-13 11:46:57 -08:00 |
Ming Ma
|
b6258e2b15
|
HDFS-9391. Update webUI/JMX to display maintenance state info. (Manoj Govindassamy via mingma)
|
2017-01-10 20:20:13 -08:00 |
Mingliang Liu
|
ce5ad0e88f
|
HDFS-11253. FileInputStream leak on failure path in BlockSender. Contributed by Arpit Agarwal
|
2017-01-10 14:48:28 -08:00 |
Xiaoyu Yao
|
48fb796fcb
|
HDFS-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao.
|
2017-01-10 14:48:23 -08:00 |
Yongjun Zhang
|
137547579b
|
HDFS-11292. log lastWrittenTxId etc info in logSyncAll. Contributed by Yongjun Zhang.
(cherry picked from commit 603cbcd513 )
|
2017-01-09 16:16:42 -08:00 |
Arpit Agarwal
|
6f35700f04
|
HDFS-11149. Support for parallel checking of FsVolumes.
Change-Id: I6e7ada81562f380a260f8f561d0fa6a4cb102560
|
2017-01-06 07:55:19 -08:00 |
Arpit Agarwal
|
fd3b1ca26c
|
HDFS-11148. Update DataNode to use StorageLocationChecker at startup.
Change-Id: I61dfae840e767f9a33c0bb45a058f2b866cbffa4
|
2017-01-05 20:49:34 -08:00 |
Arpit Agarwal
|
76f1ab524c
|
HDFS-11119. Support for parallel checking of StorageLocations on DataNode startup.
Change-Id: Iddedbeefd056af165be3557ccad199fe2878b591
|
2017-01-05 20:49:30 -08:00 |
Chris Nauroth
|
9c61858ee7
|
HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 4c8f9e1302 )
|
2017-01-05 15:05:01 -08:00 |
Andrew Wang
|
d4ca1c5226
|
HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang.
|
2017-01-04 15:10:15 -08:00 |
Andrew Wang
|
2b5b62f9cc
|
Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang."
This reverts commit 80e6640848 .
|
2017-01-03 11:12:53 -08:00 |
Andrew Wang
|
80e6640848
|
HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang.
(cherry picked from commit 7fcc73fc0d )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
|
2017-01-03 09:58:45 -08:00 |
Lei Xu
|
db81cc3add
|
HDFS-11267. Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage. (Manoj Govindassamy via lei)
(cherry picked from commit a4f66655ec )
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java
|
2016-12-29 17:06:21 +08:00 |
Lei Xu
|
f349c7692d
|
HDFS-11251. ConcurrentModificationException during DataNode#refreshVolumes. (Manoj Govindassamy via lei)
(cherry picked from commit e9f1396834 )
|
2016-12-29 15:35:17 +08:00 |
Daniel Templeton
|
af266c8c85
|
HDFS-11278. Add missing @Test annotation for TestSafeMode.testSafeModeUtils() (Contributed by Lukas Majercak via Daniel Templeton)
(cherry picked from commit ce3613c965 )
|
2016-12-28 20:11:09 -08:00 |
Daniel Templeton
|
47f0a0e15b
|
HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton)
|
2016-12-28 07:03:51 -08:00 |
Brahma Reddy Battula
|
5d46d5d4c6
|
HDFS-11252. TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException. Contributed by Yiqun Lin.
(cherry picked from commit 0ddb8defad )
|
2016-12-28 10:37:21 +05:30 |
Mingliang Liu
|
74ee21a7b1
|
HDFS-11270. Document the missing options of NameNode bootstrap command. Contributed by Yiqun Lin
(cherry picked from commit c0e0ef2969 )
|
2016-12-27 11:38:31 -08:00 |
Akira Ajisaka
|
cd331556f6
|
HDFS-11272. Refine the assert messages in TestFSDirAttrOp. Contributed by Jimmy Xiang.
(cherry picked from commit ea547529cb )
|
2016-12-26 17:17:14 +09:00 |
Akira Ajisaka
|
1b39268233
|
HDFS-11250. Fix a typo in ReplicaUnderRecovery#setRecoveryID. Contributed by Yiqun Lin.
(cherry picked from commit 8f218ea284 )
|
2016-12-26 16:52:43 +09:00 |
Akira Ajisaka
|
a779b4ab8f
|
HDFS-11271. Typo in NameNode UI. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 483cd06ad4 )
|
2016-12-26 16:37:52 +09:00 |
Akira Ajisaka
|
16c4dcad85
|
HDFS-11258. Addendum patch to fix compile issue. Contributed by Jimmy Xiang.
|
2016-12-23 03:56:12 +09:00 |
Haohui Mai
|
de926f93c2
|
HDFS-11258. File mtime change could not save to editlog. Contributed by Jimmy Xiang.
|
2016-12-21 14:22:09 -08:00 |
Xiao Chen
|
1ab279c311
|
HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu.
(cherry picked from commit 5b7acdd206 )
|
2016-12-20 12:27:40 -08:00 |
Brahma Reddy Battula
|
7a92345f16
|
HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1b401f6a73 )
|
2016-12-20 21:02:16 +05:30 |
Akira Ajisaka
|
a95acbcb6e
|
HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit d2026ae9e6 )
|
2016-12-20 14:36:03 +09:00 |
Wei-Chiu Chuang
|
0cb99db9d9
|
HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang.
|
2016-12-15 16:35:37 -08:00 |
Mingliang Liu
|
012d28a1fa
|
HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger
|
2016-12-15 14:54:40 -08:00 |
Akira Ajisaka
|
eaa50a1087
|
HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit 36947f79ba )
|
2016-12-16 00:34:43 +09:00 |
Akira Ajisaka
|
190b2dca62
|
HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
(cherry picked from commit 72bff192cd )
|
2016-12-14 18:53:24 +09:00 |
Andrew Wang
|
6b795c34d0
|
HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge.
(cherry picked from commit fbdbbd57cd )
|
2016-12-13 18:01:35 -08:00 |
Mingliang Liu
|
282a562437
|
HDFS-11226. cacheadmin, cryptoadmin and storagepolicyadmin should support generic options. Contributed by Brahma Reddy Battula
(cherry picked from commit e91494c27a0b9a4a456d92fe7d632a608c4f11f3)
|
2016-12-12 18:17:54 -08:00 |
Xiaoyu Yao
|
0bdaa23334
|
Revert "HDFS-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao."
This reverts commit 4c9ca47386 .
|
2016-12-09 21:37:13 -08:00 |
Xiaoyu Yao
|
4c9ca47386
|
HDFS-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao.
(cherry picked from commit df983b524a )
|
2016-12-09 21:31:45 -08:00 |
Wei-Chiu Chuang
|
292bd78b44
|
HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang.
|
2016-12-09 16:07:56 -08:00 |
Andrew Wang
|
215abbdf5f
|
HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore.
|
2016-12-09 14:29:22 -08:00 |
Andrew Wang
|
85adc6677b
|
HDFS-11217. Annotate NameNode and DataNode MXBean interfaces as Private/Stable. Contributed by Jagadesh Kiran N.
(cherry picked from commit 5bd7dece92 )
|
2016-12-09 12:05:45 -08:00 |
Vinayakumar B
|
199d8b5594
|
HDFS-11224. Lifeline message should be ignored for dead nodes (Contributed by Vinayakumar B)
(cherry picked from commit d1d4aba71b )
|
2016-12-09 14:54:37 +05:30 |
Xiao Chen
|
e51f32f74c
|
HDFS-11197. Listing encryption zones fails when deleting a EZ that is on a snapshotted directory. Contributed by Wellington Chevreuil.
(cherry picked from commit 401c731872 )
|
2016-12-08 12:41:17 -08:00 |
Akira Ajisaka
|
e00a124cb5
|
HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
(cherry picked from commit 9ef89ede2f )
|
2016-12-08 13:39:58 +09:00 |
Vinayakumar B
|
4b21b47f56
|
HDFS-9057. allow/disallow snapshots via webhdfs (Contributed by Brahma Reddy Battula)
(cherry picked from commit 6d2332ae37 )
|
2016-12-07 15:58:15 -08:00 |
Ming Ma
|
d2656dc5a6
|
HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma)
|
2016-12-07 08:27:17 -08:00 |
Karthik Kambatla
|
8773cd5f76
|
HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
(cherry picked from commit c8d0a049b0 )
|
2016-12-06 14:16:38 -08:00 |
Mingliang Liu
|
eb9e7820a9
|
HDFS-11211. Add a time unit to the DataNode client trace format. Contributed by Jagadesh Kiran N
(cherry picked from commit 43cb1678cc )
|
2016-12-06 09:13:38 -08:00 |
Kihwal Lee
|
f74dad7414
|
HDFS-11198. NN UI should link DN web address using hostnames. Contributed by Weiwei Yang.
|
2016-12-06 08:07:54 -06:00 |
Andrew Wang
|
6a2f239d9e
|
Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang"
This reverts commit be969e5918 .
|
2016-12-05 23:09:14 -08:00 |
Andrew Wang
|
2fdae7324b
|
HDFS-10581. Hide redundant table on NameNode WebUI when no nodes are decomissioning. Contributed by Weiwei Yang.
(cherry picked from commit 8e63fa98ea )
|
2016-12-05 18:14:06 -08:00 |
Mingliang Liu
|
be969e5918
|
HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang
(cherry picked from commit c7ff34f8dc )
|
2016-12-02 11:36:11 -08:00 |
Akira Ajisaka
|
5a7941a4fc
|
HDFS-11180. Intermittent deadlock in NameNode when failover happens.
|
2016-12-02 11:34:05 +09:00 |
Kihwal Lee
|
0d8a35bd6d
|
HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp.
|
2016-12-01 12:15:15 -06:00 |
Ravi Prakash
|
fdf5394b2a
|
HDFS-8678. Bring back the feature to view chunks of files in the HDFS file browser. Contributed by Ivo Udelsmann.
(cherry picked from commit 625df87c7b )
|
2016-11-30 09:14:36 -08:00 |
Robert Kanter
|
285edf691d
|
HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
(cherry picked from commit 47ca9e26fb )
|
2016-11-28 18:12:53 -08:00 |
Akira Ajisaka
|
0df7f5cdf6
|
HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin.
(cherry picked from commit 636f7547b7 )
|
2016-11-25 17:50:14 +09:00 |
Brahma Reddy Battula
|
2207a84a7d
|
HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
(cherry picked from commit afcf8d38e7 )
|
2016-11-22 20:32:30 +05:30 |
Kihwal Lee
|
774b0cd845
|
HDFS-10966. Enhance Dispatcher logic on deciding when to give up a source DataNode. Contributed by Mark Wagner and Zhe Zhang.
|
2016-11-21 10:39:04 -06:00 |
Brahma Reddy Battula
|
aa76fe4132
|
HDFS-11101. TestDFSShell#testMoveWithTargetPortEmpty fails intermittently. Contributed By Brahma Reddy Battula.
(cherry picked from commit f922067748 )
|
2016-11-21 19:36:10 +05:30 |
Brahma Reddy Battula
|
f3649deca5
|
HDFS-11144. TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception. Contributed By Brahma Reddy Battula.
(cherry picked from commit c68dad18ab )
|
2016-11-21 10:59:23 +05:30 |
Brahma Reddy Battula
|
3e5a85f35e
|
HDFS-11134. Fix bind exception threw in TestRenameWhileOpen. Contributed By Yiqun Lin.
(cherry picked from commit b2d4b7b1b9 )
|
2016-11-17 10:24:21 +05:30 |
Arpit Agarwal
|
da8c24bbad
|
HDFS-11114. Support for running async disk checks in DataNode.
|
2016-11-16 13:38:15 -08:00 |
Mingliang Liu
|
57a0f84860
|
HDFS-11105. TestRBWBlockInvalidation#testRWRInvalidation fails intermittently. Contributed by Yiqun Lin
(cherry picked from commit c90891e7b3 )
|
2016-11-16 13:06:25 -08:00 |
Kihwal Lee
|
f08e227671
|
HDFS-8870. Lease is leaked on write failure. Contributed by Kuhu Shukla.
(cherry picked from commit 4fcea8a0c8 )
|
2016-11-15 14:51:34 -06:00 |
Zhe Zhang
|
818915aabb
|
HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
|
2016-11-14 16:33:15 -08:00 |
Brahma Reddy Battula
|
399abe7c74
|
HDFS-11135. The tests in TestBalancer run fails due to NPE. Contributed By Yiqun Lin
(cherry picked from commit 6efb8c9c60 )
|
2016-11-14 20:41:55 +05:30 |
Erik Krogen
|
98d9e9c4c8
|
HDFS-11087. NamenodeFsck should check if the output writer is still writable. Contributed by Erik Krogen.
|
2016-11-13 14:50:33 -08:00 |
Mingliang Liu
|
fb3a5085e8
|
HADOOP-13813. TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing. Contributed by Mingliang Liu
|
2016-11-12 10:36:14 -08:00 |
Mingliang Liu
|
685d753d07
|
HDFS-11129. TestAppendSnapshotTruncate fails with bind exception. Contributed by Brahma Reddy Battula
(cherry picked from commit 2ee18fc15e )
|
2016-11-11 22:16:05 -08:00 |
Xiaoyu Yao
|
5613b0818c
|
HDFS-10941. Improve BlockManager#processMisReplicatesAsync log. Contributed by Chen Liang.
(cherry picked from commit 4484b48498 )
|
2016-11-11 14:31:54 -08:00 |
Mingliang Liu
|
289f03e49e
|
HDFS-11122. TestDFSAdmin#testReportCommand fails due to timed out. Contributed by Yiqun Lin
(cherry picked from commit aa6010ccca )
|
2016-11-11 12:30:22 -08:00 |
Brahma Reddy Battula
|
b51806b45f
|
HDFS-11128. CreateEditsLog throws NullPointerException. Contributed by Hanisha Koneru.
(cherry picked from commit 1ae57f0f75 )
|
2016-11-11 20:09:49 +05:30 |
Xiao Chen
|
a6146a1026
|
HDFS-11120. TestEncryptionZones should waitActive. Contributed by John Zhuge.
(cherry picked from commit 907b1431c0ead934e26cf7dbc51bfab5d7cc5ddc)
|
2016-11-09 17:16:31 -08:00 |
Wei-Chiu Chuang
|
16430c64b7
|
HDFS-11056. Concurrent append and read operations lead to checksum error. Contributed by Wei-Chiu Chuang.
|
2016-11-09 13:28:16 -08:00 |
Brahma Reddy Battula
|
53ff3c9e03
|
HDFS-9482. Replace DatanodeInfo constructors with a builder pattern. Contributed by Brahma Reddy Battula.
|
2016-11-09 09:58:36 +05:30 |
Mingliang Liu
|
f5c9f9f1b2
|
HDFS-11083. Add unit test for DFSAdmin -report command. Contributed by Xiaobing Zhou
(cherry picked from commit 62d8c17dfd )
|
2016-11-08 17:05:34 -08:00 |
Andrew Wang
|
4f25fd975e
|
HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.
(cherry picked from commit e1c6ef2efa )
|
2016-11-08 16:33:58 -08:00 |
Arpit Agarwal
|
b77239b46d
|
Revert "HDFS-11114. Support for running async disk checks in DataNode."
This reverts commit 732eaadddb .
|
2016-11-08 09:04:58 -08:00 |