Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,972 Commits 326 Branches 371 Tags
Commit Graph

6605 Commits

Author SHA1 Message Date
Chris Douglas
34512b2d7a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham 
(cherry picked from commit d55a84951abe87a31c17bd4b84cd309ed202e540)
 2017-10-27 15:36:18 -07:00
Arpit Agarwal
2510fc1801 HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:49:18 -07:00
Junping Du
ce10c1ef05 Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:18:50 -07:00
Xiao Chen
e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen. 
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
 2017-10-25 14:11:38 -07:00
Zhe Zhang
f3409e71d9 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit aecf6c50d351e7aed2008a682677a1edb104585d.
 2017-10-24 15:06:01 -07:00
Wei-Chiu Chuang
b8a2fd37dc HDFS-12249. dfsadmin -metaSave to output maintenance mode blocks. Contributed by Wellington Chevreuil. 
(cherry picked from commit 0f2a69127aa40b7dccdf74ff63e2205a10ae8998)
 2017-10-23 15:24:54 -07:00
Xiao Chen
a7e34be69a HDFS-12518. Re-encryption should handle task cancellation and progress better. 
(cherry picked from commit 0f5287bb2fe71b35f70f977a06c31094b352512c)
 2017-10-20 16:25:39 -07:00
Andrew Wang
ea149c10cf HDFS-12497. Re-enable TestDFSStripedOutputStreamWithFailure tests. Contributed by Huafeng Wang. 
(cherry picked from commit 0477eff8be4505ad2730ec16621105b6df9099ae)
 2017-10-20 13:27:29 -07:00
Kai Zheng
b7cb58a21d HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang 2017-10-20 09:34:58 +08:00
Inigo Goiri
f4a2f0ee9f HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 
(cherry picked from commit 0f1c0376186de6446d595be7bb445ed6b71ae499)
 2017-10-19 18:10:47 -07:00
Zhe Zhang
aecf6c50d3 HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270ed3a653c44c0bc92396167b5022df6e)
 2017-10-18 23:52:07 -07:00
Arpit Agarwal
5897095d53 HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b8c9469e8c2b64c3268d671f5a43e75)
 2017-10-17 16:45:21 -07:00
Lei Xu
6959db9c20 HDFS-12612. DFSStripedOutputStream.close will throw if called a second time with a failed streamer. (Lei (Eddy) Xu) 2017-10-17 15:53:07 -07:00
Lei Xu
cdfcd384b2 HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu) 
(cherry picked from commit 31ebccc96238136560f4210bdf6766fe18e0650c)
 2017-10-16 19:46:26 -07:00
Xiao Chen
7c00d66118 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:15 -07:00
Xiao Chen
ca1271e218 HDFS-12637. Extend TestDistributedFileSystemWithECFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit f57e5aae77a004ac9a8d548cf7fa2669e3642f30)
 2017-10-16 09:55:31 -07:00
Xiao Chen
77ef810552 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
 2017-10-16 09:51:19 -07:00
Xiao Chen
66847c27db HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:30 -07:00
Arpit Agarwal
4d19e39fd7 HDFS-12553. Add nameServiceId to QJournalProtocol. Contributed by Bharat Viswanadham 2017-10-13 14:53:45 -07:00
Arpit Agarwal
0a673f1539 HDFS-12599. Remove Mockito dependency from DataNodeTestUtils. Contributed by Ted Yu. 
(cherry picked from commit 09ad848b6484c4d36b2d59903f9ec370fdb18d3e)
 2017-10-11 15:31:39 -05:00
Kai Zheng
8947c0b881 HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang 2017-10-11 15:47:00 +08:00
Andrew Wang
a26da9dcf2 HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit a297fb08866305860dc17813c3db5701e9515101)
 2017-10-10 17:35:56 -07:00
Andrew Wang
f1cfb2a8dc Revert "HDFS-12603. Enable async edit logging by default." 
This reverts commit e9f3f49b6dabca540ce48a633c1767fbdb49b6da.
 2017-10-09 17:54:19 -07:00
Andrew Wang
1d11701e55 HDFS-12541. Extend TestSafeModeWithStripedFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit 793820823325e390bb671f4cc1b3bc6920bba5de)
 2017-10-09 13:03:39 -07:00
Andrew Wang
e9f3f49b6d HDFS-12603. Enable async edit logging by default. 
(cherry picked from commit afb42aeabf1317b755ab79e0265bc90920c896ac)
 2017-10-09 11:20:04 -07:00
Lei Xu
015eb628b8 HDFS-12606. When using native decoder, DFSStripedStream.close crashes JVM after being called multiple times. (Lei (Eddy) Xu) 
(cherry picked from commit 46644319e1b3295ddbc7597c060956bf46487d11)
 2017-10-09 10:09:49 -07:00
John Zhuge
7dfe97d84f HDFS-12494. libhdfs SIGSEGV in setTLSExceptionStrings. Contributed by John Zhuge. 
(cherry picked from commit 2856eb207bfb206f22a6266f42cad0257083ab94)
 2017-10-07 00:09:36 -07:00
Inigo Goiri
ae9f82c603 HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. 
(cherry picked from commit 53e8d0d030525e4c7f3875e23807c6dbe778890f)
 2017-10-06 19:04:47 -07:00
Inigo Goiri
87b1f87094 HDFS-12273. Federation UI. Contributed by Inigo Goiri. 
(cherry picked from commit adbb2e00c7b85524fd43bd68895d49814c16680a)
 2017-10-06 19:04:46 -07:00
Inigo Goiri
c85b4ba028 HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. 
(cherry picked from commit b12440d3479f19138bc66ea59baf41eb89061906)
 2017-10-06 19:04:46 -07:00
Inigo Goiri
3c621636e0 HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. 
(cherry picked from commit c2d6aa79055ef72406fa598e1c743b0c994b5da8)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
43616f8531 HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. 
(cherry picked from commit 928d1e87f9dbe64f89b858ccc1780723f3af58e7)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
73d3ea8012 HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. 
(cherry picked from commit 3302e792d469b7e8f3bfa10151e4e1c546589734)
 2017-10-06 19:04:45 -07:00
Inigo Goiri
e6e7143545 HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. 
(cherry picked from commit 3b19e77752afce87936f5c0d1e6d272fba798d7b)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
e8b511ca33 HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. 
(cherry picked from commit fabe02c8fafa807198054da0c02b2ebaafda76aa)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
ad48e844fa HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 23c4ddee11ab1300325a6361124ee8ad6f68d7a4)
 2017-10-06 19:04:44 -07:00
Inigo Goiri
503849477a HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. 
(cherry picked from commit 90ba6843fb3ac5dc7576535e66a75a5e3433247b)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
24d275842f HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. 
(cherry picked from commit ee3260211d94aed223dd6f2386a166eb2c7d67af)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
54a355dc8d HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. 
(cherry picked from commit ae27e31fbcf546481db0b0345772db2e9132372e)
 2017-10-06 19:04:43 -07:00
Inigo Goiri
a0cce0fa0b HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 58b97df661441150d35abd44b3a8606206b46441)
 2017-10-06 19:04:42 -07:00
Inigo Goiri
c0fb7b283e HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. 
(cherry picked from commit 928f8dab52191e733984d37f47b69719ccf11313)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
a11e99efeb HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 95cae08849d23cf12c5d280c29f90908e6a90d40)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
ad0fca5dea HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. 
(cherry picked from commit 47db6e9d8e2c264671c89fdd6cb11a7c762d2cce)
 2017-10-06 19:04:41 -07:00
Inigo Goiri
2b99a4d29f HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 8a9cdebebf26841a0f1e99fb08135f4597f2eba2)
 2017-10-06 19:04:40 -07:00
Inigo Goiri
9b09f73006 HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit c6e0bd640cdaf83a660fa050809cad6f1d4c6f4d)
 2017-10-06 19:04:40 -07:00
Inigo
05afc382d9 HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6d94c90ece1c1d23d4c97e72c54e9991f5dbc481)
 2017-10-06 19:04:39 -07:00
Inigo
ff134679e0 HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 0f88e049156dce173afc0dbda864e29190dd2210)
 2017-10-06 19:04:39 -07:00
Inigo
9e3491fafa HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. 
(cherry picked from commit 6821e801724ac38e9737538b2164c9ae88792282)
 2017-10-06 19:04:16 -07:00
Xiao Chen
3106552b75 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
 2017-10-05 19:47:13 -07:00
Andrew Wang
e159272003 HDFS-12567. BlockPlacementPolicyRackFaultTolerant fails with racks with very few nodes. 
(cherry picked from commit 644c2f6924f341f51d809c91dccfff88fc82f6f0)
 2017-10-05 16:58:46 -07:00