Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,119 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

6503 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli (I am also known as @tshooter.) b1712f9c1f HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades. 
(cherry picked from commit f19638333b)
 2017-12-08 08:03:58 -08:00
Lei Xu e309d25d2b HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 67662e2ac9)
(cherry picked from commit f3143d225a)
 2017-12-07 11:24:24 -08:00
Akira Ajisaka 99bc03f56b
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb)
(cherry picked from commit a8be4b559a)
 2017-12-07 13:24:10 +09:00
Xiao Chen 859f57e32c HDFS-12872. EC Checksum broken when BlockAccessToken is enabled. 
(cherry picked from commit 56b1ff80dd)
 2017-12-05 20:48:53 -08:00
Akira Ajisaka c49b4f7977
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a5)
(cherry picked from commit c81057d936)
 2017-12-06 11:42:12 +09:00
Chris Douglas 0d41249bec HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 42307e3c3a)
(cherry picked from commit 2399c96ee7)
 2017-12-02 23:32:59 -08:00
Chris Douglas 60adf0b8bd Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak" 
This reverts commit be664bd64d.
 2017-12-01 11:19:25 -08:00
Chris Douglas be664bd64d HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 5304698dc8)
(cherry picked from commit 482fd5a880)
 2017-12-01 10:35:31 -08:00
Kihwal Lee 2e1532a712 HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b)
 2017-11-29 15:13:49 -06:00
Kihwal Lee 6c633e64a0 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 738d1a206a)
 2017-11-22 14:20:44 -06:00
Lei Xu 781c01aa2c HDFS-12847. Regenerate editsStored and editsStored.xml in HDFS tests. Contributed by Lei (Eddy) Xu. 2017-11-22 10:23:25 -08:00
Andrew Wang 3853c33466 Update maven versions in preparation for 3.0.0 release. 2017-11-14 11:12:22 -08:00
Akira Ajisaka 9051d1b851
HDFS-12732. Correct spellings of ramdomly to randomly in log. Contributed by hu xiaodong. 
(cherry picked from commit 3a3566e1d1)
 2017-11-09 15:18:32 +09:00
Brahma Reddy Battula d25d3827d5 HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula 
(cherry picked from commit 410d0319cf)
 2017-11-08 14:49:10 +05:30
Weiwei Yang 19b1164fc6 HDFS-7060. Avoid taking locks when sending heartbeats from the DataNode. Contributed by Jiandan Yang. 2017-11-08 10:24:35 +08:00
Kihwal Lee 50b438b597 HDFS-12771. Add genstamp and block size to metasave Corrupt blocks list. Contributed by Kuhu Shukla. 
(cherry picked from commit 4d2dce40bb)
 2017-11-03 15:18:36 -05:00
Xiao Chen 71965747f4 HDFS-11467. Support ErasureCoding section in OIV XML/ReverseXML. Contributed by Huafeng Wang. 
(cherry picked from commit c8eb4beabad84686f869a2397f7188499cab12c9)
 2017-11-03 12:05:55 -07:00
Xiao Chen 621a50ebb1 HDFS-12725. BlockPlacementPolicyRackFaultTolerant fails with very uneven racks. 
(cherry picked from commit e1187bad8e9b9abb54a55b5f9ab8373b0f64e6d7)
 2017-11-02 21:53:20 -07:00
Xiao Chen 1c96e0d693 HDFS-12682. ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED. 
(cherry picked from commit 4f4cea56b25d5acc14dd6d61dea70fd4a0c7a9d9)
 2017-11-02 21:27:43 -07:00
Weiwei Yang b2f717d967 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 
(cherry picked from commit 56b88b0670)
 2017-11-01 16:53:07 +08:00
Yiqun Lin 5cada4564a
HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. Contributed by Erik Krogen. 
(cherry picked from commit 20304b91cc)
 2017-11-01 16:43:44 +09:00
Lei Xu 9ee04006cb HDFS-12482. Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery. (lei) 2017-10-31 22:03:44 -07:00
Chris Douglas b5f66b005c Revert "HDFS-7878. API - expose a unique file identifier." 
This reverts commit 1ce0eb7d23.
 2017-10-31 13:56:41 -07:00
Wei-Chiu Chuang 1347e83c90 HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8dbc8909c9)
 2017-10-31 12:52:58 -07:00
Manoj Govindassamy 166c75a0eb HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory. 
(cherry picked from commit 075dd45a24)
 2017-10-31 12:50:54 -07:00
Manoj Govindassamy 1375c7205f HDFS-12573. Divide the total blocks metrics into replicated and erasure coded. Contributed by Takanobu Asanuma. 
(cherry picked from commit 78af6cdc53)
 2017-10-31 12:50:21 -07:00
Manoj Govindassamy 014184127e HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured. 
(cherry picked from commit b406d8e375)
 2017-10-31 12:49:41 -07:00
Wei-Chiu Chuang 579612c9d2 HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4ab0c8f96a)
 2017-10-31 12:49:08 -07:00
Akira Ajisaka 143dbf8497 HDFS-12622. Fix enumerate in HDFSErasureCoding.md. Contributed by Yiqun Lin. 
(cherry picked from commit dc63a6a52b)
 2017-10-31 12:48:29 -07:00
Andrew Wang ae08fe518b Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham." 
This reverts commit f09725537e.
 2017-10-31 10:46:19 -07:00
Inigo Goiri e259030066 HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 
(cherry picked from commit 982bd2a5bf)
 2017-10-31 10:23:06 -07:00
Arpit Agarwal f09725537e HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham. 2017-10-31 10:08:05 -07:00
Chris Douglas 1ce0eb7d23 HDFS-7878. API - expose a unique file identifier. 
(cherry picked from commit d015e0bbd5)
 2017-10-31 09:46:39 -07:00
Chris Douglas 34512b2d7a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham 
(cherry picked from commit d55a84951a)
 2017-10-27 15:36:18 -07:00
Junping Du ce10c1ef05 Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf)
 2017-10-26 23:18:50 -07:00
Xiao Chen e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen. 
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
 2017-10-25 14:11:38 -07:00
Zhe Zhang f3409e71d9 Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." 
This reverts commit aecf6c50d3.
 2017-10-24 15:06:01 -07:00
Wei-Chiu Chuang b8a2fd37dc HDFS-12249. dfsadmin -metaSave to output maintenance mode blocks. Contributed by Wellington Chevreuil. 
(cherry picked from commit 0f2a69127a)
 2017-10-23 15:24:54 -07:00
Xiao Chen a7e34be69a HDFS-12518. Re-encryption should handle task cancellation and progress better. 
(cherry picked from commit 0f5287bb2fe71b35f70f977a06c31094b352512c)
 2017-10-20 16:25:39 -07:00
Andrew Wang ea149c10cf HDFS-12497. Re-enable TestDFSStripedOutputStreamWithFailure tests. Contributed by Huafeng Wang. 
(cherry picked from commit 0477eff8be)
 2017-10-20 13:27:29 -07:00
Kai Zheng b7cb58a21d HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang 2017-10-20 09:34:58 +08:00
Inigo Goiri f4a2f0ee9f HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri. 
(cherry picked from commit 0f1c037618)
 2017-10-19 18:10:47 -07:00
Zhe Zhang aecf6c50d3 HDFS-12502. nntop should support a category based on FilesInGetListingOps. 
(cherry picked from commit 60bfee270e)
 2017-10-18 23:52:07 -07:00
Arpit Agarwal 5897095d53 HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar. 
(cherry picked from commit b6942cbe9b)
 2017-10-17 16:45:21 -07:00
Lei Xu 6959db9c20 HDFS-12612. DFSStripedOutputStream.close will throw if called a second time with a failed streamer. (Lei (Eddy) Xu) 2017-10-17 15:53:07 -07:00
Lei Xu cdfcd384b2 HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu) 
(cherry picked from commit 31ebccc962)
 2017-10-16 19:46:26 -07:00
Xiao Chen 7c00d66118 HDFS-12642. Log block and datanode details in BlockRecoveryWorker. 
(cherry picked from commit 971b3ca1acc15d9a1f8e774291813dafd16ef704)
 2017-10-16 10:34:15 -07:00
Xiao Chen ca1271e218 HDFS-12637. Extend TestDistributedFileSystemWithECFile with a random EC policy. Contributed by Takanobu Asanuma. 
(cherry picked from commit f57e5aae77a004ac9a8d548cf7fa2669e3642f30)
 2017-10-16 09:55:31 -07:00
Xiao Chen 77ef810552 HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang. 
(cherry picked from commit d0311dfc5fe92a0e0f3fb8ae92e412edce609740)
 2017-10-16 09:51:19 -07:00
Xiao Chen 66847c27db HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar. 
(cherry picked from commit 11a7729c1474aa379a62c0440c8c1a11be261a75)
 2017-10-15 19:28:30 -07:00