8053 Commits

Author	SHA1	Message	Date
Anu Engineer	d9be9a8c30	HDFS-11698. Ozone: SCM: CLI: Add Debug command. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	a28557ac03	HDFS-11712. Ozone: Reuse ObjectMapper instance to improve the performance. Contributed by Yiqun Lin.	2018-04-26 05:34:18 -07:00
Anu Engineer	ee8708ca31	HDFS-11747. Ozone : need to fix OZONE_SCM_DEFAULT_PORT. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Weiwei Yang	3158f479d3	HDFS-11725. Ozone: Revise create container CLI specification and implementation. Contributed by Weiwei Yang	2018-04-26 05:34:18 -07:00
Weiwei Yang	b581cde542	HDFS-11728. Ozone: add the DB names to OzoneConsts. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	6b3da448eb	HDFS-11675. Ozone: SCM CLI: Implement delete container command. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Chen Liang	e9588c6422	HDFS-11627. Block Storage: Cblock cache should register with flusher to upload blocks to containers. Contributed by Mukul Kumar Singh.	2018-04-26 05:34:18 -07:00
Chen Liang	668b056984	HDFS-11667. Block Storage:Handling flushing of incomplete block id buffers during shutdown. Contributed by Mukul Kumar Singh.	2018-04-26 05:34:18 -07:00
Xiaoyu Yao	1a245accb5	HDFS-11668. Ozone: misc improvements for SCM CLI. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Yiqun Lin	5984d40b86	HDFS-11666. Ozone: Fix compile error due to inconsistent package name. Contributed by Yiqun Lin.	2018-04-26 05:34:18 -07:00
Xiaoyu Yao	a9ba8b5ded	HDFS-11504. Ozone: SCM: Add Block APIs. Contributed by Xiaoyu Yao.	2018-04-26 05:34:18 -07:00
Weiwei Yang	720e5c40f6	HDFS-11649. Ozone: SCM: CLI: Add shell code placeholder classes. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	6c4bd1647c	HDFS-11581. Ozone: Support force delete a container. Contributed by Yuanbo Liu.	2018-04-26 05:34:18 -07:00
Anu Engineer	d3f93d55d9	HDFS-11631. Block Storage : allow cblock server to be started from hdfs commandline. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	05b12c48cf	HDFS-11657. Ozone: Add unit test for storage container metrics. Contributed by Yiqun Lin.	2018-04-26 05:34:18 -07:00
Anu Engineer	783b7c27b1	HDFS-11582. Block Storage : add SCSI target access daemon. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	7d4a2d4104	HDFS-11569. Ozone: Implement listKey function for KeyManager. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Chen Liang	cbb7cc26a5	HDFS-11642. Block Storage: fix TestCBlockCLI and TestCBlockServerPersistence cleanup. Contributed by Xiaoyu Yao.	2018-04-26 05:34:18 -07:00
Chen Liang	5b19a03f63	HDFS-11635. Block Storage: Add metrics for Container Flushes. Contributed by Mukul Kumar Singh.	2018-04-26 05:34:18 -07:00
Xiaoyu Yao	2129c6b276	HDFS-11062. Ozone:SCM: Remove null command. Contributed by Yuanbo Liu.	2018-04-26 05:34:18 -07:00
Chen Liang	b7463924af	HDFS-11618. Block Storage: Add Support for Direct I/O. Contributed by Mukul Kumar Singh.	2018-04-26 05:34:18 -07:00
Anu Engineer	57b2a9b17d	HDFS-11006. Ozone: support setting chunk size in streaming API. Contributed by Yiqun Lin.	2018-04-26 05:34:18 -07:00
Anu Engineer	cd361fa490	HDFS-11625. Ozone: Fix UT failures that caused by hard coded datanode data dirs. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Anu Engineer	7573a0bc61	HDFS-11620. Ozone: Allocate container for MiniOzone cluster fails because of insufficient space error. Contributed by Mukul Kumar Singh.	2018-04-26 05:34:18 -07:00
Anu Engineer	fadfe37019	HDFS-11619. Ozone: Unit tests running failed in Windows. Contributed by Yiqun Lin.	2018-04-26 05:34:18 -07:00
Anu Engineer	aa16380d71	HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin.	2018-04-26 05:34:18 -07:00
Anu Engineer	82d814fa79	HDFS-11564. Ozone: SCM: Add Comparable Metric Support. Contributed by Anu Engineer.	2018-04-26 05:34:18 -07:00
Anu Engineer	68da45a789	HDFS-11519. Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis. Contributed by Tsz Wo Nicholas Sze.	2018-04-26 05:34:18 -07:00
Chen Liang	3966f42895	HDFS-11591. Block Storage: fix TestCBlockServer test cleanup. Contributed by Xiaoyu Yao	2018-04-26 05:34:18 -07:00
Anu Engineer	7c59add3da	HDFS-11594. Ozone: close container should call compactDB. Contributed by Anu Engineer.	2018-04-26 05:34:18 -07:00
Xiaoyu Yao	bc9c313907	HDFS-11567. Ozone: SCM: Support update container. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Xiaoyu Yao	17a6e62629	HDFS-11537. Block Storage : add cache layer. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	3598d4b8cf	HDFS-11548. Ozone: SCM: Add node pool management API. Contributed by Xiaoyu Yao	2018-04-26 05:34:18 -07:00
Anu Engineer	dc8e73a7d5	HDFS-11355. Block Storage : Merge configuration into ozone configuration classes. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	860a4e0044	HDFS-11550. Ozone: Add a check to prevent removing a container that has keys in it. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Anu Engineer	23044c1db8	HDFS-11361. Block Storage: add cache interface. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	d251a55ff9	HDFS-11559. Ozone: MiniOzoneCluster prints too many log messages by default. Contributed by Tsz Wo Nicholas Sze.	2018-04-26 05:34:18 -07:00
Anu Engineer	1e892f5748	HDFS-11162. Block Storage: add command line tool. Contributed by Chen Liang.	2018-04-26 05:34:18 -07:00
Anu Engineer	85c2312e7d	HDFS-11492. Ozone: Add the ability to handle sendContainerReport Command. Contributed by Anu Engineer.	2018-04-26 05:34:18 -07:00
Anu Engineer	98d3360e3a	HDFS-11444. Ozone: Fix datanode ID handling in MiniOzoneCluster. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Xiaoyu Yao	88371ff07f	HDFS-11491. Ozone: SCM: Add close container RPC. Contributed by Anu Engineer.	2018-04-26 05:34:18 -07:00
Anu Engineer	932423211f	HDFS-11469. Ozone: SCM: Container allocation based on node report. Contributed by Xiaoyu Yao.	2018-04-26 05:34:18 -07:00
Xiaoyu Yao	fc7d678d3d	HDFS-11071. Ozone: SCM: Move SCM config keys to ScmConfig. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Tsz-Wo Nicholas Sze	7b7d186b82	HDFS-11513. Ozone: Separate XceiverServer and XceiverClient into interfaces and implementations.	2018-04-26 05:34:18 -07:00
Anu Engineer	1058aa2523	HDFS-10928. Ozone:SCM: Support MXBean for SCM and NodeManager. Contributed by Weiwei Yang.	2018-04-26 05:34:18 -07:00
Anu Engineer	386dbc11da	HDFS-11196. Ozone: Improve logging and error handling in the container layer. Contributed by Anu Engineer.	2018-04-25 15:55:06 -07:00
Anu Engineer	32cc2b8f1a	HDFS-11509. Ozone: Fix TestEndpoint test regression. Contributed by Anu Engineer.	2018-04-25 15:54:56 -07:00
Anu Engineer	9c57a61f68	HDFS-11424. Block Storage: add container representation to meta data. Contributed Chen Liang.	2018-04-25 15:54:56 -07:00
Anu Engineer	3e1317de02	HDFS-11451. Ozone: Add protobuf definitions for container reports. Contributed by Anu Engineer.	2018-04-25 15:54:56 -07:00
Anu Engineer	02fb9aed32	HDFS-11158. Ozone: TestDatanodeStateMachine is failing intermittently. Contributed by Weiwei Yang.	2018-04-25 15:54:56 -07:00
Anu Engineer	753979865b	HDFS-11137. Ozone: SCM: Add negative tests cases for datanodeStatemachine. Contributed by Weiwei Yang.	2018-04-25 15:54:42 -07:00
Anu Engineer	d55564143d	HDFS-11484. Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate. Contributed by Xiaoyu Yao.	2018-04-25 15:54:42 -07:00
Anu Engineer	a2328d36ac	HDFS-11480. Ozone: TestEndpoint task failure. Contributed by Xiaoyu Yao.	2018-04-25 15:54:42 -07:00
Anu Engineer	2cba0daddc	HDFS-11425. Ozone: add client-facing container APIs and container references. Contributed by Chen Liang.	2018-04-25 15:54:42 -07:00
Anu Engineer	56f011fd02	HDFS-11447. Ozone: SCM: Send node report to SCM with heartbeat.Contributed by Xiaoyu Yao.	2018-04-25 15:54:41 -07:00
Anu Engineer	f4529316bd	HDFS-11474. Ozone: TestContainerMapping needs to cleanup levelDB files.Contributed by Xiaoyu Yao.	2018-04-25 15:54:36 -07:00
Anu Engineer	b29ae6e5f7	HDFS-11473. Ozone : exclude cblock protobuf files from findbugs check. Contributed by Xiaoyu Yao.	2018-04-25 15:54:36 -07:00
Anu Engineer	b8b72241aa	HDFS-11036. Ozone: reuse Xceiver connection. Contributed by Chen Liang.	2018-04-25 15:54:36 -07:00
Arpit Agarwal	754ed7d651	HDFS-11414. Ozone : move StorageContainerLocation protocol to hdfs-client. Contributed by Chen Liang.	2018-04-25 15:54:34 -07:00
Anu Engineer	bb410de10c	HDFS-11184. Ozone: SCM: Make SCM use container protocol. Contributed by Anu Engineer.	2018-04-25 15:54:26 -07:00
Anu Engineer	c169dd1306	HDFS-11463. Ozone: Add metrics for container operations and export over JMX. Contributed by Mukul Kumar Singh.	2018-04-25 15:54:03 -07:00
Anu Engineer	a7f82cba71	HDFS-11154. Block Storage: store server state to persistent storage. Contributed by Chen Liang	2018-04-25 15:53:58 -07:00
Anu Engineer	9997d36eb6	HDFS-11138. Block Storage: add block storage server. Contributed by Chen Liang	2018-04-25 15:53:58 -07:00
Anu Engineer	48db56adea	HDFS-11133. Ozone: Add allocateContainer RPC. Contributed by Anu Engineer	2018-04-25 15:53:58 -07:00
Anu Engineer	ca12aac5a4	HDFS-11126. Ozone: Add small file support RPC. Contributed by Anu Engineer.	2018-04-25 15:53:58 -07:00
Anu Engineer	05b44e1ad8	HDFS-11108. Ozone: use containers with the state machine. Contributed by Anu Engineer	2018-04-25 15:53:56 -07:00
Anu Engineer	8bd85268e6	HDFS-11081. Ozone:SCM: Add support for registerNode in datanode. Contributed by Anu Engineer.	2018-04-25 15:53:50 -07:00
Anu Engineer	2b8b3754f6	HDFS-11130. Block Storage : Add storage client to server protocol. Contributed by Chen Lian	2018-04-25 15:53:49 -07:00
Anu Engineer	3d83ee25c5	HDFS-11127. Block Storage : add block storage service protocol. Contributed by Chen Liang	2018-04-25 15:53:43 -07:00
Anu Engineer	8274ff356a	HDFS-11103. Ozone: Cleanup some dependencies. Contributed by Anu Engineer.	2018-04-25 15:53:39 -07:00
Anu Engineer	e49e305f25	HDFS-11001. Ozone:SCM: Add support for registerNode in SCM. Contributed by Anu Engineer.	2018-04-25 15:53:34 -07:00
Anu Engineer	964daed853	fix a build break due to merge	2018-04-25 15:53:34 -07:00
Anu Engineer	b186fc81f7	HDFS-10938. Ozone:SCM: Add datanode protocol. Contributed by Anu Engineer.	2018-04-25 15:53:32 -07:00
Anu Engineer	ee119ff60a	HDFS-11004. Ozone : move Chunk IO and container protocol calls to hdfs-client. Contributed by Chen Liang.	2018-04-25 15:53:27 -07:00
Anu Engineer	ed84388fca	HDFS-10912. Ozone:SCM: Add chill mode support to NodeManager. Contributed by Anu Engineer.	2018-04-25 15:53:27 -07:00
Anu Engineer	5520f73dee	Fixing merge conflicts due to HDFS-10637	2018-04-25 15:53:27 -07:00
Anu Engineer	56b0fddfbd	HDFS-10995. Ozone: Move ozone XceiverClient to hdfs-client. Contributed by Chen Liang.	2018-04-25 15:53:25 -07:00
Anu Engineer	d0422a74ea	HDFS-10932. Ozone: fix XceiverClient slow shutdown. Contributed by Chen Liang.	2018-04-25 15:53:21 -07:00
Anu Engineer	4c95c3d6ab	HDFS-10897. Ozone: SCM: Add NodeManager. Contributed by Anu Engineer.	2018-04-25 15:53:21 -07:00
Arpit Agarwal	e3aa2b687c	HDFS-10420. Fix Ozone unit tests to use MiniOzoneCluster. Contributed by Arpit Agarwal.	2018-04-25 15:53:21 -07:00
Anu Engineer	3beee0b3d1	HDFS-10363. Ozone: Introduce new config keys for SCM service endpoints. Contributed by Arpit Agarwal.	2018-04-25 15:53:19 -07:00
Arpit Agarwal	6c61902389	HDFS-10361. Support starting StorageContainerManager as a daemon. (Contributed by Arpit Agarwal)	2018-04-25 15:53:12 -07:00
Anu Engineer	aa3ca951f9	HDFS-10351. Ozone: Optimize key writes to chunks by providing a bulk write implementation in ChunkOutputStream. Contributed by Chris Nauroth.	2018-04-25 15:53:07 -07:00
Chris Nauroth	acf0b220ce	HDFS-10349. Ozone: StorageContainerManager fails to compile after merge of HDFS-10312 maxDataLength enforcement. Contributed by Chris Nauroth.	2018-04-25 15:53:07 -07:00
Anu Engineer	7d661a289a	HDFS-10232. Ozone: Make config key naming consistent. Contributed by Anu Engineer.	2018-04-25 15:53:05 -07:00
Anu Engineer	0ecbc13128	HDFS-10278. Ozone: Add paging support to list Volumes. Contributed by Anu Engineer.	2018-04-25 15:52:58 -07:00
Anu Engineer	7bb2ab7d7c	HDFS-10251. Ozone: Shutdown cleanly. Contributed by Anu Engineer	2018-04-25 15:52:58 -07:00
Anu Engineer	e11e824c9b	HDFS-10268. Ozone: end-to-end integration for create/get volumes, buckets and keys. Contributed by Chris Nauroth.	2018-04-25 15:52:56 -07:00
Chris Nauroth	0addb1033e	HDFS-10250. Ozone: Add key Persistence. Contributed by Anu Engineer.	2018-04-25 15:52:48 -07:00
Chris Nauroth	c6fd5ea3f0	HDFS-10238. Ozone : Add chunk persistance. Contributed by Anu Engineer.	2018-04-25 15:52:48 -07:00
Anu Engineer	0744d0a947	HDFS-8210. Ozone: Implement storage container manager. Contributed by Chris Nauroth.	2018-04-25 15:52:46 -07:00
Chris Nauroth	e758f90f93	HDFS-10195. Ozone: Add container persistence. Contributed by Anu Engineer.	2018-04-25 15:52:33 -07:00
Chris Nauroth	c18c6801ef	HDFS-10202. ozone : Add key commands to CLI. Contributed by Anu Engineer.	2018-04-25 15:52:25 -07:00
Chris Nauroth	f69ce5f3c6	HDFS-10196. Ozone : Enable better error reporting for failed commands in ozone shell. Contributed by Anu Engineer.	2018-04-25 15:52:09 -07:00
Chris Nauroth	fd2fe47b32	HDFS-10179. Ozone: Adding logging support. Contributed by Anu Engineer.	2018-04-25 15:52:07 -07:00
Chris Nauroth	7c55d7feb5	HDFS-9960. OzoneHandler : Add localstorage support for keys. Contributed by Anu Engineer.	2018-04-25 15:52:00 -07:00
Chris Nauroth	4009b66090	HDFS-10180. Ozone: Refactor container Namespace. Contributed by Anu Engineer.	2018-04-25 15:52:00 -07:00
Chris Nauroth	044cc47145	HDFS-9961. Ozone: Add buckets commands to CLI. Contributed by Anu Engineer.	2018-04-25 15:52:00 -07:00
Chris Nauroth	bb47d03906	HDFS-9944. Ozone : Add container dispatcher. Contributed by Anu Engineer.	2018-04-25 15:52:00 -07:00
Chris Nauroth	b9d53ed836	HDFS-9926. ozone : Add volume commands to CLI. Contributed by Anu Engineer.	2018-04-25 15:52:00 -07:00
Chris Nauroth	60fbef08ec	HDFS-9925. Ozone: Add Ozone Client lib for bucket handling. Contributed by Anu Engineer. ... Fix build break	2018-04-25 15:52:00 -07:00
Chris Nauroth	a9879798a6	HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer.	2018-04-25 15:52:00 -07:00
Chris Nauroth	93201330b8	HDFS-9916. OzoneHandler : Add Key handler. Contributed by Anu Engineer.	2018-04-25 15:52:00 -07:00
Anu Engineer	2b387d622c	HDFS-9920. Stop tracking CHANGES.txt in the HDFS-7240 feature branch. Contributed by Chris Nauroth.	2018-04-25 15:52:00 -07:00
Chris Nauroth	085c62545d	HDFS-9891. Ozone: Add container transport client. Contributed by Anu Engineer.	2018-04-25 15:51:58 -07:00
Chris Nauroth	9b158f3b57	HDFS-9873. Ozone: Add container transport server. Contributed by Anu Engineer.	2018-04-25 15:51:53 -07:00
Anu Engineer	3c39c18a6d	HDFS-9907. Exclude Ozone protobuf-generated classes from Findbugs analysis. Contributed by Chris Nauroth	2018-04-25 15:51:53 -07:00
Chris Nauroth	0a43e272f1	HDFS-9848. Ozone: Add Ozone Client lib for volume handling. Contributed by Anu Engineer.	2018-04-25 15:51:53 -07:00
Anu Engineer	3481897bde	HDFS-9853. Ozone: Add container definitions. Contributed by Anu Engineer.	2018-04-25 15:51:51 -07:00
cnauroth	11a6cc2a4d	HDFS-9845. OzoneHandler : Support List and Info Volumes. Contributed by Anu Engineer.	2018-04-25 15:51:39 -07:00
cnauroth	f6ef841f74	HDFS-9834. OzoneHandler : Enable MiniDFSCluster based testing for Ozone. Contributed by Anu Engineer.	2018-04-25 15:51:39 -07:00
Anu Engineer	f6b9c0f8a1	HDFS-8757 : OzoneHandler : Add localStorageHandler support for Buckets. Contributed by Anu Engineer	2018-04-25 15:51:39 -07:00
Anu Engineer	ae109d1de7	HDFS-8527. OzoneHandler: Integration of REST interface and container data pipeline back-end. Contributed by Chris Nauroth	2018-04-25 15:51:36 -07:00
Anu Engineer	a301827c6a	HDFS-8695. OzoneHandler : Add Bucket REST Interface. (aengineer)	2018-04-25 15:51:00 -07:00
Anu Engineer	764ff0d505	HDFS-8753. Ozone: Unify StorageContainerConfiguration with ozone-default.xml & ozone-site.xml. Contributed by kanaka kumar avvaru	2018-04-25 15:51:00 -07:00
Arpit Agarwal	507e7274aa	HDFS-8717. OzoneHandler : Add common bucket objects. (Contributed by Anu Engineer)	2018-04-25 15:51:00 -07:00
Arpit Agarwal	07213f4eb5	HDFS-8680. OzoneHandler : Add Local StorageHandler support for volumes. (Contributed by Anu Engineer)	2018-04-25 15:51:00 -07:00
Arpit Agarwal	835f872a0a	HDFS-8654. OzoneHandler : Add ACL support. (Contributed by Anu Engineer)	2018-04-25 15:51:00 -07:00
Arpit Agarwal	b1fa06aacb	HDFS-8644. OzoneHandler : Add volume handler. (Contributed by Anu Engineer)	2018-04-25 15:51:00 -07:00
Arpit Agarwal	2793b4c96f	HDFS-8634. OzoneHandler: Add userAuth Interface and Simple userAuth handler. (Contributed by Anu Engineer)	2018-04-25 15:51:00 -07:00
Arpit Agarwal	d65b373ec4	HDFS-8637. OzoneHandler : Add Error Table. (Contributed by Anu Engineer)	2018-04-25 15:51:00 -07:00
cnauroth	2ea29ee062	HDFS-8448. Create REST Interface for Volumes. Contributed by Anu Engineer.	2018-04-25 15:51:00 -07:00
Arpit Agarwal	0a90e6d45c	HDFS-8614. OzoneHandler : Add Quota Support. (Contributed by Anu Engineer)	2018-04-25 15:51:00 -07:00
Arpit Agarwal	d41245ca56	HDFS-8456. Introduce STORAGE_CONTAINER_SERVICE as a new NodeType. (Contributed by Arpit Agarwal)	2018-04-25 15:50:52 -07:00
Yiqun Lin	b06601acce	HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri.	2018-04-24 11:25:23 +08:00
Inigo Goiri	df92a17e02	HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang.	2018-04-23 19:12:16 -07:00
Bharat Viswanadham	9b5375e0c1	HDFS-13356. Balancer:Set default value of minBlockSize to 10mb. Contributed by Bharat Viswanadham	2018-04-23 16:09:01 -07:00
Lei Xu	42e82f0281	Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release. ... (cherry picked from commit f6ecb76d0b) Conflicts: hadoop-project-dist/pom.xml	2018-04-23 14:14:05 -07:00
Chris Douglas	f411de6a79	HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang	2018-04-23 11:13:18 -07:00
Arpit Agarwal	c533c77047	HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal.	2018-04-23 10:08:53 -07:00
Inigo Goiri	63803e7051	HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.	2018-04-22 19:49:35 -07:00
Arpit Agarwal	1c1ce63cda	HDFS-13055. Aggregate usage statistics from datanodes. Contributed by Ajay Kumar.	2018-04-22 08:07:19 -07:00
Yiqun Lin	b6dae26f44	HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri.	2018-04-21 13:19:09 +08:00
Sangjin Lee	f40969a141	HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov.	2018-04-20 20:33:10 -07:00
Inigo Goiri	1134af9ad1	HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar.	2018-04-19 14:56:36 -07:00
Shashikant Banerjee	e4c39f3247	HADOOP-15396. Some java source files are executable ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-04-19 08:35:38 +09:00
Bharat Viswanadham	bf7694d020	HDFS-13464. Fix javadoc in FsVolumeList#handleVolumeFailures. Contributed by Shashikant Banerjee	2018-04-18 08:23:45 -07:00
Mukul Kumar Singh	bf2f493f81	HDFS-13463. Fix javadoc in FsDatasetImpl#checkAndUpdate. Contributed by Shashikant Banerjee.	2018-04-18 16:11:37 +05:30
Erik Krogen	2d9e791a90	HDFS-12828. OIV ReverseXML Processor fails with escaped characters ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-04-18 14:38:23 +09:00
Wei Yan	e4313e7e47	HDFS-13466. RBF: Add more router-related information to the UI.	2018-04-17 15:01:07 -07:00
Inigo Goiri	c9b33514b8	HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak.	2018-04-17 14:19:23 -07:00
Bharat Viswanadham	a68b04370f	HDFS-13129. Add a test for DfsAdmin refreshSuperUserGroupsConfiguration. Contributed by Mukul Kumar Singh	2018-04-17 12:37:30 -07:00
Yiqun Lin	c4d3636c21	HDFS-13435. RBF: Improve the error loggings for printing the stack trace.	2018-04-17 11:23:22 +08:00
Arpit Agarwal	d907fdc3cd	HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar.	2018-04-16 14:16:59 -07:00
Wei-Chiu Chuang	e66e287efe	HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota.	2018-04-13 09:17:34 -07:00
Xiao Chen	6503593711	HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445.	2018-04-13 09:05:17 -07:00
Bharat Viswanadham	fa8b88ab2b	HDFS-13438. Fix javadoc in FsVolumeList#removeVolume. Contributed by Shashikant Banerjee.	2018-04-13 08:56:02 -07:00
Yiqun Lin	0725953efe	HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie.	2018-04-13 17:55:45 +08:00
Akira Ajisaka	9b0b9f2af2	HDFS-13436. Fix javadoc of package-info.java	2018-04-13 13:23:51 +09:00
Inigo Goiri	044341b4e4	HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.	2018-04-12 09:30:11 -07:00
Inigo Goiri	b5353c75d9	Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." ... This reverts commit ac32b3576d.	2018-04-12 09:28:23 -07:00
Inigo Goiri	d272056fcb	Revert "HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar." ... This reverts commit 18de6f2042.	2018-04-12 08:42:19 -07:00
Mukul Kumar Singh	7ed8511ad8	HDFS-13426. Fix javadoc in FsDatasetAsyncDiskService#removeVolume. Contributed by Shashikant Banerjee.	2018-04-12 20:12:31 +05:30
Akira Ajisaka	113af12cfb	HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu.	2018-04-12 17:47:37 +09:00
Akira Ajisaka	c7cd362afd	HDFS-13427. Fix the section titles of transparent encryption document.	2018-04-12 10:44:56 +09:00
Inigo Goiri	18de6f2042	HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.	2018-04-11 12:03:14 -07:00
Inigo Goiri	f7d5bace43	HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.	2018-04-11 10:43:43 -07:00
Wei Yan	0c93d43f3d	HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri.	2018-04-11 08:37:43 -07:00
James Clampffer	eefe2a147c	HDFS-13403: libhdfs++ Use hdfs::IoService object rather than asio::io_service. Contributed by James Clampffer.	2018-04-11 10:27:23 -04:00
Xiao Chen	7c9cdad6d0	HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo.	2018-04-10 21:31:48 -07:00
Xiao Chen	e76c2aeb28	HDFS-13363. Record file path when FSDirAclOp throws AclException. Contributed by Gabor Bota.	2018-04-10 11:19:48 -07:00
Rakesh Radhakrishnan	f89594f0b8	HDFS-13328. Abstract ReencryptionHandler recursive logic in separate class. Contributed by Surendra Singh Lilhore.	2018-04-10 23:35:00 +05:30
Weiwei Yang	6729047a8b	HDFS-13420. License header is displayed in ArchivalStorage/MemoryStorage html pages. Contributed by Akira Ajisaka.	2018-04-10 22:10:44 +08:00
Yiqun Lin	e87be8a2a4	HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri.	2018-04-10 15:34:42 +08:00
Yiqun Lin	a92200f4a6	HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri.	2018-04-10 14:29:28 +08:00
Inigo Goiri	e9b9f48dad	HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin.	2018-04-09 10:09:25 -07:00
Inigo Goiri	ac32b3576d	HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun.	2018-04-09 09:16:48 -07:00
Yiqun Lin	5700556cd6	HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu.	2018-04-08 12:01:55 +08:00
Surendra Singh Lilhore	70590cd8d9	HDFS-13292. Crypto command should give proper exception when trying to set key on existing EZ directory. Contributed by Ranith Sardar.	2018-04-07 11:23:49 +05:30
Wangda Tan	6cf023f9b7	Added CHANGES/RELEASES/Jdiff for 3.1.0 release ... Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39 (cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)	2018-04-05 15:52:39 -07:00
Wei Yan	3121e8c293	HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.	2018-04-05 12:00:52 -07:00
Lei Xu	d737bf99d4	HDFS-13350. Negative legacy block ID will confuse Erasure Coding to be considered as striped block. (Contributed by Lei (Eddy) Xu).	2018-04-05 09:59:10 -07:00
Yiqun Lin	2be64eb201	HDFS-13364. RBF: Support NamenodeProtocol in the Router. Contributed by Inigo Goiri.	2018-04-03 15:08:40 +08:00
Xiao Chen	57374c4737	HADOOP-15317. Improve NetworkTopology chooseRandom's loop.	2018-04-02 22:48:26 -07:00
Inigo Goiri	dc8e343201	HDFS-13289. RBF: TestConnectionManager#testCleanup() test case need correction. Contributed by Dibyendu Karmakar.	2018-03-31 09:46:13 -07:00
Konstantin V Shvachko	acfd764fcc	HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.	2018-03-30 18:55:35 -07:00
Xiao Chen	2c6cfad5a3	HDFS-13087. Snapshotted encryption zone information should be immutable. Contributed by LiXin Ge.	2018-03-29 15:46:34 -07:00
Wei-Chiu Chuang	ad10cbd91b	HDFS-13357. Improve AclException message "Invalid ACL: only directories may have a default ACL.". Contributed by Gabor Bota.	2018-03-29 07:08:22 -07:00
Arpit Agarwal	a991e899fb	HDFS-13314. NameNode should optionally exit if it detects FsImage corruption. Contributed by Arpit Agarwal.	2018-03-28 12:49:17 -07:00
Yiqun Lin	a71656c1c1	HDFS-13347. RBF: Cache datanode reports. Contributed by Inigo Goiri.	2018-03-28 11:00:08 +08:00
Inigo Goiri	4cef01147f	HDFS-13352. RBF: Add xsl stylesheet for hdfs-rbf-default.xml. Contributed by Takanobu Asanuma.	2018-03-27 10:31:03 -07:00
Inigo Goiri	947b282984	HDFS-13204. RBF: Optimize name service safe mode icon. Contributed by liuhongtong.	2018-03-26 09:42:51 -07:00
Yiqun Lin	cfc3a1c8f0	HDFS-13291. RBF: Implement available space based OrderResolver. Contributed by Yiqun Lin.	2018-03-26 18:33:07 +08:00
Lei Xu	7616683db5	Update 3.0.1 jdiff file and jdiff stable api version	2018-03-23 11:48:36 -07:00
weiy	6e31a09084	HDFS-12512. RBF: Add WebHDFS.	2018-03-23 08:32:25 -07:00
James Clampffer	8620d2bdf9	HDFS-12110: libhdfs++: Rebase HDFS-8707 on trunk, minor conflict resolution in this patch. Contributed by Deepak Majeti and Anatoli Shein.	2018-03-22 17:19:47 -04:00
James	fc5e44d9ed	HDFS-12427: libhdfs++: Prevent requests from holding dangling pointer to RpcEngine. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	48db24a430	HDFS-11294: libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James Clampffer	12942f679a	HDFS-10787: libhdfs++: Public API should expose configuration parser. Original patch contributed by Mitchell Tracy, followup work and compile warning fixes contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James Clampffer	eeb49d0ca7	HDFS-12237: libhdfs++: PROTOC_IS_COMPATIBLE check fails if protobuf library is built from source. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James Clampffer	22ea06a3dd	HDFS-12134: libhdfs++: Add a synchronization interface for the GSSAPI. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James Clampffer	033433bce7	HDFS-12026: libhdfs++: Fix compilation errors and warnings when compiling with Clang. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James Clampffer	53e40bc718	HDFS-10874: libhdfs++: Public API headers should not depend on internal implementation. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James Clampffer	3db261d45b	HDFS-12103: libhdfs++: Provide workaround to support cancel on filesystem connect until HDFS-11437 is resolved. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James Clampffer	23afd50865	HDFS-11908: libhdfs++: Authentication failure when first NN of a kerberized HA cluster is standby. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James Clampffer	e64ba87486	HDFS-12104: libhdfs++: Make sure all steps in SaslProtocol end up calling AuthComplete. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James Clampffer	3c743b475e	HDFS-12013: libhdfs++: read with offset at EOF should return 0 bytes instead of error. Contributed by Xiaowei Zhu	2018-03-22 17:19:47 -04:00
James Clampffer	c5e7a69523	HDFS-11971: libhdfs++: [Fix] a few portability issues. Contributed by Anatoli Schein	2018-03-22 17:19:47 -04:00
James Clampffer	1c9b174663	HDFS-11518: libhdfs++: Add a build option to skip building examples, tests, and tools. Contributed by Anatoli Schein.	2018-03-22 17:19:47 -04:00
James Clampffer	869317be0a	HDFS-10785: libhdfs++: Implement the rest of the tools. Contributed by Anatoli Schein	2018-03-22 17:19:47 -04:00
James Clampffer	52445fd4ee	HDFS-11544: libhdfs++: Revert HDFS-11544.HDFS-8707.001.patch due to invalid memory access regression. Done by James Clampffer	2018-03-22 17:19:47 -04:00
James Clampffer	c2386bc2f3	HDFS-11758: libhdfs++: Catch exceptions thrown by runtime hooks. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	57cdad73de	HDFS-11767: libhdfs++: SASL events should be scoped closer to usage. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James	b584e34f2f	HDFS-11730: libhdfs++: RpcConnection should handle authorization error call id. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James	fdb88eb57e	HDFS-11544: libhdfs++: Improve C API error reporting. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	3e53da2d62	HDFS-11106: libhdfs++: Some refactoring to better organize files (part 2). Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	0f3f8db113	HDFS-11449: libhdfs++: Log Datanode read size when reading from an HDFS block. Contributed by Xiaowei Zhu.	2018-03-22 17:19:47 -04:00
James	606d20c6c0	HDFS-11436: libhdfs++: Fix race condition in ScopedResolver. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	8783461e2e	HDFS-11028: libhdfs++: FileSystem needs to be able to cancel pending connections. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James	58de2df860	HDFS-10685: libhdfs++: return explicit error when non-secured client connects to secured server. Contributed by Kai Jiang.	2018-03-22 17:19:47 -04:00
James	69d55340f8	HDFS-11305: libhdfs++: Log Datanode information when reading an HDFS block. Contributed by Xiaowei Zhu.	2018-03-22 17:19:47 -04:00
James	a30cf6a369	HDFS-10796: libhdfs++: Previous commit was missing test/hdfs_ioservice_test.cc, adding it.	2018-03-22 17:19:47 -04:00
James	fbff671e0f	HDFS-10796: libhdfs++: rationalize ioservice interactions. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	dd7837c429	HDFS-11106: libhdfs++: Some refactoring to better organize files. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	2524afbc20	HDFS-11099: libhdfs++: Expose rack id in hdfsDNInfo. Contributed by Xiaowei Zhu.	2018-03-22 17:19:47 -04:00
James	b7d9a0f827	HDFS-11027: libbhdfs++: Don't retry if there is an authentication failure. Contributed by Xiaowei Zhu.	2018-03-22 17:19:47 -04:00
James	59a3926946	HDFS-11014: libhdfs++: Make connection to HA clusters faster. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	6dd47cae86	libhdfs++: Get rid of lock in RpcConnectionImpl destructor. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James	7ebecaeede	HDFS-10898: libhdfs++: Make log levels consistent. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James	2a42eeb66f	HDFS-10931: libhdfs++: Fix object lifecycle issues in the BlockReader (see follow up work in jira). Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
Bob Hansen	69cb05d292	HDFS-10595: libhdfs++: deconflate client name and client id	2018-03-22 17:19:47 -04:00
Bob Hansen	d22e4b2eb7	HDFS-10450b: libhdfs++: Add Cyrus SASL support (engines). Contributed by Don Davis.	2018-03-22 17:19:47 -04:00
Bob Hansen	549a5dbce9	HDFS-10450: libhdfs++: Add Cyrus SASL support. Contributed by Don Davis.	2018-03-22 17:19:47 -04:00
James	9d1c902159	HDFS-10705: libhdfs++: FileSystem should have a convenience no-args ctor. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	4f6cb5d1a1	HDFS-10754: libhdfs++: Create tools directory and implement hdfs_cat, hdfs_chgrp, hdfs_chown, hdfs_chmod and hdfs_find. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James	05ddb31081	HDFS-10761: libhdfs++: Fix broken logic in HA retry policy. Contributed by James Clampffer	2018-03-22 17:19:47 -04:00
James	b9cf0e932d	HDFS-10746: libhdfs++: synchronize access to working_directory and bytes_read_. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James	cbb3e9fe58	HDFS-10740: libhdfs++: Implement recursive directory generator. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James	2a8edd4e52	HDFS-9271: libhdfs++: Implement basic NN operations. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James	b1ed72e098	HDFS-10739: libhdfs++: In RpcEngine replace vector with deque for pending requests. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James	649aff11fe	HDFS-10672: libhdfs++: reorder directories in src/main/libhdfspp/examples, and add C++ version of cat tool. Contributed by Anatoli Shein.	2018-03-22 17:19:47 -04:00
James	4cb0dad5e5	HDFS-10441: libhdfs++: HA namenode support. Contributed by James Clampffer.	2018-03-22 17:19:47 -04:00
James	d75c835696	Revert HDFS-10543 patch due to correctness issues it caused. Done by James Clampffer	2018-03-22 17:19:47 -04:00
James	a586ccbcfa	HDFS-9890: libhdfs++: Add test suite to simulate network issues. Contributed by Xiaowei Zhu.	2018-03-22 17:19:47 -04:00
James	a23e6b422b	HDFS-10578. libhdfs++: Silence compile warnings from URI parser. Contributed by James Clampffer	2018-03-22 17:19:46 -04:00
James	a0c7aee3b6	HDFS-10543: libhdfs++: hdfsRead stops at block boundary. Contributed by Xiaowei Zhu.	2018-03-22 17:19:46 -04:00
Bob Hansen	d4c3cfbf47	HDFS-10524: libhdfs++: Implement chmod and chown. Contributed by Anatoli Shein.	2018-03-22 17:19:46 -04:00
Bob Hansen	88c5768f99	HDFS-10515: libhdfs++: Implement mkdirs, rmdir, rename, and remove	2018-03-22 17:19:46 -04:00
Bob Hansen	193314dc34	HDFS-10511: libhdfs++: make error returning mechanism consistent across all hdfs operations. Contributed by Anatoli Shein.	2018-03-22 17:19:46 -04:00
Bob Hansen	2616fe2025	HDFS-10526: libhdfs++: Add connect timeouts to async_connect calls. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	de6fce7817	HDFS-10527: libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings. Contributed by James Clampffer.	2018-03-22 17:19:46 -04:00
Bob Hansen	9ac66ccaa3	HDFS-10494: libhdfs++: Implement snapshot operations and GetFsStats. Contributed by Anatoli Shein.	2018-03-22 17:19:46 -04:00
James	d64bbf983e	Revert HDFS-9890. Needs some more work to reflect the current status of HDFS-8707. Done by James Clampffer	2018-03-22 17:19:46 -04:00
James	11b68ecebe	HDFS-9890. libhdfs++: Add test suite to simulate network issues. Contributed by Xiaowei Zhu.	2018-03-22 17:19:46 -04:00
Bob Hansen	50aa4ea776	HDFS-10454: libhdfspp: Move NameNodeOp to a separate file. Contributed by Anatoli Shein.	2018-03-22 17:19:46 -04:00
Bob Hansen	0496bc5464	HDFS-10464: libhdfs++: Implement GetPathInfo and ListDirectory. Contributed by Anatoli Shein.	2018-03-22 17:19:46 -04:00
Bob Hansen	18f4d2f42e	HDFS-10465: libhdfs++: Implement GetBlockLocations. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
Bob Hansen	f1f0b8f0f8	HDFS-10366: libhdfs++: Add SASL authentication. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
James	93382381f6	HDFS-10188. libhdfs++: Implement debug allocators. Contributed by Xiaowei Zhu	2018-03-22 17:19:46 -04:00
James	b9eeecc477	HDFS-10332. hdfs-native-client fails to build with CMake 2.8.11 or earlier. Contributed by Tibor Kiss	2018-03-22 17:19:46 -04:00
James	cc51f2ce58	HDFS-10310. hdfsConnect hangs when given bad host or port. Contributed by James Clampffer.	2018-03-22 17:19:46 -04:00
James	e542db66ee	HDFS-10311: DatanodeConnection::Cancel should not delete the underlying socket. Contributed by James Clampffer	2018-03-22 17:19:46 -04:00
James	1cbfd6f962	libhdfs++: File length doesn't always count the last block if it's being written to. Contributed by Xiaowei Zhu.	2018-03-22 17:19:46 -04:00
James	60c3437267	HDFS-10247: libhdfs++: Datanode protocol version mismatch fix. Contributed by James Clampffer	2018-03-22 17:19:46 -04:00
Bob Hansen	ed77d8d5df	HDFS-10231: libhdfs++: Fix race conditions in RPC layer. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	015d93a715	HDFS-10222. libhdfs++: Shutdown sockets to avoid 'Connection reset by peer'. Contributed by James Clampffer	2018-03-22 17:19:46 -04:00
James	427edae365	HDFS-9616. libhdfs++: Add runtime hooks to allow a client application to add low level monitoring and tests. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
James	0f1a278dd5	HDFS-9118: libhdfs++ Add logging system. Contributed by James Clampffer	2018-03-22 17:19:46 -04:00
Bob Hansen	8f4a66ab8f	HDFS-9556: libhdfs++: pull Options from default configs by default. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
Bob Hansen	f25bff50bf	HDFS-9932: added uriparser2 library to HDFS-8707. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
Bob Hansen	69ee2e6a7e	HDFS-9792: libhdfs++: EACCES not setting errno correctly. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	6a96f978eb	HDFS-9699: libhdfs++: Add appropriate catch blocks for asio operations that throw. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
Bob Hansen	1600e6bba8	HDFS-9791: libhdfs+_+: ConfigurationLoader throws parse_exception on invalid input. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	2cd7ab5e94	HDFS-9753. libhdfs++: Client fails to pass TokenProto from LocatedBlockProto to server when reading a block. Contributed by James Clampffer.	2018-03-22 17:19:46 -04:00
Bob Hansen	22ae319360	HDFS-9737: libhdfs++: Create examples of consuming libhdfs++ (pt 2). Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
Bob Hansen	f591b95e08	HDFS-9749: libhdfs++: RPC engine will attempt to close an asio socket before it's been opened. Contributed by James Clampffer	2018-03-22 17:19:46 -04:00
Bob Hansen	288a9a9ee7	HDFS-9741: libhdfs++: GetLastError not returning meaningful messages after some failures. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
Bob Hansen	d807773752	HDFS-9738: libhdfs++: Implement simple authentication. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
Bob Hansen	71b4f2ea25	HDFS-9737: libhdfs++: Create examples of consuming libhdfs++. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
Bob Hansen	7e946c7e30	HDFS-9712. libhdfs++: Reimplement Status object as a normal struct	2018-03-22 17:19:46 -04:00
Bob Hansen	ad23cf1490	HDFS-9679: Fix inconsistencies with libhdfs C API. Contributed by James Clampffer	2018-03-22 17:19:46 -04:00
James	166b3d49df	HDFS-9643. libhdfs++: Support async cancellation of read operations. Contributed by James Clampffer.	2018-03-22 17:19:46 -04:00
James	5cd2a1766c	HDFS-9687. libhdfs++: potential segfault after teardown. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	1017ccabeb	HDFS-9628. libhdfs++: implement builder apis from C bindings. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	dc335474a6	HDFS-9636. libhdfs++: for consistency, include files should be in hdfspp. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	11671c2bf6	HDFS-9627. libhdfs++: Add mechanism to retrieve human readable error messages through the C API. Contributed by James Clampffer.	2018-03-22 17:19:46 -04:00
James	e376c022f4	HDFS-9609. libhdfs++: Allow seek to EOF. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
James	7d8452040d	HDFS-9325. libhdfs++ Allow the location of hadoop source tree resources to be passed to CMake during a build. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	5dc2da1e6f	HDFS-9487. libhdfs++ Enable builds with no compiler optimizations. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	e18db92398	HDFS-9523. libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	31d28e3105	HDFS-9524. libhdfs++ deadlocks in Filesystem::New if NN connection fails. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	dba377bfcc	HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	6c80d02a03	HDFS-9538. libhdfs: load configuration from files. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	567c3ed44f	HDFS-9537. libhdfs++ implement HDFSConfiguration class. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
James	6c33f89aea	HDFS-9417. Clean up the RAT warnings in the HDFS-8707 branch. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	7cd98323ec	HDFS-9489. Enable CI infrastructure to use libhdfs++ hdfsRead. Contributed by Stephen Walkauskas.	2018-03-22 17:19:46 -04:00
James	d6a04cdbdd	HDFS-9460. Suppress warnings from third-party libraries. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	c59bd00a56	HDFS-9486. Fix valgrind failures when using more than 1 io_service worker thread. Contributed by James Clampffer.	2018-03-22 17:19:46 -04:00
James	58f2c7183e	HDFS-9228. libhdfs++ should respect NN retry configuration settings. Contributed by Bob Hansen	2018-03-22 17:19:46 -04:00
James	eb70a64362	HDFS-9504. Initialize BadNodeTracker in FileSystemImpl constructor. Contributed by James Clampffer.	2018-03-22 17:19:46 -04:00
James	8dac1094d8	HDFS-9497. move lib/proto/cpp_helpers to third-party since it won't have an ASF license. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	d7ecf396c9	HDFS-9144. Refactoring libhdfs++ into stateful/ephemeral objects. Contributed by Bob Hansen.	2018-03-22 17:19:46 -04:00
James	5ba8e8ab7b	Revert HDFS-9448.	2018-03-22 17:19:46 -04:00
James	9a0a34bbfa	HDFS-9448. Enable valgrind for libhdfspp unit tests. Contributed by Bob Hansen.	2018-03-22 17:19:45 -04:00
James	584c2a204d	HDFS-9452. libhdfs++ Fix memory stomp in OpenFileForRead. Contributed by James Clampffer	2018-03-22 17:19:45 -04:00
James	87362b1c17	HDFS-9117. Config file reader / options classes for libhdfs++. Contributed by Bob Hansen.	2018-03-22 17:19:45 -04:00
James	a38703fdfc	HDFS-9359. Test libhdfs++ with existing libhdfs tests. Contributed by Stephen Walkauskas.	2018-03-22 17:19:45 -04:00
James	64f0e78490	HDFS-9368. Implement reads with implicit offset state in libhdfs++. Contributed by James Clampffer.	2018-03-22 17:19:45 -04:00
Haohui Mai	6f44d92071	HDFS-9103. Retry reads on DN failure. Contributed by James Clampffer.	2018-03-22 17:19:45 -04:00
Haohui Mai	7dd29e548c	HDFS-9408. Build both static and dynamic libraries for libhdfspp. Contributed by Stephen Walkauskas.	2018-03-22 17:19:45 -04:00
Haohui Mai	af9bc25ac5	HDFS-9419. Import the optional library into libhdfs++. Contributed by Bob Hansen.	2018-03-22 17:19:45 -04:00
Haohui Mai	a0b8f56317	HDFS-9328. Formalize coding standards for libhdfs++. Contributed by James Clampffer.	2018-03-22 17:19:45 -04:00
Haohui Mai	a59714dcdb	HDFS-9320. libhdfspp should use sizeof(int32_t) instead of sizeof(int) when parsing data. Contributed by James Clampffer.	2018-03-22 17:19:45 -04:00
Haohui Mai	5f1d0957b2	HDFS-9340. libhdfspp fails to compile after HDFS-9207. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	dbd1d0c75b	HDFS-8766. Implement a libhdfs(3) compatible API. Contributed by James Clampffer.	2018-03-22 17:19:45 -04:00
Haohui Mai	422a6e4ed5	HDFS-9288. Import RapidXML 1.13 for libhdfspp. Contributed by Bob Hansen.	2018-03-22 17:19:45 -04:00
Haohui Mai	a14d1f741f	HDFS-9265. InputStreamImpl should hold a shared_ptr of the BlockReader. Contributed by James Clampffer.	2018-03-22 17:19:45 -04:00
Haohui Mai	08794423e8	HDFS-9207. Move the implementation to the hdfs-native-client module. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	9e929a7a0d	HDFS-9095. RPC client should fail gracefully when the connection is timed out or reset. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	06326b37c9	HDFS-9108. InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	6294141aeb	HDFS-9116. Suppress false positives from Valgrind on uninitialized variables in tests. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	9480c116ac	HDFS-9093. Initialize protobuf fields in RemoteBlockReaderTest. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	a559ef0243	HDFS-9025. Fix compilation issues on arch linux. Contributed by Owen O'Malley.	2018-03-22 17:19:45 -04:00
Haohui Mai	bc47acc9d9	HDFS-8952. InputStream.PositionRead() should be aware of available DNs. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	1efb677976	HDFS-8774. Implement FileSystem and InputStream API for libhdfspp. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	bccc640648	HDFS-8775. SASL support for data transfer protocol in libhdfspp. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	26d9f6cee3	HDFS-8788. Implement unit tests for remote block reader in libhdfspp. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	1bec75a13c	HDFS-8764. Generate Hadoop RPC stubs from protobuf definitions. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	65b864f341	HDFS-8759. Implement remote block reader in libhdfspp. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	a6b2fb64c4	HDFS-8758. Implement the continuation library in libhdfspp. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	63eee296c7	HDFS-8745. Use Doxygen to generate documents for libhdfspp. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	40a1f3631d	HDFS-8737. Initial implementation of a Hadoop RPC v9 client. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	95b479b8c1	HDFS-8725. Use std::chrono to implement the timer in the asio library. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	eb6c865516	HDFS-8724. Import third_party libraries into the repository. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Haohui Mai	d61e844c20	HDFS-8723. Integrate the build infrastructure with hdfs-client. Contributed by Haohui Mai.	2018-03-22 17:19:45 -04:00
Inigo Goiri	e196d158a2	HDFS-12792. RBF: Test Router-based federation using HDFSContract. Contributed by Inigo Goiri.	2018-03-22 13:32:57 -07:00
Wei-Chiu Chuang	f738d75a86	HDFS-11900. Hedged reads thread pool creation not synchronized. Contributed by John Zhuge.	2018-03-22 11:29:31 -07:00
Kihwal Lee	66461ed98b	HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.	2018-03-22 12:21:10 -05:00
Inigo Goiri	3d0ee8b804	HDFS-13318. RBF: Fix FindBugs in hadoop-hdfs-rbf. Contributed by Ekanth S.	2018-03-22 09:21:52 -07:00
Konstantin V Shvachko	8d898ab25f	HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.	2018-03-21 16:46:03 -07:00
Xiaoyu Yao	389bc6d3da	HDFS-11043. TestWebHdfsTimeouts fails. Contributed by Xiaoyu Yao and Chao Sun.	2018-03-21 13:53:35 -07:00
Yongjun Zhang	6c63cc7d30	HDFS-13315. Add a test for the issue reported in HDFS-11481 which is fixed by HDFS-10997. Contributed by Yongjun Zhang.	2018-03-20 23:04:05 -07:00
Yiqun Lin	2caba999bb	HDFS-13250. RBF: Router to manage requests across multiple subclusters. Contributed by Inigo Goiri.	2018-03-21 11:32:05 +08:00
Yiqun Lin	69fe4407eb	HDFS-13307. RBF: Improve the use of setQuota command. Contributed by liuhongtong.	2018-03-21 10:51:35 +08:00
weiy	6e2b5fa493	HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan	2018-03-19 22:13:40 -07:00
Chris Douglas	3fc3fa9711	HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer	2018-03-19 16:05:55 -07:00
Inigo Goiri	08ff1586d5	HDFS-12886. Ignore minReplication for block recovery. Contributed by Lukas Majercak.	2018-03-16 10:29:19 -07:00
Xiaoyu Yao	78b05fde6c	HDFS-13280. WebHDFS: Fix NPE in get snasphottable directory list call. Contributed by Lokesh Jain.	2018-03-15 11:02:27 -07:00
Inigo Goiri	e71bc00a47	HDFS-13224. RBF: Resolvers to support mount points across multiple subclusters. Contributed by Inigo Goiri.	2018-03-15 10:32:30 -07:00
Xiaoyu Yao	da777a5498	HDFS-13251. Avoid using hard coded datanode data dirs in unit tests(addendum). Contributed by Ajay Kumar.	2018-03-15 10:18:44 -07:00
Inigo Goiri	6de135169e	HDFS-12723. TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Contributed by Ajay Kumar.	2018-03-15 10:14:35 -07:00
fang zhenyi	5e013d50d1	HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings. ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-15 16:12:07 +09:00
Xiao Chen	5ff22d4c3a	HDFS-13246. FileInputStream redundant closes in readReplicasFromCache. Contributed by liaoyuxiangqin.	2018-03-14 21:59:51 -07:00
Yiqun Lin	3a0f4bc0d5	HDFS-13261. Fix incorrect null value check. Contributed by Jianfei Jiang.	2018-03-15 11:06:04 +08:00
Inigo Goiri	41fc7f80be	HDFS-13198. RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router. Contributed by Wei Yan.	2018-03-14 13:14:36 -07:00
Xiaoyu Yao	f83716b7f2	HDFS-13251. Avoid using hard coded datanode data dirs in unit tests. Contributed by Ajay Kumar.	2018-03-14 11:26:58 -07:00
Xiaoyu Yao	0be0f1ce1d	HDFS-13275. Adding log for BlockPoolManager#refreshNamenodes failures. Contributed by Ajay Kumar.	2018-03-14 10:38:00 -07:00
Arpit Agarwal	4c57fb0cd9	HDFS-13257. Code cleanup: INode never throws QuotaExceededException. Contributed by Tsz Wo Nicholas Sze.	2018-03-14 09:42:48 -07:00
Xiaoyu Yao	a34d83d2fd	HDFS-13249. Document webhdfs support for getting snapshottable directory list. Contributed by Lokesh Jain.	2018-03-14 09:14:26 -07:00
Sammi Chen	ad1b988a82	HDFS-11600. Refactor TestDFSStripedOutputStreamWithFailure test classes. Contributed by Sammi Chen.	2018-03-14 14:39:53 +08:00
Yiqun Lin	76be6cbf6c	HDFS-12773. RBF: Improve State Store FS implementation. Contributed by Inigo Goiri.	2018-03-14 11:20:59 +08:00
Arpit Agarwal	9714fc1dd4	HDFS-336. dfsadmin -report should report number of blocks from datanode. Contributed by Bharat Viswanadham.	2018-03-13 16:39:17 -07:00
Arpit Agarwal	39537b7c84	HDFS-13235. DiskBalancer: Update Documentation to add newly added options. Contributed by Bharat Viswanadham.	2018-03-13 16:35:51 -07:00
Xiao Chen	8211a3d469	HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma.	2018-03-13 10:48:45 -07:00
Xiao Chen	f82d38dcb3	Revert "HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma." ... This reverts commit 84c1095586.	2018-03-13 10:36:16 -07:00
Xiao Chen	3b8dbc2cb7	HDFS-12587. Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies. Contributed by Takanobu Asanuma.	2018-03-13 10:14:05 -07:00
Xiao Chen	d6931c30c5	HDFS-13239. Fix non-empty dir warning message when setting default EC policy. Contributed by Bharat Viswanadham.	2018-03-13 10:07:26 -07:00
Xiao Chen	84c1095586	HDFS-12505. Extend TestFileStatusWithECPolicy with a random EC policy. Contributed by Takanobu Asanuma.	2018-03-13 09:58:03 -07:00
Chris Douglas	b2b9ce5859	HDFS-13271. WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument. Contributed by Lokesh Jain	2018-03-13 09:43:22 -07:00
Xiaoyu Yao	0355ec20eb	HDFS-13141. WebHDFS: Add support for getting snasphottable directory list. Contributed by Lokesh Jain.	2018-03-12 20:41:37 -07:00
Chris Douglas	45d1b0fdcc	HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer	2018-03-12 20:05:39 -07:00
Yiqun Lin	19292bc264	HDFS-13226. RBF: Throw the exception if mount table entry validated failed. Contributed by maobaolong.	2018-03-13 11:03:31 +08:00
Yiqun Lin	7fab787de7	HDFS-13253. RBF: Quota management incorrect parent-child relationship judgement. Contributed by Yiqun Lin.	2018-03-13 10:30:20 +08:00
Akira Ajisaka	319defafc1	HDFS-12156. TestFSImage fails without -Pnative	2018-03-13 11:26:56 +09:00
Yiqun Lin	4afd50b106	HDFS-10803. TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available. Contributed by Yiqun Lin.	2018-03-13 10:15:51 +08:00
Inigo Goiri	91c82c90f0	HDFS-13241. RBF: TestRouterSafemode failed if the port 8888 is in use. Contributed by maobaolong.	2018-03-12 17:28:15 -07:00
Chris Douglas	39a5fbae47	HDFS-12677. Extend TestReconstructStripedFile with a random EC policy. Contributed by Takanobu Asanuma	2018-03-12 14:29:44 -07:00
Chris Douglas	ddb67ca707	HADOOP-14742. Document multi-URI replication Inode for ViewFS. Contributed by Gera Shegalov	2018-03-12 13:43:27 -07:00
Anu Engineer	cceb68ffea	HDFS-10618. TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition. Contributed by Eric Badger.	2018-03-12 12:07:22 -07:00
Inigo Goiri	ac627f561f	HDFS-11399. Many tests fails in Windows due to injecting disk failures. Contributed by Yiqun Lin.	2018-03-12 09:58:56 -07:00
Yiqun Lin	4743d4a2c7	HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.	2018-03-10 11:28:55 +08:00
Inigo Goiri	8133cd5305	HDFS-13232. RBF: ConnectionPool should return first usable connection. Contributed by Ekanth S.	2018-03-09 18:25:05 -08:00
Inigo Goiri	afe1a3ccd5	HDFS-13212. RBF: Fix router location cache issue. Contributed by Weiwei Wu.	2018-03-09 17:18:51 -08:00
Tsz-Wo Nicholas Sze	ba0da2785d	HDFS-13252. Code refactoring: Remove Diff.ListType.	2018-03-09 15:50:26 -08:00
Hanisha Koneru	4eeff62f69	HDFS-13244. Add stack, conf, metrics links to utilities dropdown in NN webUI. Contributed by Bharat Viswanadham.	2018-03-09 15:27:17 -08:00
Lokesh Jain	7b0dc31020	HDFS-13190. Document WebHDFS support for snapshot diff ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org> Signed-off-by: Xiaoyu Yao <xyao@apache.org>	2018-03-09 15:06:15 -08:00
Hanisha Koneru	9a082fbe6e	HDFS-11394. Support for getting erasure coding policy through WebHDFS#FileStatus.	2018-03-09 13:20:32 -08:00
Yiqun Lin	122805b43a	HDFS-13233. RBF: MountTableResolver doesn't return the correct mount point of the given path. Contributed by wangzhiyuan.	2018-03-09 15:42:57 +08:00
Inigo Goiri	0c2b969e01	HDFS-13232. RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns. Contributed by Chao Sun.	2018-03-08 09:32:05 -08:00
Hanisha Koneru	19ae4429f9	HDFS-13225. StripeReader#checkMissingBlocks() 's IOException info is incomplete. Contributed by lufei.	2018-03-07 14:17:10 -08:00
Sean Mackrory	46d29e3d7e	HDFS-13176. WebHdfs file path gets truncated when having semicolon (;) inside. Contributed by Zsolt Venczel.	2018-03-07 13:33:41 -07:00
Tsz-Wo Nicholas Sze	88fba00caa	HDFS-13222. Update getBlocks method to take minBlockSize in RPC calls. Contributed by Bharat Viswanadham	2018-03-07 11:27:53 -08:00
Yiqun Lin	58ea2d7a65	HDFS-13214. RBF: Complete document of Router configuration. Contributed by Yiqun Lin.	2018-03-07 15:26:38 +08:00
Xiaoyu Yao	edf9445708	HDFS-13109. Support fully qualified hdfs path in EZ commands. Contributed by Hanisha Koneru.	2018-03-06 16:44:20 -08:00
Tsz-Wo Nicholas Sze	346caa2095	HDFS-13227. Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList. Contributed by Shashikant Banerjee	2018-03-06 13:35:03 -08:00
Tsz-Wo Nicholas Sze	871d0d39fa	HDFS-13223. Reduce DiffListBySkipList memory usage. Contributed by Shashikant Banerjee	2018-03-06 12:23:03 -08:00
Xiao Chen	9276ef0665	HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell.	2018-03-06 09:57:35 -08:00
Inigo Goiri	7060725662	HDFS-13188. Disk Balancer: Support multiple block pools during block move. Contributed by Bharat Viswanadham.	2018-03-06 09:09:32 -08:00
Robert Kanter	21176a8ba7	HADOOP-15282. HADOOP-15235 broke TestHttpFSServerWebServer ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-04 07:33:47 -08:00
Arpit Agarwal	a3c304c5dd	HDFS-13178. Disk Balancer: Add a force option to DiskBalancer Execute command. Contributed by Bharat Viswanadham.	2018-03-03 15:42:16 -08:00
Tsz-Wo Nicholas Sze	ba82e5c488	HDFS-13173. Replace ArrayList with DirectoryDiffList(SnapshotSkipList) to store DirectoryDiffs. Contributed by Shashikant Banerjee	2018-03-02 17:47:48 -08:00
Xiao Chen	c75105f07b	HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen.	2018-03-02 16:46:04 -08:00
Tsz-Wo Nicholas Sze	60080fbfcf	HDFS-13171. Handle Deletion of nodes in SnasphotSkipList. Contributed by Shashikant Banerjee	2018-03-02 10:51:05 -08:00
Tsz-Wo Nicholas Sze	850b2f2567	HDFS-1686. Federation: Add more Balancer tests with federation setting. Contributed by Bharat Viswanadham	2018-03-02 10:42:39 -08:00
Yiqun Lin	55669515f6	HDFS-13210. Fix the typo in MiniDFSCluster class. Contributed by fang zhenyi.	2018-03-02 11:49:12 +08:00
Tsz-Wo Nicholas Sze	96e8f260ab	HDFS-13211. Fix a bug in DirectoryDiffList.getMinListForRange. Contributed by Shashikant Banerjee	2018-03-01 14:12:15 -08:00
Yiqun Lin	ececeea8f2	HDFS-13202. Fix the outdated javadocs in HAUtil. Contributed by Chao Sun.	2018-03-01 17:51:43 +08:00
Tsz-Wo Nicholas Sze	81d9446a92	HDFS-13102. Implement SnapshotSkipList class to store Multi level DirectoryDiffs. Contributed by Shashikant Banerjee	2018-02-28 13:42:58 -08:00
Xiaoyu Yao	f20e10b2dd	HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar.	2018-02-28 09:44:39 -08:00
Xiaoyu Yao	2574375bf5	HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru.	2018-02-28 08:37:01 -08:00
Yiqun Lin	a9c14b1119	HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang.	2018-02-28 10:17:43 +08:00
Inigo Goiri	d86f301d46	HDFS-13199. RBF: Fix the hdfs router page missing label icon issue. Contributed by maobaolong.	2018-02-27 17:39:02 -08:00
Tsz-Wo Nicholas Sze	55c77bf722	HDFS-13143. SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree. Contributed by Shashikant Banerjee	2018-02-27 15:28:41 -08:00
Arpit Agarwal	1cc9a58dda	HDFS-13181. DiskBalancer: Add an configuration for valid plan hours . Contributed by Bharat Viswanadham.	2018-02-27 10:18:07 -08:00
Inigo Goiri	cd4a97bf80	HDFS-13192. Change the code order in getFileEncryptionInfo to avoid unnecessary call of assignment. Contributed by LiXin Ge.	2018-02-27 08:53:00 -08:00
Inigo Goiri	225d877092	HDFS-13193. Various Improvements for BlockTokenSecretManager. Contributed by BELUGA BEHR.	2018-02-27 08:48:03 -08:00
Yiqun Lin	1e85a995d1	HDFS-13184. RBF: Improve the unit test TestRouterRPCClientRetries. Contributed by Yiqun Lin.	2018-02-27 10:48:52 +08:00
Chao Sun	ae290a4bb4	HDFS-13145. SBN crash when transition to ANN with in-progress edit tailing enabled. Contributed by Chao Sun.	2018-02-26 16:15:00 -08:00
Wei Yan	6ce9f79cc9	HDFS-13187. RBF: Fix Routers information shown in the web UI. Contributed by Inigo Goiri and Wei Yan.	2018-02-26 15:13:41 -08:00
Arpit Agarwal	46c93453e9	HDFS-12781. After Datanode down, In Namenode UI Datanode tab is throwing warning message.. Contributed by Brahma Reddy Battula.	2018-02-26 13:56:34 -08:00
Kihwal Lee	451265a83d	HDFS-12070. Failed block recovery leaves files open indefinitely and at risk for data loss. Contributed by Kihwal Lee.	2018-02-26 10:28:04 -06:00
Arpit Agarwal	2fa7963c3d	HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.	2018-02-24 14:41:55 -08:00
Arpit Agarwal	c30a26abc5	HDFS-12865. RequestHedgingProxyProvider should handle case when none of the proxies are available. Contributed by Mukul Kumar Singh.	2018-02-24 14:25:56 -08:00
Xiaoyu Yao	1e84e46f16	HDFS-13052. WebHDFS: Add support for snasphot diff. Contributed by Lokesh Jain.	2018-02-23 19:35:12 -08:00
Xiao Chen	51088d3233	HDFS-13164. File not closed if streamer fail with DSQuotaExceededException.	2018-02-23 13:49:09 -08:00
Gabor Bota	c36b4aa31c	HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-02-23 13:55:18 +09:00
Xiaoyu Yao	84a1321f6a	HDFS-13136. Avoid taking FSN lock while doing group member lookup for FSD permission check. Contributed by Xiaoyu Yao.	2018-02-22 11:32:32 -08:00
Anu Engineer	121e1e1280	HDFS-13175. Add more information for checking argument in DiskBalancerVolume. ... Contributed by Lei (Eddy) Xu.	2018-02-20 19:16:30 -08:00
Inigo Goiri	6f81cc0bee	HDFS-13167. DatanodeAdminManager Improvements. Contributed by BELUGA BEHR.	2018-02-20 15:18:27 -08:00
Inigo Goiri	17c592e6cf	HDFS-13168. XmlImageVisitor - Prefer Array over LinkedList. Contributed by BELUGA BEHR.	2018-02-20 15:16:01 -08:00
Arpit Agarwal	9028ccaf83	HDFS-13159. TestTruncateQuotaUpdate fails in trunk. Contributed by Nanda kumar.	2018-02-20 11:40:20 -08:00
Yiqun Lin	8896d20b91	HDFS-13119. RBF: Manage unavailable clusters. Contributed by Yiqun Lin.	2018-02-20 09:37:08 +08:00
Tsz-Wo Nicholas Sze	83e2bb98ee	HDFS-12998. SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff. Contributed by Shashikant Banerjee	2018-02-19 11:42:10 +08:00
fang zhenyi	4d4dde5112	HADOOP-15223. Replace Collections.EMPTY* with empty* when available ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-02-18 22:19:39 +09:00
Chen Liang	c008d10a11	HDFS-13161. Update comment in start-dfs.sh to mention correct variable for secure datanode user. Contributed by Ajay Kumar.	2018-02-16 16:04:50 -08:00
Arpit Agarwal	4c2119f04e	HDFS-13058. Fix dfs.namenode.shared.edits.dir in TestJournalNode. Contributed by Bharat Viswanadham.	2018-02-16 10:29:22 -08:00
Arpit Agarwal	8d5ea7470a	HDFS-13153. Enable HDFS diskbalancer by default. Contributed by Ajay Kumar.	2018-02-16 09:38:34 -08:00
Bharat Viswanadham	a1e05e0292	HDFS-13151. Fix the javadoc error in ReplicaInfo ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-02-16 16:22:24 +09:00
Kihwal Lee	47473952e5	HDFS-13112. Token expiration edits may cause log corruption or deadlock. Contributed by Daryn Sharp.	2018-02-15 15:32:42 -06:00
Kihwal Lee	da59acd8ca	xattr api cleanup	2018-02-15 11:11:55 -06:00
Tsz-Wo Nicholas Sze	6ea7d78ccb	HDFS-13142. Define and Implement a DiifList Interface to store and manage SnapshotDiffs. Contributed by Shashikant Banerjee	2018-02-15 19:33:44 +08:00
Steve Loughran	f20dc0d577	HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions. ... Contributed by Andras Bokor.	2018-02-14 16:20:14 +00:00
Brahma Reddy Battula	35c17351ca	HDFS-8693. Addendum patch to execute the command using UGI. Contributed by Brahma Reddy Battula.	2018-02-12 22:14:34 +05:30
Arpit Agarwal	96bb6a51ec	HDFS-10453. ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.. Contributed by He Xiaoqiao.	2018-02-12 07:17:40 -08:00
Yiqun Lin	25fbec67d1	HDFS-13130. Log object instance get incorrectly in SlowDiskTracker. Contributed by Jianfei Jiang.	2018-02-11 12:02:10 +08:00
Wangda Tan	60f9e60b3b	Preparing for 3.2.0 development ... Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938	2018-02-11 11:17:38 +08:00
Yiqun Lin	543f3abbee	HDFS-13099. RBF: Use the ZooKeeper as the default State Store. Contributed by Yiqun Lin.	2018-02-09 13:57:42 +08:00
Steve Loughran	996796f104	HADOOP-15214. Make Hadoop compatible with Guava 21.0. ... Contributed by Igor Dvorzhak	2018-02-08 10:55:54 -08:00
Xiaoyu Yao	8faf0b50d4	HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao.	2018-02-08 08:59:48 -08:00
Yongjun Zhang	f491f717e9	HDFS-13115. In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted. Contributed by Yongjun Zhang.	2018-02-07 12:58:09 -08:00
Jitendra Pandey	b061215ecf	HDFS-11701. NPE from Unresolved Host causes permanent DFSInputStream failures. Contributed by Lokesh Jain.	2018-02-07 11:22:36 -08:00
Brahma Reddy Battula	01bd6ab18f	HDFS-12935. Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up. Contributed by Jianfei Jiang.	2018-02-07 23:10:33 +05:30
Xiao Chen	e5c2fdddd6	HDFS-12933. Improve logging when DFSStripedOutputStream failed to write some blocks. Contributed by chencan.	2018-02-06 22:54:53 -08:00
Tsz-Wo Nicholas Sze	4fadcf1631	HDFS-13107. Add Mover Cli Unit Tests for Federated cluster. Contributed by Bharat Viswanadham	2018-02-06 16:59:26 -08:00
Sean Mackrory	b14db95c35	HDFS-13106. Need to exercise all HDFS APIs for EC. Contributed by Haibo Yan.	2018-02-06 16:39:00 -07:00
Tsz-Wo Nicholas Sze	4d1bf33d0f	HDFS-12947. Limit the number of Snapshots allowed to be created for a Snapshottable Directory. Contributed by Shashikant Banerjee	2018-02-06 14:46:44 -08:00
Anu Engineer	4304fcd5bd	HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.	2018-02-06 13:43:45 -08:00
Yongjun Zhang	4e9a59ce16	HDFS-13100. Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Contributed by Aaron T. Myers and Yongjun Zhang.	2018-02-02 22:58:44 -08:00
Wei-Chiu Chuang	2021f4bdce	HDFS-11187. Optimize disk access for last partial chunk checksum of Finalized replica. Contributed by Wei-Chiu Chuang.	2018-02-02 17:18:42 -08:00
Hanisha Koneru	0ef639235b	HDFS-13073. Cleanup code in InterQJournalProtocol.proto. Contributed by Bharat Viswanadham.	2018-02-02 16:28:03 -08:00
Akira Ajisaka	4aef8bd2ef	HDFS-13048. LowRedundancyReplicatedBlocks metric can be negative	2018-02-02 14:34:07 +09:00
Yiqun Lin	b0627c891b	HDFS-13068. RBF: Add router admin option to manage safe mode. Contributed by Yiqun Lin.	2018-02-02 11:25:41 +08:00
Anu Engineer	aa45faf0b2	HDFS-12942. Synchronization issue in FSDataSetImpl#moveBlock. Contributed by Ajay Kumar.	2018-02-01 18:03:01 -08:00
Hanisha Koneru	dd50f53997	HDFS-13062. Provide support for JN to use separate journal disk per namespace. Contributed by Bharat Viswanadham.	2018-02-01 12:28:17 -08:00
Xiaoyu Yao	b3ae11d597	HDFS-12997. Move logging to slf4j in BlockPoolSliceStorage and Storage. Contributed by Ajay Kumar.	2018-02-01 10:45:34 -08:00
Inigo Goiri	6ca7204ceb	HDFS-13043. RBF: Expose the state of the Routers in the federation. Contributed by Inigo Goiri.	2018-02-01 10:37:14 -08:00
Xiao Chen	ae2177d296	HDFS-12897. getErasureCodingPolicy should handle .snapshot dir better. Contributed by LiXin Ge.	2018-01-31 22:50:25 -08:00
Xiaoyu Yao	af015c0b23	HDFS-13060. Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver. Contributed by Ajay Kumar.	2018-01-31 22:39:51 -08:00
Hanisha Koneru	3ce2190b58	HDFS-13092. Reduce verbosity for ThrottledAsyncChecker#schedule. Contributed by Mukul Kumar Singh.	2018-01-31 11:05:17 -08:00
Xiaoyu Yao	37b7536568	HDFS-13061. SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel. Contributed by Ajay Kumar.	2018-01-31 10:47:02 -08:00
Inigo Goiri	5206b2c7ca	HDFS-13083. RBF: Fix doc error setting up client. Contributed by tartarus.	2018-01-30 18:27:18 -08:00
Weiwei Yang	2e7331ca26	HDFS-12528. Add an option to not disable short-circuit reads on failures. Contributed by Xiao Chen.	2018-01-31 07:25:03 +08:00
Yiqun Lin	dbb9dded33	HDFS-13044. RBF: Add a safe mode for the Router. Contributed by Inigo Goiri.	2018-01-30 12:12:08 +08:00
Kihwal Lee	fde95d463c	HDFS-12574. Add CryptoInputStream to WebHdfsFileSystem read call. Contributed by Rushabh S Shah	2018-01-29 17:23:29 -06:00
Xiao Chen	b63dcd583f	HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi.	2018-01-28 22:19:49 -08:00
Xiao Chen	6bc2f7f4b4	HDFS-13065. TestErasureCodingMultipleRacks#testSkewedRack3 is failing. Contributed by Gabor Bota.	2018-01-28 22:12:05 -08:00
Arpit Agarwal	e990904dd5	HDFS-13054. Handling PathIsNotEmptyDirectoryException in DFSClient delete call. Contributed by Nanda kumar.	2018-01-26 13:09:13 -08:00
Yiqun Lin	7721fff744	HDFS-13042. RBF: Heartbeat Router State. Contributed by Inigo Goiri.	2018-01-25 15:51:26 +08:00
Jianfei Jiang	eb2dd08688	HDFS-13063. Fix the incorrect spelling in HDFSHighAvailabilityWithQJM.md ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-01-25 15:30:42 +09:00
Inigo Goiri	95743c672e	HDFS-12772. RBF: Federation Router State State Store internal API. Contributed by Inigo Goiri.	2018-01-23 19:15:44 -08:00
Yiqun Lin	d95c13774e	HDFS-12963. Error log level in ShortCircuitRegistry#removeShm. Contributed by hu xiaodong.	2018-01-24 10:43:36 +08:00
Hanisha Koneru	6347b2253d	HDFS-13023. Journal Sync does not work on a secure cluster. Contributed by Bharat Viswanadham.	2018-01-22 16:02:32 -08:00
Chen Liang	62c9e7fa99	HDFS-13036. Reusing the volume storage ID obtained by replicaInfo. Contributed by liaoyuxiangqin.	2018-01-19 17:51:53 -08:00
Lei Xu	2ed9d61aad	HDFS-13039. StripedBlockReader.createBlockReader leaks socket on IOException. (Lei (Eddy) Xu)	2018-01-19 16:40:58 -08:00
Inigo Goiri	130f8bce00	HDFS-13028. RBF: Fix spurious TestRouterRpc#testProxyGetStats. Contributed by Inigo Goiri.	2018-01-19 09:47:40 -08:00
Yiqun Lin	9e4f52d323	HDFS-12973. RBF: Document global quota supporting in federation. Contributed by Yiqun Lin.	2018-01-19 14:18:19 +08:00
Vinayakumar B	09efdfe9e1	HDFS-9049. Make Datanode Netty reverse proxy port to be configurable. Contributed by Vinayakumar B.	2018-01-17 14:16:48 +05:30
Lei Xu	3bd9ea63df	HDFS-13004. TestLeaseRecoveryStriped.testLeaseRecovery is failing when safeLength is 0MB or larger than the test file. (Zsolt Venczel via lei)	2018-01-16 15:15:11 -08:00
Yufei Gu	b202935353	HADOOP-15157. Zookeeper authentication related properties to support CredentialProviders. (Contributed by Gergo Repas)	2018-01-16 10:15:22 -08:00
Brahma Reddy Battula	880b9d24ff	HDFS-8693. refreshNamenodes does not support adding a new standby to a running DN. Contributed by Ajith S.	2018-01-16 16:21:02 +05:30
Yiqun Lin	9afb8025d6	HDFS-12972. RBF: Display mount table quota info in Web UI and admin command. Contributed by Yiqun Lin.	2018-01-13 13:16:43 +08:00
Inigo Goiri	d5d6a0353b	HDFS-12919. RBF: Support erasure coding methods in RouterRpcServer. Contributed by Inigo Goiri.	2018-01-12 16:25:39 -08:00
Arpit Agarwal	b278f7b293	HDFS-12984. BlockPoolSlice can leak in a mini dfs cluster. Contributed by Ajay Kumar.	2018-01-12 08:04:00 -08:00
Yiqun Lin	d98a2e6e23	HDFS-12934. RBF: Federation supports global quota. Contributed by Yiqun Lin.	2018-01-10 13:59:11 +08:00
Inigo Goiri	d9006d8a4e	HDFS-12802. RBF: Control MountTableResolver cache size. Contrubuted by Inigo Goiri.	2018-01-09 18:53:25 -08:00
Lei Xu	47563d86fe	HDFS-12994. TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout. (Contributed by Lei (Eddy) Xu)	2018-01-09 11:53:49 -08:00
Inigo Goiri	b3290c41a9	HDFS-12808. Add LOG.isDebugEnabled() guard for LOG.debug(...). Contributed by Bharat Viswanadham.	2018-01-08 17:51:09 -08:00
Manoj Govindassamy	73ff09b79a	HDFS-12985. NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted.	2018-01-08 15:34:00 -08:00
Wei Yan	2ee0d64ace	HDFS-12945. Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods. Contributed by Wei Yan.	2018-01-08 14:25:39 -08:00
Yiqun Lin	bf5c948995	HDFS-11848. Enhance dfsadmin listOpenFiles command to list files under a given path. Contributed by Yiqun Lin.	2018-01-06 14:31:08 +08:00
Inigo Goiri	83b513ac6d	HDFS-12988. RBF: Mount table entries not properly updated in the local cache. Contributed by Inigo Goiri.	2018-01-05 09:11:38 -08:00
Lei Xu	dc735b286b	HDFS-12860. StripedBlockUtil#getRangesInternalBlocks throws exception for the block group size larger than 2GB. (Contributed by Lei (Eddy) Xu)	2018-01-04 10:54:56 -08:00
Arpit Agarwal	739d3c394d	HDFS-12987. Document - Disabling the Lazy persist file scrubber.. Contributed by Karthik Palanisamy.	2018-01-04 10:32:00 -08:00
Sean Mackrory	45a47198b4	HDFS-12913. TestDNFencingWithReplication sometimes fails because of NameNode in standby state. Contributed by Zsolt Venczel.	2018-01-04 08:37:21 -07:00
Yiqun Lin	2a48b3594c	HDFS-12948. DiskBalancer report command top option should only take positive numeric values. Contributed by Shashikant Banerjee.	2018-01-04 10:48:44 +08:00
Xiaoyu Yao	3ba985997d	HDFS-12931. Handle InvalidEncryptionKeyException during DistributedFileSystem#getFileChecksum. Contributed by Mukul Kumar Singh.	2018-01-03 14:54:20 -08:00
Manoj Govindassamy	5c28804b95	HDFS-12629. NameNode UI should report total blocks count by type - replicated and erasure coded.	2018-01-02 15:05:27 -08:00
Manoj Govindassamy	42a1c98597	HDFS-11847. Enhance dfsadmin listOpenFiles command to list files blocking datanode decommissioning.	2018-01-02 14:59:36 -08:00
Arpit Agarwal	b4d11337c9	HDFS-12351. Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document.. Contributed by Hanisha Koneru.	2018-01-02 12:54:40 -08:00
Chris Douglas	7fe6f83c8f	HADOOP-15117. open(PathHandle) contract test should be exhaustive for default options	2017-12-30 17:58:35 -08:00
Lei Xu	6e3e1b8cde	HDFS-12915. Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy. (Contributed by Chris Douglas)	2017-12-29 12:21:57 -08:00
Xiao Chen	5bf7e594d7	HDFS-9023. When NN is not able to identify DN for replication, reason behind it can be logged.	2017-12-28 11:54:08 -08:00
Manoj Govindassamy	76e664e931	HDFS-12959. Fix TestOpenFilesWithSnapshot redundant configurations.	2017-12-21 15:47:15 -08:00
Chen Liang	826507c41b	HDFS-12951. Incorrect javadoc in SaslDataTransferServer.java#receive. Contributed by Mukul Kumar Singh.	2017-12-21 11:20:30 -08:00
Lei Xu	b318bed01a	HDFS-12938. TestErasureCodigCLI testAll failing consistently. (Contributed by Ajay Kumar)	2017-12-21 10:28:24 -08:00
Wei Yan	a78db99190	HDFS-12932. Fix confusing LOG message for block replication. Contributed by Chao Sun.	2017-12-20 08:55:46 -08:00
Yiqun Lin	e040c97b77	HDFS-12937. RBF: Add more unit tests for router admin commands. Contributed by Yiqun Lin.	2017-12-19 15:31:34 +08:00
Junping Du	a7f8caf58e	Add 2.8.3 release jdiff files. ... (cherry picked from commit c89f99aade)	2017-12-18 22:39:01 -08:00
Yiqun Lin	25a36b7452	HDFS-12930. Remove the extra space in HdfsImageViewer.md. Contributed by Rahul Pathak.	2017-12-19 11:23:16 +08:00
Tsz-Wo Nicholas Sze	c7499f2d24	HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham	2017-12-19 10:02:30 +08:00
Erik Krogen	94576b17fb	HDFS-12818. Support multiple storages in DataNodeCluster / SimulatedFSDataset. Contributed by Erik Krogen.	2017-12-18 11:36:22 -08:00
Chris Douglas	5e81f32d11	HADOOP-15106. FileSystem::open(PathHandle) should throw a specific exception on validation failure	2017-12-16 10:53:10 -08:00
Virajith Jalaparti	8239e3afb3	HDFS-12712. [9806] Code style cleanup	2017-12-15 17:51:41 -08:00
Virajith Jalaparti	80c3fec3a1	HDFS-12912. [READ] Fix configuration and implementation of LevelDB-based alias maps	2017-12-15 17:51:41 -08:00
Virajith Jalaparti	c89b29bd42	HDFS-12893. [READ] Support replication of Provided blocks with non-default topologies.	2017-12-15 17:51:41 -08:00
Virajith Jalaparti	0f6aa9564c	HDFS-12905. [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.	2017-12-15 17:51:41 -08:00
Chris Douglas	2298f2d76b	HDFS-12874. Documentation for provided storage. Contributed by Virajith Jalaparti	2017-12-15 17:51:41 -08:00
Virajith Jalaparti	71ec170107	HDFS-12887. [READ] Allow Datanodes with Provided volumes to start when blocks with the same id exist locally	2017-12-15 17:51:41 -08:00
Virajith Jalaparti	4531588a94	HDFS-11640. [READ] Datanodes should use a unique identifier when reading from external stores	2017-12-15 17:51:41 -08:00
Virajith Jalaparti	fb996a32a9	HDFS-12894. [READ] Skip setting block count of ProvidedDatanodeStorageInfo on DN registration update	2017-12-15 17:51:40 -08:00
Virajith Jalaparti	9c35be86e1	HDFS-12713. [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata. Contributed by Ewan Higgs	2017-12-15 17:51:40 -08:00
Virajith Jalaparti	a027055dd2	HDFS-12885. Add visibility/stability annotations. Contributed by Chris Douglas	2017-12-15 17:51:40 -08:00
Virajith Jalaparti	b634053c4d	HDFS-12591. [READ] Implement LevelDBFileRegionFormat. Contributed by Ewan Higgs.	2017-12-15 17:51:40 -08:00
Virajith Jalaparti	352f994b64	HDFS-12665. [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb). Contributed by Ewan Higgs.	2017-12-15 17:51:40 -08:00
Virajith Jalaparti	cc933cba77	HDFS-12685. [READ] FsVolumeImpl exception when scanning Provided storage volume	2017-12-15 17:51:40 -08:00
Virajith Jalaparti	4d59dabb7f	HDFS-12809. [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.	2017-12-15 17:51:40 -08:00
Virajith Jalaparti	3d3be87e30	HDFS-12778. [READ] Report multiple locations for PROVIDED blocks	2017-12-15 17:51:39 -08:00
Virajith Jalaparti	3b1d30301b	HDFS-12775. [READ] Fix reporting of Provided volumes	2017-12-15 17:51:39 -08:00
Virajith Jalaparti	e1a28f95b8	HDFS-12777. [READ] Reduce memory and CPU footprint for PROVIDED volumes.	2017-12-15 17:51:39 -08:00
Virajith Jalaparti	6cd80b2521	HDFS-12779. [READ] Allow cluster id to be specified to the Image generation tool	2017-12-15 17:51:39 -08:00
Virajith Jalaparti	90d1b47a2a	HDFS-12776. [READ] Increasing replication for PROVIDED files should create local replicas	2017-12-15 17:51:39 -08:00
Virajith Jalaparti	71d0a82571	HDFS-12607. [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED	2017-12-15 17:51:39 -08:00
Virajith Jalaparti	98f5ed5aa3	HDFS-11902. [READ] Merge BlockFormatProvider and FileRegionProvider.	2017-12-15 17:51:38 -08:00
Virajith Jalaparti	d6a9a89973	HDFS-12605. [READ] TestNameNodeProvidedImplementation#testProvidedDatanodeFailures fails after rebase	2017-12-15 17:51:38 -08:00
Virajith Jalaparti	aca023b72c	HDFS-12289. [READ] HDFS-12091 breaks the tests for provided block reads	2017-12-15 17:51:38 -08:00
Virajith Jalaparti	2407c9b93a	HDFS-12093. [READ] Share remoteFS between ProvidedReplica instances.	2017-12-15 17:51:38 -08:00
Virajith Jalaparti	663b3c08b1	HDFS-12091. [READ] Check that the replicas served from a ProvidedVolumeImpl belong to the correct external storage	2017-12-15 17:51:38 -08:00
Virajith Jalaparti	546b95f484	HDFS-11673. [READ] Handle failures of Datanode with PROVIDED storage	2017-12-15 17:51:38 -08:00
Virajith Jalaparti	55ade54b8e	HDFS-11792. [READ] Test cases for ProvidedVolumeDF and ProviderBlockIteratorImpl	2017-12-15 17:51:38 -08:00
Virajith Jalaparti	89b9faf529	HDFS-11703. [READ] Tests for ProvidedStorageMap	2017-12-15 17:51:37 -08:00
Virajith Jalaparti	aa5ec85f7f	HDFS-11663. [READ] Fix NullPointerException in ProvidedBlocksBuilder	2017-12-15 17:51:37 -08:00
Virajith Jalaparti	1108cb7691	HDFS-11653. [READ] ProvidedReplica should return an InputStream that is bounded by its length	2017-12-15 17:51:37 -08:00
Virajith Jalaparti	d65df0f273	HDFS-11190. [READ] Namenode support for data stored in external stores.	2017-12-15 17:51:37 -08:00
Virajith Jalaparti	b668eb9155	HDFS-10675. Datanode support to read from external stores.	2017-12-15 17:51:37 -08:00
Chen Liang	aa503a29d0	HDFS-12917. Fix description errors in testErasureCodingConf.xml. Contributed by chencan.	2017-12-15 13:45:37 -08:00
Lei Xu	949be14b08	HDFS-12927. Update erasure coding doc to address unsupported APIs. (Contributed by Lei (Eddy) Xu)	2017-12-15 10:20:29 -08:00
Lei Xu	1c15b1751c	HDFS-12819. Setting/Unsetting EC policy shows warning if the directory is not empty. (Contributed by Lei (Eddy) Xu)	2017-12-15 10:04:43 -08:00
Yiqun Lin	ee028bfdf1	HDFS-12895. RBF: Add ACL support for mount table. Contributed by Yiqun Lin.	2017-12-15 14:09:24 +08:00
Xiao Chen	e1cb278cd0	HDFS-12910. Secure Datanode Starter should log the port when it fails to bind. Contributed by Stephen O'Donnell and Nanda kumar.	2017-12-14 19:22:51 -08:00
Kihwal Lee	f5a72424c0	HDFS-12907. Allow read-only access to reserved raw for non-superusers. Contributed by Rushabh S Shah.	2017-12-14 14:58:47 -06:00
Jason Lowe	80db744ee5	HDFS-12881. Output streams closed with IOUtils suppressing write errors. Contributed by Ajay Kumar	2017-12-14 09:45:44 -06:00
Yiqun Lin	91c96bdf8e	HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.	2017-12-14 16:00:53 +08:00
Chen Liang	46e18c8da7	HADOOP-14914. Change to a safely casting long to int. Contributed by Ajay Kumar.	2017-12-13 14:56:14 -08:00
Andrew Wang	d447152d49	Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release.	2017-12-13 13:05:32 -08:00
Chris Douglas	693169ef34	HDFS-12882. Support full open(PathHandle) contract in HDFS	2017-12-11 20:14:15 -08:00
Wei-Chiu Chuang	55fc2d6485	HDFS-12891. Do not invalidate blocks if toInvalidate is empty. Contributed by Zsolt Venczel.	2017-12-11 16:43:03 -08:00
Inigo Goiri	5cd1056ad7	HDFS-12875. RBF: Complete logic for -readonly option of dfsrouteradmin add command. Contributed by Inigo Goiri.	2017-12-11 15:14:57 -08:00
Manoj Govindassamy	ef7d334d36	HDFS-12825. Fsck report shows config key name for min replication issues (Contributed by Gabor Bota).	2017-12-08 11:46:30 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	f19638333b	HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades.	2017-12-08 08:00:21 -08:00
Xiao Chen	19e0894209	HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.	2017-12-07 21:05:55 -08:00
Wei-Chiu Chuang	d6c31a3e6b	HDFS-11915. Sync rbw dir on the first hsync() to avoid file lost on power failure. Contributed by Vinayakumar B.	2017-12-07 14:50:30 -08:00
Lei Xu	67662e2ac9	HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu.	2017-12-07 11:15:40 -08:00
Akira Ajisaka	6cca5b3bcb	HDFS-12889. Addendum patch to add missing file.	2017-12-07 13:23:37 +09:00
Xiao Chen	56b1ff80dd	HDFS-12872. EC Checksum broken when BlockAccessToken is enabled.	2017-12-05 20:48:16 -08:00
Akira Ajisaka	44b06d34a5	HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham.	2017-12-06 11:40:33 +09:00
Brahma Reddy Battula	6d16a99ae8	HDFS-11751. DFSZKFailoverController daemon exits with wrong status code. Contributed by Bharat Viswanadham	2017-12-05 19:53:46 +05:30
Arpit Agarwal	e00c7f78c1	HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.	2017-12-04 21:02:04 -08:00
Xiao Chen	404eab4dc0	HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.	2017-12-04 10:40:11 -08:00
Chris Douglas	42307e3c3a	HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak	2017-12-01 22:34:30 -08:00
Wei-Chiu Chuang	0faf506245	HDFS-12836. startTxId could be greater than endTxId when tailing in-progress edit log. Contributed by Chao Sun.	2017-12-01 12:01:21 -08:00
Chris Douglas	53bbef3802	Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak" ... This reverts commit 5304698dc8.	2017-12-01 11:19:38 -08:00
Chris Douglas	5304698dc8	HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak	2017-12-01 10:29:30 -08:00
Konstantin V Shvachko	60fd0d7fd7	HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko.	2017-11-30 18:18:28 -08:00
Tsz-Wo Nicholas Sze	b1c7654ee4	HDFS-12594. snapshotDiff fails if the report exceeds the RPC response limit. Contributed by Shashikant Banerjee	2017-11-30 12:18:29 -08:00
Chris Douglas	0e560f3b8d	HDFS-12681. Make HdfsLocatedFileStatus a subtype of LocatedFileStatus	2017-11-29 20:28:06 -08:00
Kihwal Lee	53509f295b	HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev.	2017-11-29 15:11:14 -06:00
Wei Yan	301641811d	HDFS-12835. Fix the javadoc errors in Router-based federation.	2017-11-29 09:43:03 -08:00
Konstantin V Shvachko	d331762f24	HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko.	2017-11-28 17:14:23 -08:00
Surendra Singh Lilhore	30941d99c9	HDFS-12857. StoragePolicyAdmin should support schema based path. Contributed by Surendra Singh Lilhore.	2017-11-28 23:57:03 +05:30
Yiqun Lin	94bed50471	HDFS-12858. Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin.	2017-11-28 11:48:55 +08:00
Kihwal Lee	738d1a206a	HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla.	2017-11-22 13:01:55 -06:00
Lei Xu	785732c13e	HDFS-12847. Regenerate editsStored and editsStored.xml in HDFS tests. Contributed by Lei (Eddy) Xu.	2017-11-22 10:22:32 -08:00
Tsz-Wo Nicholas Sze	659e85e304	HDFS-12813. RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1. Contributed by Mukul Kumar Singh	2017-11-20 17:09:19 -08:00
Chen Liang	60fc2a1388	HDFS-12804. Use slf4j instead of log4j in FSEditLog. Contributed by Mukul Kumar Singh.	2017-11-20 12:49:53 -08:00
Manoj Govindassamy	9fb4effd2c	HDFS-12730. Verify open files captured in the snapshots across config disable and enable.	2017-11-20 10:28:12 -08:00
Inigo Goiri	e182e77794	HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri.	2017-11-16 16:58:47 -08:00
Weiwei Yang	462e25a3b2	HDFS-12814. Add blockId when warning slow mirror/disk in BlockReceiver. Contributed by Jiandan Yang.	2017-11-16 16:19:53 +08:00
Chris Douglas	675e9a8f57	Revert "HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus." ... This reverts commit b85603e3f8.	2017-11-15 19:20:37 -08:00
Arpit Agarwal	4908a8970e	HDFS-12705. WebHdfsFileSystem exceptions should retain the caused by exception. Contributed by Hanisha Koneru.	2017-11-13 11:30:39 -08:00
Arpit Agarwal	6d201f77c7	HDFS-12498. Journal Syncer is not started in Federated + HA cluster. Contributed by Bharat Viswanadham.	2017-11-10 16:30:38 -08:00
Arpit Agarwal	1d6f8bebe9	HADOOP-14929. Cleanup usage of decodecomponent and use QueryStringDecoder from netty. Contributed by Bharat Viswanadham.	2017-11-10 16:28:12 -08:00
Jitendra Pandey	8a1bd9a4f4	HDFS-12797. Add Test for NFS mount of not supported filesystems like (file:///). Contributed by Mukul Kumar Singh.	2017-11-09 23:53:17 -08:00
Chen Liang	10a1f557e7	HDFS-12791. NameNode Fsck http Connection can timeout for directories with multiple levels. Contributed by Mukul Kumar Singh.	2017-11-09 18:47:34 -08:00
John Zhuge	bf6a660232	HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.	2017-11-09 10:16:12 -08:00
Akira Ajisaka	3a3566e1d1	HDFS-12732. Correct spellings of ramdomly to randomly in log. Contributed by hu xiaodong.	2017-11-09 15:14:46 +09:00
Brahma Reddy Battula	410d0319cf	HDFS-12788. Reset the upload button when file upload fails. Contributed by Brahma Reddy Battula	2017-11-08 14:41:16 +05:30
Weiwei Yang	bb8a6eea52	HDFS-7060. Avoid taking locks when sending heartbeats from the DataNode. Contributed by Jiandan Yang.	2017-11-08 10:22:13 +08:00
Xiaoyu Yao	169cdaa38e	HDFS-10528. Add logging to successful standby checkpointing. Contributed by Xiaoyu Yao.	2017-11-03 20:34:40 -07:00
Chris Douglas	b85603e3f8	HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus.	2017-11-03 14:30:57 -07:00
Kihwal Lee	4d2dce40bb	HDFS-12771. Add genstamp and block size to metasave Corrupt blocks list. Contributed by Kuhu Shukla.	2017-11-03 15:16:46 -05:00
Xiao Chen	299d38295d	HDFS-11467. Support ErasureCoding section in OIV XML/ReverseXML. Contributed by Huafeng Wang.	2017-11-03 12:05:45 -07:00
Xiao Chen	b00f828d84	HDFS-12725. BlockPlacementPolicyRackFaultTolerant fails with very uneven racks.	2017-11-02 21:53:13 -07:00
Xiao Chen	e565b5277d	HDFS-12682. ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED.	2017-11-02 21:27:35 -07:00
Weiwei Yang	56b88b0670	HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang.	2017-11-01 16:41:45 +08:00
Yiqun Lin	20304b91cc	HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. Contributed by Erik Krogen.	2017-11-01 14:37:08 +08:00
John Zhuge	b8c8b5bc27	HDFS-12714. Hadoop 3 missing fix for HDFS-5169. Contributed by Joe McDonnell.	2017-10-31 22:44:16 -07:00
Lei Xu	9367c25dbd	HDFS-12482. Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery. (lei)	2017-10-31 21:58:14 -07:00
Andrew Wang	5f681fa821	Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham." ... This reverts commit b922ba7393.	2017-10-31 10:46:10 -07:00
Arpit Agarwal	b922ba7393	HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham.	2017-10-31 10:23:00 -07:00
Inigo Goiri	982bd2a5bf	HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri.	2017-10-31 10:21:42 -07:00
Chris Douglas	d015e0bbd5	HDFS-7878. API - expose a unique file identifier.	2017-10-31 09:44:01 -07:00
Sean Mackrory	81225430d0	HDFS-206. Support for head in FSShell. Contributed by Gabor Bota.	2017-10-31 08:34:01 -06:00
Chris Douglas	d55a84951a	HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham	2017-10-27 15:36:03 -07:00
Arpit Agarwal	cd2a1dd063	HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao.	2017-10-27 07:43:54 -07:00
Junping Du	a25b5aa0cf	Add several jdiff xml files for 2.8.2 release.	2017-10-26 19:30:48 -07:00
Arpit Agarwal	7da15eac7a	HDFS-12579. JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url. Contributed by Hanisha Koneru.	2017-10-25 14:24:22 -07:00
Xiao Chen	f66ad1fab9	HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen.	2017-10-25 14:11:30 -07:00
Manoj Govindassamy	075dd45a24	HDFS-12544. SnapshotDiff - support diff generation on any snapshot root descendant directory.	2017-10-25 10:54:40 -07:00
Zhe Zhang	17cd8d0c17	Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps." ... This reverts commit 60bfee270e.	2017-10-24 15:06:50 -07:00
Wei-Chiu Chuang	0f2a69127a	HDFS-12249. dfsadmin -metaSave to output maintenance mode blocks. Contributed by Wellington Chevreuil.	2017-10-23 15:24:34 -07:00
Arpit Agarwal	96be795656	HDFS-12650. Use slf4j instead of log4j in LeaseManager. Contributed by Ajay Kumar.	2017-10-23 13:20:46 -07:00
Arpit Agarwal	4b00c9a47f	HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham.	2017-10-23 10:47:16 -07:00
Xiao Chen	248d9b6fff	HDFS-12518. Re-encryption should handle task cancellation and progress better.	2017-10-20 16:25:04 -07:00
Andrew Wang	0477eff8be	HDFS-12497. Re-enable TestDFSStripedOutputStreamWithFailure tests. Contributed by Huafeng Wang.	2017-10-20 13:27:21 -07:00
Kai Zheng	ce7cf66e5e	HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang	2017-10-20 09:42:04 +08:00
Inigo Goiri	0f1c037618	HDFS-12620. Backporting HDFS-10467 to branch-2. Contributed by Inigo Goiri.	2017-10-19 18:08:45 -07:00
Wei-Chiu Chuang	4ab0c8f96a	HDFS-12619. Do not catch and throw unchecked exceptions if IBRs fail to process. Contributed by Wei-Chiu Chuang.	2017-10-19 06:17:59 -07:00
Zhe Zhang	60bfee270e	HDFS-12502. nntop should support a category based on FilesInGetListingOps.	2017-10-18 23:51:24 -07:00
Lei Xu	f27a4ad032	HDFS-12612. DFSStripedOutputStream.close will throw if called a second time with a failed streamer. (Lei (Eddy) Xu)	2017-10-17 15:52:09 -07:00
Lei Xu	31ebccc962	HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu)	2017-10-16 19:44:30 -07:00
Manoj Govindassamy	b406d8e375	HDFS-12614. FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured.	2017-10-16 17:42:41 -07:00
Wei-Chiu Chuang	8dbc8909c9	HDFS-12485. expunge may fail to remove trash from encryption zone. Contributed by Wei-Chiu Chuang.	2017-10-16 12:57:48 -07:00
Xiao Chen	21bc855587	HDFS-12642. Log block and datanode details in BlockRecoveryWorker.	2017-10-16 10:34:06 -07:00
Xiao Chen	7bd700941d	HDFS-12637. Extend TestDistributedFileSystemWithECFile with a random EC policy. Contributed by Takanobu Asanuma.	2017-10-16 09:55:22 -07:00
Xiao Chen	035c6ee587	HDFS-12603. Enable async edit logging by default. Contributed by Andrew Wang.	2017-10-16 09:51:10 -07:00
Xiao Chen	20575ececb	HDFS-12659. Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval. Contributed by Ajay Kumar.	2017-10-15 19:28:22 -07:00
Manoj Govindassamy	133d7ca76e	HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem	2017-10-13 17:43:21 -07:00
Arpit Agarwal	8dd1eeb94f	HDFS-12553. Add nameServiceId to QJournalProtocol. Contributed by Bharat Viswanadham	2017-10-13 14:22:21 -07:00
Arpit Agarwal	8acdf5c274	HDFS-12542. Update javadoc and documentation for listStatus. Contributed by Ajay Kumar.	2017-10-11 12:29:35 -07:00
Arpit Agarwal	bb0a742aac	HDFS-12627. Fix typo in DFSAdmin command output. Contributed by Ajay Kumar.	2017-10-11 12:26:14 -07:00
Akira Ajisaka	dc63a6a52b	HDFS-12622. Fix enumerate in HDFSErasureCoding.md. Contributed by Yiqun Lin.	2017-10-11 18:09:53 +09:00
Kai Zheng	d8d37b63c7	HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang	2017-10-11 15:45:28 +08:00
Andrew Wang	a297fb0886	HDFS-12547. Extend TestQuotaWithStripedBlocks with a random EC policy. Contributed by Takanobu Asanuma.	2017-10-10 17:35:49 -07:00
Manoj Govindassamy	78af6cdc53	HDFS-12573. Divide the total blocks metrics into replicated and erasure coded. Contributed by Takanobu Asanuma.	2017-10-10 14:23:29 -07:00
Jitendra Pandey	f29e55bf5e	HADOOP-14910. Upgrade netty-all jar to latest 4.0.x.Final. Contributed by Vinayakumar B.	2017-10-10 11:00:07 -07:00
Jitendra Pandey	d6602b5f39	HDFS-11575. Supporting HDFS NFS gateway with Federated HDFS. Contributed by Mukul Kumar Singh.	2017-10-10 10:38:05 -07:00
Andrew Wang	82cd85d868	Revert "HDFS-12603. Enable async edit logging by default." ... This reverts commit afb42aeabf.	2017-10-09 17:53:56 -07:00
Andrew Wang	7938208233	HDFS-12541. Extend TestSafeModeWithStripedFile with a random EC policy. Contributed by Takanobu Asanuma.	2017-10-09 13:03:32 -07:00
Andrew Wang	afb42aeabf	HDFS-12603. Enable async edit logging by default.	2017-10-09 11:20:00 -07:00
Arpit Agarwal	09ad848b64	HDFS-12599. Remove Mockito dependency from DataNodeTestUtils. Contributed by Ted Yu.	2017-10-09 10:29:01 -07:00
Lei Xu	46644319e1	HDFS-12606. When using native decoder, DFSStripedStream.close crashes JVM after being called multiple times. (Lei (Eddy) Xu)	2017-10-09 10:08:30 -07:00
John Zhuge	2856eb207b	HDFS-12494. libhdfs SIGSEGV in setTLSExceptionStrings. Contributed by John Zhuge.	2017-10-06 23:29:28 -07:00
Inigo Goiri	5d63a388d1	HDFS-12577. Rename Router tooling. Contributed by Inigo Goiri. ... (cherry picked from commit 53e8d0d030)	2017-10-06 18:50:52 -07:00
Inigo Goiri	81601dac8e	HDFS-12273. Federation UI. Contributed by Inigo Goiri. ... (cherry picked from commit adbb2e00c7)	2017-10-06 18:50:52 -07:00
Inigo Goiri	6c69e23dcd	HDFS-12580. Rebasing HDFS-10467 after HDFS-12447. Contributed by Inigo Goiri. ... (cherry picked from commit b12440d347)	2017-10-06 18:50:51 -07:00
Inigo Goiri	ad41c81559	HDFS-12381. [Documentation] Adding configuration keys for the Router. Contributed by Inigo Goiri. ... (cherry picked from commit c2d6aa7905)	2017-10-06 18:50:51 -07:00
Inigo Goiri	67785fe006	HDFS-12450. Fixing TestNamenodeHeartbeat and support non-HA. Contributed by Inigo Goiri. ... (cherry picked from commit 928d1e87f9)	2017-10-06 18:50:50 -07:00
Inigo Goiri	1f06b81ecb	HDFS-12430. Rebasing HDFS-10467 After HDFS-12269 and HDFS-12218. Contributed by Inigo Goiri. ... (cherry picked from commit 3302e792d4)	2017-10-06 18:50:50 -07:00
Inigo Goiri	bc9e588a19	HDFS-12335. Federation Metrics. Contributed by Inigo Goiri. ... (cherry picked from commit 3b19e77752)	2017-10-06 18:50:50 -07:00
Inigo Goiri	cc58e7a983	HDFS-12384. Fixing compilation issue with BanDuplicateClasses. Contributed by Inigo Goiri. ... (cherry picked from commit fabe02c8fa)	2017-10-06 18:50:49 -07:00
Inigo Goiri	7cb6bdf09e	HDFS-10631. Federation State Store ZooKeeper implementation. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit 23c4ddee11)	2017-10-06 18:50:49 -07:00
Inigo Goiri	346c9fce43	HDFS-12312. Rebasing HDFS-10467 (2). Contributed by Inigo Goiri. ... (cherry picked from commit 90ba6843fb)	2017-10-06 18:50:48 -07:00
Inigo Goiri	67d10087af	HDFS-11554. [Documentation] Router-based federation documentation. Contributed by Inigo Goiri. ... (cherry picked from commit ee3260211d)	2017-10-06 18:50:48 -07:00
Inigo Goiri	b3e6bd22e3	HDFS-10646. Federation admin tool. Contributed by Inigo Goiri. ... (cherry picked from commit ae27e31fbc)	2017-10-06 18:50:48 -07:00
Inigo Goiri	6f0de27318	HDFS-10880. Federation Mount Table State Store internal API. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit 58b97df661)	2017-10-06 18:50:47 -07:00
Inigo Goiri	d8c8107332	HDFS-11826. Federation Namenode Heartbeat. Contributed by Inigo Goiri. ... (cherry picked from commit 928f8dab52)	2017-10-06 18:50:47 -07:00
Inigo Goiri	55da7fd7eb	HDFS-10687. Federation Membership State Store internal API. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit 95cae08849)	2017-10-06 18:50:47 -07:00
Inigo Goiri	0ec82b8cdf	HDFS-12223. Rebasing HDFS-10467. Contributed by Inigo Goiri. ... (cherry picked from commit 47db6e9d8e)	2017-10-06 18:50:46 -07:00
Inigo Goiri	ca4f209b49	HDFS-11546. Federation Router RPC server. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit 8a9cdebebf)	2017-10-06 18:50:46 -07:00
Inigo Goiri	4bf877b03f	HDFS-10630. Federation State Store FS Implementation. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit c6e0bd640c)	2017-10-06 18:50:45 -07:00
Inigo	2c740a684a	HDFS-10882. Federation State Store Interface API. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit 6d94c90ece)	2017-10-06 18:50:45 -07:00
Inigo	533b986633	HDFS-10881. Federation State Store Driver API. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit 0f88e04915)	2017-10-06 18:50:45 -07:00
Inigo	2761bbc91a	HDFS-10629. Federation Roter. Contributed by Jason Kace and Inigo Goiri. ... (cherry picked from commit 6821e80172)	2017-10-06 18:50:44 -07:00
Xiao Chen	25f31d9fc4	HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.	2017-10-05 19:46:47 -07:00
Andrew Wang	644c2f6924	HDFS-12567. BlockPlacementPolicyRackFaultTolerant fails with racks with very few nodes.	2017-10-05 16:58:43 -07:00
Arpit Agarwal	b6942cbe9b	HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar.	2017-10-05 15:26:52 -07:00
Xiaoyu Yao	107c177782	HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar.	2017-10-03 13:02:12 -07:00
Arpit Agarwal	b91305119b	HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh.	2017-10-03 11:23:40 -07:00
Anu Engineer	015abcd8ce	HDFS-12576. JournalNodes are getting started, even though dfs.namenode.shared.edits.dir is not configured. Contributed by Bharat Viswanadham.	2017-10-02 15:40:00 -07:00
Lei Xu	27ffd43b64	HDFS-12569. Unset EC policy logs empty payload in edit log. (Lei (Eddy) Xu)	2017-10-02 15:35:49 -07:00
Chen Liang	2c62ff7fd4	HDFS-12271. Incorrect statement in Downgrade section of HDFS Rolling Upgrade document. Contributed by Nandakumar.	2017-10-02 13:18:00 -07:00
Chen Liang	5a68c2cef3	HDFS-12552. Use slf4j instead of log4j in FSNamesystem. Contributed by Ajay Kumar.	2017-10-02 11:26:53 -07:00
Lei Xu	f40dbc170e	HDFS-12453. TestDataNodeHotSwapVolumes fails in trunk Jenkins runs. (Lei (Eddy) Xu)	2017-09-29 10:46:17 -07:00
Chen Liang	8e1bd114ee	HDFS-12560. Remove the extra word it in HdfsUserGuide.md. Contributed by fang zhenyi.	2017-09-28 10:22:27 -07:00
Wei-Chiu Chuang	7c34ceaf4f	HDFS-12458. TestReencryptionWithKMS fails regularly. Contributed by Xiao Chen.	2017-09-28 05:10:26 -07:00
Daryn Sharp	0da29cbeea	[HDFS-12386] Add fsserver defaults call to WebhdfsFileSystem. (Rushabh Shah via daryn)	2017-09-26 15:15:24 -05:00
Lei Xu	1267ff22ce	HDFS-12523. Thread pools in ErasureCodingWorker do not shutdown. (Huafeng Wang via Lei)	2017-09-26 10:08:16 -07:00
Brahma Reddy Battula	9d3e4cccf9	HDFS-5040.Audit log for admin commands/ logging output of all DFS admin commands. Contributed by Kuhu Shukla.	2017-09-26 21:59:22 +05:30
Yiqun Lin	e9b790db9d	HDFS-12495. TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently. Contributed by Eric Badger.	2017-09-26 17:21:42 +08:00
Akira Ajisaka	02e2a9b115	HDFS-12304. Remove unused parameter from FsDatasetImpl#addVolume. Contributed by Chen Liang.	2017-09-26 01:25:07 +09:00
Anu Engineer	d0b2c5850b	HDFS-12516. Suppress the fsnamesystem lock warning on nn startup. Contributed by Ajay Kumar.	2017-09-24 21:03:06 -07:00
Anu Engineer	415e5a157a	HDFS-12375. Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh. Contributed by Bharat Viswanadham.	2017-09-23 15:05:25 -07:00
Anu Engineer	ecc85620e8	HDFS-12339. NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper. Contributed by Mukul Kumar Singh.	2017-09-23 12:27:34 -07:00
Anu Engineer	40ef9fa171	HADOOP-14904. Fix javadocs issues in Hadoop HDFS. Contributed by Mukul Kumar Singh.	2017-09-23 12:16:48 -07:00
Anu Engineer	11af907c64	HADOOP-14905. Fix javadocs issues in Hadoop HDFS-NFS. Contributed by Mukul Kumar Singh.	2017-09-23 12:12:12 -07:00
Anu Engineer	2a81af447f	HDFS-12536. Add documentation for getconf command with -journalnodes option. Contributed by Bharat Viswanadham.	2017-09-23 10:53:59 -07:00
Anu Engineer	e9a18b625f	HDFS-12535. Change the Scope of the Class DFSUtilClient to Private. Contributed by Bharat Viswanadham.	2017-09-23 10:47:17 -07:00
Anu Engineer	423ebcaf51	HDFS-12320. Add quantiles for transactions batched in Journal sync. Contributed by Hanisha Koneru.	2017-09-23 10:34:13 -07:00
Anu Engineer	36fb90c939	HDFS-12064. Reuse object mapper in HDFS. Contributed by Hanisha Koneru.	2017-09-23 10:11:00 -07:00
Jitendra Pandey	cda3378659	HDFS-12486. GetConf to get journalnodeslist. Contributed by Bharat Viswanadham.	2017-09-22 16:52:47 -07:00
Arpit Agarwal	08fca508e6	HDFS-12530. Processor argument in Offline Image Viewer should be case insensitive. Contributed by Hanisha Koneru.	2017-09-22 09:47:57 -07:00
Tsz-Wo Nicholas Sze	3baae4322e	HDFS-12507. StripedBlockUtil.java:694: warning - Tag @link: reference not found: StripingCell. Contributed by Mukul Kumar Singh	2017-09-22 10:37:04 +08:00
Arpit Agarwal	b9e423fa8d	HDFS-12496. Make QuorumJournalManager timeout properties configurable. Contributed by Ajay Kumar.	2017-09-21 08:44:43 -07:00
Kihwal Lee	6bf921a5c3	HDFS-12371. BlockVerificationFailures and BlocksVerified show up as 0 in Datanode JMX. Contributed by Hanisha Koneru.	2017-09-21 08:42:50 -05:00
Akira Ajisaka	50849ec9eb	HDFS-12526. FSDirectory should use Time.monotonicNow for durations. Contributed by Bharat Viswanadham.	2017-09-21 19:27:48 +09:00
Andrew Wang	a12f09ba3c	HDFS-12447. Rename AddECPolicyResponse to AddErasureCodingPolicyResponse. Contributed by SammiChen.	2017-09-20 11:51:17 -07:00
Ming Ma	ce943eb17a	HDFS-11035. Better documentation for maintenace mode and upgrade domain.	2017-09-20 09:36:33 -07:00
Ming Ma	230b85d586	HDFS-12473. Change hosts JSON file format.	2017-09-20 09:03:59 -07:00
Andrew Wang	12d9d7bc50	HDFS-12437. Fix test setup in TestLeaseRecoveryStriped.	2017-09-19 16:42:20 -07:00
Andrew Wang	51edaacd09	HDFS-12445. Correct spellings of choosen to chosen. Contributed by hu xiaodong.	2017-09-19 13:48:23 -07:00
Andrew Wang	59830ca772	HDFS-12444. Reduce runtime of TestWriteReadStripedFile. Contributed by Huafeng Wang and Andrew Wang.	2017-09-19 13:44:42 -07:00
Lei Xu	7bbeacb75e	HDFS-12449. TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s. (SammiChen via lei)	2017-09-19 11:50:01 -07:00
Brahma Reddy Battula	fda1221c55	HDFS-11799. Introduce a config to allow setting up write pipeline with fewer nodes than replication factor. Contributed by Brahma Reddy Battula	2017-09-19 11:25:45 +05:30
Brahma Reddy Battula	31b58406ac	HDFS-12480. TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk. Contributed by Hanisha Koneru	2017-09-19 10:37:07 +05:30
Kai Zheng	dba7a7dd9d	HDFS-12479. Some misuses of lock in DFSStripedOutputStream. Contributed by Huafeng Wang	2017-09-19 17:45:41 +08:00
Arpit Agarwal	a2dcba1853	HDFS-12470. DiskBalancer: Some tests create plan files under system directory. Contributed by Hanisha Koneru.	2017-09-18 09:53:24 -07:00
Kai Zheng	0f9af246e8	HDFS-12460. Make addErasureCodingPolicy an idempotent operation. Contributed by Sammi Chen	2017-09-18 18:07:12 +08:00
Arpit Agarwal	8d7cc22ac2	HDFS-12472. Add JUNIT timeout to TestBlockStatsMXBean. Contributed by Bharat Viswanadham.	2017-09-16 10:09:27 -07:00
Andrew Wang	ef8cd5dc56	HDFS-10701. TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails. Contributed by SammiChen.	2017-09-15 16:20:36 -07:00
Erik Krogen	90894c7262	HDFS-12323. NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout. Contributed by Erik Krogen.	2017-09-15 13:56:27 -07:00
Lei Xu	fbe06b5880	HDFS-12349. Improve log message when it could not alloc enough blocks for EC. (Lei (Eddy) Xu)	2017-09-15 12:12:42 -07:00
Nathan Roberts	de197fc156	HDFS-12441. Supress UnresolvedPathException in namenode log. Contributed by Kihwal Lee.	2017-09-15 13:08:41 -05:00
Kihwal Lee	78bdf10ae4	HDFS-12424. Datatable sorting on the Datanode Information page in the Namenode UI is broken. Contributed by Shawna Martell.	2017-09-15 09:28:31 -05:00
Arpit Agarwal	50764ef3e4	HDFS-12456. TestNamenodeMetrics.testSyncAndBlockReportMetric fails. Contributed by Bharat Viswanadham.	2017-09-14 22:23:36 -07:00
Kai Zheng	08d996d3e9	HDFS-12395. Support erasure coding policy operations in namenode edit log. Contributed by Sammi Chen	2017-09-15 09:43:39 +08:00
Kai Zheng	ae8f55b932	HDFS-7859. Erasure Coding: Persist erasure coding policies in NameNode. Contributed by Sammi Chen	2017-09-15 09:08:18 +08:00
Lei Xu	61cee3a0b9	HDFS-12378. TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk. (Lei (Eddy) Xu)	2017-09-14 17:03:25 -07:00
Andrew Wang	390c2b5df0	Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang." ... This reverts commit 7fcc73fc0d. Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java	2017-09-14 15:12:26 -07:00
Andrew Wang	2f867115a8	Revert "HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS. Contributed by Weiwei Yang" ... This reverts commit 931a49800e. Conflicts: hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/client/HttpFSFileSystem.java hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/FSOperations.java hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java	2017-09-14 15:02:27 -07:00
John Zhuge	7ee02d1065	HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.	2017-09-14 11:26:49 -07:00
Arpit Agarwal	65a941008d	Revert "HDFS-10391. Always enable NameNode service RPC port. Contributed by Gergely Novak." ... This reverts commit aa4b6fbe75.	2017-09-14 11:17:08 -07:00
Kai Zheng	e12f3e85bd	HDFS-12438. Rename dfs.datanode.ec.reconstruction.stripedblock.threads.size to dfs.datanode.ec.reconstruction.threads. Contributed by Andrew Wang	2017-09-14 15:39:10 +08:00
ChenSammi	e0b3c644e1	HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen	2017-09-14 09:15:29 +08:00
Lei Xu	73aed34dff	HDFS-12409. Add metrics of execution time of different stages in EC recovery task. (Lei (Eddy) Xu)	2017-09-13 17:14:13 -07:00
Arpit Agarwal	f153e60576	HADOOP-14867. Update HDFS Federation setup document, for incorrect property name for secondary name node http address. Contributed by Bharat Viswanadham.	2017-09-13 12:54:02 -07:00
Xiao Chen	fa6cc43edd	Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah." ... This reverts commit 0a6d5c0cf1.	2017-09-12 19:53:07 -07:00
Lei Xu	123342cd07	HDFS-12412. Change ErasureCodingWorker.stripedReadPool to cached thread pool. (Lei (Eddy) Xu)	2017-09-12 18:12:07 -07:00
Andrew Wang	f4b6267465	HDFS-12222. Document and test BlockLocation for erasure-coded files. Contributed by Huafeng Wang.	2017-09-12 17:35:30 -07:00
Arpit Agarwal	68282c8eac	HDFS-12407. Journal node fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start. Contributed by Ajay Kumar.	2017-09-12 16:18:41 -07:00
Andrew Wang	80ee89b287	HDFS-12417. Disable flaky TestDFSStripedOutputStreamWithFailure.	2017-09-12 11:20:56 -07:00
Chen Liang	738c2a9682	HDFS-12406. dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled. Contributed by Nandakumar.	2017-09-11 14:48:07 -07:00
Lei Xu	de9994bd89	Revert "HDFS-12349. Improve log message when it could not alloc enough blocks for EC. (lei)" ... This reverts commit 3e6d0ca2b2.	2017-09-11 10:06:05 -07:00
Arpit Agarwal	aa4b6fbe75	HDFS-10391. Always enable NameNode service RPC port. Contributed by Gergely Novak.	2017-09-09 08:40:53 -07:00
Xiao Chen	b3a4d7d2a0	HDFS-12400. Provide a way for NN to drain the local key cache before re-encryption.	2017-09-07 20:51:02 -07:00
Lei Xu	3e6d0ca2b2	HDFS-12349. Improve log message when it could not alloc enough blocks for EC. (lei)	2017-09-07 18:01:37 -07:00
Manoj Govindassamy	3b3be355b3	HDFS-12404. Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users.	2017-09-07 17:20:42 -07:00
Andrew Wang	4e50dc976a	HDFS-12218. Addendum. Rename split EC / replicated block metrics in BlockManager.	2017-09-07 16:57:19 -07:00
Andrew Wang	40c2f31f8d	HDFS-12218. Rename split EC / replicated block metrics in BlockManager.	2017-09-07 16:56:35 -07:00
Xiao Chen	52b894db33	HDFS-12369. Edit log corruption due to hard lease recovery of not-closed file which has snapshots.	2017-09-07 16:30:12 -07:00
Yongjun Zhang	d77ed238a9	HDFS-12357. Let NameNode to bypass external attribute provider for configured users. Contributed by Yongjun Zhang, Arun Suresh.	2017-09-07 09:50:36 -07:00
Arpit Agarwal	5ff74167dd	HDFS-12376. Enable JournalNode Sync by default. Contributed by Hanisha Koneru.	2017-09-07 08:18:28 -07:00
Kai Zheng	2adf8bed71	HDFS-12402. Refactor ErasureCodingPolicyManager and related codes. Contributed by Sammi Chen	2017-09-07 20:38:23 +08:00
Chris Douglas	1f3bc63e67	HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov	2017-09-05 23:51:51 -07:00
Kai Zheng	d7f27043ce	HDFS-12392. Writing striped file failed due to different cell size. Contributed by Sammi Chen	2017-09-06 13:29:52 +08:00
Andrew Wang	d4035d42f0	HDFS-12377. Refactor TestReadStripedFileWithDecoding to avoid test timeouts.	2017-09-05 16:33:29 -07:00
Andrew Wang	ccd2ac60ec	HDFS-11882. Precisely calculate acked length of striped block groups in updatePipeline.	2017-09-05 14:16:03 -07:00
Xiao Chen	0ba8ff4b77	HDFS-12359. Re-encryption should operate with minimum KMS ACL requirements.	2017-09-05 10:08:27 -07:00
Kai Zheng	5dba54596a	HDFS-12388. A bad error message in DFSStripedOutputStream. Contributed by Huafeng Wang	2017-09-05 17:46:07 +08:00
Xiao Chen	633c1ea455	HDFS-12383. Re-encryption updater should handle canceled tasks better.	2017-09-03 19:50:41 -07:00
Andrew Wang	0d419c984f	Preparing for 3.1.0 development	2017-09-01 11:53:48 -07:00
Allen Wittenauer	a3fee475f7	HADOOP-14414. Calling maven-site-plugin directly for docs profile is unnecessary (Andras Bokor via aw)	2017-09-01 08:38:30 -07:00
Kai Zheng	7a96033b15	HDFS-11964. Decoding inputs should be correctly prepared in pread. Contributed by Takanobu Asanuma	2017-09-01 17:48:26 +08:00
Xiao Chen	1b3b9938cf	HDFS-12300. Audit-log delegation token related operations.	2017-08-31 23:20:01 -07:00
Mingliang Liu	36f33a1efb	HDFS-12380. Simplify dataQueue.wait condition logical operation in DataStreamer::run(). Contributed by liaoyuxiangqin	2017-08-31 23:18:48 -07:00
Mingliang Liu	1fbb662c70	HDFS-12363. Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages. Contributed by Xiao Chen	2017-08-31 22:36:56 -07:00
Allen Wittenauer	71bbb86d69	HADOOP-14670. Increase minimum cmake version for all platforms ... Signed-off-by: Chris Douglas <cdouglas@apache.org>	2017-08-30 21:47:24 -07:00
Arpit Agarwal	fd66a243bf	HDFS-12356. Unit test for JournalNode sync during Rolling Upgrade. Contributed by Hanisha Koneru.	2017-08-30 10:29:42 -07:00
Rakesh Radhakrishnan	200b11368d	HDFS-12258. ec -listPolicies should list all policies in system, no matter it's enabled or disabled. Contributed by Wei Zhou.	2017-08-30 12:58:56 +05:30
Xiao Chen	f3661fd08e	HDFS-12336. Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory. Contributed by Wellington Chevreuil.	2017-08-29 21:30:02 -07:00
Yongjun Zhang	cf93d60d3f	HDFS-12191. Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file. Contributed by Yongjun Zhang.	2017-08-29 16:57:03 -07:00
Manoj Govindassamy	63fc1b0b6d	HDFS-11912. Snapshot functionality test along with randomized file IO operations. (George Huang via Manoj Govindassamy)	2017-08-29 11:27:47 -07:00
Arpit Agarwal	a1e3f84afe	HDFS-12293. DataNode should log file name on disk error. Contributed by Ajay Kumar.	2017-08-28 15:49:59 -07:00
Arpit Agarwal	077a5eed9f	HDFS-12358. Handle IOException when transferring edit log to Journal current dir through JN sync. Contributed by Hanisha Koneru.	2017-08-26 22:47:55 -07:00
Brahma Reddy Battula	bb6a3c8330	HDFS-12248. SNN will not upload fsimage on IOE and Interrupted exceptions. (Brahma Reddy Battula)	2017-08-26 13:47:12 +08:00
Manoj Govindassamy	b89ffcff36	HDFS-11986. Dfsadmin should report erasure coding related information separately.	2017-08-25 17:21:56 -07:00
Lei Xu	36bada3032	HDFS-12215. DataNode.transferBlock does not create its daemon in the xceiver thread group. (Lei Xu)	2017-08-25 16:01:14 -07:00
Andrew Wang	f29a0fc288	HDFS-12303. Change default EC cell size to 1MB for better performance. Contributed by Wei Zhou.	2017-08-25 14:14:23 -07:00
Kihwal Lee	8455d70756	HDFS-12299. Race Between update pipeline and DN Re-Registration	2017-08-25 14:49:29 -05:00
Arpit Agarwal	4b2c442d4e	HDFS-12319. DirectoryScanner will throw IllegalStateException when Multiple BP's are present. Contributed by Brahma Reddy Battula.	2017-08-25 10:41:52 -07:00
John Zhuge	3123895db0	HDFS-12318. Fix IOException condition for openInfo in DFSInputStream. Contributed by legend.	2017-08-24 00:26:37 -07:00
Xiao Chen	1000a2af04	HDFS-10899. Add functionality to re-encrypt EDEKs.	2017-08-23 17:06:16 -07:00
John Zhuge	b6bfb2fcb2	HDFS-11738. Hedged pread takes more time when block moved from initial locations. Contributed by Vinayakumar B.	2017-08-21 13:45:30 -07:00
Manoj Govindassamy	913760cb4f	HDFS-11988. Verify HDFS Snapshots with open files captured are consistent across truncates and appends to current version file.	2017-08-21 11:08:38 -07:00
Manoj Govindassamy	4230872dd6	HDFS-12316. Verify HDFS snapshot deletion doesn't crash the ongoing file writes.	2017-08-17 16:23:48 -07:00
Andrew Wang	b298948897	HDFS-12072. Provide fairness between EC and non-EC recovery tasks. Contributed by Eddy Xu.	2017-08-17 15:26:11 -07:00
Andrew Wang	dd7916d3cd	HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.	2017-08-17 09:35:36 -07:00
Andrew Wang	96b3a6b972	HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen.	2017-08-16 22:17:06 -07:00
Akira Ajisaka	08aaa4b36f	HDFS-12269. Better to return a Map rather than HashMap in getErasureCodingCodecs. Contributed by Huafeng Wang.	2017-08-17 13:20:27 +09:00
Ravi Prakash	f34646d652	HDFS-12301. NN File Browser UI: Navigate to a path when enter is pressed	2017-08-15 15:44:59 -07:00
Wei-Chiu Chuang	e3ae3e2644	HDFS-12066. When Namenode is in safemode,may not allowed to remove an user's erasure coding policy. Contributed by lufei.	2017-08-15 07:41:43 -07:00
Wei-Chiu Chuang	1040bae6fc	HDFS-12054. FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode. Contributed by lufei.	2017-08-15 07:38:43 -07:00
Yiqun Lin	2e43c28e01	HDFS-11696. Fix warnings from Spotbugs in hadoop-hdfs. Contributed by Yiqun Lin.	2017-08-15 16:48:49 +08:00
Chris Douglas	645a8f2a4d	HADOOP-14726. Mark FileStatus::isDir as final	2017-08-14 21:57:20 -07:00
Anu Engineer	d72124a442	HDFS-12162. Update listStatus document to describe the behavior when the argument is a file. Contributed by Ajay Kumar.	2017-08-14 11:32:49 -07:00
Lei Xu	ce797a1706	HDFS-12221. Replace xcerces in XmlEditsVisitor. (Ajay Kumar via lei)	2017-08-14 10:27:47 -07:00
John Zhuge	8b242f09a6	HDFS-11303. Hedged read might hang infinitely if read data from all DN failed . Contributed by Chen Zhang, Wei-chiu Chuang, and John Zhuge.	2017-08-11 19:42:07 -07:00
Yiqun Lin	f13ca94954	HDFS-12287. Remove a no-longer applicable TODO comment in DatanodeManager. Contributed by Chen Liang.	2017-08-11 14:13:45 +08:00
John Zhuge	312e57b954	HDFS-11957. Enable POSIX ACL inheritance by default. Contributed by John Zhuge.	2017-08-10 10:30:47 -07:00
Kihwal Lee	b5c02f95b5	HDFS-12278. LeaseManager operations are inefficient in 2.8. Contributed by Rushabh S Shah.	2017-08-09 16:46:05 -05:00
Kihwal Lee	69afa26f19	HDFS-12157. Do fsyncDirectory(..) outside of FSDataset lock. Contributed by inayakumar B.	2017-08-09 09:03:51 -05:00
Wei-Chiu Chuang	8a4bff02c1	HDFS-12117. HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface. Contributed by Wellington Chevreuil.	2017-08-08 23:58:53 -07:00
Wei-Chiu Chuang	9a3c2379ef	HDFS-12182. BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks. Contributed by Wellington Chevreuil.	2017-08-08 23:44:18 -07:00
Kai Zheng	a53b8b6fdc	HDFS-11975. Provide a system-default EC policy. Contributed by Huichun Lu	2017-08-09 10:12:58 +08:00
Haohui Mai	1db4788b7d	HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran.	2017-08-08 16:33:18 -07:00
Haohui Mai	71b8dda4f6	HDFS-10326. Disable setting tcp socket send/receive buffers for write pipelines. Contributed by Daryn Sharp.	2017-08-08 14:58:16 -07:00
Kai Zheng	0b67436068	HDFS-12306. Add audit log for some erasure coding operations. Contributed by Huafeng Wang	2017-08-07 19:30:10 +08:00
Arpit Agarwal	bbc6d254c8	HDFS-12224. Add tests to TestJournalNodeSync for sync after JN downtime. Contributed by Hanisha Koneru.	2017-08-04 12:51:33 -07:00
Lei Xu	fe3341786a	HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu)	2017-08-04 11:21:58 -07:00
Andrew Wang	f4c6b00a9f	HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen.	2017-08-03 15:44:51 -07:00
Manoj Govindassamy	79df1e750e	HDFS-9388. Decommission related code to support Maintenance State for datanodes.	2017-08-02 14:22:46 -07:00
Chris Douglas	12e44e7bda	HDFS-6984. Serialize FileStatus via protobuf.	2017-08-02 12:12:48 -07:00
Sean Mackrory	1a1bf6b7d0	HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.	2017-08-02 12:25:05 -06:00
Haohui Mai	6814324c33	HDFS-12107. FsDatasetImpl#removeVolumes floods the logs when removing the volume. Contributed by Kelvin Chu.	2017-08-01 18:34:07 -07:00
Manoj Govindassamy	52d7bafcf4	HDFS-12217. HDFS snapshots doesn't capture all open files when one of the open files is deleted.	2017-08-01 16:28:20 -07:00
Sean Mackrory	7774759830	HDFS-12151. Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes.	2017-08-01 14:34:25 -06:00
Akira Ajisaka	b38a1eea8e	HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor.	2017-08-01 15:15:43 +09:00
Lei Xu	9586b0e24f	HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu)	2017-07-31 20:12:40 -07:00
Weiwei Yang	ea568123fa	HDFS-12154. Incorrect javadoc description in StorageLocationChecker#check. Contributed by Nandakumar.	2017-07-31 17:02:44 -07:00
Arpit Agarwal	3e23415a92	HDFS-12082. BlockInvalidateLimit value is incorrectly set after namenode heartbeat interval reconfigured. Contributed by Weiwei Yang.	2017-07-31 11:33:55 -07:00
Andrew Wang	480c8db40c	HDFS-12206. Rename the split EC / replicated block metrics.	2017-07-28 11:24:44 -07:00
Lei Xu	77791e4c36	HDFS-12044. Mismatch between BlockManager.maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery. (Contributed by Lei (Eddy) Xu)	2017-07-28 10:50:49 -07:00
Wei-Chiu Chuang	369f731264	HDFS-12062. removeErasureCodingPolicy needs super user permission. Contributed by Wei-Chiu Chuang.	2017-07-28 00:51:03 -07:00
Yongjun Zhang	c6330f22a5	HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang.	2017-07-27 16:48:24 -07:00
Jitendra Pandey	e3c7300225	HDFS-2319. Add test cases for FSshell -stat. Contributed by XieXianshan and Bharat Viswanadham.	2017-07-27 13:23:15 -07:00
Brahma Reddy Battula	c4a85c694f	HDFS-11896. Non-dfsUsed will be doubled on dead node re-registration. Contributed by Brahma Reddy Battula.	2017-07-27 12:02:57 -07:00
Kihwal Lee	a68b5b31cf	HDFS-12171. Reduce IIP object allocations for inode lookup. Contributed by Daryn Sharp.	2017-07-25 11:03:49 -05:00
Brahma Reddy Battula	6d983cca52	HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula.	2017-07-25 23:51:53 +08:00
Kihwal Lee	1a79dcfc45	HDFS-12143. Improve performance of getting and removing inode features. Contributed by Daryn Sharp.	2017-07-25 10:28:57 -05:00
Ravi Prakash	c98201b5d8	HDFS-12193. Fix style issues in HttpFS tests. Contributed by Zoran Dimitrijevic	2017-07-24 19:06:15 -07:00
Akira Ajisaka	770cc46228	HDFS-12176. dfsadmin shows DFS Used%: NaN% if the cluster has zero block. Contributed by Weiwei Yang.	2017-07-24 16:24:23 +09:00
Kihwal Lee	8e3a992ecc	HDFS-11742. Improve balancer usability after HDFS-8818. Contributed by Kihwal Lee	2017-07-21 09:14:19 -05:00
John Zhuge	3b48f81411	HDFS-12166. Do not deprecate HTTPFS_TEMP. Contributed by John Zhuge. ... Change-Id: Icdd032de9feea3d0dde71bf8145b70497993d97f	2017-07-20 20:45:09 -07:00
Konstantin V Shvachko	8c2c812832	HDFS-11472. Fix inconsistent replica size after a data pipeline failure. Contributed by Erik Krogen and Wei-Chiu Chuang.	2017-07-20 14:47:25 -07:00
Yongjun Zhang	3556e36be3	HDFS-12139. HTTPFS liststatus returns incorrect pathSuffix for path of file. Contributed by Yongjun Zhang.	2017-07-19 10:56:50 -07:00
Anu Engineer	413b23eb04	HDFS-12158. Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protection. Contributed by Mukul Kumar Singh.	2017-07-19 10:29:06 -07:00
Brahma Reddy Battula	04ff412dab	HDFS-12133. Correct ContentSummaryComputationContext Logger class name.. Contributed by Surendra Singh Lilhore.	2017-07-19 23:43:10 +08:00
Brahma Reddy Battula	f8cd55fe33	HDFS-12067. Correct dfsadmin commands usage message to reflects IPC port. Contributed by steven-wugang.	2017-07-19 23:21:43 +08:00
Tsz-Wo Nicholas Sze	ed27f2b2cc	HDFS-12138. Remove redundant 'public' modifiers from BlockCollection. Contributed by Chen Liang	2017-07-17 13:54:16 -07:00
Brahma Reddy Battula	b778887af5	HDFS-12112. TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE. Contributed by Wei-Chiu Chuang.	2017-07-15 10:38:31 +08:00
Xiao Chen	0a6d5c0cf1	HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.	2017-07-14 22:22:53 -07:00
Tsz-Wo Nicholas Sze	f413ee33df	HDFS-12130. Optimizing permission check for getContentSummary. Contributed by Chen Liang	2017-07-14 14:35:51 -07:00
Tsz-Wo Nicholas Sze	a1f12bb543	Revert "HDFS-12130. Optimizing permission check for getContentSummary." to fix commit message. ... This reverts commit a29fe100b3.	2017-07-14 14:34:01 -07:00
Kihwal Lee	e7d187a1b6	HDFS-12140. Remove BPOfferService lock contention to get block pool id. Contributed by Daryn Sharp.	2017-07-14 16:07:17 -05:00
Kihwal Lee	8d86a93915	HDFS-12137. DN dataset lock should be fair. Contributed by Daryn Sharp.	2017-07-14 15:41:43 -05:00
Tsz-Wo Nicholas Sze	a29fe100b3	HDFS-12130. Optimizing permission check for getContentSummary.	2017-07-14 13:36:27 -07:00
Xiaoyu Yao	e15e2713e1	HDFS-11502. Datanode UI should display hostname based on JMX bean instead of window.location.hostname. Contributed by Jeffrey E Rodriguez and Yuanbo Liu.	2017-07-12 16:26:19 -07:00
Tsz-Wo Nicholas Sze	931a49800e	HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS. Contributed by Weiwei Yang	2017-07-12 14:15:04 -07:00
John Zhuge	ac0a04a6e1	HDFS-12114. Consistent HttpFS property names. Contributed by John Zhuge.	2017-07-11 21:06:41 -07:00
Akira Ajisaka	9144fd9e9b	HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor.	2017-07-12 11:35:50 +09:00
John Zhuge	12c8fdceaf	HDFS-12052. Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS. Contributed by Zoran Dimitrijevic.	2017-07-11 11:19:08 -07:00