Commit Graph

5825 Commits

Author SHA1 Message Date
Anu Engineer ef84ac4699 HDFS-10995. Ozone: Move ozone XceiverClient to hdfs-client. Contributed by Chen Liang. 2016-10-12 17:37:14 -07:00
Anu Engineer 4217f85202 HDFS-10932. Ozone: fix XceiverClient slow shutdown. Contributed by Chen Liang. 2016-09-30 17:12:43 -07:00
Anu Engineer 595257e3f4 Merge branch 'trunk' into HDFS-7240 2016-09-29 11:12:53 -07:00
Anu Engineer 71c9b5be7b HDFS-10897. Ozone: SCM: Add NodeManager. Contributed by Anu Engineer. 2016-09-29 10:36:25 -07:00
Mingliang Liu 84c6264079 HDFS-10892. Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'. Contributed by Mingliang Liu 2016-09-28 16:03:51 -07:00
Andrew Wang 92e5e91598 HDFS-10914. Move remnants of oah.hdfs.client to hadoop-hdfs-client. 2016-09-28 16:01:03 -07:00
Kihwal Lee 5f34402ada HDFS-10779. Rename does not need to re-solve destination. Contributed by Daryn Sharp. 2016-09-28 17:57:23 -05:00
Arpit Agarwal c3b235e565 HDFS-10824. MiniDFSCluster#storageCapacities has no effects on real capacity. Contributed by Xiaobing Zhou. 2016-09-28 11:47:37 -07:00
Anu Engineer 03f519a757 HDFS-9850. DiskBalancer: Explore removing references to FsVolumeSpi. Contributed by Manoj Govindassamy. 2016-09-27 21:35:06 -07:00
Mingliang Liu 6437ba18c5 HDFS-10915. Fix time measurement bug in TestDatanodeRestart. Contributed by Xiaobing Zhou 2016-09-27 20:40:17 -07:00
Anu Engineer 9c9736463b HDFS-10900. DiskBalancer: Complete the documents for the report command. Contributed by Yiqun Lin. 2016-09-27 19:28:41 -07:00
Yongjun Zhang 2acfb1e1e4 HDFS-10376. Enhance setOwner testing. (John Zhuge via Yongjun Zhang) 2016-09-27 14:55:28 -07:00
Wangda Tan 875062b5bc HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 2016-09-27 11:26:45 -07:00
Arpit Agarwal 8ae4729107 HDFS-10828. Fix usage of FsDatasetImpl object lock in ReplicaMap. (Arpit Agarwal) 2016-09-27 10:02:15 -07:00
Masatake Iwasaki f55eb981dd HDFS-10426. TestPendingInvalidateBlock failed in trunk. Contributed by Yiqun Lin. 2016-09-28 01:29:24 +09:00
Brahma Reddy Battula df1d0f5d56 HDFS-10889. Remove outdated Fault Injection Framework documentaion. Contributed by Brahma Reddy Battula 2016-09-27 19:33:10 +05:30
Brahma Reddy Battula edf0d0f8b2 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 2016-09-27 07:04:37 +05:30
Arpit Agarwal 059058f961 HDFS-10713. Throttle FsNameSystem lock warnings. Contributed by Hanisha Koneru. 2016-09-26 17:09:47 -07:00
Wei-Chiu Chuang 8e06d865c4 Addendum patch for HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. 2016-09-26 14:41:04 -07:00
Wei-Chiu Chuang 3ae652f821 HDFS-10609. Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications. Contributed by Wei-Chiu Chuang. 2016-09-26 13:11:32 -07:00
Brahma Reddy Battula 3e37e243ee HDFS-10869. Remove the unused method InodeId#checkId(). Contributed by Jagadesh Kiran N 2016-09-25 11:02:46 +05:30
Konstantin V Shvachko 6eb700ee74 HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko. 2016-09-23 14:10:11 -07:00
Wei-Chiu Chuang 74b3dd514c HDFS-10876. Dispatcher#dispatch should log IOException stacktrace. Contributed by Manoj Govindassamy. 2016-09-23 13:26:57 -07:00
Konstantin V Shvachko a5bb88c8e0 HDFS-10843. Update space quota when a UC block is completed rather than committed. Contributed by Erik Krogen. 2016-09-23 10:37:46 -07:00
Brahma Reddy Battula bbdf350ff9 HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document. 2016-09-23 19:21:34 +05:30
Brahma Reddy Battula c4480f7f42 HDFS-10894. Remove the redundant charactors for command -saveNamespace in HDFSCommands.md Contributed by Yiqun Lin. 2016-09-23 19:11:02 +05:30
Anu Engineer d85d9b2e7b HDFS-10871. DiskBalancerWorkItem should not import jackson relocated by htrace. Contributed by Manoj Govindassamy. 2016-09-22 19:36:16 -07:00
Andrew Wang 40acacee08 HDFS-10877. Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers. Contributed by Sean Mackrory. 2016-09-22 11:43:11 -07:00
Masatake Iwasaki 964e546ab1 HDFS-9333. Some tests using MiniDFSCluster errored complaining port in use. (iwasakims) 2016-09-21 10:35:25 +09:00
Xiao Chen 0e918dff59 HDFS-10879. TestEncryptionZonesWithKMS#testReadWrite fails intermittently. Contributed by Xiao Chen. 2016-09-20 16:56:52 -07:00
Kai Zheng 734d54c1a8 HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen 2016-09-21 21:34:48 +08:00
Xiao Chen e52d6e7a46 HDFS-10875. Optimize du -x to cache intermediate result. Contributed by Xiao Chen. 2016-09-19 21:44:42 -07:00
Andrew Wang c54f6ef30f HDFS-10868. Remove stray references to DFS_HDFS_BLOCKS_METADATA_ENABLED. 2016-09-19 11:17:03 -07:00
Xiao Chen ea839bd48e HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 2016-09-17 22:25:39 -07:00
Akira Ajisaka b09a03cd7d HDFS-10862. Typos in 4 log messages. Contributed by Mehran Hassani. 2016-09-16 16:08:47 +09:00
Arpit Agarwal ec3ea18875 HDFS-9895. Remove unnecessary conf cache from DataNode. Contributed by Xiaobing Zhou. 2016-09-15 15:25:47 -07:00
Arpit Agarwal 2a8f55a0cf HDFS-10805. Reduce runtime for append test. Contributed by Gergely Novak. 2016-09-14 09:31:17 -07:00
Kai Zheng ea0c2b8b05 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-15 10:46:00 +08:00
Lei Xu 86c9862bec HDFS-10636. Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File. (Virajith Jalaparti via lei) 2016-09-13 12:54:14 -07:00
Anu Engineer 1c0d18f322 HDFS-10562. DiskBalancer: update documentation on how to report issues and debug. Contributed by Anu Engineer. 2016-09-13 12:42:10 -07:00
Andrew Wang db6d243cf8 HDFS-10837. Standardize serializiation of WebHDFS DirectoryListing. 2016-09-13 11:02:36 -07:00
Anu Engineer e3f7f58a5f HDFS-10599. DiskBalancer: Execute CLI via Shell. Contributed by Manoj Govindassamy. 2016-09-13 09:38:12 -07:00
Akira Ajisaka f0876b8b60 HDFS-10856. Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport. Contributed by Yiqun Lin. 2016-09-13 14:50:03 +09:00
Yongjun Zhang d2466ec3e0 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 2016-09-12 21:25:06 -07:00
Jing Zhao 72dfb048a9 HDFS-10858. FBR processing may generate incorrect reportedBlock-blockGroup mapping. Contributed by Jing Zhao. 2016-09-12 16:40:11 -07:00
Anu Engineer 8a93f45a80 HDFS-10821. DiskBalancer: Report command support with multiple nodes. Contributed by Yiqun Lin. 2016-09-12 15:45:26 -07:00
Allen Wittenauer 58ed4fa544 HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
This commit includes the following changes:

	HADOOP-13356. Add a function to handle command_subcommand_OPTS
	HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
	HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
	HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
	HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
	HADOOP-13357. Modify common to use hadoop_subcommand_opts
	HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
	HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
	HADOOP-13564. modify mapred to use hadoop_subcommand_opts
	HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
	HADOOP-13360. Documentation for HADOOP_subcommand_OPTS

This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
Xiao Chen cc01ed7026 HDFS-10855. Fix typos in HDFS documents. Contributed by Yiqun Lin. 2016-09-10 23:24:49 -07:00
Arpit Agarwal a99bf26a08 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:22:25 -07:00
Anu Engineer bee9f57f5c HDFS-10808. DiskBalancer does not execute multi-steps plan-redux. Contributed by Anu Engineer. 2016-09-09 15:00:39 -07:00