Commit Graph

14854 Commits

Author SHA1 Message Date
Mingliang Liu 3441c746b5 HDFS-10972. Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'. Contributed by Xiaobing Zhou 2016-10-10 11:33:37 -07:00
Steve Loughran cef61d505e HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu. 2016-10-10 12:32:39 +01:00
Kai Zheng af50da3298 HDFS-10895. Update HDFS Erasure Coding doc to add how to use ISA-L based coder. Contributed by Sammi Chen 2016-10-10 11:55:49 +06:00
Kai Zheng 3d59b18d49 HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang 2016-10-09 15:53:36 +06:00
Kai Zheng bea004eaeb MAPREDUCE-6780. Add support for HDFS directory with erasure code policy to TeraGen and TeraSort. Contributed by Sammi Chen 2016-10-09 15:33:26 +06:00
Kai Zheng ec0b70716c HADOOP-12579. Deprecate WriteableRPCEngine. Contributed by Wei Zhou 2016-10-09 15:07:03 +06:00
Kai Zheng c31b5e61b1 HADOOP-13701. AbstractContractRootDirectoryTest can fail when handling delete "/". Contributed by Genmao Yu 2016-10-08 17:35:59 +06:00
Kai Zheng a57bba470b Merge branch 'trunk' into HADOOP-12756 2016-10-09 10:29:40 +08:00
Jing Zhao 4d106213c0 HDFS-10968. BlockManager#isInNewRack should consider decommissioning nodes. Contributed by Jing Zhao. 2016-10-07 22:44:54 -07:00
Xiao Chen 6a38d118d8 HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get counted twice. Contributed by Sean Mackrory. 2016-10-07 17:37:15 -07:00
Kihwal Lee e57fa81d95 HDFS-10980. Optimize check for existence of parent directory. Contributed by Daryn Sharp. 2016-10-07 17:20:15 -05:00
Robert Kanter f3f37e6fb8 MAPREDUCE-6776. yarn.app.mapreduce.client.job.max-retries should have a more useful default (miklos.szegedi@cloudera.com via rkanter) 2016-10-07 14:47:06 -07:00
Xiao Chen 2e853be657 HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen. 2016-10-07 13:46:27 -07:00
Kihwal Lee 3565c9af17 HDFS-10979. Pass IIP for FSDirDeleteOp methods. Contributed by Daryn Sharp. 2016-10-07 14:15:59 -05:00
Chris Nauroth 69620f9559 HADOOP-13692. hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts. Contributed by Chris Nauroth. 2016-10-07 11:41:19 -07:00
Wei-Chiu Chuang 3059b251d8 HDFS-10933. Refactor TestFsck. Contributed by Takanobu Asanuma. 2016-10-07 10:17:50 -07:00
Brahma Reddy Battula be3cb10f53 HDFS-10969. Fix typos in hdfs-default.xml Contributed by Yiqun Lin 2016-10-07 22:18:40 +05:30
Robert Kanter c183b9de8d HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter) 2016-10-07 09:33:31 -07:00
Junping Du 459a4833a9 YARN-5659. getPathFromYarnURL should use standard methods. Contributed by Sergey Shelukhin. 2016-10-07 07:46:08 -07:00
Steve Loughran ebd4f39a39 HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran. 2016-10-07 12:51:40 +01:00
Andrew Wang bf372173d0 HADOOP-13689. Do not attach javadoc and sources jars during non-dist build. 2016-10-06 15:08:24 -07:00
Kihwal Lee 48b9d5fd2a HDFS-10955. Pass IIP for FSDirAttr methods. Contributed by Daryn Sharp. 2016-10-06 16:33:46 -05:00
Chris Nauroth 1d330fbaf6 HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth. 2016-10-06 13:19:16 -07:00
Kihwal Lee f32e9fc8f7 HDFS-10939. Reduce performance penalty of encryption zones. Contributed by Daryn sharp. 2016-10-06 15:11:14 -05:00
Andrew Wang 72a2ae6452 HADOOP-13688. Stop bundling HTML source code in javadoc JARs. 2016-10-06 11:19:38 -07:00
Chris Nauroth 2d46c3f6b7 HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran. 2016-10-06 10:57:01 -07:00
Steve Loughran 2cc841f16e HADOOP-13678 Update jackson from 1.9.13 to 2.x in hadoop-tools. Contributed by Akira Ajisaka. 2016-10-06 16:31:00 +01:00
Rohith Sharma K S 4d2f380d78 YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G. 2016-10-06 20:42:36 +05:30
Vinayakumar B 311954883f HDFS-10957. Retire BKJM from trunk (Vinayakumar B) 2016-10-06 19:28:25 +05:30
Brahma Reddy Battula 35b9d7de9f HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin 2016-10-06 18:06:08 +05:30
Brahma Reddy Battula b90fc70d67 HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen 2016-10-06 17:47:31 +05:30
Akira Ajisaka 272a21747e MAPREDUCE-6789. Fix TestAMWebApp failure. Contributed by Daniel Templeton. 2016-10-06 15:57:15 +09:00
Mingliang Liu 202325485d HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test. Contributed by Mingliang Liu 2016-10-05 22:33:29 -07:00
Wei-Chiu Chuang c5ca216915 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 2016-10-05 17:36:50 -07:00
Andrew Wang e68c7b96c7 HDFS-10962. TestRequestHedgingProxyProvider is flaky. 2016-10-05 15:08:56 -07:00
Mingliang Liu 00160f71b6 HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang 2016-10-05 16:50:01 -04:00
Chris Douglas d65b957776 YARN-5702. Refactor TestPBImplRecords for reuse in other YARN modules. Contributed by Subru Krishnan 2016-10-05 12:16:49 -07:00
Jing Zhao 8867762256 HDFS-10826. Correctly report missing EC blocks in FSCK. Contributed by Takanobu Asanuma. 2016-10-05 10:52:50 -07:00
Steve Loughran d6be1e75d8 HADOOP-12667 s3a to support createNonRecursive API. Contributed by Sean Mackrory 2016-10-05 15:02:11 +01:00
Akira Ajisaka 6cfe649375 HADOOP-13681. Reduce Kafka dependencies in hadoop-kafka module. Contributed by Grant Henke.
This closes #133
2016-10-05 20:44:39 +09:00
Akira Ajisaka 9a61b52fbe HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao. 2016-10-05 20:41:08 +09:00
Varun Vasudev 0992708d79 YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana. 2016-10-05 15:31:38 +05:30
Jian He 31f8da22d0 YARN-3139. Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler. Contributed by Wangda Tan 2016-10-04 17:23:13 -07:00
Kihwal Lee 44f48ee96e HDFS-10956. Remove rename/delete performance penalty when not using snapshots. Contributed by Daryn Sharp. 2016-10-04 15:05:09 -05:00
Chris Nauroth 88b9444a81 HADOOP-13674. S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint. Contributed by Chris Nauroth. 2016-10-04 10:36:58 -07:00
Kihwal Lee 382307cbdd HDFS-10878. TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException. Contributed by Rushabh S Shah. 2016-10-04 11:09:03 -05:00
Brahma Reddy Battula ef7f06f7d1 HDFS-10947. Correct the API name for truncate in webhdfs document. Contributed by Surendra Singh Lilhore 2016-10-04 18:46:42 +05:30
Brahma Reddy Battula 5ea0210c7f HDFS-10944. Correct the javadoc of dfsadmin#disallowSnapshot. Contributed by Jagadesh Kiran N 2016-10-04 18:33:22 +05:30
Mingliang Liu f61e3d13e9 HDFS-10934. TestDFSShell#testStat fails intermittently. Contributed by Eric Badger 2016-10-03 22:34:41 -04:00
Mingliang Liu 8078a5efd0 HDFS-10810. setreplication removing block from underconstrcution temporarily. Contributed by Brahma Reddy Battula 2016-10-03 21:50:16 -04:00