Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,545 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

16545 Commits

Author SHA1 Message Date
Allen Wittenauer 20ba86d66a MAPREDUCE-6536. hadoop-pipes doesn't use maven properties for openssl 
Signed-off-by: Ravi Prakash <raviprak@apache.org>
 2017-06-28 17:33:44 -07:00
Sunil G c1edca101c YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin. 2017-06-28 15:40:58 -07:00
Junping Du 4e3eebc943 YARN-5311. Document graceful decommission CLI and usage. Contributed by Elek, Marton. 2017-06-28 15:32:04 -07:00
Mingliang Liu 990aa34de2 HADOOP-14609. NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks an error code. Contributed by Steve Loughran 2017-06-28 14:18:59 -07:00
Wei-Chiu Chuang e9d8bdfdf5 HADOOP-14297. Update the documentation about the new ec codecs config keys. Contributed by Kai Sasaki. 2017-06-28 13:53:54 -07:00
Lei Xu d6df0fdbbd Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable. Contributed by luhuichun via lei. 2017-06-28 13:47:23 -07:00
Daniel Templeton 25d891a784 YARN-6743. yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml 
(Contributed by Lori Loberg via Daniel Templeton)
 2017-06-28 13:17:58 -07:00
Wei-Chiu Chuang f99b6d19de HDFS-11870. Add CLI cmd to enable/disable an erasure code policy. Contributed by lufei. 2017-06-28 10:54:25 -07:00
Steve Loughran ee243e5289
HADOOP-14190. Add more on S3 regions to the s3a documentation. 
Contributed by Steve Loughran
 2017-06-28 10:22:13 +01:00
Xiao Chen fb5ee3fafb HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j. 2017-06-27 23:49:09 -07:00
Akira Ajisaka a5c0476a99
MAPREDUCE-6697. Concurrent task limits should only be applied when necessary. Contributed by Nathan Roberts. 2017-06-28 10:50:09 +09:00
Mingliang Liu 7e031c2c18 HADOOP-14546. Azure: Concurrent I/O does not work when secure.mode is enabled. Contributed by Thomas 2017-06-27 17:32:07 -07:00
Mingliang Liu 686a634f01 HADOOP-14573. regression: Azure tests which capture logs failing with move to SLF4J. Contributed by Steve Loughran 2017-06-27 16:48:47 -07:00
Jason Lowe 63ce1593c5 YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich 2017-06-27 17:12:42 -05:00
Mingliang Liu bc4dfe9c9c HADOOP-14594. ITestS3AFileOperationCost::testFakeDirectoryDeletion to uncomment metric assertions. Contributed by Mingliang Liu 2017-06-27 13:19:14 -07:00
Steve Loughran 94e39c6c4e
HADOOP-14536. Update azure-storage sdk to version 5.3.0 
Contributed by Georgi Chalakov
 2017-06-27 15:09:03 +01:00
Akira Ajisaka 07defa4c09
HDFS-12040. TestFsDatasetImpl.testCleanShutdownOfVolume fails. Contributed by hu xiaodong. 2017-06-27 20:49:26 +09:00
Anu Engineer 8641a2c08b HDFS-12045. Add log when Diskbalancer volume is transient storage type. Contributed by steven-wugang. 2017-06-27 00:39:47 -07:00
Robert Kanter 2b87faf166 MAPREDUCE-6904. HADOOP_JOB_HISTORY_OPTS should be HADOOP_JOB_HISTORYSERVER_OPTS in mapred-config.sh (rkanter) 2017-06-26 17:35:55 -07:00
Lei Xu 144753e87f HDFS-12033. DatanodeManager picking EC recovery tasks should also consider the number of regular replication tasks. Contributed by Lei (Eddy) Xu. 2017-06-26 15:43:50 -07:00
Ravi Prakash a9d3412b4c HDFS-11993. Add log info when connect to datanode socket address failed. Contributed by chencan 2017-06-26 13:24:27 -07:00
Andrew Wang 2c367b464c HDFS-11956. Do not require a storage ID or target storage IDs when writing a block. Contributed by Ewan Higgs. 2017-06-26 11:20:07 -07:00
Andrew Wang 06c8ca3bb3 HDFS-12032. Inaccurate comment on DatanodeDescriptor#getNumberOfBlocksToBeErasureCoded. 2017-06-26 10:54:01 -07:00
Steve Loughran 48f4a229a9
HADOOP-14461 Azure: handle failure gracefully in case of missing account access key. 
Contributed by Mingliang Liu.
 2017-06-26 13:39:47 +01:00
Kai Zheng 379f19a2c7 HDFS-11943. [Erasure coding] Warn log frequently print to screen in doEncode/doDecode functions. Contributed by liaoyuxiangqin 2017-06-26 16:26:09 +08:00
Akira Ajisaka a594f96fb1
HADOOP-14549. Use GenericTestUtils.setLogLevel when available in hadoop-tools. Contributed by wenxin he. 2017-06-26 16:41:00 +09:00
Arpit Agarwal 0111711d8b HADOOP-14543. ZKFC should use getAversion() while setting the zkacl. Contributed by Brahma Reddy Battula. 2017-06-23 16:50:47 -07:00
Steve Loughran c6bd73c6c5
HADOOP-14547. [WASB] the configured retry policy is not used for all storage operations. 
Contributed by Thomas.
 2017-06-23 21:38:41 +01:00
Yufei Gu 0b77262890 YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu) 2017-06-23 13:26:03 -07:00
Brahma Reddy Battula abdea26280 HDFS-12024. Fix typo's in FsDatasetImpl.java. Contributed by Yasen liu. 2017-06-23 22:56:28 +08:00
Steve Loughran e5db9af8a0
HADOOP-14568. GenericTestUtils#waitFor missing parameter verification. 
Contributed by Yiqun Lin
 2017-06-23 14:39:58 +01:00
Sunil G ca13b224b2 YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne. 2017-06-22 23:50:57 -07:00
Xiao Chen 68dc7c2405 HDFS-12009. Accept human-friendly units in dfsadmin -setBalancerBandwidth and -setQuota. Contributed by Andrew Wang. 2017-06-22 19:57:54 -07:00
Naganarasimha 740204b292 YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt. 2017-06-23 07:52:41 +05:30
Akira Ajisaka 092ebdf885
HADOOP-12940. Fix warnings from Spotbugs in hadoop-common. 2017-06-23 10:28:58 +09:00
Arpit Agarwal 8ceaac1877 HDFS-12010. TestCopyPreserveFlag fails consistently because of mismatch in access time. Contributed by Mukul Kumar Singh. 2017-06-22 15:42:50 -07:00
Arpit Agarwal 6d116ffad2 HDFS-11789. Maintain Short-Circuit Read Statistics. Contributed by Hanisha Koneru. 2017-06-22 13:35:56 -07:00
Arun Suresh 49aa60e50d YARN-6127. Add support for work preserving NM restart when AMRMProxy is enabled. (Botong Huang via asuresh). 2017-06-22 11:27:13 -07:00
Vinayakumar B 8dbd53ef9f HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B. 2017-06-22 17:37:08 +05:30
Akira Ajisaka b64951905e
HADOOP-14542. Add IOUtils.cleanupWithLogger that accepts slf4j logger API. Contributed by Chen Liang. 2017-06-22 17:42:59 +09:00
Arpit Agarwal 9ae9467f92 HDFS-11998. Enable DFSNetworkTopology as default. Contributed by Chen Liang. 2017-06-21 22:01:41 -07:00
Zhe Zhang c22cf00442 Confusion/name conflict between NameNodeActivity#BlockReportNumOps and RpcDetailedActivity#BlockReportNumOps. Contributed by Erik Krogen. 2017-06-21 16:34:19 -07:00
Daryn Sharp e806c6e0ce HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp 2017-06-21 11:03:41 -05:00
Kai Zheng 5db3f98468 HDFS-11606. Add CLI cmd to remove an erasure code policy. Contributed by Tim Yao 2017-06-21 14:01:55 +08:00
Kai Zheng a010b330e7 HDFS-11933. Arguments check for ErasureCodingPolicy->composePolicyName. Contributed by Lu Fei 2017-06-21 13:46:18 +08:00
Akira Ajisaka 1a598479a9
HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong. 2017-06-21 11:19:48 +09:00
Yongjun Zhang 5157f6c46e HADOOP-14429. FTPFileSystem#getFsAction always returns FsAction.NONE. (Hongyuan Li via Yongjun Zhang) 2017-06-20 16:51:13 -07:00
Lei Xu 45ff4d38e6 HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun. 2017-06-20 11:55:09 -07:00
Wei-Chiu Chuang 2b654a493c HDFS-11978. Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc. Contributed by wenxin he. 2017-06-20 09:36:55 -07:00
Jason Lowe dd65eea74b HADOOP-8143. Change distcp to have -pb on by default. Contributed by Mithun Radhakrishnan 2017-06-20 09:53:47 -05:00