Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,929 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

4318 Commits

Author SHA1 Message Date
Andrey Dyatlov 04a5f5a6dc
HADOOP-14156. Fix grammar error in ConfTest.java. 
This closes #187

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2017-03-13 16:15:53 +09:00
Ray Chiang 4db9cc70d0 YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang) 2017-03-10 16:13:31 -08:00
Jian He 4478273e5f HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-10 09:25:58 -08:00
Mingliang Liu fd26783aaf HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 2017-03-10 00:21:20 -08:00
John Zhuge 570827a819 HADOOP-14052. Fix dead link in KMS document. Contributed by Christina Vu. 
Change-Id: I7093f443d93927184196f62f02cc106a2c89e9cf
 2017-03-08 23:50:15 -08:00
Arpit Agarwal 0a1762125c HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh. 2017-03-08 15:34:02 -08:00
Arpit Agarwal 647de3c41e HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-08 15:34:01 -08:00
Mingliang Liu 223c268535 HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-08 15:34:00 -08:00
Mingliang Liu bb0bc7d909 Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth" 
This reverts commit 6b7cd62b8c.
 2017-03-08 15:34:00 -08:00
Ray Chiang e8864e920d YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang) 2017-03-08 15:33:59 -08:00
Andrew Wang a4c1fec7b5 HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers. 2017-03-08 15:33:58 -08:00
Akira Ajisaka 28529e5204 HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma. 2017-03-08 15:33:58 -08:00
Mingliang Liu e291aba474 HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-08 15:33:56 -08:00
Jian He 2be8947d12 Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand" 
This reverts commit 241c1cc05b.
 2017-03-08 13:20:01 -08:00
Jian He 241c1cc05b HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:48:27 -08:00
John Zhuge 98142d2f72 Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran" 
This reverts commit 53a12fa721.
 2017-03-08 09:54:22 -08:00
Arpit Agarwal 1f9848dfe1 HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh. 2017-03-07 11:41:05 -08:00
Arpit Agarwal 959940b0ab HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-07 10:12:35 -08:00
Mingliang Liu 686823529b HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-06 17:16:36 -08:00
Mingliang Liu 52d7d5aa1a Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth" 
This reverts commit 6b7cd62b8c.
 2017-03-06 17:10:11 -08:00
Ray Chiang d9dc444dc7 YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang) 2017-03-06 14:02:49 -08:00
Andrew Wang ec839b94c0 HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers. 2017-03-06 10:47:15 -08:00
Akira Ajisaka 209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma. 2017-03-07 01:34:51 +09:00
Mingliang Liu 6b7cd62b8c HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-03 17:09:12 -08:00
Anu Engineer 0951726233 Merge branch 'trunk' into HDFS-7240 2017-03-03 14:03:35 -08:00
Jason Lowe 05237636d3 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang 2017-03-03 07:57:37 -06:00
Harsh J eb5a17954a HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java. 
This closes #146

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2017-03-03 18:38:04 +09:00
Rakesh Radhakrishnan 3749152b66 HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang. 2017-03-03 09:28:03 +05:30
Andrew Wang 8f4817f2c5 Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru." 
This reverts commit e61491d476.
 2017-03-02 16:20:48 -08:00
Arpit Agarwal e61491d476 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:25 -08:00
Arpit Agarwal eeca8b0c4e HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang. 2017-03-02 09:21:27 -08:00
Arpit Agarwal 899d5c4d49 HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh. 2017-03-01 12:59:02 -08:00
Brahma Reddy Battula dcd03df9f9 HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 2017-03-01 10:45:56 +05:30
Akira Ajisaka 258342e76c HADOOP-14118. move jets3t into a dependency on hadoop-aws JAR. 2017-02-28 13:47:44 +09:00
Yiqun Lin 9db2e0c8d4 HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin. 2017-02-27 18:39:14 +08:00
Xuan 289bc50e66 HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover 
on certain exception. Contributed by Jian He
 2017-02-24 11:42:23 -08:00
Andrew Wang c1a52b04d0 HDFS-11427. Rename rs-default to rs. 2017-02-24 10:58:45 -08:00
Harsh J e8694deb6a HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh) 2017-02-24 21:34:00 +05:30
Akira Ajisaka 50decd3613 HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton. 2017-02-25 00:28:31 +09:00
Andrew Wang 132f758e3d HDFS-11426. Refactor EC CLI to be similar to storage policies CLI. 2017-02-23 16:00:11 -08:00
Mingliang Liu a4d4a23785 HADOOP-13321. Deprecate FileSystem APIs that promote inefficient call patterns. Contributed by Chris Nauroth and Mingliang Liu 2017-02-23 12:55:40 -08:00
Mingliang Liu 003ae00693 HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze 2017-02-21 15:32:46 -08:00
Eric Yang 172b23af33 HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu. 2017-02-18 18:34:13 -08:00
Yongjun Zhang 4c26c241ad HADOOP-13805. UGI.getCurrentUser() fails if user does not have a keytab associated. Contributed by Xiao Chen, Wei-Chiu Chuang, Yongjun Zhang. 2017-02-17 09:18:50 -08:00
Wei-Chiu Chuang 5690b51ef7 HDFS-11100. Recursively deleting file protected by sticky bit should fail. Contributed by John Zhuge. 2017-02-16 05:39:37 -08:00
Wei-Chiu Chuang cc45da79fd HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor. 2017-02-13 10:14:45 -08:00
Arpit Agarwal 0aacd8fd25 HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru. 2017-02-11 01:17:56 -08:00
Kihwal Lee 0c01cf5798 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 2017-02-09 16:17:24 -06:00
Kihwal Lee b6bb99c18a HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 2017-02-09 10:47:29 -06:00
Kihwal Lee a0bfb41504 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 2017-02-09 10:04:28 -06:00
Junping Du eec52e158b YARN-6145. Improve log message on fail over. Contributed by Jian He. 2017-02-08 02:11:19 -08:00
Xiao Chen 2007e0cf2a HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled. 2017-02-07 20:36:11 -08:00
Xiao Chen 69b23632c4 HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge. 2017-02-07 09:36:55 -08:00
Xiao Chen d88497d44a HADOOP-14047. Require admin to access KMS instrumentation servlets. Contributed by John Zhuge. 2017-02-06 13:14:17 -08:00
Junping Du cce35c3815 HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena. 2017-02-05 19:42:11 -08:00
Yiqun Lin 3ea6d3517e HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin. 2017-02-04 11:01:27 +08:00
Akira Ajisaka cb8f3f3adf HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin. 2017-02-04 10:58:08 +09:00
Xiao Chen ba75bc7593 HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 2017-02-03 17:13:53 -08:00
Chris Douglas 59c5f18784 HADOOP-13895. Make FileStatus Serializable 2017-02-01 10:19:36 -08:00
Xiao Chen ebd40056a0 HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge. 2017-01-27 10:49:26 -08:00
Xiaoyu Yao 2034315763 HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao. 2017-01-26 20:34:32 -08:00
Andrew Wang ff02bdfe65 Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release. 2017-01-25 15:39:40 -08:00
Jason Lowe 9e19f758c1 YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-25 21:41:43 +00:00
Xiaoyu Yao a46933e8ce HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao. 2017-01-25 13:33:06 -08:00
Steve Loughran 7fc3e68a87 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:29:27 +00:00
Xiao Chen 9c0a4d3e71 HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge. 2017-01-24 21:30:10 -08:00
Arpit Agarwal b57368b6f8 HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 16:58:20 -08:00
Eric Yang a847903b6e HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 2017-01-21 15:43:18 -08:00
Lei Xu e015b56319 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 2017-01-20 14:48:04 +08:00
Andrew Wang 5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Daniel Templeton f5839fd6df YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton) 2017-01-19 12:45:17 -08:00
Akira Ajisaka 1763467210 HADOOP-14001. Improve delegation token validity checking. 2017-01-19 17:56:39 +09:00
Yiqun Lin 383aa9c9f5 HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin. 2017-01-19 09:42:56 +08:00
Allen Wittenauer 0eb4b513b7 HADOOP-13673. Update scripts to be smarter when running with privilege 
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
 2017-01-18 14:39:05 -08:00
Akira Ajisaka 9130af3f74 HADOOP-13955. Replace deprecated HttpServer2 and SSLFactory constants. Contributed by John Zhuge. 2017-01-18 18:11:33 +09:00
Kihwal Lee 706d630eb9 HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger. 2017-01-17 15:10:24 -06:00
Akira Ajisaka e407449ddb HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore. 2017-01-17 10:10:23 +09:00
Jitendra Pandey d1d0b3e1fd HDFS-11307. The rpc to portmap service for NFS has hardcoded timeout. Contributed by Mukul Kumar Singh. 2017-01-16 14:53:53 -08:00
Lei Xu ed09c1418d HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei) 2017-01-15 14:02:11 +08:00
Andrew Wang 5f336512d0 HADOOP-13961. Fix compilation failure from missing hadoop-kms test jar. Contributed by Sangjin Lee and John Zhuge. 2017-01-11 15:48:50 -08:00
Steve Loughran e648b6e138 HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran 2017-01-11 17:25:15 +00:00
Arun Suresh be529dade1 HADOOP-13903. Improvements to KMS logging to help debug authorization errors. (Tristan Stevens via asuresh) 2017-01-11 00:26:02 -08:00
Arpit Agarwal 4046794a53 HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru. 2017-01-10 10:43:11 -08:00
Andrew Wang 511d39e074 HADOOP-13885. Implement getLinkTarget for ViewFileSystem. Contributed by Manoj Govindassamy. 2017-01-09 18:01:37 -08:00
Wei-Chiu Chuang 0a212a40fc HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen. 2017-01-09 15:18:26 -08:00
Arpit Agarwal 4a659ff40f HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin. 2017-01-05 19:34:32 -08:00
Xiao Chen 5d182949ba HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge. 2017-01-05 17:21:57 -08:00
Jason Lowe a0a2761621 HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales 2017-01-04 14:46:25 +00:00
Akira Ajisaka 01d31fe938 HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang. 2017-01-04 14:10:36 +09:00
Mingliang Liu 88731c731a Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran" 
This reverts commit 451efb08fe.
 2017-01-03 14:44:26 -08:00
Mingliang Liu 451efb08fe HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 2017-01-03 13:08:38 -08:00
Robert Kanter 591fb15944 YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter) 2017-01-03 12:13:32 -08:00
Brahma Reddy Battula 6938b67711 HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin. 2016-12-31 16:16:02 +05:30
Akira Ajisaka 0665c5f09a HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula. 2016-12-28 01:39:30 +09:00
Daniel Templeton ded2d08f33 HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton) 2016-12-27 07:18:08 -08:00
Xiaoyu Yao 4e9029653d HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou. 2016-12-22 23:46:58 -08:00
Mingliang Liu e92a77099b HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth 2016-12-22 20:15:18 -08:00
Akira Ajisaka 22befbd585 MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt. 2016-12-23 04:48:04 +09:00
Kai Zheng 56a13a6a59 HDFS-11216. Add remoteBytesRead counter metrics for erasure coding reconstruction task. Contributed by Sammi Chen 2016-12-22 14:18:54 +08:00
Akira Ajisaka f6e2521eb2 HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin. 2016-12-21 14:17:47 +09:00