b053fdc547
HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu
2017-04-12 14:30:34 -07:00
4dd6206547
HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets
...
(Conttributed by Robert Konter via Daniel Templeton)
2017-04-12 11:17:31 -07:00
b8305e6d06
HADOOP-14248. Retire SharedInstanceProfileCredentialsProvider in trunk. Contributed by Mingliang Liu.
2017-04-12 10:02:13 -07:00
23b1a7bdf1
HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore.
2017-04-11 22:03:09 -07:00
f050afb578
HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki.
2017-04-11 07:32:13 -07:00
0e065f2ede
YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu
2017-04-11 08:44:18 -05:00
a5e57df3c5
HADOOP-14225. Remove xmlenc dependency
2017-04-10 11:48:40 -07:00
be144117a8
HADOOP-14293. Initialize FakeTimer with a less trivial value.
2017-04-10 11:37:01 -07:00
2ed65540a3
HADOOP-14066 VersionInfo should be marked as public API
2017-04-08 13:41:10 +01:00
56e81f2a20
HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 12:04:44 -07:00
96cbb4fce2
HADOOP-14202. fix jsvc/secure user var inconsistencies
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
95b7f1d29a
HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen.
2017-04-06 16:59:21 -07:00
32bb36b750
HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang.
2017-04-05 17:28:00 -07:00
18432130a7
HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah.
2017-04-04 13:38:25 -07:00
6eba79232f
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
2017-04-03 20:13:14 -07:00
bbd68478d5
HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin.
2017-04-03 07:57:28 -07:00
1309c585fb
HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles)
2017-03-30 14:14:43 -05:00
8c591b8d19
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
2017-03-30 11:16:05 -07:00
7297e82cb4
HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu
2017-03-30 10:17:11 -07:00
4966a6e26e
HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy.
2017-03-29 14:37:21 -07:00
13c766b62c
HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu
2017-03-29 11:13:39 -07:00
523f467d93
HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles)
2017-03-29 10:12:02 -05:00
6b09336438
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
2017-03-28 23:02:07 +08:00
253e3e78ab
HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge.
2017-03-27 23:05:57 -07:00
448ec81fd7
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts.
2017-03-28 14:32:40 +09:00
db2adf356a
Configuration#get return value optimization (jeagles)
2017-03-27 12:48:44 -05:00
858d597be0
Delay construction of PreCondition.check failure message in Configuration#set (jeagles)
2017-03-27 11:01:48 -05:00
6df029db36
Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release.
2017-03-25 14:28:48 -07:00
d8e6d6df4c
Add 2.8.0 RELEASENOTEs.md and CHANGES.md.
2017-03-25 14:02:25 -07:00
84ddedc0b2
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
2017-03-25 10:06:52 +09:00
332a997e10
HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou.
2017-03-24 12:56:46 -07:00
52b00600df
HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy.
2017-03-24 11:44:46 -07:00
d49d1862a6
YARN-6360. Prevent FS state dump logger from cramming other log files
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-03-24 11:31:04 -07:00
0e556a5ba6
HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen.
2017-03-24 11:12:02 -07:00
ab759e91b7
HDFS-10649. Remove unused PermissionStatus#applyUMask. Contributed by Chen Liang.
2017-03-23 23:31:27 -07:00
128015584d
HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar.
2017-03-23 13:57:08 -07:00
d35e79abc2
HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu
2017-03-23 13:34:03 -07:00
595f62e362
HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles
2017-03-23 09:28:10 -07:00
59d69257a8
HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
2017-03-22 22:22:22 -07:00
e1a99802fc
HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen.
2017-03-17 17:12:49 -07:00
92ea6d74ec
HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki.
2017-03-17 11:26:02 -07:00
c04fb35c45
HADOOP-14191. Duplicate hadoop-minikdc dependency in hadoop-common module. Contributed by Xiaobing Zhou
2017-03-16 16:08:32 -07:00
09ad8effb8
HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh.
2017-03-16 12:20:46 -07:00
fa67a96d7b
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-14 14:38:21 -07:00
e6cda5819b
Revert "HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu"
...
This reverts commit b8c69557b7
2017-03-14 13:03:42 -07:00
9832ae0ed8
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
2017-03-13 17:30:10 -07:00
55796a0946
HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
2017-03-13 14:24:51 -07:00
b8c69557b7
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-13 14:15:02 -07:00
04a5f5a6dc
HADOOP-14156. Fix grammar error in ConfTest.java.
...
This closes #187
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-13 16:15:53 +09:00
4db9cc70d0
YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang)
2017-03-10 16:13:31 -08:00
4478273e5f
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-10 09:25:58 -08:00
fd26783aaf
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-03-10 00:21:20 -08:00
570827a819
HADOOP-14052. Fix dead link in KMS document. Contributed by Christina Vu.
...
Change-Id: I7093f443d93927184196f62f02cc106a2c89e9cf
2017-03-08 23:50:15 -08:00
2be8947d12
Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand"
...
This reverts commit 241c1cc05b
2017-03-08 13:20:01 -08:00
241c1cc05b
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-08 10:48:27 -08:00
98142d2f72
Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran"
...
This reverts commit 53a12fa721
2017-03-08 09:54:22 -08:00
1f9848dfe1
HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh.
2017-03-07 11:41:05 -08:00
959940b0ab
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-07 10:12:35 -08:00
686823529b
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-06 17:16:36 -08:00
52d7d5aa1a
Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
...
This reverts commit 6b7cd62b8c
2017-03-06 17:10:11 -08:00
d9dc444dc7
YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang)
2017-03-06 14:02:49 -08:00
ec839b94c0
HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers.
2017-03-06 10:47:15 -08:00
209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma.
2017-03-07 01:34:51 +09:00
6b7cd62b8c
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-03 17:09:12 -08:00
05237636d3
YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
2017-03-03 07:57:37 -06:00
eb5a17954a
HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java.
...
This closes #146
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-03 18:38:04 +09:00
3749152b66
HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang.
2017-03-03 09:28:03 +05:30
8f4817f2c5
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
...
This reverts commit e61491d476
2017-03-02 16:20:48 -08:00
e61491d476
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-02 15:38:25 -08:00
eeca8b0c4e
HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
2017-03-02 09:21:27 -08:00
899d5c4d49
HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh.
2017-03-01 12:59:02 -08:00
dcd03df9f9
HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
2017-03-01 10:45:56 +05:30
258342e76c
HADOOP-14118. move jets3t into a dependency on hadoop-aws JAR.
2017-02-28 13:47:44 +09:00
9db2e0c8d4
HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin.
2017-02-27 18:39:14 +08:00
289bc50e66
HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover
...
on certain exception. Contributed by Jian He
2017-02-24 11:42:23 -08:00
c1a52b04d0
HDFS-11427. Rename rs-default to rs.
2017-02-24 10:58:45 -08:00
e8694deb6a
HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh)
2017-02-24 21:34:00 +05:30
50decd3613
HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton.
2017-02-25 00:28:31 +09:00
132f758e3d
HDFS-11426. Refactor EC CLI to be similar to storage policies CLI.
2017-02-23 16:00:11 -08:00
a4d4a23785
HADOOP-13321. Deprecate FileSystem APIs that promote inefficient call patterns. Contributed by Chris Nauroth and Mingliang Liu
2017-02-23 12:55:40 -08:00
003ae00693
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
2017-02-21 15:32:46 -08:00
172b23af33
HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu.
2017-02-18 18:34:13 -08:00
4c26c241ad
HADOOP-13805. UGI.getCurrentUser() fails if user does not have a keytab associated. Contributed by Xiao Chen, Wei-Chiu Chuang, Yongjun Zhang.
2017-02-17 09:18:50 -08:00
5690b51ef7
HDFS-11100. Recursively deleting file protected by sticky bit should fail. Contributed by John Zhuge.
2017-02-16 05:39:37 -08:00
cc45da79fd
HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor.
2017-02-13 10:14:45 -08:00
0aacd8fd25
HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru.
2017-02-11 01:17:56 -08:00
0c01cf5798
HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp.
2017-02-09 16:17:24 -06:00
b6bb99c18a
HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp.
2017-02-09 10:47:29 -06:00
a0bfb41504
HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
2017-02-09 10:04:28 -06:00
eec52e158b
YARN-6145. Improve log message on fail over. Contributed by Jian He.
2017-02-08 02:11:19 -08:00
2007e0cf2a
HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled.
2017-02-07 20:36:11 -08:00
69b23632c4
HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge.
2017-02-07 09:36:55 -08:00
d88497d44a
HADOOP-14047. Require admin to access KMS instrumentation servlets. Contributed by John Zhuge.
2017-02-06 13:14:17 -08:00
cce35c3815
HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
2017-02-05 19:42:11 -08:00
3ea6d3517e
HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin.
2017-02-04 11:01:27 +08:00
cb8f3f3adf
HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin.
2017-02-04 10:58:08 +09:00
ba75bc7593
HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre.
2017-02-03 17:13:53 -08:00
59c5f18784
HADOOP-13895. Make FileStatus Serializable
2017-02-01 10:19:36 -08:00
ebd40056a0
HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge.
2017-01-27 10:49:26 -08:00
2034315763
HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao.
2017-01-26 20:34:32 -08:00
ff02bdfe65
Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release.
2017-01-25 15:39:40 -08:00
9e19f758c1
YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger
2017-01-25 21:41:43 +00:00
a46933e8ce
HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao.
2017-01-25 13:33:06 -08:00
7fc3e68a87
HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang.
2017-01-25 21:29:27 +00:00
9c0a4d3e71
HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge.
2017-01-24 21:30:10 -08:00
b57368b6f8
HDFS-11194. Maintain aggregated peer performance metrics on NameNode.
2017-01-24 16:58:20 -08:00
a847903b6e
HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
2017-01-21 15:43:18 -08:00
e015b56319
HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
2017-01-20 14:48:04 +08:00
5d8b80ea9b
Preparing for 3.0.0-alpha3 development
2017-01-19 15:50:07 -08:00
f5839fd6df
YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton)
2017-01-19 12:45:17 -08:00
1763467210
HADOOP-14001. Improve delegation token validity checking.
2017-01-19 17:56:39 +09:00
383aa9c9f5
HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin.
2017-01-19 09:42:56 +08:00
0eb4b513b7
HADOOP-13673. Update scripts to be smarter when running with privilege
...
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
2017-01-18 14:39:05 -08:00
9130af3f74
HADOOP-13955. Replace deprecated HttpServer2 and SSLFactory constants. Contributed by John Zhuge.
2017-01-18 18:11:33 +09:00
706d630eb9
HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger.
2017-01-17 15:10:24 -06:00
e407449ddb
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
2017-01-17 10:10:23 +09:00
d1d0b3e1fd
HDFS-11307. The rpc to portmap service for NFS has hardcoded timeout. Contributed by Mukul Kumar Singh.
2017-01-16 14:53:53 -08:00
ed09c1418d
HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei)
2017-01-15 14:02:11 +08:00
5f336512d0
HADOOP-13961. Fix compilation failure from missing hadoop-kms test jar. Contributed by Sangjin Lee and John Zhuge.
2017-01-11 15:48:50 -08:00
e648b6e138
HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran
2017-01-11 17:25:15 +00:00
be529dade1
HADOOP-13903. Improvements to KMS logging to help debug authorization errors. (Tristan Stevens via asuresh)
2017-01-11 00:26:02 -08:00
4046794a53
HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru.
2017-01-10 10:43:11 -08:00
511d39e074
HADOOP-13885. Implement getLinkTarget for ViewFileSystem. Contributed by Manoj Govindassamy.
2017-01-09 18:01:37 -08:00
0a212a40fc
HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen.
2017-01-09 15:18:26 -08:00
4a659ff40f
HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin.
2017-01-05 19:34:32 -08:00
5d182949ba
HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge.
2017-01-05 17:21:57 -08:00
a0a2761621
HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales
2017-01-04 14:46:25 +00:00
01d31fe938
HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang.
2017-01-04 14:10:36 +09:00
88731c731a
Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
...
This reverts commit 451efb08fe
2017-01-03 14:44:26 -08:00
451efb08fe
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-01-03 13:08:38 -08:00
591fb15944
YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter)
2017-01-03 12:13:32 -08:00
6938b67711
HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin.
2016-12-31 16:16:02 +05:30
0665c5f09a
HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula.
2016-12-28 01:39:30 +09:00
ded2d08f33
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
2016-12-27 07:18:08 -08:00
4e9029653d
HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou.
2016-12-22 23:46:58 -08:00
e92a77099b
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
2016-12-22 20:15:18 -08:00
22befbd585
MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
2016-12-23 04:48:04 +09:00
56a13a6a59
HDFS-11216. Add remoteBytesRead counter metrics for erasure coding reconstruction task. Contributed by Sammi Chen
2016-12-22 14:18:54 +08:00
f6e2521eb2
HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
2016-12-21 14:17:47 +09:00
30f85d7a88
HADOOP-13911. Remove TRUSTSTORE_PASSWORD related scripts from KMS. Contributed by John Zhuge.
2016-12-20 16:02:26 -08:00
631f1daee3
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-15 20:52:40 +00:00
169bfc0903
Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger"
...
This reverts commit 9947aeb60c
2016-12-15 20:51:24 +00:00
f5e0bd30fd
HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
2016-12-14 13:45:21 -08:00
6ba9587d37
HDFS-10958. Add instrumentation hooks around Datanode disk IO.
2016-12-14 11:18:58 -08:00
72bff192cd
HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
2016-12-14 18:50:43 +09:00
9947aeb60c
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-13 22:55:09 +00:00
f66f61892a
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-12 13:58:27 +00:00
4c38f11cec
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-12-09 21:27:04 -08:00
b606e025f1
HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.
2016-12-09 15:22:21 -08:00
80b8023276
HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
2016-12-09 18:21:42 +05:30
7d8e440eee
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
...
This reverts commit c265515725
2016-12-09 12:49:27 +09:00
c265515725
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-08 17:57:15 +00:00
0ef796174e
HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B.
2016-12-08 18:57:43 +05:30
deb4743b2c
Revert "HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin."
...
This reverts commit 0857641f62
2016-12-08 13:37:06 +09:00
0857641f62
HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
2016-12-08 13:34:45 +09:00
c73e08a6da
HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma)
2016-12-07 08:26:09 -08:00
c8d0a049b0
HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
2016-12-06 14:10:58 -08:00
f53b481ffe
HDFS-11172. Support an erasure coding policy using RS 10 + 4. Contributed by Wei Zhou.
2016-12-06 12:49:38 -08:00
79d90b810c
HADOOP-13827. Add reencryptEncryptedKey interface to KMS.
2016-12-06 12:04:04 -08:00
7b988e8899
HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn.
2016-12-05 23:18:18 -08:00
b2a3d6c519
HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. Contributed by Varun Vasudev.
2016-12-06 14:01:47 +09:00
a2b5d60220
HADOOP-13864. KMS should not require truststore password. Contributed by Mike Yoder.
2016-12-05 17:36:00 -08:00
291df5c7fb
HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge.
2016-12-05 09:35:17 -08:00
19f373a46b
HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane
2016-12-01 12:54:28 -08:00
1f7613be95
HADOOP-13840. Implement getUsed() for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-30 17:55:12 -08:00
51e6c1cc3f
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-30 15:52:56 +08:00
cfd8076f81
Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen"
...
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
2016-11-30 15:44:52 +08:00
00096dcc0c
HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge.
2016-11-29 19:47:02 +09:00
67d9f2808e
HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project.
2016-11-29 14:07:19 +09:00
47ca9e26fb
HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
2016-11-28 18:08:09 -08:00
a2b1ff0257
HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-28 11:54:43 -08:00
5d5614f847
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-28 14:34:44 +08:00
209e805430
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
2016-11-28 14:34:57 +09:00
07825f2b49
HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J.
2016-11-25 22:22:23 +05:30
ee3d437a33
HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula.
2016-11-25 19:54:50 +05:30
01665e456d
HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli
...
Cherry picked from 24715cefe8
2016-11-24 17:54:10 +00:00
3df3fa396c
HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula.
2016-11-24 17:44:36 +00:00
13501053dd
HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula.
2016-11-24 22:23:22 +05:30
abb9fa7fc6
HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash
2016-11-24 16:41:59 +00:00
c7a5f2906f
HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li.
2016-11-23 17:08:38 -08:00
860d49aa6a
HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran
2016-11-23 16:42:27 -08:00
de4894936a
HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R.
2016-11-23 16:42:06 -08:00
dd98a8005a
HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-23 16:40:39 -08:00
3d94da1e00
HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth
2016-11-23 16:01:55 -08:00
2bf9a15e8a
HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran
2016-11-22 14:27:23 -08:00
3a09e5970d
HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei)
2016-11-22 13:52:09 -08:00
beb70fed4f
HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
...
This closes #131
2016-11-22 13:12:23 -08:00
afcf8d38e7
HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
2016-11-22 19:45:45 +05:30
c65d6b6541
HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka.
2016-11-21 11:25:11 +09:00
c0b1a44f6c
HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory.
2016-11-17 22:48:35 -06:00
ae8849fe37
HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran
2016-11-17 14:11:38 -08:00
bd3735554f
HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula.
2016-11-17 12:16:38 -06:00
aab9737a05
HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula
2016-11-16 20:08:48 -08:00
61c0bedf77
HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk.
2016-11-15 16:26:27 -08:00
5af572b644
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
2016-11-15 10:57:00 -08:00
04014c4c73
HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran
...
This closes #158
2016-11-14 19:38:10 -08:00
ff0b99eafe
HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
2016-11-14 11:05:29 -08:00
5c61ad2488
HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane
2016-11-11 11:15:07 -08:00
fd2f22adec
HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang.
2016-11-10 22:42:59 -08:00
470bdaa27a
HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
2016-11-10 22:38:38 -08:00
8848a8a76c
HDFS-11116. Fix javac warnings caused by deprecation of APIs in TestViewFsDefaultValue. Contributed by Yiqun Lin.
2016-11-11 13:45:30 +09:00
822ae88f7d
HADOOP-13346. DelegationTokenAuthenticationHandler writes via closed writer. Contributed by Gregory Chanan and Hrishikesh Gadre.
2016-11-09 09:33:00 -08:00
367c3d4121
HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception.
2016-11-09 09:07:12 -08:00
c074880096
HADOOP-13800. Remove unused HADOOP_AUDIT_LOGGER from hadoop-env.sh. Contributed by Yiqun Lin.
2016-11-09 22:02:40 +09:00
e1c6ef2efa
HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.
2016-11-08 16:33:55 -08:00
77c13c3857
HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
2016-11-08 16:07:36 -08:00
2a65eb121e
HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn
2016-11-08 15:40:22 -08:00
29e3b3417c
YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru).
2016-11-08 14:38:18 -08:00
dbb133ccfc
HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu.
2016-11-08 20:55:10 +05:30
3dbad5d823
HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
2016-11-07 16:08:10 -08:00
f76895573d
HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt
2016-11-07 12:36:10 +00:00
d8bab3dcb6
HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu.
2016-11-04 18:06:55 -07:00
95665a6eea
Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao."
...
This reverts commit 9097e2efe4
2016-11-04 16:02:47 -07:00
de0132748d
MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen.
2016-11-05 03:49:19 +09:00
abfc15d5ef
HADOOP-13792. Stackoverflow for schemeless defaultFS with trailing slash. Contributed by John Zhuge
2016-11-04 10:46:27 -07:00
7154a20bcb
HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
2016-11-03 13:09:03 -07:00
7e521c5a49
HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory.
2016-11-02 19:11:05 -07:00
0dc2a6a3a5
HADOOP-13667. Fix typing mistake of inline document in hadoop-metrics2.properties (Contributed by Rui Gao via Daniel Templeton)
2016-11-02 06:53:33 -07:00
1b6ecaf016
HADOOP-13738. DiskChecker should perform some disk IO.
2016-11-01 18:02:23 -07:00
a1761a841e
HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi.
2016-10-31 20:54:46 +00:00
112f04eb1b
HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
2016-10-28 15:33:27 -07:00
c017171da0
HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang
2016-10-28 14:57:50 +00:00
b62bc2bbd8
HADOOP-13763. KMS REST API Documentation Decrypt URL typo. Contributed by Jeffrey E Rodriguez.
2016-10-27 18:05:40 -07:00
5877f20f9c
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
2016-10-27 16:09:00 -07:00
0c837db8a8
HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu
2016-10-27 19:46:41 +05:30
0bdd263d82
HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
2016-10-27 15:46:59 +09:00
22ff0eff4d
HADOOP-8299. ViewFileSystem link slash mount point crashes with IndexOutOfBoundsException. Contributed by Manoj Govindassamy.
2016-10-26 14:25:03 -07:00
1f8490a5ba
HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth.
2016-10-26 08:55:42 -07:00
9cad3e2350
HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran.
2016-10-26 08:27:26 -07:00
d88dca844a
HADOOP-11798. Native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-25 16:53:53 -07:00
084bdab156
HDFS-5684. Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting. Contributed by Manoj Govindassamy.
2016-10-25 15:35:39 -07:00
86c735bcb1
Revert "HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu."
...
This reverts commit cef61d505e
2016-10-25 13:45:52 -07:00
09ef97dccb
HADOOP-13669. Addendum patch 2 for KMS Server should log exceptions before throwing.
2016-10-25 09:59:12 -07:00
309a43925c
HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
2016-10-25 09:03:03 -07:00
d8fa1cfa67
HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth.
2016-10-24 21:22:34 -07:00
dc3272bfe8
HDFS-11046. Duplicate '-' in the daemon log name.
2016-10-25 10:07:43 +09:00
d0a347984d
HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-23 10:58:36 -07:00
da901b6c14
Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao."
...
This reverts commit be72372248
2016-10-23 08:25:37 -07:00
25438526ed
HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-21 16:20:07 -07:00
be72372248
HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-21 14:23:02 -07:00
ae8bccd509
HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du
2016-10-21 12:59:54 -07:00
262827cf75
HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal.
2016-10-20 13:35:26 -07:00
3fbf4cd5da
HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran.
2016-10-20 12:33:58 -07:00
f872c6bc03
HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
2016-10-20 21:47:17 +05:30
4bca385241
HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter
2016-10-18 18:32:01 -07:00
d75cbc5749
HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log.
2016-10-18 18:24:59 -07:00
efdf810cf9
HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge.
2016-10-18 18:18:43 -07:00
6c348c5691
HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran
2016-10-18 21:16:02 +01:00
c023c74886
HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki
2016-10-18 12:02:53 +06:00
bedfec0c10
HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini.
2016-10-18 15:00:44 +09:00
b671ee6846
HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy.
2016-10-17 14:14:50 -07:00
987ee51141
HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
2016-10-17 13:25:58 -07:00
0f4afc8100
HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy.
2016-10-17 13:15:11 -07:00
ed9fcbec54
HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory.
2016-10-17 05:04:49 -07:00
aee538be6c
HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy.
2016-10-14 14:08:31 -07:00
dbe663d524
HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang.
2016-10-13 23:05:16 -07:00
5a5a724731
HADOOP-13417. Fix javac and checkstyle warnings in hadoop-auth package.
2016-10-14 14:45:55 +09:00
ae51b11f78
HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing.
2016-10-13 22:32:08 -07:00
008122b3c9
HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru.
2016-10-13 11:37:03 -07:00
9097e2efe4
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-10-13 10:52:28 -07:00
12d739a34b
HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
2016-10-12 15:19:52 -07:00
85cd06f663
HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
2016-10-12 15:11:42 -05:00
b84c4891f9
HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
2016-10-11 17:05:00 -07:00
8a09bf7c19
HADOOP-13705. Revert HADOOP-13534 Remove unused TrashPolicy#getInstance and initialize code.
2016-10-11 13:46:07 -07:00
4b32b1420d
HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang.
2016-10-11 13:21:33 -07:00
2fb392a587
HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu
2016-10-11 10:57:08 -07:00
c874fa914d
HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu
2016-10-10 13:33:07 -07:00
65912e4027
HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya.
2016-10-10 12:51:12 -07:00
03060075c5
HADOOP-13699. Configuration does not substitute multiple references to the same var.
2016-10-10 12:19:26 -07:00
cef61d505e
HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu.
2016-10-10 12:32:39 +01:00
3d59b18d49
HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang
2016-10-09 15:53:36 +06:00
ec0b70716c
HADOOP-12579. Deprecate WriteableRPCEngine. Contributed by Wei Zhou
2016-10-09 15:07:03 +06:00
2e853be657
HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen.
2016-10-07 13:46:27 -07:00
c183b9de8d
HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter)
2016-10-07 09:33:31 -07:00
ebd4f39a39
HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran.
2016-10-07 12:51:40 +01:00
1d330fbaf6
HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth.
2016-10-06 13:19:16 -07:00
2d46c3f6b7
HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran.
2016-10-06 10:57:01 -07:00
35b9d7de9f
HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin
2016-10-06 18:06:08 +05:30
b90fc70d67
HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen
2016-10-06 17:47:31 +05:30
c5ca216915
HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge.
2016-10-05 17:36:50 -07:00
00160f71b6
HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang
2016-10-05 16:50:01 -04:00
9a61b52fbe
HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao.
2016-10-05 20:41:08 +09:00
853d65a157
HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen.
2016-10-03 16:01:54 -07:00
89bd6d29a6
HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya.
2016-09-30 17:51:39 -07:00
57aec2b46b
HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark.
2016-09-30 12:58:37 -07:00
1e0ea27e96
Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin."
...
This reverts commit 0458a2af6e
2016-09-29 13:59:09 -07:00
236ac773c9
HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp.
2016-09-29 13:27:30 -05:00
ee0c722dc8
HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan.
2016-09-29 17:01:00 +01:00
1518cb9532
HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri
2016-09-29 11:35:00 +01:00
e19b37ead2
HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp.
2016-09-28 08:24:21 -05:00
9a44a832a9
HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang
2016-09-27 17:36:53 -07:00
875062b5bc
HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
2016-09-27 11:26:45 -07:00
edf0d0f8b2
HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki
2016-09-27 07:04:37 +05:30
fa397e74fe
HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang.
2016-09-26 13:00:57 -07:00
6eb700ee74
HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko.
2016-09-23 14:10:11 -07:00
bbdf350ff9
HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
2016-09-23 19:21:34 +05:30
e80386d69d
HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
2016-09-20 13:20:01 -07:00
734d54c1a8
HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen
2016-09-21 21:34:48 +08:00
ea839bd48e
HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
2016-09-17 22:25:39 -07:00
58bae35447
YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng
2016-09-18 08:43:36 +08:00
8a40953058
HDFS-10823. Implement HttpFSFileSystem#listStatusIterator.
2016-09-16 15:37:36 -07:00
f6f3a447bf
HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
2016-09-16 14:53:30 -07:00
fcbac00212
Revert "HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)"
...
This reverts commit 4d3ea92f4f
2016-09-15 10:18:56 -07:00
7cad7b7046
HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
2016-09-15 23:42:34 +09:00
53a12fa721
HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran
2016-09-14 15:45:04 +01:00
ea0c2b8b05
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-15 10:46:00 +08:00
08d8e0ba25
HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
2016-09-13 11:12:52 -07:00
d2466ec3e0
HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
2016-09-12 21:25:06 -07:00
59d59667a8
HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang
2016-09-12 16:17:08 -07:00
58ed4fa544
HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
...
This commit includes the following changes:
HADOOP-13356. Add a function to handle command_subcommand_OPTS
HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
HADOOP-13357. Modify common to use hadoop_subcommand_opts
HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
HADOOP-13564. modify mapred to use hadoop_subcommand_opts
HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
HADOOP-13360. Documentation for HADOOP_subcommand_OPTS
This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
a99bf26a08
HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy)
2016-09-10 18:22:25 -07:00
9f192cc5ac
MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan
2016-09-09 11:12:44 -07:00
d4d076876a
HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
2016-09-09 10:39:35 -05:00
011f3b24d4
HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang
2016-09-08 17:53:40 -07:00
1192781a78
HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran
2016-09-08 17:46:12 -07:00
cae331186d
Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)"
...
This reverts commit 05ede00386
2016-09-08 12:40:30 -07:00
401db4fc65
HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng.
2016-09-08 11:54:33 -07:00
d355573f56
Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng"
...
This reverts commit 62a9667136
2016-09-08 05:50:17 +08:00
f414d5e118
HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor.
2016-09-07 11:09:41 -07:00
680be58aac
HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
2016-09-06 20:54:17 -07:00
f0d5382ff3
HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth.
2016-09-06 11:02:39 -07:00
d37dc5d1b8
HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin
2016-09-06 10:38:04 -07:00
f388a20943
Add CHANGES and release notes for 3.0.0-alpha1 to site
2016-09-06 09:51:55 -07:00
39d1b1d747
HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
2016-09-06 10:02:42 -05:00
62a9667136
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-07 17:05:33 +08:00
23abb09c1f
HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp.
2016-09-02 11:03:18 -05:00
76cd81f4b6
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-09-01 15:44:44 -05:00
3069df7551
FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria
2016-09-01 11:32:26 -07:00
dcd21d083a
HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang)
2016-09-01 11:03:06 -07:00
05ede00386
YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)
2016-08-29 15:55:33 -07:00
6fcb04c178
HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri)
2016-08-29 13:04:28 -07:00
e1ad598cef
HADOOP-7363. TestRawLocalFileSystemContract is needed. Contributed by Andras Bokor.
2016-08-29 09:26:46 -07:00
92d8f37155
HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe
2016-08-29 15:55:38 +00:00
81485dbfc1
Revert "HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp."
...
This reverts commit d288a0ba83
2016-08-25 16:04:54 -05:00
d288a0ba83
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-08-25 11:44:13 -05:00
52b25fe6ae
HADOOP-13533. Do not require user to set HADOOP_SSH_OPTS to a non-null string, allow setting of an empty string. (Albert Chu via aw) closes #121
...
Signed-off-by: Allen Wittenauer <aw@apache.org>
2016-08-25 07:11:06 -07:00
601599b036
HADOOP-13532. Fix typo in hadoop_connect_to_hosts error message (Albert Chu via aw) closes #120
2016-08-25 06:58:42 -07:00
ab3b727b5f
HADOOP-13534. Remove unused TrashPolicy#getInstance and initialize code. Contributed by Yiqun Lin.
2016-08-25 13:54:57 +09:00
3476156807
HADOOP-13396. Allow pluggable audit loggers in KMS. Contributed by Xiao Chen
2016-08-24 10:14:46 -07:00
092b4d5bfd
HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin.
2016-08-24 16:47:52 +09:00
c37346d0e3
HADOOP-12726. Unsupported FS operations should throw UnsupportedOperationException. Contributed by Daniel Templeton.
2016-08-23 14:12:52 -07:00
8aae8d6bf0
HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu.
2016-08-24 00:03:27 +09:00
f0efea490e
HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen.
2016-08-23 04:14:24 -07:00
c49333becf
HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang)
2016-08-22 18:29:56 -07:00
4070caad70
HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya.
2016-08-22 18:09:35 -07:00
f4d4d3474c
HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen.
2016-08-22 14:42:13 -07:00
115ecb52a8
HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang)
2016-08-21 09:40:29 -07:00
99603e9022
HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan.
2016-08-19 19:08:53 -07:00
763f0497bb
HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
2016-08-19 10:48:10 -07:00
03a9343d57
HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen.
2016-08-19 09:22:49 -07:00
8179f9a493
HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu.
2016-08-19 16:15:00 +09:00
dbcaf999d9
HADOOP-13504. Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010. Contributed by Sammi Chen
2016-08-19 11:18:15 +08:00
c5c3e81b49
HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.
2016-08-18 14:55:26 -07:00
0f51eae0c0
HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu)
2016-08-18 14:10:37 -07:00
0da69c324d
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
...
(cherry picked from commit d464483bf7
2016-08-18 07:27:23 -07:00
040c185d62
HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie
2016-08-18 14:36:55 +01:00
c57523163f
HADOOP-11786. Fix Javadoc typos in org.apache.hadoop.fs.FileSystem. Contributed by Andras Bokor.
2016-08-17 15:00:14 -07:00
23532716fc
HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)
2016-08-16 17:33:04 -07:00
27a6e09c4e
Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)"
...
This reverts commit 9336a0495f
2016-08-16 16:25:37 -07:00
4b689e7a75
HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory.
2016-08-16 15:01:18 -07:00
b8a446ba57
HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki.
2016-08-16 13:30:40 +09:00
9336a0495f
HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)
2016-08-15 20:24:54 -07:00
382d615260
HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu)
2016-08-15 20:22:14 -07:00
4bcbef39f7
HDFS-10724. Document caller context config keys. (Contributed by Mingliang Liu)
2016-08-15 20:20:33 -07:00
12ad63d723
HDFS-10725. Caller context should always be constructed by a builder. (Contributed by Mingliang Liu)
2016-08-15 20:14:05 -07:00
9daa9979a1
HADOOP-13437. KMS should reload whitelist and default key ACLs when hot-reloading. Contributed by Xiao Chen.
2016-08-15 18:14:45 -07:00
d714030b5d
HADOOP-13333. testConf.xml ls comparators in wrong order (Vrushali C via Varun Saxena)
2016-08-16 03:03:44 +05:30
b5af9be72c
HDFS-8668. Erasure Coding: revisit buffer used for encoding and decoding. Contributed by Sammi Chen
2016-08-13 13:52:37 +08:00
4d3ea92f4f
HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)
2016-08-11 19:56:58 -07:00
db719ef125
HADOOP-13190. Mention LoadBalancingKMSClientProvider in KMS HA documentation. Contributed by Wei-Chiu Chuang.
2016-08-11 12:27:09 -07:00
d892ae9576
HADOOP-13441. Document LdapGroupsMapping keystore password properties. Contributed by Yuanbo Liu.
2016-08-11 11:57:43 -07:00
8fbb57fbd9
HADOOP-11588. Benchmark framework and test for erasure coders. Contributed by Rui Li
2016-08-12 15:05:52 +08:00
e83be44af5
HADOOP-13461. NPE in KeyProvider.rollNewVersion. Contributed by Colm O hEigeartaigh.
2016-08-10 16:28:02 -07:00
4d4fe07c3c
HADOOP-13476. CredentialProviderFactory fails at class loading from libhdfs (JNI). Contributed by Aaron Fabbri.
2016-08-10 09:54:31 -07:00
d00d3add9e
HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah.
2016-08-09 18:11:34 -07:00
85422bb7c5
HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha)
2016-08-09 13:42:32 -07:00
caf800d529
HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp.
2016-08-09 14:33:15 -05:00
8f9b61852b
HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang.
2016-08-09 09:54:44 +09:00
0ad48aa2c8
HADOOP-12747. support wildcard in libjars argument (sjlee)
2016-08-08 17:34:56 -07:00
070548943a
HADOOP-13395. Enhance TestKMSAudit. Contributed by Xiao Chen.
2016-08-08 15:11:05 -07:00
6418edd6fe
HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei)
2016-08-08 15:06:03 -07:00
58e1523c8e
HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang)
2016-08-08 12:36:27 -07:00
625585950a
HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu.
2016-08-08 11:00:19 -07:00
10ed06a0c9
HADOOP-13418. Fix javadoc warnings by JDK8 in hadoop-nfs package. Contributed by Kai Sasaki.
2016-08-06 12:22:02 +09:00
49ba09a922
HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang.
2016-08-05 16:32:44 -07:00
cca6229696
HDFS-10718. Prefer direct ByteBuffer in native RS encoder and decoder. Contributed by Sammi Chen
2016-08-05 04:22:48 +08:00
331ef25152
HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang)
2016-08-04 12:25:39 -07:00
b8ca84ac99
HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal)
2016-08-04 10:07:53 -07:00
9422515239
HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp.
2016-08-04 10:45:55 -05:00
05db64913d
HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner.
2016-08-04 15:57:34 +08:00
a1f6564d31
HADOOP-13458. LoadBalancingKMSClientProvider#doOp should log IOException stacktrace. Contributed by Chen Liang.
2016-08-03 14:19:47 -07:00
c82745432a
HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger
2016-08-03 20:17:30 +00:00
580a833496
HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp.
2016-08-03 13:22:22 -05:00
2d8227605f
HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp.
2016-08-03 09:31:49 -05:00
d28c2d9f55
HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor)
2016-08-02 15:17:45 -07:00
954465e7ba
HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley)
2016-08-02 13:40:33 -07:00
0458a2af6e
HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin.
2016-08-02 12:43:30 -07:00
b3018e73cc
HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp.
2016-08-02 10:40:28 -05:00
770b5eb2db
HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
2016-08-01 17:35:59 +09:00
34ccaa8367
HADOOP-11540. Raw Reed-Solomon coder using Intel ISA-L library. Contributed by Kai Zheng
2016-08-01 06:34:26 +08:00
Mingliang Liu
Daniel Templeton
Chris Nauroth
Wei-Chiu Chuang
Jason Lowe
Chris Douglas
Andrew Wang
Steve Loughran
John Zhuge
Allen Wittenauer
Zhe Zhang
Xiaoyu Yao
Jonathan Eagles
Yiqun Lin
John Zhuge
Akira Ajisaka
Junping Du
Tsuyoshi Ozawa
Ravi Prakash
Erik Krogen
Jitendra Pandey
Chen Liang
Jing Zhao
Andrey Dyatlov
Ray Chiang
Jian He
Arpit Agarwal
Harsh J
Rakesh Radhakrishnan
Brahma Reddy Battula
Xuan
Eric Yang
Yongjun Zhang
Kihwal Lee
Xiao Chen
Jason Lowe
Lei Xu
Arun Suresh
Robert Kanter
Kai Zheng
Ming Ma
Karthik Kambatla
Robert Kanter
Subru Krishnan
Masatake Iwasaki
Anu Engineer
Benoy Antony
Wangda Tan
Konstantin V Shvachko
Sangjin Lee
Albert Chu
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
Varun Saxena