62857be211
HADOOP-14456. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin.
2017-05-31 01:07:58 +08:00
bd6a2172e0
HDFS-11891. DU#refresh should print the path of the directory when an exception is caught. Contributed by Chen Liang.
2017-05-26 16:02:40 -07:00
2cd612ba8e
Update 3.0.0-alpha3 changes, release notes, jdiff.
2017-05-26 14:14:38 -07:00
16ad896d5c
Update maven version for 3.0.0-alpha4 development
2017-05-26 14:09:44 -07:00
8bf0e2d6b3
HADOOP-14430 the accessTime of FileStatus returned by SFTPFileSystem's
...
getFileStatus method is always 0.
Contributed by Hongyuan Li.
2017-05-25 15:19:58 +01:00
1ba9704eec
HADOOP-14399. Configuration does not correctly XInclude absolute file URIs.
...
Contributed by Jonathan Eagles
2017-05-25 14:59:33 +01:00
6a52b5e144
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.
2017-05-25 15:36:44 +09:00
dcf4559ebd
HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore.
2017-05-25 01:27:13 +08:00
b7a0c0e701
HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin.
2017-05-25 01:03:22 +08:00
a62be38a5e
HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen
2017-05-24 18:45:52 +08:00
52661e0912
HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
2017-05-23 23:52:42 +08:00
1b5451bf05
HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen.
2017-05-23 17:03:28 +05:30
2a8fcf0c9a
HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin.
2017-05-23 02:16:25 +08:00
b6f66b0da1
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
2017-05-22 14:10:06 +05:30
c80d3bc480
HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin
2017-05-21 01:23:35 -07:00
1db186f662
HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou
2017-05-19 14:21:01 -07:00
ef9e536a71
HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak
2017-05-17 17:21:03 -07:00
eb7791b474
HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B
2017-05-17 13:12:14 -07:00
d4aa9e3c69
HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang.
2017-05-17 15:38:28 -04:00
d87a63a901
HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.
2017-05-17 08:27:45 +05:30
7bc2172248
HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
2017-05-12 16:54:08 -05:00
a9e24a13b7
HADOOP-14375. Remove tomcat support from hadoop-functions.sh. Contributed by John Zhuge.
2017-05-12 08:48:51 -05:00
0d5c8ed8e0
HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor.
2017-05-11 16:37:32 -05:00
09f28da2d2
HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
...
(Contributed by Erik Krogen via Daniel Templeton)
2017-05-11 12:06:06 -07:00
4aae2d40a3
HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
2017-05-11 23:33:45 +05:30
3873904a94
HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou
2017-05-10 14:33:33 -07:00
a5fa954684
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong.
2017-05-10 05:29:47 -05:00
06ffeb8d4d
HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge.
2017-05-10 14:16:41 +09:00
f7faac8e90
HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
2017-05-09 16:08:34 -05:00
45382bf047
AuditLogger and TestAuditLogger are dead code. Contributed by Vrushali C
2017-05-09 10:31:52 -07:00
149b903be3
HADOOP-14384. Reduce the visibility of FileSystem.newFSDataOutputStreamBuilder before the API becomes stable. (lei)
2017-05-09 10:27:17 -07:00
543aac9f28
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
2017-05-09 09:22:53 -07:00
54fd0e44b7
HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.
2017-05-08 21:59:49 -07:00
ff5ec3b841
HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS endpoints.
2017-05-08 15:28:45 -07:00
e4f34ecb04
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
2017-05-05 12:10:50 -07:00
4e6bbd049d
HADOOP-14382 Remove usages of MoreObjects.toStringHelper.
...
Contributed by Andrew Wang
2017-05-05 13:03:09 +01:00
c2a52ef9c2
HDFS-11643. Add shouldReplicate option to create builder. Contributed by SammiChen.
2017-05-04 11:39:14 -07:00
81092b1f11
HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru.
2017-05-03 16:29:30 -07:00
30cd265134
Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
...
This reverts commit 08fb82d6d1
2017-05-03 16:28:47 -07:00
08fb82d6d1
HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru.
2017-05-03 15:46:08 -07:00
83dded556d
HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran
2017-05-03 11:22:44 -07:00
d4631e466b
HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger.
2017-05-03 09:47:17 -05:00
8b82317fab
HADOOP-14352. Make some HttpServer2 SSL properties optional (jzhuge via rkanter)
2017-05-02 17:51:28 -07:00
cedaf4cab9
HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger
2017-05-02 16:50:51 -05:00
dcc292d7de
HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri.
2017-05-02 10:51:20 -07:00
20cde55274
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
2017-05-02 23:36:54 +09:00
b7d769d020
HADOOP-14359. Remove unnecessary shading of commons-httpclient. Contributed by Wei-Chiu Chuang.
2017-05-01 15:22:28 +09:00
c735362df7
HADOOP-14363. Inconsistent default block location in FileSystem javadoc. Contributed by Chen Liang
2017-04-29 23:49:36 -07:00
6fe11f6155
HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger.
2017-04-28 14:45:26 -05:00
373bb4931f
YARN-679. Add an entry point that can start any Yarn service. Contributed by Steve Loughran.
2017-04-28 10:45:02 -07:00
cb672a45a0
HDFS-11605. Allow user to customize new erasure code policies. Contributed by Huafeng Wang
2017-04-28 13:18:50 +08:00
689fb2fc66
HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo Goiri
2017-04-27 16:26:39 -07:00
31cf480d65
HADOOP-14309. Add PowerShell NodeFencer. Contributed by Inigo Goiri
2017-04-27 16:09:28 -07:00
bbf8cac14d
HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao.
2017-04-27 12:39:47 -07:00
ddaeb3e497
Revert "HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao."
...
This reverts commit 872088c6e7
2017-04-27 12:25:47 -07:00
872088c6e7
HADOOP-13200. Implement customizable and configurable erasure coders. Contributed by Tim Yao.
2017-04-27 11:59:33 -07:00
61cda39e4e
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed.
...
Contributed by Pierre Lacave
(cherry picked from commit 40b9c30d64
2017-04-27 12:19:04 +01:00
edd693833b
HADOOP-14340. Enable KMS and HttpFS to exclude SSL ciphers. Contributed by John Zhuge.
2017-04-26 11:44:59 -07:00
9ccb849eb6
HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge.
2017-04-25 22:06:51 -07:00
4ea2778acb
HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore.
2017-04-25 18:45:56 -07:00
d11d280b8b
HADOOP-12856. FileUtil.checkDest() and RawLocalFileSystem.mkdirs() to throw stricter IOEs; RawLocalFS contract tests to verify. Contributed by Steve Loughran
2017-04-25 18:33:41 -07:00
a22fe02fba
HADOOP-14261. Some refactoring work for erasure coding raw coder. Contributed by Lin Zeng.
2017-04-21 11:35:36 -07:00
667966c13c
HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran
2017-04-20 17:13:36 -07:00
f356f0f4cf
YARN-6453. fairscheduler-statedump.log gets generated regardless of service
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-04-20 14:13:07 -07:00
0344bea3fd
HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge.
2017-04-19 11:50:54 -07:00
d4483a2fe4
HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton)
2017-04-19 09:41:09 -07:00
a9f07e0d3e
HADOOP-14317. KMSWebServer$deprecateEnv may leak secret. Contributed by John Zhuge.
2017-04-18 09:29:16 -07:00
654372db85
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation
...
This closes #214
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-04-18 17:14:22 +09:00
84a8848aae
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu.
2017-04-18 16:43:50 +09:00
c0ca785dbb
HDFS-11652. Improve ECSchema and ErasureCodingPolicy toString, hashCode, equals.
2017-04-17 16:30:25 -07:00
b053fdc547
HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu
2017-04-12 14:30:34 -07:00
4dd6206547
HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets
...
(Conttributed by Robert Konter via Daniel Templeton)
2017-04-12 11:17:31 -07:00
b8305e6d06
HADOOP-14248. Retire SharedInstanceProfileCredentialsProvider in trunk. Contributed by Mingliang Liu.
2017-04-12 10:02:13 -07:00
23b1a7bdf1
HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore.
2017-04-11 22:03:09 -07:00
f050afb578
HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki.
2017-04-11 07:32:13 -07:00
0e065f2ede
YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu
2017-04-11 08:44:18 -05:00
a5e57df3c5
HADOOP-14225. Remove xmlenc dependency
2017-04-10 11:48:40 -07:00
be144117a8
HADOOP-14293. Initialize FakeTimer with a less trivial value.
2017-04-10 11:37:01 -07:00
2ed65540a3
HADOOP-14066 VersionInfo should be marked as public API
2017-04-08 13:41:10 +01:00
56e81f2a20
HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge.
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 12:04:44 -07:00
96cbb4fce2
HADOOP-14202. fix jsvc/secure user var inconsistencies
...
Signed-off-by: John Zhuge <jzhuge@apache.org>
2017-04-07 08:59:21 -07:00
95b7f1d29a
HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen.
2017-04-06 16:59:21 -07:00
32bb36b750
HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang.
2017-04-05 17:28:00 -07:00
18432130a7
HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah.
2017-04-04 13:38:25 -07:00
6eba79232f
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
2017-04-03 20:13:14 -07:00
bbd68478d5
HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin.
2017-04-03 07:57:28 -07:00
1309c585fb
HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles)
2017-03-30 14:14:43 -05:00
8c591b8d19
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
2017-03-30 11:16:05 -07:00
7297e82cb4
HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu
2017-03-30 10:17:11 -07:00
4966a6e26e
HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy.
2017-03-29 14:37:21 -07:00
13c766b62c
HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu
2017-03-29 11:13:39 -07:00
523f467d93
HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles)
2017-03-29 10:12:02 -05:00
6b09336438
HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang.
2017-03-28 23:02:07 +08:00
253e3e78ab
HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge.
2017-03-27 23:05:57 -07:00
448ec81fd7
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts.
2017-03-28 14:32:40 +09:00
db2adf356a
Configuration#get return value optimization (jeagles)
2017-03-27 12:48:44 -05:00
858d597be0
Delay construction of PreCondition.check failure message in Configuration#set (jeagles)
2017-03-27 11:01:48 -05:00
6df029db36
Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release.
2017-03-25 14:28:48 -07:00
d8e6d6df4c
Add 2.8.0 RELEASENOTEs.md and CHANGES.md.
2017-03-25 14:02:25 -07:00
84ddedc0b2
HADOOP-10101. Update guava dependency to the latest version. (ozawa)
2017-03-25 10:06:52 +09:00
332a997e10
HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou.
2017-03-24 12:56:46 -07:00
52b00600df
HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy.
2017-03-24 11:44:46 -07:00
d49d1862a6
YARN-6360. Prevent FS state dump logger from cramming other log files
...
(Contributed by Yufei Gu via Daniel Templeton)
2017-03-24 11:31:04 -07:00
0e556a5ba6
HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen.
2017-03-24 11:12:02 -07:00
ab759e91b7
HDFS-10649. Remove unused PermissionStatus#applyUMask. Contributed by Chen Liang.
2017-03-23 23:31:27 -07:00
128015584d
HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar.
2017-03-23 13:57:08 -07:00
d35e79abc2
HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu
2017-03-23 13:34:03 -07:00
595f62e362
HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles
2017-03-23 09:28:10 -07:00
59d69257a8
HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen.
2017-03-22 22:22:22 -07:00
e1a99802fc
HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen.
2017-03-17 17:12:49 -07:00
92ea6d74ec
HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki.
2017-03-17 11:26:02 -07:00
c04fb35c45
HADOOP-14191. Duplicate hadoop-minikdc dependency in hadoop-common module. Contributed by Xiaobing Zhou
2017-03-16 16:08:32 -07:00
09ad8effb8
HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh.
2017-03-16 12:20:46 -07:00
fa67a96d7b
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-14 14:38:21 -07:00
e6cda5819b
Revert "HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu"
...
This reverts commit b8c69557b7
2017-03-14 13:03:42 -07:00
9832ae0ed8
HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang.
2017-03-13 17:30:10 -07:00
55796a0946
HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.
2017-03-13 14:24:51 -07:00
b8c69557b7
HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu
2017-03-13 14:15:02 -07:00
04a5f5a6dc
HADOOP-14156. Fix grammar error in ConfTest.java.
...
This closes #187
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-13 16:15:53 +09:00
4db9cc70d0
YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang)
2017-03-10 16:13:31 -08:00
4478273e5f
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-10 09:25:58 -08:00
fd26783aaf
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-03-10 00:21:20 -08:00
570827a819
HADOOP-14052. Fix dead link in KMS document. Contributed by Christina Vu.
...
Change-Id: I7093f443d93927184196f62f02cc106a2c89e9cf
2017-03-08 23:50:15 -08:00
2be8947d12
Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand"
...
This reverts commit 241c1cc05b
2017-03-08 13:20:01 -08:00
241c1cc05b
HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand
2017-03-08 10:48:27 -08:00
98142d2f72
Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran"
...
This reverts commit 53a12fa721
2017-03-08 09:54:22 -08:00
1f9848dfe1
HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh.
2017-03-07 11:41:05 -08:00
959940b0ab
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-07 10:12:35 -08:00
686823529b
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-06 17:16:36 -08:00
52d7d5aa1a
Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
...
This reverts commit 6b7cd62b8c
2017-03-06 17:10:11 -08:00
d9dc444dc7
YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang)
2017-03-06 14:02:49 -08:00
ec839b94c0
HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers.
2017-03-06 10:47:15 -08:00
209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma.
2017-03-07 01:34:51 +09:00
6b7cd62b8c
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
2017-03-03 17:09:12 -08:00
05237636d3
YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang
2017-03-03 07:57:37 -06:00
eb5a17954a
HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java.
...
This closes #146
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-03-03 18:38:04 +09:00
3749152b66
HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang.
2017-03-03 09:28:03 +05:30
8f4817f2c5
Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru."
...
This reverts commit e61491d476
2017-03-02 16:20:48 -08:00
e61491d476
HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru.
2017-03-02 15:38:25 -08:00
eeca8b0c4e
HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang.
2017-03-02 09:21:27 -08:00
899d5c4d49
HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh.
2017-03-01 12:59:02 -08:00
dcd03df9f9
HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula.
2017-03-01 10:45:56 +05:30
258342e76c
HADOOP-14118. move jets3t into a dependency on hadoop-aws JAR.
2017-02-28 13:47:44 +09:00
9db2e0c8d4
HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin.
2017-02-27 18:39:14 +08:00
289bc50e66
HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover
...
on certain exception. Contributed by Jian He
2017-02-24 11:42:23 -08:00
c1a52b04d0
HDFS-11427. Rename rs-default to rs.
2017-02-24 10:58:45 -08:00
e8694deb6a
HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh)
2017-02-24 21:34:00 +05:30
50decd3613
HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton.
2017-02-25 00:28:31 +09:00
132f758e3d
HDFS-11426. Refactor EC CLI to be similar to storage policies CLI.
2017-02-23 16:00:11 -08:00
a4d4a23785
HADOOP-13321. Deprecate FileSystem APIs that promote inefficient call patterns. Contributed by Chris Nauroth and Mingliang Liu
2017-02-23 12:55:40 -08:00
003ae00693
HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze
2017-02-21 15:32:46 -08:00
172b23af33
HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu.
2017-02-18 18:34:13 -08:00
4c26c241ad
HADOOP-13805. UGI.getCurrentUser() fails if user does not have a keytab associated. Contributed by Xiao Chen, Wei-Chiu Chuang, Yongjun Zhang.
2017-02-17 09:18:50 -08:00
5690b51ef7
HDFS-11100. Recursively deleting file protected by sticky bit should fail. Contributed by John Zhuge.
2017-02-16 05:39:37 -08:00
cc45da79fd
HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor.
2017-02-13 10:14:45 -08:00
0aacd8fd25
HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru.
2017-02-11 01:17:56 -08:00
0c01cf5798
HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp.
2017-02-09 16:17:24 -06:00
b6bb99c18a
HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp.
2017-02-09 10:47:29 -06:00
a0bfb41504
HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
2017-02-09 10:04:28 -06:00
eec52e158b
YARN-6145. Improve log message on fail over. Contributed by Jian He.
2017-02-08 02:11:19 -08:00
2007e0cf2a
HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled.
2017-02-07 20:36:11 -08:00
69b23632c4
HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge.
2017-02-07 09:36:55 -08:00
d88497d44a
HADOOP-14047. Require admin to access KMS instrumentation servlets. Contributed by John Zhuge.
2017-02-06 13:14:17 -08:00
cce35c3815
HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
2017-02-05 19:42:11 -08:00
3ea6d3517e
HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin.
2017-02-04 11:01:27 +08:00
cb8f3f3adf
HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin.
2017-02-04 10:58:08 +09:00
ba75bc7593
HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre.
2017-02-03 17:13:53 -08:00
59c5f18784
HADOOP-13895. Make FileStatus Serializable
2017-02-01 10:19:36 -08:00
ebd40056a0
HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge.
2017-01-27 10:49:26 -08:00
2034315763
HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao.
2017-01-26 20:34:32 -08:00
ff02bdfe65
Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release.
2017-01-25 15:39:40 -08:00
9e19f758c1
YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger
2017-01-25 21:41:43 +00:00
a46933e8ce
HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao.
2017-01-25 13:33:06 -08:00
7fc3e68a87
HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang.
2017-01-25 21:29:27 +00:00
9c0a4d3e71
HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge.
2017-01-24 21:30:10 -08:00
b57368b6f8
HDFS-11194. Maintain aggregated peer performance metrics on NameNode.
2017-01-24 16:58:20 -08:00
a847903b6e
HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
2017-01-21 15:43:18 -08:00
e015b56319
HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
2017-01-20 14:48:04 +08:00
5d8b80ea9b
Preparing for 3.0.0-alpha3 development
2017-01-19 15:50:07 -08:00
f5839fd6df
YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton)
2017-01-19 12:45:17 -08:00
1763467210
HADOOP-14001. Improve delegation token validity checking.
2017-01-19 17:56:39 +09:00
383aa9c9f5
HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin.
2017-01-19 09:42:56 +08:00
0eb4b513b7
HADOOP-13673. Update scripts to be smarter when running with privilege
...
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
2017-01-18 14:39:05 -08:00
9130af3f74
HADOOP-13955. Replace deprecated HttpServer2 and SSLFactory constants. Contributed by John Zhuge.
2017-01-18 18:11:33 +09:00
706d630eb9
HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger.
2017-01-17 15:10:24 -06:00
e407449ddb
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
2017-01-17 10:10:23 +09:00
d1d0b3e1fd
HDFS-11307. The rpc to portmap service for NFS has hardcoded timeout. Contributed by Mukul Kumar Singh.
2017-01-16 14:53:53 -08:00
ed09c1418d
HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei)
2017-01-15 14:02:11 +08:00
5f336512d0
HADOOP-13961. Fix compilation failure from missing hadoop-kms test jar. Contributed by Sangjin Lee and John Zhuge.
2017-01-11 15:48:50 -08:00
e648b6e138
HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran
2017-01-11 17:25:15 +00:00
be529dade1
HADOOP-13903. Improvements to KMS logging to help debug authorization errors. (Tristan Stevens via asuresh)
2017-01-11 00:26:02 -08:00
4046794a53
HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru.
2017-01-10 10:43:11 -08:00
511d39e074
HADOOP-13885. Implement getLinkTarget for ViewFileSystem. Contributed by Manoj Govindassamy.
2017-01-09 18:01:37 -08:00
0a212a40fc
HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen.
2017-01-09 15:18:26 -08:00
4a659ff40f
HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin.
2017-01-05 19:34:32 -08:00
5d182949ba
HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge.
2017-01-05 17:21:57 -08:00
a0a2761621
HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales
2017-01-04 14:46:25 +00:00
01d31fe938
HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang.
2017-01-04 14:10:36 +09:00
88731c731a
Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
...
This reverts commit 451efb08fe
2017-01-03 14:44:26 -08:00
451efb08fe
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-01-03 13:08:38 -08:00
591fb15944
YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter)
2017-01-03 12:13:32 -08:00
6938b67711
HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin.
2016-12-31 16:16:02 +05:30
0665c5f09a
HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula.
2016-12-28 01:39:30 +09:00
ded2d08f33
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
2016-12-27 07:18:08 -08:00
4e9029653d
HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou.
2016-12-22 23:46:58 -08:00
e92a77099b
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
2016-12-22 20:15:18 -08:00
22befbd585
MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
2016-12-23 04:48:04 +09:00
56a13a6a59
HDFS-11216. Add remoteBytesRead counter metrics for erasure coding reconstruction task. Contributed by Sammi Chen
2016-12-22 14:18:54 +08:00
f6e2521eb2
HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
2016-12-21 14:17:47 +09:00
30f85d7a88
HADOOP-13911. Remove TRUSTSTORE_PASSWORD related scripts from KMS. Contributed by John Zhuge.
2016-12-20 16:02:26 -08:00
631f1daee3
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-15 20:52:40 +00:00
169bfc0903
Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger"
...
This reverts commit 9947aeb60c
2016-12-15 20:51:24 +00:00
f5e0bd30fd
HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
2016-12-14 13:45:21 -08:00
6ba9587d37
HDFS-10958. Add instrumentation hooks around Datanode disk IO.
2016-12-14 11:18:58 -08:00
72bff192cd
HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
2016-12-14 18:50:43 +09:00
9947aeb60c
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-13 22:55:09 +00:00
f66f61892a
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-12 13:58:27 +00:00
4c38f11cec
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-12-09 21:27:04 -08:00
b606e025f1
HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.
2016-12-09 15:22:21 -08:00
80b8023276
HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
2016-12-09 18:21:42 +05:30
7d8e440eee
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
...
This reverts commit c265515725
2016-12-09 12:49:27 +09:00
c265515725
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-08 17:57:15 +00:00
0ef796174e
HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B.
2016-12-08 18:57:43 +05:30
deb4743b2c
Revert "HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin."
...
This reverts commit 0857641f62
2016-12-08 13:37:06 +09:00
0857641f62
HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
2016-12-08 13:34:45 +09:00
c73e08a6da
HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma)
2016-12-07 08:26:09 -08:00
c8d0a049b0
HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
2016-12-06 14:10:58 -08:00
f53b481ffe
HDFS-11172. Support an erasure coding policy using RS 10 + 4. Contributed by Wei Zhou.
2016-12-06 12:49:38 -08:00
79d90b810c
HADOOP-13827. Add reencryptEncryptedKey interface to KMS.
2016-12-06 12:04:04 -08:00
7b988e8899
HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn.
2016-12-05 23:18:18 -08:00
b2a3d6c519
HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. Contributed by Varun Vasudev.
2016-12-06 14:01:47 +09:00
a2b5d60220
HADOOP-13864. KMS should not require truststore password. Contributed by Mike Yoder.
2016-12-05 17:36:00 -08:00
291df5c7fb
HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge.
2016-12-05 09:35:17 -08:00
19f373a46b
HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane
2016-12-01 12:54:28 -08:00
1f7613be95
HADOOP-13840. Implement getUsed() for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-30 17:55:12 -08:00
51e6c1cc3f
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-30 15:52:56 +08:00
cfd8076f81
Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen"
...
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
2016-11-30 15:44:52 +08:00
00096dcc0c
HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge.
2016-11-29 19:47:02 +09:00
67d9f2808e
HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project.
2016-11-29 14:07:19 +09:00
47ca9e26fb
HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
2016-11-28 18:08:09 -08:00
a2b1ff0257
HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-28 11:54:43 -08:00
5d5614f847
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-28 14:34:44 +08:00
209e805430
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
2016-11-28 14:34:57 +09:00
07825f2b49
HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J.
2016-11-25 22:22:23 +05:30
ee3d437a33
HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula.
2016-11-25 19:54:50 +05:30
01665e456d
HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli
...
Cherry picked from 24715cefe8
2016-11-24 17:54:10 +00:00
3df3fa396c
HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula.
2016-11-24 17:44:36 +00:00
13501053dd
HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula.
2016-11-24 22:23:22 +05:30
abb9fa7fc6
HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash
2016-11-24 16:41:59 +00:00
c7a5f2906f
HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li.
2016-11-23 17:08:38 -08:00
860d49aa6a
HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran
2016-11-23 16:42:27 -08:00
de4894936a
HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R.
2016-11-23 16:42:06 -08:00
dd98a8005a
HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-23 16:40:39 -08:00
3d94da1e00
HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth
2016-11-23 16:01:55 -08:00
2bf9a15e8a
HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran
2016-11-22 14:27:23 -08:00
3a09e5970d
HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei)
2016-11-22 13:52:09 -08:00
beb70fed4f
HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
...
This closes #131
2016-11-22 13:12:23 -08:00
afcf8d38e7
HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
2016-11-22 19:45:45 +05:30
c65d6b6541
HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka.
2016-11-21 11:25:11 +09:00
c0b1a44f6c
HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory.
2016-11-17 22:48:35 -06:00
ae8849fe37
HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran
2016-11-17 14:11:38 -08:00
bd3735554f
HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula.
2016-11-17 12:16:38 -06:00
aab9737a05
HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula
2016-11-16 20:08:48 -08:00
61c0bedf77
HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk.
2016-11-15 16:26:27 -08:00
5af572b644
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
2016-11-15 10:57:00 -08:00
04014c4c73
HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran
...
This closes #158
2016-11-14 19:38:10 -08:00
ff0b99eafe
HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
2016-11-14 11:05:29 -08:00
5c61ad2488
HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane
2016-11-11 11:15:07 -08:00
fd2f22adec
HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang.
2016-11-10 22:42:59 -08:00
470bdaa27a
HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
2016-11-10 22:38:38 -08:00
8848a8a76c
HDFS-11116. Fix javac warnings caused by deprecation of APIs in TestViewFsDefaultValue. Contributed by Yiqun Lin.
2016-11-11 13:45:30 +09:00
822ae88f7d
HADOOP-13346. DelegationTokenAuthenticationHandler writes via closed writer. Contributed by Gregory Chanan and Hrishikesh Gadre.
2016-11-09 09:33:00 -08:00
367c3d4121
HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception.
2016-11-09 09:07:12 -08:00
c074880096
HADOOP-13800. Remove unused HADOOP_AUDIT_LOGGER from hadoop-env.sh. Contributed by Yiqun Lin.
2016-11-09 22:02:40 +09:00
e1c6ef2efa
HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.
2016-11-08 16:33:55 -08:00
77c13c3857
HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
2016-11-08 16:07:36 -08:00
2a65eb121e
HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn
2016-11-08 15:40:22 -08:00
29e3b3417c
YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru).
2016-11-08 14:38:18 -08:00
dbb133ccfc
HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu.
2016-11-08 20:55:10 +05:30
3dbad5d823
HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
2016-11-07 16:08:10 -08:00
f76895573d
HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt
2016-11-07 12:36:10 +00:00
d8bab3dcb6
HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu.
2016-11-04 18:06:55 -07:00
95665a6eea
Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao."
...
This reverts commit 9097e2efe4
2016-11-04 16:02:47 -07:00
de0132748d
MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen.
2016-11-05 03:49:19 +09:00
abfc15d5ef
HADOOP-13792. Stackoverflow for schemeless defaultFS with trailing slash. Contributed by John Zhuge
2016-11-04 10:46:27 -07:00
7154a20bcb
HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
2016-11-03 13:09:03 -07:00
7e521c5a49
HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory.
2016-11-02 19:11:05 -07:00
0dc2a6a3a5
HADOOP-13667. Fix typing mistake of inline document in hadoop-metrics2.properties (Contributed by Rui Gao via Daniel Templeton)
2016-11-02 06:53:33 -07:00
1b6ecaf016
HADOOP-13738. DiskChecker should perform some disk IO.
2016-11-01 18:02:23 -07:00
a1761a841e
HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi.
2016-10-31 20:54:46 +00:00
112f04eb1b
HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
2016-10-28 15:33:27 -07:00
c017171da0
HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang
2016-10-28 14:57:50 +00:00
b62bc2bbd8
HADOOP-13763. KMS REST API Documentation Decrypt URL typo. Contributed by Jeffrey E Rodriguez.
2016-10-27 18:05:40 -07:00
5877f20f9c
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
2016-10-27 16:09:00 -07:00
0c837db8a8
HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu
2016-10-27 19:46:41 +05:30
0bdd263d82
HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
2016-10-27 15:46:59 +09:00
22ff0eff4d
HADOOP-8299. ViewFileSystem link slash mount point crashes with IndexOutOfBoundsException. Contributed by Manoj Govindassamy.
2016-10-26 14:25:03 -07:00
1f8490a5ba
HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth.
2016-10-26 08:55:42 -07:00
9cad3e2350
HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran.
2016-10-26 08:27:26 -07:00
d88dca844a
HADOOP-11798. Native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-25 16:53:53 -07:00
084bdab156
HDFS-5684. Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting. Contributed by Manoj Govindassamy.
2016-10-25 15:35:39 -07:00
86c735bcb1
Revert "HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu."
...
This reverts commit cef61d505e
2016-10-25 13:45:52 -07:00
09ef97dccb
HADOOP-13669. Addendum patch 2 for KMS Server should log exceptions before throwing.
2016-10-25 09:59:12 -07:00
309a43925c
HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
2016-10-25 09:03:03 -07:00
d8fa1cfa67
HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth.
2016-10-24 21:22:34 -07:00
dc3272bfe8
HDFS-11046. Duplicate '-' in the daemon log name.
2016-10-25 10:07:43 +09:00
d0a347984d
HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-23 10:58:36 -07:00
da901b6c14
Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao."
...
This reverts commit be72372248
2016-10-23 08:25:37 -07:00
25438526ed
HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-21 16:20:07 -07:00
be72372248
HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-21 14:23:02 -07:00
ae8bccd509
HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du
2016-10-21 12:59:54 -07:00
262827cf75
HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal.
2016-10-20 13:35:26 -07:00
3fbf4cd5da
HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran.
2016-10-20 12:33:58 -07:00
f872c6bc03
HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
2016-10-20 21:47:17 +05:30
4bca385241
HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter
2016-10-18 18:32:01 -07:00
d75cbc5749
HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log.
2016-10-18 18:24:59 -07:00
efdf810cf9
HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge.
2016-10-18 18:18:43 -07:00
6c348c5691
HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran
2016-10-18 21:16:02 +01:00
c023c74886
HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki
2016-10-18 12:02:53 +06:00
bedfec0c10
HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini.
2016-10-18 15:00:44 +09:00
b671ee6846
HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy.
2016-10-17 14:14:50 -07:00
987ee51141
HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
2016-10-17 13:25:58 -07:00
0f4afc8100
HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy.
2016-10-17 13:15:11 -07:00
ed9fcbec54
HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory.
2016-10-17 05:04:49 -07:00
aee538be6c
HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy.
2016-10-14 14:08:31 -07:00
dbe663d524
HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang.
2016-10-13 23:05:16 -07:00
5a5a724731
HADOOP-13417. Fix javac and checkstyle warnings in hadoop-auth package.
2016-10-14 14:45:55 +09:00
ae51b11f78
HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing.
2016-10-13 22:32:08 -07:00
008122b3c9
HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru.
2016-10-13 11:37:03 -07:00
9097e2efe4
HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.
2016-10-13 10:52:28 -07:00
12d739a34b
HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
2016-10-12 15:19:52 -07:00
85cd06f663
HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
2016-10-12 15:11:42 -05:00
b84c4891f9
HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
2016-10-11 17:05:00 -07:00
8a09bf7c19
HADOOP-13705. Revert HADOOP-13534 Remove unused TrashPolicy#getInstance and initialize code.
2016-10-11 13:46:07 -07:00
4b32b1420d
HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang.
2016-10-11 13:21:33 -07:00
2fb392a587
HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu
2016-10-11 10:57:08 -07:00
c874fa914d
HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu
2016-10-10 13:33:07 -07:00
65912e4027
HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya.
2016-10-10 12:51:12 -07:00
03060075c5
HADOOP-13699. Configuration does not substitute multiple references to the same var.
2016-10-10 12:19:26 -07:00
cef61d505e
HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu.
2016-10-10 12:32:39 +01:00
3d59b18d49
HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang
2016-10-09 15:53:36 +06:00
ec0b70716c
HADOOP-12579. Deprecate WriteableRPCEngine. Contributed by Wei Zhou
2016-10-09 15:07:03 +06:00
2e853be657
HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen.
2016-10-07 13:46:27 -07:00
c183b9de8d
HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter)
2016-10-07 09:33:31 -07:00
ebd4f39a39
HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran.
2016-10-07 12:51:40 +01:00
1d330fbaf6
HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth.
2016-10-06 13:19:16 -07:00
2d46c3f6b7
HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran.
2016-10-06 10:57:01 -07:00
35b9d7de9f
HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin
2016-10-06 18:06:08 +05:30
b90fc70d67
HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen
2016-10-06 17:47:31 +05:30
c5ca216915
HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge.
2016-10-05 17:36:50 -07:00
00160f71b6
HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang
2016-10-05 16:50:01 -04:00
9a61b52fbe
HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao.
2016-10-05 20:41:08 +09:00
853d65a157
HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen.
2016-10-03 16:01:54 -07:00
89bd6d29a6
HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya.
2016-09-30 17:51:39 -07:00
57aec2b46b
HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark.
2016-09-30 12:58:37 -07:00
1e0ea27e96
Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin."
...
This reverts commit 0458a2af6e
2016-09-29 13:59:09 -07:00
236ac773c9
HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp.
2016-09-29 13:27:30 -05:00
ee0c722dc8
HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan.
2016-09-29 17:01:00 +01:00
1518cb9532
HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri
2016-09-29 11:35:00 +01:00
e19b37ead2
HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp.
2016-09-28 08:24:21 -05:00
9a44a832a9
HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang
2016-09-27 17:36:53 -07:00
875062b5bc
HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
2016-09-27 11:26:45 -07:00
edf0d0f8b2
HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki
2016-09-27 07:04:37 +05:30
fa397e74fe
HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang.
2016-09-26 13:00:57 -07:00
6eb700ee74
HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko.
2016-09-23 14:10:11 -07:00
bbdf350ff9
HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
2016-09-23 19:21:34 +05:30
e80386d69d
HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
2016-09-20 13:20:01 -07:00
734d54c1a8
HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen
2016-09-21 21:34:48 +08:00
ea839bd48e
HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
2016-09-17 22:25:39 -07:00
58bae35447
YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng
2016-09-18 08:43:36 +08:00
8a40953058
HDFS-10823. Implement HttpFSFileSystem#listStatusIterator.
2016-09-16 15:37:36 -07:00
f6f3a447bf
HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang.
2016-09-16 14:53:30 -07:00
fcbac00212
Revert "HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)"
...
This reverts commit 4d3ea92f4f
2016-09-15 10:18:56 -07:00
7cad7b7046
HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
2016-09-15 23:42:34 +09:00
53a12fa721
HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran
2016-09-14 15:45:04 +01:00
ea0c2b8b05
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-15 10:46:00 +08:00
08d8e0ba25
HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
2016-09-13 11:12:52 -07:00
d2466ec3e0
HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
2016-09-12 21:25:06 -07:00
59d59667a8
HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang
2016-09-12 16:17:08 -07:00
58ed4fa544
HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
...
This commit includes the following changes:
HADOOP-13356. Add a function to handle command_subcommand_OPTS
HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
HADOOP-13357. Modify common to use hadoop_subcommand_opts
HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
HADOOP-13564. modify mapred to use hadoop_subcommand_opts
HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
HADOOP-13360. Documentation for HADOOP_subcommand_OPTS
This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
a99bf26a08
HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy)
2016-09-10 18:22:25 -07:00
9f192cc5ac
MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan
2016-09-09 11:12:44 -07:00
d4d076876a
HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
2016-09-09 10:39:35 -05:00
011f3b24d4
HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang
2016-09-08 17:53:40 -07:00
1192781a78
HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran
2016-09-08 17:46:12 -07:00
cae331186d
Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)"
...
This reverts commit 05ede00386
2016-09-08 12:40:30 -07:00
401db4fc65
HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng.
2016-09-08 11:54:33 -07:00
d355573f56
Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng"
...
This reverts commit 62a9667136
2016-09-08 05:50:17 +08:00
f414d5e118
HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor.
2016-09-07 11:09:41 -07:00
680be58aac
HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
2016-09-06 20:54:17 -07:00
f0d5382ff3
HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth.
2016-09-06 11:02:39 -07:00
d37dc5d1b8
HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin
2016-09-06 10:38:04 -07:00
f388a20943
Add CHANGES and release notes for 3.0.0-alpha1 to site
2016-09-06 09:51:55 -07:00
39d1b1d747
HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
2016-09-06 10:02:42 -05:00
62a9667136
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-07 17:05:33 +08:00
23abb09c1f
HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp.
2016-09-02 11:03:18 -05:00
76cd81f4b6
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-09-01 15:44:44 -05:00
3069df7551
FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria
2016-09-01 11:32:26 -07:00
dcd21d083a
HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang)
2016-09-01 11:03:06 -07:00
05ede00386
YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)
2016-08-29 15:55:33 -07:00
6fcb04c178
HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri)
2016-08-29 13:04:28 -07:00
e1ad598cef
HADOOP-7363. TestRawLocalFileSystemContract is needed. Contributed by Andras Bokor.
2016-08-29 09:26:46 -07:00
92d8f37155
HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe
2016-08-29 15:55:38 +00:00
81485dbfc1
Revert "HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp."
...
This reverts commit d288a0ba83
2016-08-25 16:04:54 -05:00
d288a0ba83
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-08-25 11:44:13 -05:00
52b25fe6ae
HADOOP-13533. Do not require user to set HADOOP_SSH_OPTS to a non-null string, allow setting of an empty string. (Albert Chu via aw) closes #121
...
Signed-off-by: Allen Wittenauer <aw@apache.org>
2016-08-25 07:11:06 -07:00
601599b036
HADOOP-13532. Fix typo in hadoop_connect_to_hosts error message (Albert Chu via aw) closes #120
2016-08-25 06:58:42 -07:00
ab3b727b5f
HADOOP-13534. Remove unused TrashPolicy#getInstance and initialize code. Contributed by Yiqun Lin.
2016-08-25 13:54:57 +09:00
3476156807
HADOOP-13396. Allow pluggable audit loggers in KMS. Contributed by Xiao Chen
2016-08-24 10:14:46 -07:00
092b4d5bfd
HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin.
2016-08-24 16:47:52 +09:00
c37346d0e3
HADOOP-12726. Unsupported FS operations should throw UnsupportedOperationException. Contributed by Daniel Templeton.
2016-08-23 14:12:52 -07:00
8aae8d6bf0
HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu.
2016-08-24 00:03:27 +09:00
f0efea490e
HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen.
2016-08-23 04:14:24 -07:00
c49333becf
HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang)
2016-08-22 18:29:56 -07:00
4070caad70
HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya.
2016-08-22 18:09:35 -07:00
f4d4d3474c
HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen.
2016-08-22 14:42:13 -07:00
115ecb52a8
HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang)
2016-08-21 09:40:29 -07:00
99603e9022
HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan.
2016-08-19 19:08:53 -07:00
763f0497bb
HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
2016-08-19 10:48:10 -07:00
03a9343d57
HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen.
2016-08-19 09:22:49 -07:00
8179f9a493
HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu.
2016-08-19 16:15:00 +09:00
dbcaf999d9
HADOOP-13504. Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010. Contributed by Sammi Chen
2016-08-19 11:18:15 +08:00
c5c3e81b49
HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.
2016-08-18 14:55:26 -07:00
0f51eae0c0
HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu)
2016-08-18 14:10:37 -07:00
0da69c324d
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
...
(cherry picked from commit d464483bf7
2016-08-18 07:27:23 -07:00
040c185d62
HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie
2016-08-18 14:36:55 +01:00
c57523163f
HADOOP-11786. Fix Javadoc typos in org.apache.hadoop.fs.FileSystem. Contributed by Andras Bokor.
2016-08-17 15:00:14 -07:00
23532716fc
HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)
2016-08-16 17:33:04 -07:00
27a6e09c4e
Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)"
...
This reverts commit 9336a0495f
2016-08-16 16:25:37 -07:00
4b689e7a75
HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory.
2016-08-16 15:01:18 -07:00
b8a446ba57
HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki.
2016-08-16 13:30:40 +09:00
9336a0495f
HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)
2016-08-15 20:24:54 -07:00
382d615260
HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu)
2016-08-15 20:22:14 -07:00
4bcbef39f7
HDFS-10724. Document caller context config keys. (Contributed by Mingliang Liu)
2016-08-15 20:20:33 -07:00
12ad63d723
HDFS-10725. Caller context should always be constructed by a builder. (Contributed by Mingliang Liu)
2016-08-15 20:14:05 -07:00
9daa9979a1
HADOOP-13437. KMS should reload whitelist and default key ACLs when hot-reloading. Contributed by Xiao Chen.
2016-08-15 18:14:45 -07:00
d714030b5d
HADOOP-13333. testConf.xml ls comparators in wrong order (Vrushali C via Varun Saxena)
2016-08-16 03:03:44 +05:30
b5af9be72c
HDFS-8668. Erasure Coding: revisit buffer used for encoding and decoding. Contributed by Sammi Chen
2016-08-13 13:52:37 +08:00
4d3ea92f4f
HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)
2016-08-11 19:56:58 -07:00
db719ef125
HADOOP-13190. Mention LoadBalancingKMSClientProvider in KMS HA documentation. Contributed by Wei-Chiu Chuang.
2016-08-11 12:27:09 -07:00
d892ae9576
HADOOP-13441. Document LdapGroupsMapping keystore password properties. Contributed by Yuanbo Liu.
2016-08-11 11:57:43 -07:00
8fbb57fbd9
HADOOP-11588. Benchmark framework and test for erasure coders. Contributed by Rui Li
2016-08-12 15:05:52 +08:00
e83be44af5
HADOOP-13461. NPE in KeyProvider.rollNewVersion. Contributed by Colm O hEigeartaigh.
2016-08-10 16:28:02 -07:00
4d4fe07c3c
HADOOP-13476. CredentialProviderFactory fails at class loading from libhdfs (JNI). Contributed by Aaron Fabbri.
2016-08-10 09:54:31 -07:00
d00d3add9e
HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah.
2016-08-09 18:11:34 -07:00
85422bb7c5
HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha)
2016-08-09 13:42:32 -07:00
caf800d529
HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp.
2016-08-09 14:33:15 -05:00
8f9b61852b
HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang.
2016-08-09 09:54:44 +09:00
0ad48aa2c8
HADOOP-12747. support wildcard in libjars argument (sjlee)
2016-08-08 17:34:56 -07:00
070548943a
HADOOP-13395. Enhance TestKMSAudit. Contributed by Xiao Chen.
2016-08-08 15:11:05 -07:00
6418edd6fe
HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei)
2016-08-08 15:06:03 -07:00
58e1523c8e
HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang)
2016-08-08 12:36:27 -07:00
625585950a
HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu.
2016-08-08 11:00:19 -07:00
10ed06a0c9
HADOOP-13418. Fix javadoc warnings by JDK8 in hadoop-nfs package. Contributed by Kai Sasaki.
2016-08-06 12:22:02 +09:00
49ba09a922
HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang.
2016-08-05 16:32:44 -07:00
cca6229696
HDFS-10718. Prefer direct ByteBuffer in native RS encoder and decoder. Contributed by Sammi Chen
2016-08-05 04:22:48 +08:00
331ef25152
HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang)
2016-08-04 12:25:39 -07:00
b8ca84ac99
HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal)
2016-08-04 10:07:53 -07:00
9422515239
HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp.
2016-08-04 10:45:55 -05:00
05db64913d
HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner.
2016-08-04 15:57:34 +08:00
a1f6564d31
HADOOP-13458. LoadBalancingKMSClientProvider#doOp should log IOException stacktrace. Contributed by Chen Liang.
2016-08-03 14:19:47 -07:00
c82745432a
HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger
2016-08-03 20:17:30 +00:00
580a833496
HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp.
2016-08-03 13:22:22 -05:00
2d8227605f
HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp.
2016-08-03 09:31:49 -05:00
d28c2d9f55
HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor)
2016-08-02 15:17:45 -07:00
954465e7ba
HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley)
2016-08-02 13:40:33 -07:00
0458a2af6e
HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin.
2016-08-02 12:43:30 -07:00
b3018e73cc
HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp.
2016-08-02 10:40:28 -05:00
770b5eb2db
HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
2016-08-01 17:35:59 +09:00
34ccaa8367
HADOOP-11540. Raw Reed-Solomon coder using Intel ISA-L library. Contributed by Kai Zheng
2016-08-01 06:34:26 +08:00
3d191cc152
HADOOP-13440. FileContext does not react on changing umask via configuration.
2016-07-31 11:29:15 +09:00
8ebf2e95d2
HADOOP-13381. KMS clients should use KMS Delegation Tokens from current UGI. Contributed by Xiao Chen.
2016-07-28 18:24:41 -07:00
d9aae22fdf
HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge
2016-07-28 16:29:40 -07:00
a3d0cba810
HDFS-10689. Hdfs dfs chmod should reset sticky bit permission when the bit is omitted in the octal mode. (Manoj Govindassamy via Lei Xu)
2016-07-28 13:52:14 -07:00
54fe17a607
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
2016-07-27 19:41:09 +09:00
255ea45e50
HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin.
2016-07-26 15:33:20 -07:00
f1a4863dfc
HADOOP-13041. Adding tests for coder utilities. Contributed by Kai Sasaki
2016-07-26 21:53:37 +08:00
22a9a6b0d4
HADOOP-13272. ViewFileSystem should support storage policy related API. Contributed by Peter Shi
2016-07-22 18:08:12 -07:00
5fda66e4a3
HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran.
2016-07-22 15:38:18 -07:00
43cf6b101d
HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge.
2016-07-21 14:12:31 -07:00
37362c2f92
HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan)
2016-07-20 13:42:51 +01:00
dc065dd64c
HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
2016-07-19 16:05:48 -07:00
92fe2db540
HADOOP-13301. Millisecond timestamp for FsShell console log and MapReduce jobsummary log. Contributed by John Zhuge.
2016-07-18 15:45:44 -07:00
c2bcffb34e
HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki.
2016-07-18 11:48:23 -07:00
76be82bc04
HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor
2016-07-18 14:38:35 +01:00
da456ffd62
Preparing for 3.0.0-alpha2 development
2016-07-15 19:04:17 -07:00
442162048a
HADOOP-13254. Create framework for configurable disk checkers (yufeigu via rkanter)
2016-07-15 13:41:26 -07:00
1381483233
HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou.
2016-07-14 23:13:55 -07:00
be26c1b9b0
Revert "HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor"
...
This reverts commit 45af585e7a
2016-07-14 10:30:36 +01:00
45af585e7a
HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor
2016-07-14 10:29:29 +01:00
728bf7f698
HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
2016-07-13 16:37:40 -07:00
505ce88437
HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R.
2016-07-13 13:02:20 -07:00
77ffe76212
HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
2016-07-13 21:28:04 +09:00
a290a98b6a
HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei)
2016-07-12 16:49:32 -07:00
32b033d57c
YARN-5052 Update timeline service v2 documentation to capture information about filters (Varun Saxena via Vrushali C)
2016-07-10 08:46:03 -07:00
ef30bf3c3f
HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer.
2016-07-08 14:17:14 -07:00
6e597600f7
HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu.
2016-07-07 14:58:19 -07:00
a0035661c1
HADOOP-13349. HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH (aw)
2016-07-07 14:15:34 -07:00
d1626a7b37
MAPREDUCE-6717. Remove deprecated StringUtils.getFormattedTimeWithDiff. Contributed by Shen Yinjie.
2016-07-07 11:18:43 -07:00
d792a90206
YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du
2016-07-05 18:05:16 -07:00
aa42c7a6dd
HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu.
2016-07-01 15:34:03 -07:00
c25021fb71
HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B)
2016-07-01 12:09:59 +05:30
846ada2de3
HADOOP-12345. Pad hostname correctly in CredentialsSys.java. Contributed by Pradeep Nayak Udupi Kadbet.
2016-06-29 17:32:35 -07:00
5c07c573db
HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims)
2016-06-30 07:21:08 +09:00
96fa0f848b
HADOOP-12709 Cut s3:// from trunk. Contributed by Mingliang Liu.
2016-06-29 16:04:50 +01:00
111739df8f
HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki
2016-06-29 14:32:03 +01:00
b3649adf6a
HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw)
2016-06-28 20:47:05 -07:00
6103635591
HADOOP-9330. Add custom JUnit4 test runner with configurable timeout (Steve Loughran via aw)
2016-06-28 20:40:41 -07:00
1faaa69078
HADOOP-9321. fix coverage org.apache.hadoop.net (Ivan A. Veselovsky via aw)
2016-06-28 20:37:42 -07:00
77031a9c37
HADOOP-12864. Remove bin/rcc script. Contributed by Allen Wittenauer.
2016-06-28 14:25:02 -07:00
be38e530bb
HADOOP-9888. KerberosName static initialization gets default realm, which is unneeded in non-secure deployment. (Dmytro Kabakchei via aw)
2016-06-28 07:22:51 -07:00
23c3ff85a9
HADOOP-13209. replace slaves with workers (John Smith via aw)
2016-06-28 05:53:03 -07:00
7d2070493e
HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen.
2016-06-27 18:46:33 -07:00
771f798edf
HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen.
2016-06-27 18:20:56 -07:00
9683eab0e1
HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell)
2016-06-27 09:36:05 -07:00
d328e66706
HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls.
2016-06-25 15:45:16 +08:00
bf74dbf80d
HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee)
2016-06-24 14:44:15 -07:00
975786492c
Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
2016-06-24 09:46:36 -07:00
0b9edf6e0f
HADOOP-13019. Implement ErasureCodec for HitchHiker XOR coding. Contributed by Kai Sasaki.
2016-06-23 15:52:51 -07:00
e98c0c7a1c
Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen."
...
This reverts commit 35356de1ba
2016-06-23 11:08:02 -07:00
4ee3543625
HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel.
2016-06-22 15:45:25 +01:00
67089875f0
HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims)
2016-06-22 23:38:20 +09:00
e15cd43369
HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton.
2016-06-21 20:16:22 +09:00
5d58858bb6
HADOOP-9613. [JDK8] Update jersey version to latest 1.x release.
2016-06-21 08:05:32 +09:00
8c1f81d4bf
HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe)
2016-06-20 14:25:07 -07:00
5370a6ffae
HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe)
2016-06-20 10:46:18 -07:00
fc6b50cc57
HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde.
2016-06-20 17:07:26 +09:00
0319d73c3b
HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal)
2016-06-18 16:16:54 -07:00
5f6bc65bb3
Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)"
...
This reverts commit 97056c3355
2016-06-17 23:50:22 -07:00
0761379fe4
HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao.
2016-06-17 15:25:14 -07:00
09e82acaf9
HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang.
2016-06-17 16:20:38 +09:00
51d497fa93
MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao.
2016-06-17 11:03:54 +09:00
a2a5cb60b0
HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi.
2016-06-16 18:20:49 -07:00
bf780406f2
HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe)
2016-06-16 16:48:05 -07:00
b1674caa40
HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen.
2016-06-16 15:22:00 -07:00
127d2c7281
HADOOP-13241. document s3a better. Contributed by Steve Loughran.
2016-06-16 11:18:02 -07:00
cc6c265171
HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B)
2016-06-16 16:47:06 +05:30
6f0aa75121
HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin.
2016-06-15 11:41:49 -07:00
e2f640942b
HADOOP-13245. Fix up some misc create-release issues (aw)
2016-06-14 16:03:20 -07:00
8e8cb4c6ca
HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma)
2016-06-14 16:01:26 +05:30
20b13d109a
HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki.
2016-06-14 19:20:46 +09:00
e3ba9ad3f1
HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
2016-06-14 10:18:41 +09:00
0accc3306d
HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge.
2016-06-13 11:43:46 -07:00
49b4064644
HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha)
2016-06-12 14:12:31 -07:00
8a1dccecce
HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis.
...
This closes #97 .
2016-06-11 03:32:21 +09:00
0bbb4ddd79
HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu.
2016-06-10 10:38:13 -07:00
03fc6b1bb0
YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
2016-06-10 09:51:09 -07:00
9581fb715c
HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane.
2016-06-09 14:33:31 -07:00
31ffaf76f2
HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory.
2016-06-09 21:00:47 +01:00
656c460c0e
HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth
2016-06-09 17:28:49 +01:00
723432b338
HADOOP-13220. Follow on fixups after upgraded mini-kdc using Kerby. Contributed by Jiajia Li
2016-06-09 15:56:12 +08:00
733f3f18d5
MAPREDUCE-6702. TestMiniMRChildTask.testTaskEnv and TestMiniMRChildTask.testTaskOldEnv are failing (ajisakaa via rkanter)
2016-06-07 15:46:06 -07:00
c14c1b298e
HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe.
2016-06-07 09:18:58 -07:00
35f255b03b
Revert "Revert "HADOOP-13226 Support async call retry and failover.""
...
This reverts commit 5360da8bd9
2016-06-06 16:31:43 +08:00
574dcd34c0
Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls.""
...
This reverts commit e4450d47f1
2016-06-06 16:31:23 +08:00
aa20fa150d
Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou""
...
This reverts commit 4d36b221a2
2016-06-06 16:28:47 +08:00
eded3d109e
Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
...
This reverts commit 106234d873
2016-06-06 16:28:21 +08:00
106234d873
Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
...
This reverts commit fc94810d3f
2016-06-03 18:09:55 -07:00
4d36b221a2
Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
...
This reverts commit 1b9f18623a
2016-06-03 18:09:18 -07:00
e4450d47f1
Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."
...
This reverts commit 42c22f7e3d
2016-06-03 18:09:16 -07:00
5360da8bd9
Revert "HADOOP-13226 Support async call retry and failover."
...
This reverts commit 83f2f78c11
2016-06-03 18:09:09 -07:00
713cb71820
HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen.
2016-06-03 16:48:54 -07:00
d82bc85018
HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu.
2016-06-03 16:38:30 -07:00
78b3a03831
HADOOP-13109. Add ability to edit existing token file via dtutil -alias flag (Matthew Paduano via aw)
2016-06-03 15:34:39 -07:00
99cc439e29
YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du
2016-06-03 11:10:42 -07:00
c58a59f708
HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran.
2016-06-03 08:55:33 -07:00
97e2449477
HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (Contributed by Akira Ajisaka)
2016-06-02 13:14:45 -07:00
ead61c45da
HADOOP-13224. Grep job in Single Cluster document fails. (aajisaka)
2016-06-03 02:00:13 +09:00
aadb77e412
HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula.
2016-06-02 20:55:04 +09:00
99675e00df
HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou.
2016-06-02 19:14:53 +09:00
35356de1ba
HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen.
2016-06-01 13:13:17 -07:00
5870611030
HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel)
2016-06-01 14:18:20 +01:00
8ceb06e239
HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe)
2016-05-31 17:54:34 -07:00
83f2f78c11
HADOOP-13226 Support async call retry and failover.
2016-05-31 16:30:11 -07:00
bca31fe276
HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang.
2016-05-31 09:35:24 -07:00
93d8a7f2a2
Revert "HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng"
...
This reverts commit a6c79f92d5
2016-06-01 08:41:15 +08:00
4ca8859583
HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao.
2016-05-27 18:07:44 -07:00
916140604f
HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li
2016-05-28 14:23:39 +08:00
34cc21f6d1
HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang)
2016-05-26 22:43:45 -07:00
55c3e2de3d
HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha)
2016-05-26 14:24:31 -07:00
fed9bf0ec1
HADOOP-12727. Minor cleanups needed for CMake 3.X (Alan Burlison via aw)
2016-05-26 07:37:22 -07:00
77202fa103
HADOOP-13010. Refactor raw erasure coders. Contributed by Kai Zheng
2016-05-27 13:23:34 +08:00
3c83cee118
HADOOP-12925. Checks for SPARC architecture need to include 64-bit SPARC (Alan Burlison via aw)
2016-05-25 15:28:02 -07:00
a6c79f92d5
HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng
2016-05-27 04:29:42 +08:00
57c31a3fef
HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha)
2016-05-24 10:37:00 -07:00
eebb39a56f
HADOOP-13112. Change CredentialShell to use CommandShell base class (Matthew Paduano via aw)
2016-05-23 13:37:38 -07:00
d8c1fd1944
HADOOP-13178. TestShellBasedIdMapping.testStaticMapUpdate doesn't work on OS X (Kai Sasaki via aw)
2016-05-21 10:00:36 -07:00
39ec1515a2
HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran)
2016-05-21 16:39:31 +01:00
bcde1562d2
HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth.
2016-05-20 12:47:41 -07:00
757050ff35
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong.
2016-05-20 13:52:15 +01:00
42c22f7e3d
HADOOP-13168. Support Future.get with timeout in ipc async calls.
2016-05-19 15:34:04 -07:00
feb90ffcca
YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
2016-05-19 13:01:36 -07:00
2120de588b
Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk
2016-05-19 07:17:08 -07:00
182fc1986a
HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang
2016-05-19 07:15:52 -07:00
22ff9e68d1
HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.
2016-05-19 14:48:18 +01:00
bad85f3e3a
HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B.
2016-05-18 09:39:43 -07:00
f2c1d9181f
HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe)
2016-05-18 09:15:32 -07:00
7154ace712
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
2016-05-17 17:44:30 -07:00
9478484845
HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao.
2016-05-17 14:58:22 -07:00
e24fe2641b
HDFS-9732, Improve DelegationTokenIdentifier.toString() for better logging. Contributed by Yongjun Zhang.
2016-05-17 14:03:08 -07:00
9fe5828f05
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
2016-05-17 15:53:09 +09:00
61f46be071
HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee)
2016-05-16 18:49:47 -07:00
730bc746f9
HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw)
...
This commit contains the following JIRA issues:
HADOOP-12931. bin/hadoop work for dynamic subcommands
HADOOP-12932. bin/yarn work for dynamic subcommands
HADOOP-12933. bin/hdfs work for dynamic subcommands
HADOOP-12934. bin/mapred work for dynamic subcommands
HADOOP-12935. API documentation for dynamic subcommands
HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
HADOOP-13086. enable daemonization of dynamic commands
HADOOP-13087. env var doc update for dynamic commands
HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
HADOOP-13089. hadoop distcp adds client opts twice when dynamic
HADOOP-13094. hadoop-common unit tests for dynamic commands
HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
HADOOP-13107. clean up how rumen is executed
HADOOP-13108. dynamic subcommands need a way to manipulate arguments
HADOOP-13110. add a streaming subcommand to mapred
HADOOP-13111. convert hadoop gridmix to be dynamic
HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
HADOOP-13117. clarify daemonization and security vars for dynamic commands
HADOOP-13120. add a --debug message when dynamic commands have been used
HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
HADOOP-13129. fix typo in dynamic subcommand docs
HADOOP-13151. Underscores should be escaped in dynamic subcommands document
HADOOP-13153. fix typo in debug statement for dynamic subcommands
2016-05-16 17:54:45 -07:00
a9a8297cad
HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.
2016-05-16 15:23:36 -07:00
1f2794b4fa
HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
2016-05-13 10:01:46 -07:00
3bfd29949f
HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
2016-05-12 23:48:37 -07:00
3c5c57af28
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
2016-05-12 18:27:28 -07:00
ca5613af91
Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
...
This reverts commit 6b53802cba
2016-05-12 15:32:45 -07:00
0f3d6bc65e
HADOOP-12581. ShellBasedIdMapping needs suport for Solaris (Alan Burlison via aw)
2016-05-12 14:42:04 -07:00
27c4e90efc
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:24:20 +01:00
6b53802cba
Update project version to 3.0.0-alpha1-SNAPSHOT.
2016-05-12 11:05:05 -07:00
0bbe01f8d5
YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)
2016-05-12 10:11:23 -07:00
def2a6d385
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:57:35 +01:00
687233f20d
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
2016-05-11 13:45:39 -07:00
acb509b2fa
HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay)
2016-05-11 14:30:07 -04:00
dee279b532
HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
2016-05-11 10:58:32 -07:00
3553261400
HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel)
2016-05-11 14:21:08 +01:00
6e56578031
HADOOP-10694. Remove synchronized input streams from Writable deserialization. Contributed by Gopal V and Rajesh Balamohan.
2016-05-10 17:27:10 -07:00
307db61aac
HDFS-10172. hdfs erasurecode command should remove the redundant -usage option. Contributed by Yuanbo Liu.
2016-05-10 15:20:17 -07:00
6b1c1cb01c
YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts.
2016-05-10 21:28:02 +00:00
025219b12f
HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel)
2016-05-10 21:37:22 +01:00
829a2e4d27
HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel).
2016-05-10 21:32:57 +01:00
0f0c6415af
HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeStream javadoc. Contributed by Wei-Chiu Chuang.
2016-05-10 10:02:46 -07:00
8ef75a702e
HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge.
2016-05-06 17:23:11 -07:00
1c5bbf6499
HADOOP-12866. add a subcommand for gridmix (Kai Sasaki via aw)
2016-05-06 14:07:02 -07:00
dacd1f50fe
HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
2016-05-05 18:08:47 -07:00
4e5e87ddd4
HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao)
2016-05-05 17:56:58 -07:00
f305d9c0f6
HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException
2016-05-05 15:53:02 -07:00
35cf503149
HADOOP-13077. Handle special characters in passwords in httpfs.sh (Xiao Chen via aw)
2016-05-05 11:33:06 -07:00
1268cf5fbe
HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma)
2016-05-04 17:02:26 -07:00
f343d91ecc
HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor)
2016-05-04 09:49:33 -07:00
36972d61d1
HADOOP-12504. Remove metrics v1. (aajisaka)
2016-05-04 22:52:23 +09:00
355325bcc7
HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang.
2016-05-04 15:12:51 +09:00
c1cc6ac667
HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri
2016-05-02 22:36:58 -07:00
1b9f18623a
HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou
2016-05-02 11:16:30 -07:00
2beedead72
HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
2016-05-02 08:58:32 -07:00
971af603ea
HADOOP-13045. hadoop_add_classpath is not working in .hadooprc
2016-04-30 12:23:51 -07:00
2753185a01
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
2016-04-29 22:32:27 -07:00
9d4d30243b
Remove parent's env vars from child processes
2016-04-29 09:25:51 -07:00
6f26b66587
HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen.
2016-04-27 15:56:16 -07:00
0a152103f1
HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
2016-04-27 14:22:51 -07:00
3337ef2bfe
HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor)
2016-04-27 10:06:54 -07:00
4beff01354
YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode
2016-04-26 21:00:17 -07:00
ea5475d1c1
HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu)
2016-04-26 20:46:38 -07:00
68b4564e78
HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang.
2016-04-27 10:45:36 +09:00
fc94810d3f
HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou
2016-04-26 17:10:13 -07:00
5865fe2bf0
HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R.
2016-04-25 22:01:54 -07:00
bec5b4cd8c
HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims)
2016-04-25 22:41:50 +09:00
63e5412f1a
HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.
2016-04-22 15:14:40 -07:00
c610031cab
HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor.
2016-04-23 06:19:57 +09:00
9dbdc8e12d
HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp.
2016-04-22 15:02:46 -05:00
d6402faded
Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano"
...
This reverts commit 4838b735f0
2016-04-22 10:17:20 -07:00
19f0f9608e
HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel)
2016-04-22 11:25:03 +01:00
337bcde1dc
HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers
2016-04-21 20:17:33 -07:00
4a043b3fec
HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
2016-04-21 20:17:27 -07:00
4838b735f0
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
2016-04-21 11:32:39 -07:00
b4be288c5d
HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
2016-04-21 10:18:48 -07:00
5bd7b592e5
HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
2016-04-20 23:10:52 -07:00
b5d4c7dc76
HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li.
2016-04-20 15:47:01 +08:00
4feed9b2db
HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel
2016-04-15 17:44:12 +01:00
6e6b6dd5aa
HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi.
2016-04-15 14:14:36 +09:00
a74580a4d3
HADOOP-12811. Change kms server port number which conflicts with HMaster port number. Contributed by Xiao Chen.
2016-04-14 11:36:12 -07:00
df18b6e984
HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel)
2016-04-14 12:44:55 +01:00
40211d1f0a
HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel)
2016-04-14 10:35:31 +01:00
27b131e79c
HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor.
2016-04-14 10:55:51 +09:00
8ced42daff
HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao.
2016-04-13 15:34:17 -07:00
35f0770555
HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
2016-04-12 16:28:42 -07:00
042a3ae960
HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
2016-04-12 14:40:43 -07:00
209303be3a
HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang.
2016-04-12 15:26:50 +09:00
a409508b3f
HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran.
2016-04-12 14:55:01 +09:00
069c6c62de
HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba.
2016-04-11 12:02:06 -07:00
843ee8d59d
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
2016-04-08 13:36:58 -07:00
6791221572
HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel)
2016-04-08 12:59:19 +01:00
594c70f779
HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen.
2016-04-07 23:50:27 -07:00
a62637a413
HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou
2016-04-07 14:02:51 +08:00
8d29e2451f
HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B
...
This closes #89
2016-04-07 10:15:24 +05:30
93bacda08b
YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev
2016-04-06 16:13:47 -07:00
85ec5573eb
HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
2016-04-06 03:22:48 +09:00
917464505c
HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla.
2016-04-05 09:07:24 -05:00
7280550a8f
HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran)
2016-04-04 10:50:11 -07:00
da614ca5dc
HADOOP-12967. Remove FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
2016-04-04 17:48:08 +09:00
0ecdd4cffa
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse.
2016-04-03 16:40:19 +01:00
a8d8b80a20
HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
2016-04-01 13:59:14 +09:00
aac4d65bf9
HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao.
2016-03-31 15:22:24 -07:00
19639785f5
HADOOP-12955. Fix bugs in the initialization of the ISA-L library JNI bindings (Kai Zheng via cmccabe)
2016-03-31 15:09:11 -07:00
0dd9bcab97
YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage
2016-03-31 14:28:13 -07:00
d95c6eb32c
HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao.
2016-03-31 08:42:57 -07:00
0a74610d1c
HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw)
2016-03-31 07:51:05 -07:00
acca149ec9
HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak.
2016-03-31 16:04:47 +09:00
e4fc609d5d
HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang.
2016-03-30 14:13:11 -07:00
e3d15a2e23
DOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
2016-03-29 17:13:52 -07:00
46a5245db9
HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S)
2016-03-29 12:08:46 -07:00
8bfaa80037
HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
2016-03-28 14:13:48 -07:00
8cac1bb09f
HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter)
2016-03-28 10:36:59 -07:00
90fcb16c0f
MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang.
2016-03-28 05:30:42 -07:00
01cfee6381
HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
2016-03-28 15:57:57 +09:00
9a09200a1f
HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
2016-03-25 22:58:04 +00:00
d4df7849a5
HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen.
2016-03-25 15:28:53 -07:00
938222b2e2
HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
2016-03-23 14:57:14 -07:00
738155063e
HADOOP-12857. rework hadoop-tools (aw)
2016-03-23 13:46:38 -07:00
e7ed05e4f5
HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay.
2016-03-21 13:19:43 -07:00
e3bb38d625
HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
2016-03-21 11:39:05 -07:00
ed1e23fe8f
HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.
2016-03-20 17:40:59 -07:00
cd8b6889a7
HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee)
2016-03-19 14:02:04 -07:00
33239c9925
HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison.
2016-03-18 16:33:01 -07:00
605fdcbb81
YARN-4593 Deadlock in AbstractService.getConfig() (stevel)
2016-03-16 14:35:24 +00:00
5a725f0ab8
HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel)
2016-03-16 14:31:19 +00:00
19e8f07691
HADOOP-12826. Rename the new Java coder and make it default. Contributed by Rui Li.
2016-03-14 16:45:32 -07:00
1898810cda
HADOOP-12923. Move the test code in ipc.Client to test.
2016-03-14 15:48:01 -07:00
658ee95ff3
HADOOP-11996. Improve and restructure native ISAL support (Kai Zheng via cmccabe)
2016-03-11 12:57:54 -08:00
6e9a582eb1
HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe)
2016-03-11 12:26:40 -08:00
754299695b
Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)"
...
This reverts commit 682adc6ba9
2016-03-11 17:00:17 +00:00
682adc6ba9
HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
2016-03-11 15:03:40 +09:00
9a79b738c5
HADOOP-12906. AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException. (Steve Loughran via gtcarrera9)
2016-03-10 11:38:31 -08:00
318c9b68b0
HADOOP-11404. Clarify the "expected client Kerberos principal is null" authorization message. Contributed by Stephen Chu
2016-03-10 17:05:09 +05:30
2e040d31c7
HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal)
2016-03-08 23:29:43 -08:00
87c8005ad3
HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
2016-03-09 15:35:51 +09:00
89b16d27e2
HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
2016-03-08 21:22:06 -08:00
55f73a1cbd
HADOOP-12798. Update changelog and release notes (2016-03-04) (aw)
2016-03-08 16:48:38 -08:00
a3cc6e2511
HADOOP-12895. SSLFactory#createSSLSocketFactory exception message is wrong. Contributed by Wei-Chiu Chuang.
2016-03-08 13:51:48 -08:00
f86850b544
HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
2016-03-08 14:28:47 +09:00
c2140d05ef
HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu)
2016-03-07 21:10:24 -08:00
49eedc7ff0
HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
2016-03-07 20:26:19 -08:00
391da36d93
HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang)
2016-03-07 14:00:02 -08:00
2759689d7d
HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
2016-03-04 15:29:50 -08:00
3e8099a45a
HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen.
2016-03-04 09:48:05 -08:00
cbd31328a6
HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
2016-03-04 14:11:36 +09:00
1bc454615e
HADOOP-11792. Remove all of the CHANGES.txt files.
2016-03-03 21:02:31 -08:00
0a9f00af5e
HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
2016-03-03 23:32:30 +09:00
1c3136cbd8
HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
2016-03-03 23:22:35 +09:00
eb864d35d6
HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
2016-03-03 18:46:48 +09:00
f70e317ccc
HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
2016-03-03 17:14:32 +09:00
27941a1811
HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou)
2016-03-02 18:35:28 -08:00
700b0e4019
HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
2016-03-02 17:56:11 -08:00
480302b4ba
HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng.
2016-03-02 09:40:30 -08:00
f98dff329b
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
2016-03-01 13:18:42 -08:00
44d9bac1f5
Add HADOOP-12843 to 2.8.0 in CHANGES.txt.
2016-03-02 00:24:38 +09:00
d251e55415
HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
2016-02-29 21:59:52 -08:00
307ec80aca
HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng
2016-02-29 21:52:20 -08:00
680f3fc02d
HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha)
2016-02-29 18:59:59 -08:00
d8f390d015
HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du
2016-02-29 16:24:05 -08:00
0fa54d45b1
HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.
2016-02-29 11:41:00 -08:00
809ebc0b14
HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
2016-02-29 18:20:14 +09:00
e3ac231f72
Move HADOOP-9121 from 3.0.0 to 2.7.3 in CHANGES.txt.
2016-02-29 11:40:18 +09:00
7634d404b7
HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
2016-02-28 11:22:55 -08:00
7545ce6636
HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
2016-02-27 21:59:03 -08:00
03cfb454fe
HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel)
2016-02-27 20:23:51 +00:00
798babf661
HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
2016-02-26 21:59:08 -08:00
2093acf6b6
HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei)
2016-02-26 10:47:49 -08:00
f0de733ca0
Moved HADOOP-8818 from 3.0.0 to 2.7.3 in CHANGES.txt.
2016-02-27 01:30:20 +09:00
Brahma Reddy Battula
Arpit Agarwal
Andrew Wang
Steve Loughran
Akira Ajisaka
Kai Zheng
Rakesh Radhakrishnan
Sunil G
Mingliang Liu
Chris Douglas
Rohith Sharma K S
Jason Lowe
Daniel Templeton
Masatake Iwasaki
Lei Xu
Haohui Mai
Kihwal Lee
Robert Kanter
Eric Payne
Junping Du
Wei-Chiu Chuang
John Zhuge
John Zhuge
Xiaoyu Yao
Kengo Seki
Chris Nauroth
Allen Wittenauer
Zhe Zhang
Jonathan Eagles
Yiqun Lin
Tsuyoshi Ozawa
Ravi Prakash
Erik Krogen
Jitendra Pandey
Chen Liang
Jing Zhao
Andrey Dyatlov
Ray Chiang
Jian He
Harsh J
Xuan
Eric Yang
Yongjun Zhang
Xiao Chen
Jason Lowe
Arun Suresh
Ming Ma
Karthik Kambatla
Robert Kanter
Subru Krishnan
Anu Engineer
Benoy Antony
Wangda Tan
Konstantin V Shvachko
Sangjin Lee
Albert Chu
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
Varun Saxena
Vrushali Channapattan
Vinayakumar B
Tsz-Wo Nicholas Sze
Colin Patrick Mccabe
Karthik Kambatla
Larry McCay
Ravi Prakash
Zhe ZHang
Zhe Zhang
Li Lu
Uma Maheswara Rao G