2d846fdcbd
YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
...
(cherry picked from commit feb90ffcca
2016-05-19 13:02:05 -07:00
151ecdf26d
HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.
2016-05-19 14:44:44 +01:00
686691df60
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
2016-05-18 14:55:31 -07:00
42f64b3bcc
HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B.
...
(cherry picked from commit 0a527196dcb35a699e12121165bc3738766b569e)
2016-05-18 09:32:15 -07:00
feabfe9cda
HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe)
...
(cherry picked from commit f2c1d9181f
2016-05-18 09:19:45 -07:00
e9dd0d84e5
Revert "HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder."
...
This reverts commit e205421555
2016-05-18 17:57:46 +09:00
e205421555
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
...
(cherry picked from commit 7154ace712
2016-05-17 17:44:34 -07:00
937bc924cb
HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 9478484845744d5edc87
2016-05-17 15:51:47 -07:00
7f03c1c90e
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 9fe5828f05
2016-05-17 15:56:21 +09:00
9330a7b4de
HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee)
...
(cherry picked from commit 61f46be071
2016-05-16 18:59:19 -07:00
af70fc42e7
HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.
...
(cherry picked from commit a9a8297cad
2016-05-16 15:26:48 -07:00
8a316676b7
HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
...
(cherry picked from commit 1f2794b4fa
2016-05-13 10:02:47 -07:00
d6f6b99c83
HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
...
(cherry picked from commit 3bfd29949f
2016-05-12 23:48:58 -07:00
1370dfc775
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:23:31 +01:00
d6d13ec670
YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)
...
(cherry picked from commit 0bbe01f8d5
2016-05-12 10:14:24 -07:00
257b2f5beb
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:57:05 +01:00
15bfcde238
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
...
(cherry picked from commit 687233f20d
2016-05-11 14:02:03 -07:00
788f80b617
HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay)
2016-05-11 14:38:21 -04:00
31279ae45e
HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
...
(cherry picked from commit dee279b532
2016-05-11 10:58:42 -07:00
0ff3ec1f67
HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel)
2016-05-11 14:19:41 +01:00
eb4182f8f5
HADOOP-10694. Remove synchronized input streams from Writable deserialization. Contributed by Gopal V and Rajesh Balamohan.
...
(cherry picked from commit 6e56578031
2016-05-10 17:27:43 -07:00
de4daf9d22
YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts.
...
(cherry picked from commit 6b1c1cb01c
2016-05-10 21:37:24 +00:00
f47ea0cc3f
HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel)
2016-05-10 21:40:13 +01:00
092b199741
HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel).
2016-05-10 21:33:11 +01:00
7cbf306e4c
HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeStream javadoc. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit 0f0c6415af
2016-05-10 10:03:41 -07:00
e2216a96d7
HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 28023b7759
2016-05-10 09:49:00 -07:00
1d563f4d7e
HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge.
...
(cherry picked from commit 8ef75a702e
2016-05-06 17:23:31 -07:00
35859872b7
HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit dacd1f50fe
2016-05-05 18:15:32 -07:00
d18a991817
HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao)
...
(cherry picked from commit 4e5e87ddd4
2016-05-05 17:58:41 -07:00
b66b85094a
HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException
2016-05-05 15:50:50 -07:00
5b53833171
HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma)
...
(cherry picked from commit 1268cf5fbe
2016-05-04 17:04:44 -07:00
cb0a035bd1
HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor)
2016-05-04 09:49:51 -07:00
2d01ffaf24
HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang.
...
(cherry picked from commit 355325bcc7
2016-05-04 15:18:41 +09:00
a50dc05a60
HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri
...
(cherry picked from commit c1cc6ac667
2016-05-02 22:37:36 -07:00
7e0824faa9
HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou
2016-05-02 11:20:10 -07:00
b16c376c3b
HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
...
(cherry picked from commit 2beedead72
2016-05-02 09:43:42 -07:00
ac8fb579c6
Remove parent's env vars from child processes
2016-04-29 09:26:09 -07:00
7271e91b79
HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen.
2016-04-27 17:13:50 -07:00
4289cb8b36
HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
...
(cherry picked from commit 0a152103f1
2016-04-27 15:06:35 -07:00
14b8701a63
HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor)
2016-04-27 10:07:08 -07:00
9d3ddb0b4d
YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode
...
(cherry picked from commit 4beff01354
2016-04-26 21:02:04 -07:00
dba737f1e5
HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu)
2016-04-26 20:46:47 -07:00
c12fcbde44
HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang.
...
(cherry picked from commit 68b4564e78
2016-04-27 10:48:26 +09:00
d316f44059
HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou
2016-04-26 17:21:20 -07:00
5bceaa9683
HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims)
...
(cherry picked from commit bec5b4cd8c
2016-04-25 22:46:50 +09:00
88e1427a03
HDFS-9525. hadoop utilities need to support provided delegation tokens. Contributed by HeeSoo Kim
2016-04-23 20:50:56 -07:00
5949436010
HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor.
...
(cherry picked from commit c610031cab
2016-04-23 06:20:44 +09:00
d0718ed466
HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp.
...
(cherry picked from commit 9dbdc8e12d
2016-04-22 15:03:56 -05:00
edcb2a8410
HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel)
2016-04-22 11:24:50 +01:00
a0605ff002
HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers
2016-04-21 20:16:08 -07:00
5353289c8c
HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
...
(cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a)
2016-04-21 20:16:02 -07:00
432531dcf7
HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
...
(cherry picked from commit b4be288c5d
2016-04-21 10:19:35 -07:00
a2a65922dd
HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 5bd7b592e5
2016-04-20 23:11:42 -07:00
8d11a771b3
HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel
2016-04-15 17:43:52 +01:00
5ae74507c0
HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi.
...
(cherry picked from commit 6e6b6dd5aa
2016-04-15 14:15:33 +09:00
e124c3a2ae
HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel)
2016-04-14 12:45:10 +01:00
a59e05ad0a
HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel)
2016-04-14 10:35:20 +01:00
03bf09865f
HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor.
...
(cherry picked from commit 27b131e79c
2016-04-14 10:57:50 +09:00
d9d12b9e72
HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
...
(cherry picked from commit 042a3ae960
2016-04-13 17:42:28 -07:00
42040f706a
HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 8ced42daff
2016-04-13 16:42:55 -07:00
2b0b332e2f
HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
...
(cherry picked from commit 35f0770555
2016-04-12 16:29:15 -07:00
bb1ed426d1
HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang.
2016-04-12 15:28:05 +09:00
8f968171bd
HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran.
...
(cherry picked from commit a409508b3f
2016-04-12 14:55:25 +09:00
4041d2b49e
HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba.
...
(cherry picked from commit 069c6c62de
2016-04-11 12:03:39 -07:00
26a23eff82
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
...
(cherry picked from commit 843ee8d59d
2016-04-08 13:37:46 -07:00
c8797e0e39
HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel)
2016-04-08 12:59:01 +01:00
2f983b161f
HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen.
...
(cherry picked from commit 594c70f779
2016-04-07 23:50:36 -07:00
46352de1a2
HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou
2016-04-07 14:49:48 +08:00
d72db7d3aa
HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389649 13f79535-47bb-0310-9956-ffa450edef68
2016-04-07 14:39:22 +08:00
aea518ef30
Addendum : HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B)
2016-04-07 14:33:48 +08:00
c2b271fe05
HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B
...
This closes #91
(cherry picked from commit 8d29e2451f
2016-04-07 10:17:43 +05:30
42bc565630
YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev
2016-04-06 16:14:13 -07:00
1371f993a9
HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits. Contributed by Allen Wittenauer.
2016-04-06 17:43:31 +09:00
2542e9bccf
HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
...
(cherry picked from commit 85ec5573eb
2016-04-06 03:26:33 +09:00
ef3da82357
HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla.
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java
2016-04-05 09:16:05 -05:00
30e12edb67
HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran)
2016-04-04 10:50:28 -07:00
20e808d83e
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse.
2016-04-03 16:39:51 +01:00
80d122d7fe
HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit a8d8b80a20
2016-04-01 13:59:45 +09:00
ab9dc84d4a
HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao.
...
(cherry picked from commit aac4d65bf9dc78250aa4
2016-03-31 15:50:17 -07:00
3afc2caec8
YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage
2016-03-31 14:31:38 -07:00
6db3c9d394
HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao.
...
(cherry picked from commit d95c6eb32ca0c001c0b9
2016-03-31 09:05:37 -07:00
b4fbc22688
HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak.
...
(cherry picked from commit acca149ec9
2016-03-31 16:05:51 +09:00
9216993b02
HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang.
2016-03-30 14:14:05 -07:00
9df2e54160
HADOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
...
(cherry picked from commit e3d15a2e23
2016-03-29 17:14:36 -07:00
759d0acdd4
HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S)
2016-03-29 12:09:10 -07:00
a61a90c562
HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
...
(cherry picked from commit 8bfaa80037
2016-03-28 14:14:05 -07:00
5a552973f4
HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter)
...
(cherry picked from commit 8cac1bb09f
2016-03-28 10:37:58 -07:00
ae29b1a17b
MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit 90fcb16c0f
2016-03-28 05:31:46 -07:00
42d312663f
HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
...
(cherry picked from commit 01cfee6381
2016-03-28 15:58:28 +09:00
5e823d839d
HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
...
(cherry picked from commit 9a09200a1f
2016-03-25 22:59:14 +00:00
c58599acba
HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen.
...
(cherry picked from commit d4df7849a5
2016-03-25 15:29:06 -07:00
daf24eeb6b
HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
...
(cherry picked from commit 938222b2e2
2016-03-23 14:57:18 -07:00
4dd02f9484
HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay.
...
(cherry picked from commit e7ed05e4f5
2016-03-21 13:21:54 -07:00
e826d860a7
HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
...
(cherry picked from commit e3bb38d625
2016-03-21 11:39:19 -07:00
d956e0a0bb
HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee)
2016-03-21 10:56:32 -07:00
478a25b929
HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.
2016-03-20 17:41:20 -07:00
283e44f978
HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison.
...
(cherry picked from commit 33239c9925
2016-03-18 16:33:28 -07:00
186a7c6bb3
YARN-4593 Deadlock in AbstractService.getConfig() (stevel)
2016-03-16 14:35:13 +00:00
1463400aad
HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel)
2016-03-16 14:31:50 +00:00
f85d979a3f
HADOOP-12923. Move the test code in ipc.Client to test.
2016-03-14 15:49:34 -07:00
Jian He
Steve Loughran
Andrew Wang
Chris Nauroth
Colin Patrick Mccabe
Akira Ajisaka
Xiaoyu Yao
Sangjin Lee
Jing Zhao
Larry McCay
Tsuyoshi Ozawa
Eric Payne
Harsh J
Tsz-Wo Nicholas Sze
Ming Ma
Arpit Agarwal
Masatake Iwasaki
Chris Douglas
Robert Kanter
Lei Xu
Ravi Prakash
Kihwal Lee
Vinod Kumar Vavilapalli
Suresh Srinivas
Vinayakumar B
Zhe ZHang
Junping Du
Jason Lowe
Benoy Antony
Haohui Mai