Commit Graph

8085 Commits

Author SHA1 Message Date
Junping Du 6f252f7f36 YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)
(cherry picked from commit a696fbb001)
2014-12-22 03:08:25 -08:00
Tsuyoshi Ozawa 370a137c19 HADOOP-11414. FileBasedIPList#readLines() can leak file descriptors. (ozawa)
(cherry picked from commit ecf1469fa5)
2014-12-22 13:10:46 +09:00
yliu 7e49c99ead HDFS-7557. Fix spacing for a few keys in DFSConfigKeys.java (Colin P. McCabe) 2014-12-22 00:57:18 +08:00
Haohui Mai e6662ec6a4 HADOOP-11429. Findbugs warnings in hadoop extras. Contributed by Varun Saxena. 2014-12-21 14:57:41 -08:00
Haohui Mai db2984b044 HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. Contributed by Haohui Mai. 2014-12-21 14:50:42 -08:00
Tsuyoshi Ozawa d5d13bbe0f CHANGES.txt: move YARN-2977 from 2.6.1 to 2.7.0 2014-12-21 12:53:25 +09:00
Karthik Kambatla 2abec14ec6 YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha)
(cherry picked from commit 24ee9e3431)
2014-12-20 12:20:29 -08:00
Tsuyoshi Ozawa 7b6a0badc2 CHANGES.txt: add YARN-2977 2014-12-20 22:57:58 +09:00
Tsuyoshi Ozawa 31753da961 YARN-2977. Fixed intermittent TestNMClient failure. (Contributed by Junping Du) 2014-12-20 22:43:47 +09:00
arp 0a5b28605f HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Contributed by Chris Nauroth) 2014-12-19 18:54:35 -08:00
Jian He 9180d11b3b YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks
(cherry picked from commit 808cba3821)
2014-12-19 16:56:55 -08:00
Karthik Kambatla b4e8ae591d YARN-2675. containersKilled metrics is not updated when the container is killed during localization. (Zhihai Xu via kasha)
(cherry picked from commit 954fb8581e)
2014-12-19 16:03:02 -08:00
Robert Kanter f9341c1e2c MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)
(cherry picked from commit 390a7c12f5)
2014-12-19 15:44:01 -08:00
Karthik Kambatla 8ee40a1580 YARN-2738. [YARN-2574] Add FairReservationSystem for FairScheduler. (Anubhav Dhoot via kasha)
(cherry picked from commit a22ffc3188)
2014-12-19 15:38:27 -08:00
Karthik Kambatla e6c73a1c1a HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha)
(cherry picked from commit 6f1e3667cf)
2014-12-19 15:07:39 -08:00
Colin Patrick Mccabe bcaf15e2fa HDFS-7443. Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume (cmccabe)
(cherry picked from commit 8fa265a290)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataStorage.java
2014-12-19 13:19:52 -08:00
Colin Patrick Mccabe c60e3bdc4b HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe)
(cherry picked from commit e369d98ba2)
2014-12-19 13:12:20 -08:00
Robert Kanter 22b38cf29a MAPREDUCE-6045. need close the DataInputStream after open it in TestMapReduce.java (zxu via rkanter)
(cherry picked from commit d9e4d67d18)
2014-12-19 12:00:00 -08:00
Colin Patrick Mccabe 22f72c7946 HDFS-7552. Change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration (Liang Xie via Colin P. McCabe)
(cherry picked from commit a4876c130f)
2014-12-19 11:20:43 -08:00
Colin Patrick Mccabe fe38ed2ee7 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe)
(cherry picked from commit 6635ccd217)
2014-12-18 19:41:59 -08:00
Haohui Mai 99c176ea6a HADOOP-11431. Clean up redundant maven-site-plugin configuration. Contributed by Herve Boutemy. 2014-12-18 16:24:17 -08:00
Jason Lowe 173664d70f YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by Jian He
(cherry picked from commit 0402bada19)
2014-12-18 23:31:11 +00:00
cnauroth 947475c127 HDFS-7431. log message for InvalidMagicNumberException may be incorrect. Contributed by Yi Liu.
(cherry picked from commit 5df7ecb33a)
2014-12-18 15:06:00 -08:00
Andrew Wang 8d98d87745 HDFS-7530. Allow renaming of encryption zone roots. Contributed by Charles Lamb.
(cherry picked from commit b0b9084433)
2014-12-18 14:18:14 -08:00
Haohui Mai 27ef6e4a6e HADOOP-11428. Remove obsolete reference to Cygwin in BUILDING.txt. Contributed by Arpit Agarwal. 2014-12-18 13:38:15 -08:00
Jason Lowe 84ea92879c HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov
(cherry picked from commit b9d49761f7)
2014-12-18 21:28:57 +00:00
Haohui Mai a508001ddd HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:39:17 -08:00
Haohui Mai b1703c5c8f HDFS-7543. Avoid path resolution when getting FileStatus for audit logs. Contributed by Haohui Mai. 2014-12-18 11:25:03 -08:00
Colin Patrick Mccabe 2743b94c27 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe)
(cherry picked from commit 07619aa516)
2014-12-18 11:05:33 -08:00
Kihwal Lee 8bffaa46fc HDFS-7373. Clean up temporary files after fsimage transfer failures. Contributed by Kihwal Lee
(cherry picked from commit c0d666c74e)
2014-12-18 13:00:18 -06:00
Haohui Mai 8854c78015 HADOOP-11125. Remove redundant tests in TestOsSecureRandom. Contributed by Masanori Oyama. 2014-12-18 10:59:48 -08:00
Junping Du cec9300201 YARN-2949. Add documentation for CGroups. (Contributed by Varun Vasudev)
(cherry picked from commit 389f881d42)
2014-12-18 06:26:53 -08:00
yliu 2d1ddbe58e HADOOP-11358. Tests for encryption/decryption with IV calculation overflow. (yliu) 2014-12-18 00:43:31 +08:00
Junping Du 11e4ec52a1 YARN-2972. DelegationTokenRenewer thread pool never expands. Contributed by Jason Lowe
(cherry picked from commit 2b4b0e8847)
2014-12-17 17:41:21 -08:00
Colin Patrick Mccabe dda1fc169d HDFS-7531. Improve the concurrent access on FsVolumeList (Lei Xu via Colin P. McCabe)
(cherry picked from commit 3b173d9517)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2014-12-17 16:43:33 -08:00
Karthik Kambatla d0d42c4e32 YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)
(cherry picked from commit b7f64823e1)
2014-12-17 16:34:33 -08:00
Karthik Kambatla 375a1e5971 YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance. (Chris Trezzo via kasha)
(cherry picked from commit a1bd140964)
2014-12-17 16:25:02 -08:00
Karthik Kambatla 2d832ad2eb YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read locks. (Tsuyoshi Ozawa via kasha)
(cherry picked from commit f2d150ea12)
2014-12-17 16:24:17 -08:00
Colin Patrick Mccabe 883ad3bf5a HADOOP-11421. Add IOUtils#listDirectory (cmccabe)
(cherry picked from commit 9937eef7f7)
2014-12-17 15:18:35 -08:00
Haohui Mai c28449d4b5 HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstack. Contributed by Li Lu.
(cherry picked from commit 2e98ad34ce)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:14 -08:00
Steve Loughran e71484be18 HADOOP-11412 POMs mention "The Apache Software License" rather than "Apache License". (Herve Boutemy via stevel)
(cherry picked from commit 07bb0b0bbb)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:13 -08:00
cnauroth 5c32c4b2e4 HADOOP-10809. SyncableDataOutputStream must implement sync method on branch-2. 2014-12-17 14:57:13 -08:00
Aaron T. Myers 66808e6aac HADOOP-10400. Incorporate new S3A FileSystem implementation. Contributed by Jordan Mendelson and Dave Wang.
(cherry picked from commit 24d920b80e)

Conflicts:
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/BasicAWSCredentialsProvider.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AInputStream.java
	hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AOutputStream.java
	hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/contract/s3a/TestS3AContractRename.java
	hadoop-tools/hadoop-aws/src/test/resources/contract/s3a.xml
2014-12-17 14:57:13 -08:00
cnauroth 535d98bbb3 HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics collection. Contributed by Shanyu Zhao.
(cherry picked from commit 734eeb4f35)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:13 -08:00
cnauroth 1646cc9f29 HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson.
(cherry picked from commit f4b7e99f4e)
2014-12-17 14:57:13 -08:00
cnauroth 5a737026cc HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell.
(cherry picked from commit 2217e2f8ff)
2014-12-17 14:57:13 -08:00
Allen Wittenauer 9a2e4f4f98 HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw)
(cherry picked from commit 9f03a7c018)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:13 -08:00
cnauroth 156e78c1da HADOOP-10690. Correct CHANGES.txt. 2014-12-17 14:57:13 -08:00
Chris Nauroth cb6eb5931f HADOOP-10690. Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close(). Contributed by Chen He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604236 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 61bf9f7799)
2014-12-17 14:57:12 -08:00
Chris Nauroth 02a3bf8bda HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611247 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0a02b5a19b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-12-17 14:57:12 -08:00