Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,382 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9382 Commits

Author SHA1 Message Date
Jason Lowe 63b2019ab4 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger 
(cherry picked from commit 4163e36c2b)
 2016-03-07 15:59:45 +00:00
Zhihai Xu 274e182860 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee 
(cherry picked from commit e1ccc9622b)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacityScheduler.java
 2016-03-06 20:46:56 -08:00
Robert Kanter 66e1e92ffd MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter) 
(cherry picked from commit 0f72da7e28)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-03-06 18:34:46 -08:00
Akira Ajisaka 71e89e82e9 HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0a9f00af5e)
(cherry picked from commit 899715a15e)
 2016-03-03 23:33:09 +09:00
Akira Ajisaka 53106a3a4c HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c3136cbd8)
(cherry picked from commit 96a0939d5b)
 2016-03-03 23:23:39 +09:00
Masatake Iwasaki 08fc048018 HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims) 
(cherry picked from commit 33a412e8a4)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 55f7ceb0db)
 2016-03-03 19:00:50 +09:00
Akira Ajisaka 06d9a245fe HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 
(cherry picked from commit eb864d35d6)
(cherry picked from commit 9e87f59dea)
 2016-03-03 18:52:18 +09:00
Akira Ajisaka 8f2d0d4cea HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 2016-03-02 14:45:33 +09:00
Akira Ajisaka 2f3ceb8c65 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
(cherry picked from commit e840141726)
 2016-03-02 14:16:58 +09:00
Kihwal Lee 006ed54a16 HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee. 
(cherry picked from commit e76b13c415)
 2016-03-01 17:02:43 -06:00
Kihwal Lee 9bc9e13a97 HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo. 
(cherry picked from commit b8dbffbef87c0ee0bee5e17649586fc9f0e1f55b)
 2016-03-01 15:01:04 -06:00
Kihwal Lee 9fa300ad1f HDFS-9198. Coalesce IBR processing in the NN. Contributed by Daryn Sharp. 2016-03-01 13:02:05 -06:00
Akira Ajisaka e14ab939bf HDFS-9864. Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 056f9013122dc3f0effc62d620261c312dd7f8ed)
(cherry picked from commit 6a9f8d95b7c4f9c66253d975ebbca1d186267d4e)
 2016-02-29 18:41:57 +09:00
Suresh Srinivas 0481817381 HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418005 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit a5331eeead)
(cherry picked from commit fca24fbbaa)
 2016-02-29 11:36:40 +09:00
Jason Lowe f68e1401b8 YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla 2016-02-26 20:28:29 +00:00
Suresh Srinivas 3bcca662bc HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 0c53ed4cd1)
(cherry picked from commit 7b64e5805747f7be8ad1b8cbcefc7a312350a199)
 2016-02-27 01:26:47 +09:00
Kihwal Lee 25b3531eb4 HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla. 2016-02-26 09:45:52 -06:00
Sangjin Lee 8ceb9f38af YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee) 
(cherry picked from commit 553b591ba0)
 2016-02-24 09:35:23 -08:00
Jason Lowe b406dcaff2 YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma 2016-02-23 20:53:30 +00:00
Varun Vasudev 0edc764184 MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException. Contributed by Junping Du. 
(cherry picked from commit c6f2d761d5)
(cherry picked from commit f1999fe275)

 Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-02-23 14:45:07 +05:30
Vinayakumar B 33b961ee88 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 
Addendum to fix compilation
 2016-02-23 14:39:24 +05:30
Tsz-Wo Nicholas Sze 1b139593c5 HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo 2016-02-22 15:18:46 -08:00
Zhe Zhang 79027309c9 HDFS-9688. Test the effect of nested encryption zones in HDFS downgrade. 
Change-Id: I2a802325a2bc82c97012d2c9fb388b292fe3af8f
 2016-02-22 15:10:31 -08:00
Akira Ajisaka 541dc02a6a YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 5e7d4d51f8)
(cherry picked from commit 34635f9e37)
 2016-02-22 17:18:26 +09:00
Andrew Wang 403934c011 MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 37577852ba)
(cherry picked from commit 7f6737951a)
 2016-02-19 16:37:28 -08:00
Zhe Zhang c420dfeffb HADOOP-12800. Copy docker directory from 2.8 to 2.7/2.6 repos to enable pre-commit Jenkins runs. (zhz) 
Change-Id: I893319c53e497420e2b20511f0d5c0803d8515ba
 2016-02-19 14:34:16 -08:00
Junping Du 78a4c34894 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala. 
(cherry picked from commit 18f9b77a32)
(cherry picked from commit e38c2ef6c5)
 2016-02-19 14:26:53 -08:00
Kihwal Lee 019770c769 HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts. 
(cherry picked from commit ba6d5ed955)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockPlacementPolicyDefault.java
 2016-02-18 14:10:43 -06:00
Sangjin Lee 6475d468f5 YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee) 
(cherry picked from commit 7de70680fe)
 2016-02-17 21:00:23 -08:00
Kihwal Lee a4492dc6ac HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe) 
(cherry picked from commit ec183faadc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-17 09:18:55 -06:00
Vinayakumar B a9c1bb4241 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 
(cherry picked from commit 96ea309431)
(cherry picked from commit 2bf5a005fa)
 2016-02-17 10:16:13 +05:30
Vinayakumar B 05c7821530 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 
(cherry picked from commit 4b0e59fdc0)
(cherry picked from commit e79a5e4460)
 2016-02-16 17:33:11 +05:30
Akira Ajisaka 8377683b63 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 
(cherry picked from commit 8ed07bd3e6)
(cherry picked from commit 8dec72bfd7)
 2016-02-15 19:10:03 +09:00
Akira Ajisaka 893911e57c HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 
(cherry picked from commit 1c48e50ce7)
(cherry picked from commit a670165bbd)
 2016-02-15 11:39:24 +09:00
Jian He a291b342d8 YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran 2016-02-14 17:25:10 +08:00
Junping Du 63069389ee Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48)
(cherry picked from commit a28be9edc7)
 2016-02-13 01:50:30 -08:00
Masatake Iwasaki a2f3ab9f4e HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims) 
(cherry picked from commit 36ba5cac37)
 2016-02-13 15:02:59 +09:00
Jason Lowe 81f8927050 YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi 
(cherry picked from commit b2e6cf607f)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/webapp/AppBlock.java
 2016-02-12 18:59:51 +00:00
Kihwal Lee a30043ca26 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla. 
(cherry picked from commit a7fce9ab41)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-11 08:15:35 -06:00
Jason Lowe 4737d46861 HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger 
(cherry picked from commit 6f03959e4d)

Conflicts:

	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUserGroupInformation.java
 2016-02-10 22:02:32 +00:00
Jason Lowe 717b1a1f99 MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu. 
(cherry picked from commit e3ace31e2b)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2016-02-10 16:58:57 +00:00
Jason Lowe 9d574368b5 MAPREDUCE-6191. Improve clearing stale state of Java serialization 
testcase.  (Sam Liu via Eric Yang)
(cherry picked from commit c379e102dd)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
(cherry picked from commit 303c650d0d)
 2016-02-10 16:48:06 +00:00
Akira Ajisaka 948dd27960 HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. (Contributed by Walter Su) 2016-02-10 03:52:42 +09:00
Akira Ajisaka 2a46d9c6c4 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 
(cherry picked from commit 60d2011b7c)
(cherry picked from commit cb53dfcc95)
 2016-02-10 03:33:31 +09:00
Jason Lowe f264939c47 YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu 
(cherry picked from commit 333f9a896d)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2016-02-09 16:51:36 +00:00
Jason Lowe 6257ed8431 MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu 
(cherry picked from commit aa5b15b03b)

Conflicts:

	hadoop-mapreduce-project/CHANGES.txt
 2016-02-09 16:33:07 +00:00
Zhe Zhang ef05096f95 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
(cherry picked from commit ef3f3f6bb1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-09 10:42:21 +08:00
Sangjin Lee 20e013cac8 HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 
(cherry picked from commit 58acbf940a)
 2016-02-08 14:00:19 -08:00
Kihwal Lee dfea9c711d HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla. 
(cherry picked from commit 49e176c29f)
 2016-02-05 15:50:42 -06:00
Haohui Mai cb3aa41f53 HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 11:36:12 -08:00