From a5d7b6ef6fbfed9630c948df8ddf70cd259ad105 Mon Sep 17 00:00:00 2001 From: Suresh Srinivas Date: Sat, 25 May 2013 15:15:50 +0000 Subject: [PATCH] HADOOP-8562. Moved related jiras to 2.0.5 section in CHANGES.txt git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1486336 13f79535-47bb-0310-9956-ffa450edef68 --- hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt | 154 ++++++++++---------- hadoop-yarn-project/CHANGES.txt | 118 ++++++++------- 2 files changed, 134 insertions(+), 138 deletions(-) diff --git a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt index 61972a3d5f8..532731e7507 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt +++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt @@ -21,10 +21,6 @@ Trunk (Unreleased) HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. (Junping Du via szetszwo) - HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows - Azure environments. (See breakdown of tasks below for subtasks and - contributors) - HDFS-4659 Support setting execution bit for regular files (Brandon Li via sanjay) IMPROVEMENTS @@ -260,10 +256,6 @@ Trunk (Unreleased) HDFS-4586. TestDataDirs.testGetDataDirsFromURIs fails with all directories in dfs.datanode.data.dir are invalid. (Ivan Mitic via atm) - HDFS-4732. Fix TestDFSUpgradeFromImage which fails on Windows due to - failure to unpack old image tarball that contains hard links. - (Chris Nauroth via szetszwo) - HDFS-4757. Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota. (Jing Zhao via szetszwo) @@ -273,70 +265,6 @@ Trunk (Unreleased) HDFS-4687. TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7. (Andrew Wang via atm) - BREAKDOWN OF HADOOP-8562 and HDFS-3602 SUBTASKS AND RELATED JIRAS - - HDFS-4145. Merge hdfs cmd line scripts from branch-1-win. (David Lao, - Bikas Saha, Lauren Yang, Chuan Liu, Thejas M Nair and Ivan Mitic via suresh) - - HDFS-4163. HDFS distribution build fails on Windows. (Chris Nauroth via - suresh) - - HDFS-4316. branch-trunk-win contains test code accidentally added during - work on fixing tests on Windows. (Chris Nauroth via suresh) - - HDFS-4297. Fix issues related to datanode concurrent reading and writing on - Windows. (Arpit Agarwal, Chuan Liu via suresh) - - HDFS-4573. Fix TestINodeFile on Windows. (Arpit Agarwal via suresh) - - HDFS-4572. Fix TestJournal failures on Windows. (Arpit Agarwal via suresh) - - HDFS-4287. HTTPFS tests fail on Windows. (Chris Nauroth via suresh) - - HDFS-4593. TestSaveNamespace fails on Windows. (Arpit Agarwal via suresh) - - HDFS-4582. TestHostsFiles fails on Windows. (Ivan Mitic via suresh) - - HDFS-4603. TestMiniDFSCluster fails on Windows. (Ivan Mitic via suresh) - - HDFS-4604. TestJournalNode fails on Windows. (Ivan Mitic via suresh) - - HDFS-4625. Make TestNNWithQJM#testNewNamenodeTakesOverWriter work on - Windows. (Ivan Mitic via suresh) - - HDFS-4674. TestBPOfferService fails on Windows due to failure parsing - datanode data directory as URI. (Chris Nauroth via suresh) - - HDFS-4725. Fix HDFS file handle leaks in FSEditLog, NameNode, - OfflineEditsBinaryLoader and some tests. (Chris Nauroth via szetszwo) - - HDFS-4615. Fix TestDFSShell failures on Windows. (Arpit Agarwal - via szetszwo) - - HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows. - (Arpit Agarwal via szetszwo) - - HDFS-4741. TestStorageRestore#testStorageRestoreFailure fails on Windows. - (Arpit Agarwal via suresh) - - HDFS-4743. TestNNStorageRetentionManager fails on Windows. - (Chris Nauroth via suresh) - - HDFS-4740. Fixes for a few test failures on Windows. - (Arpit Agarwal via suresh) - - HDFS-4722. TestGetConf#testFederation times out on Windows. - (Ivan Mitic via suresh) - - HDFS-4705. Address HDFS test failures on Windows because of invalid - dfs.namenode.name.dir. (Ivan Mitic via suresh) - - HDFS-4734. HDFS Tests that use ShellCommandFencer are broken on Windows. - (Arpit Agarwal via suresh) - - HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable and - FileUtil#canRead/Write/Execute. (Ivan Mitic via suresh) - BREAKDOWN OF HDFS-2802 HDFS SNAPSHOT SUBTASKS HDFS-4076. Support snapshot of single files. (szetszwo) @@ -680,11 +608,11 @@ Release 2.0.5-beta - UNRELEASED INCOMPATIBLE CHANGES - HDFS-4434. Provide a mapping from INodeId to INode. (suresh) - HDFS-4305. Add a configurable limit on number of blocks per file, and min block size. (Andrew Wang via atm) + HDFS-4434. Provide a mapping from INodeId to INode. (suresh) + NEW FEATURES HDFS-1804. Add a new block-volume device choosing policy that looks at @@ -709,6 +637,10 @@ Release 2.0.5-beta - UNRELEASED HDFS-347. DFS read performance suboptimal when client co-located on nodes with data. (Colin Patrick McCabe via todd and atm) + HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows + Azure environments. (See breakdown of tasks below for subtasks and + contributors) + IMPROVEMENTS HDFS-4222. NN is unresponsive and loses heartbeats from DNs when @@ -861,9 +793,6 @@ Release 2.0.5-beta - UNRELEASED HDFS-4620. Documentation for dfs.namenode.rpc-address specifies wrong format. (Sandy Ryza via atm) - HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific - line separator; otherwise, it fails on Windows. (Ivan Mitic via szetszwo) - HDFS-4609. TestAuditLogs should release log handles between tests. (Ivan Mitic via szetszwo) @@ -956,6 +885,9 @@ Release 2.0.5-beta - UNRELEASED HDFS-4298. StorageRetentionManager spews warnings when used with QJM. (atm) + HDFS-4725. Fix HDFS file handle leaks in FSEditLog, NameNode, + OfflineEditsBinaryLoader and some tests. (Chris Nauroth via szetszwo) + BREAKDOWN OF HDFS-347 SUBTASKS AND RELATED JIRAS HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. @@ -1015,6 +947,74 @@ Release 2.0.5-beta - UNRELEASED HDFS-4661. A few little code cleanups of some HDFS-347-related code. (Colin Patrick McCabe via atm) + BREAKDOWN OF HADOOP-8562 and HDFS-3602 SUBTASKS AND RELATED JIRAS + + HDFS-4145. Merge hdfs cmd line scripts from branch-1-win. (David Lao, + Bikas Saha, Lauren Yang, Chuan Liu, Thejas M Nair and Ivan Mitic via suresh) + + HDFS-4163. HDFS distribution build fails on Windows. (Chris Nauroth via + suresh) + + HDFS-4316. branch-trunk-win contains test code accidentally added during + work on fixing tests on Windows. (Chris Nauroth via suresh) + + HDFS-4297. Fix issues related to datanode concurrent reading and writing on + Windows. (Arpit Agarwal, Chuan Liu via suresh) + + HDFS-4573. Fix TestINodeFile on Windows. (Arpit Agarwal via suresh) + + HDFS-4572. Fix TestJournal failures on Windows. (Arpit Agarwal via suresh) + + HDFS-4287. HTTPFS tests fail on Windows. (Chris Nauroth via suresh) + + HDFS-4593. TestSaveNamespace fails on Windows. (Arpit Agarwal via suresh) + + HDFS-4582. TestHostsFiles fails on Windows. (Ivan Mitic via suresh) + + HDFS-4603. TestMiniDFSCluster fails on Windows. (Ivan Mitic via suresh) + + HDFS-4604. TestJournalNode fails on Windows. (Ivan Mitic via suresh) + + HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific + line separator; otherwise, it fails on Windows. (Ivan Mitic via szetszwo) + + HDFS-4625. Make TestNNWithQJM#testNewNamenodeTakesOverWriter work on + Windows. (Ivan Mitic via suresh) + + HDFS-4674. TestBPOfferService fails on Windows due to failure parsing + datanode data directory as URI. (Chris Nauroth via suresh) + + HDFS-4615. Fix TestDFSShell failures on Windows. (Arpit Agarwal + via szetszwo) + + HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows. + (Arpit Agarwal via szetszwo) + + HDFS-4732. Fix TestDFSUpgradeFromImage which fails on Windows due to + failure to unpack old image tarball that contains hard links. + (Chris Nauroth via szetszwo) + + HDFS-4741. TestStorageRestore#testStorageRestoreFailure fails on Windows. + (Arpit Agarwal via suresh) + + HDFS-4743. TestNNStorageRetentionManager fails on Windows. + (Chris Nauroth via suresh) + + HDFS-4740. Fixes for a few test failures on Windows. + (Arpit Agarwal via suresh) + + HDFS-4722. TestGetConf#testFederation times out on Windows. + (Ivan Mitic via suresh) + + HDFS-4705. Address HDFS test failures on Windows because of invalid + dfs.namenode.name.dir. (Ivan Mitic via suresh) + + HDFS-4734. HDFS Tests that use ShellCommandFencer are broken on Windows. + (Arpit Agarwal via suresh) + + HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable and + FileUtil#canRead/Write/Execute. (Ivan Mitic via suresh) + Release 2.0.4-alpha - 2013-04-25 INCOMPATIBLE CHANGES diff --git a/hadoop-yarn-project/CHANGES.txt b/hadoop-yarn-project/CHANGES.txt index b2cdc792e8a..aa18395ed33 100644 --- a/hadoop-yarn-project/CHANGES.txt +++ b/hadoop-yarn-project/CHANGES.txt @@ -6,10 +6,6 @@ Trunk - Unreleased NEW FEATURES - HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows - Azure environments. (See breakdown of tasks below for subtasks and - contributors) - IMPROVEMENTS YARN-84. Use Builder to build RPC server. (Brandon Li via suresh) @@ -18,66 +14,12 @@ Trunk - Unreleased BUG FIXES - YARN-488. TestContainerManagerSecurity fails on Windows. (Chris Nauroth - via hitesh) - - YARN-490. TestDistributedShell fails on Windows. (Chris Nauroth via hitesh) - - YARN-491. TestContainerLogsPage fails on Windows. (Chris Nauroth via hitesh) - - YARN-557. Fix TestUnmanagedAMLauncher failure on Windows. (Chris Nauroth via - vinodkv) - YARN-524 TestYarnVersionInfo failing if generated properties doesn't include an SVN URL. (stevel) - YARN-487. Modify path manipulation in LocalDirsHandlerService to let - TestDiskFailures pass on Windows. (Chris Nauroth via vinodkv) - - YARN-493. Fixed some shell related flaws in YARN on Windows. (Chris Nauroth - via vinodkv) - - YARN-593. container launch on Windows does not correctly populate - classpath with new process's environment variables and localized resources - (Chris Nauroth via bikas) - YARN-597. TestFSDownload fails on Windows due to dependencies on tar/gzip/jar tools. (Ivan Mitic via acmurthy) - BREAKDOWN OF HADOOP-8562 SUBTASKS AND RELATED JIRAS - - YARN-158. Yarn creating package-info.java must not depend on sh. - (Chris Nauroth via suresh) - - YARN-176. Some YARN tests fail to find winutils. (Chris Nauroth via suresh) - - YARN-207. YARN distribution build fails on Windows. (Chris Nauroth via - suresh) - - YARN-199. Yarn cmd line scripts for windows. (Ivan Mitic via suresh) - - YARN-213. YARN build script would be more readable using abspath. - (Chris Nauroth via suresh) - - YARN-233. Added support for running containers in MS Windows to YARN. (Chris - Nauroth via acmurthy) - - YARN-234. Added support for process tree and resource calculator in MS Windows - to YARN. (Chris Nauroth via acmurthy) - - YARN-259. Fix LocalDirsHandlerService to use Path rather than URIs. (Xuan - Gong via acmurthy) - - YARN-316. YARN container launch may exceed maximum Windows command line - length due to long classpath. (Chris Nauroth via suresh) - - YARN-359. Fixing commands for container signalling in Windows. (Chris Nauroth - via vinodkv) - - YARN-506. Move to common utils FileUtil#setReadable/Writable/Executable and - FileUtil#canRead/Write/Execute. (Ivan Mitic via suresh) - - Release 2.0.5-beta - UNRELEASED INCOMPATIBLE CHANGES @@ -141,6 +83,10 @@ Release 2.0.5-beta - UNRELEASED YARN-563. Add the concept of an application-type for each application. (Mayank Bansal via vinodkv) + HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows + Azure environments. (See breakdown of tasks below for subtasks and + contributors) + IMPROVEMENTS YARN-365. Change NM heartbeat handling to not generate a scheduler event @@ -312,12 +258,12 @@ Release 2.0.5-beta - UNRELEASED YARN-498. Unmanaged AM launcher does not set various constants in env for an AM, also does not handle failed AMs properly. (Hitesh Shah via bikas) - YARN-474. Fix CapacityScheduler to trigger application-activation when - am-resource-percent configuration is refreshed. (Zhijie Shen via vinodkv) - YARN-496. Fair scheduler configs are refreshed inconsistently in reinitialize. (Sandy Ryza via tomwhite) + YARN-474. Fix CapacityScheduler to trigger application-activation when + am-resource-percent configuration is refreshed. (Zhijie Shen via vinodkv) + YARN-209. Fix CapacityScheduler to trigger application-activation when the cluster capacity changes. (Zhijie Shen via vinodkv) @@ -416,6 +362,56 @@ Release 2.0.5-beta - UNRELEASED YARN-715. Fixed unit test failures - TestDistributedShell and TestUnmanagedAMLauncher. (Vinod Kumar Vavilapalli via sseth) + BREAKDOWN OF HADOOP-8562 SUBTASKS AND RELATED JIRAS + + YARN-158. Yarn creating package-info.java must not depend on sh. + (Chris Nauroth via suresh) + + YARN-176. Some YARN tests fail to find winutils. (Chris Nauroth via suresh) + + YARN-207. YARN distribution build fails on Windows. (Chris Nauroth via + suresh) + + YARN-199. Yarn cmd line scripts for windows. (Ivan Mitic via suresh) + + YARN-213. YARN build script would be more readable using abspath. + (Chris Nauroth via suresh) + + YARN-233. Added support for running containers in MS Windows to YARN. (Chris + Nauroth via acmurthy) + + YARN-234. Added support for process tree and resource calculator in MS Windows + to YARN. (Chris Nauroth via acmurthy) + + YARN-259. Fix LocalDirsHandlerService to use Path rather than URIs. (Xuan + Gong via acmurthy) + + YARN-316. YARN container launch may exceed maximum Windows command line + length due to long classpath. (Chris Nauroth via suresh) + + YARN-359. Fixing commands for container signalling in Windows. (Chris Nauroth + via vinodkv) + + YARN-506. Move to common utils FileUtil#setReadable/Writable/Executable and + FileUtil#canRead/Write/Execute. (Ivan Mitic via suresh) + + YARN-488. TestContainerManagerSecurity fails on Windows. (Chris Nauroth + via hitesh) + + YARN-490. TestDistributedShell fails on Windows. (Chris Nauroth via hitesh) + + YARN-491. TestContainerLogsPage fails on Windows. (Chris Nauroth via hitesh) + + YARN-487. Modify path manipulation in LocalDirsHandlerService to let + TestDiskFailures pass on Windows. (Chris Nauroth via vinodkv) + + YARN-593. container launch on Windows does not correctly populate + classpath with new process's environment variables and localized resources + (Chris Nauroth via bikas) + + YARN-493. Fixed some shell related flaws in YARN on Windows. (Chris Nauroth + via vinodkv) + Release 2.0.4-alpha - 2013-04-25 INCOMPATIBLE CHANGES