Commit Graph

2125 Commits

Author SHA1 Message Date
Tsz-wo Sze 6afe3e0d22 HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197329 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 22:34:47 +00:00
Vinod Kumar Vavilapalli dae055bb70 MAPREDUCE-3215. Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197101 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 13:19:29 +00:00
Vinod Kumar Vavilapalli aa297b188e MAPREDUCE-3221. Reneabled the previously ignored test in TestSubmitJob and fixed bugs in it. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197080 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 12:25:18 +00:00
Vinod Kumar Vavilapalli c27601fefe MAPREDUCE-3297. Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196986 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 08:02:19 +00:00
Arun Murthy 0df4878033 MAPREDUCE-3337. Added missing license headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196977 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 07:06:53 +00:00
Todd Lipcon 40fe96546f HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196976 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:54:59 +00:00
Arun Murthy 5d5e2df9d3 HADOOP-7797. Fix top-level pom.xml to refer to correct staging maven repository. Contributed by Owen O'Malley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196971 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:34:32 +00:00
Arun Murthy c7b1d6f392 HADOOP-7798. Fixed jira number in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196966 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:31:18 +00:00
Arun Murthy 59c0b31d78 HADOOP-7789. Add support gpg signatures for maven release artifacts. Contributed by Doug Cutting.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196957 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:20:46 +00:00
Todd Lipcon fd8c757b9f Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196904 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:02:28 +00:00
Todd Lipcon 11cf658d0a HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196902 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:00:25 +00:00
Todd Lipcon f84552ac35 HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196889 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 00:35:37 +00:00
Jakob Homan 201a18de0c MAPREDUCE-3139. SlivePartitioner generates negative partitions.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196776 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 19:38:31 +00:00
Hairong Kuang a4baabe4a4 HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196676 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 16:31:21 +00:00
Aaron Myers 571d7990f4 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1196458 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 05:34:31 +00:00
Jitendra Nath Pandey bd21ddcb78 HDFS-2416. distcp with a webhdfs uri on a secure cluster fails.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196434 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 02:08:20 +00:00
Arun Murthy 3ad6024a84 HADOOP-7789. Fixed site to include yarn-default.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196412 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:50:59 +00:00
Arun Murthy 073210043d HADOOP-7789. Fixed site to include yarn-default.xml.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196411 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:50:41 +00:00
Suresh Srinivas e161ab0821 Add transient file to svn:ignore in hadoop-mapreduce-project
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196396 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:33:55 +00:00
Jitendra Nath Pandey cd2a553fbd HADOOP-7792. Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196386 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:15:13 +00:00
Mahadev Konar bb35bff29b MAPREDUCE-3332. contrib/raid compile breaks due to changes in hdfs/protocol/datatransfer/Sender#writeBlock related to checksum handling (Hitesh Shah via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196356 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:07:56 +00:00
Arun Murthy eee85adecf HADOOP-7789. Minor edits to add CHANGES.txt and yarn-default.xml to the site.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196328 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 22:21:41 +00:00
Aaron Myers abe45f59ac HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196171 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 17:59:53 +00:00
Eli Collins 1852c2c1da Remove FsConfig as intended in HADOOP-7786.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196143 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 17:08:53 +00:00
Eli Collins 877021eb50 HADOOP-7786. Remove HDFS-specific config keys defined in FsConfig. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196129 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:58:28 +00:00
Eli Collins 4961441584 HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196113 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:44:28 +00:00
Arun Murthy 1112a50ad3 HADOOP-7789. Improvements to site navigation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195876 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:53:38 +00:00
Arun Murthy 4e42044b1c Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:46:22 +00:00
Konstantin Shvachko 22000ce96d HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:37:11 +00:00
Arun Murthy a3a4ccfed7 Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 06:02:53 +00:00
Todd Lipcon a6c110ebd0 HADOOP-7785. Add equals, hashcode, toString to DataChecksum. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195832 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:25:21 +00:00
Todd Lipcon 1c940637b1 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:17:08 +00:00
Thomas White 8e04fa8b84 HADOOP-7782. Aggregate project javadocs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195817 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:47:10 +00:00
Mahadev Konar adf58e70a0 MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname. (Ravi Gummadi via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195814 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:32:03 +00:00
Mahadev Konar 68dfbff8db MAPREDUCE-3316. Rebooted link is not working properly. (Bhallamudi Venkata Siva Kamesh via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195805 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:06:39 +00:00
Arun Murthy cfb6a9883d MAPREDUCE-3237. Move LocalJobRunner to hadoop-mapreduce-client-core. Contributed by Tom White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 03:16:44 +00:00
Arun Murthy e5badc0c1a Fixing CHANGES.txt to reflect 0.23 content.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195766 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:09:51 +00:00
Arun Murthy d36f847b87 MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195764 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:00:58 +00:00
Mahadev Konar 68fa208b1c MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195761 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:51:56 +00:00
Tsz-wo Sze 8f9661da48 HADOOP-7771. FsShell -copyToLocal, -get, etc. commands throw NPE if the destination directory does not exist. Contributed by John George and Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195760 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:50:56 +00:00
Tsz-wo Sze bb8fd6a267 TestHDFSCLI is failing due to HADOOP-7360. HDFS-2038 is going to fix it. Disable it for the moment.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195754 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:31:06 +00:00
Todd Lipcon 3ab295994a HDFS-2523. Small NN fixes to include HAServiceProtocol and prevent NPE on shutdown. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1195753 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:29:59 +00:00
Arun Murthy b451dd7aaa MAPREDUCE-3220. Fixed TestCombineOutputCollector. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195745 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:04:15 +00:00
Arun Murthy 5f7e991659 MAPREDUCE-3321. Disabled a few MR tests for 0.23. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195743 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:57:22 +00:00
Tsz-wo Sze 8d1a09b741 HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:38:57 +00:00
Todd Lipcon c46876982e HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 21:53:58 +00:00
Tsz-wo Sze 32cad9affe HDFS-2385. Support renew and cancel delegation tokens in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 20:37:16 +00:00
Jitendra Nath Pandey 7cb77a3b1b HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 19:03:55 +00:00
Arun Murthy b3f90c7060 MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195579 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:33:29 +00:00
Arun Murthy 9db078212f MAPREDUCE-3035. Fixed MR JobHistory to ensure rack information is present. Contributed by chakravarthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195575 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:27:42 +00:00