Commit Graph

1659 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 167f920da5 MAPREDUCE-3221. Reneabled the previously ignored test in TestSubmitJob and fixed bugs in it. Contributed by Devaraj K.
svn merge -c r1197080 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1197082 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 12:27:30 +00:00
Vinod Kumar Vavilapalli b793e277aa MAPREDUCE-3297. Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module. Contributed by Siddharth Seth.
svn merge -c r1196986 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196988 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 08:07:16 +00:00
Arun Murthy 46d9ffc886 Merge -c 1196977 from trunk to branch-0.23 to fix MAPREDUCE-3337.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196978 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 07:08:33 +00:00
Todd Lipcon 40d15ba6ff HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196975 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:53:44 +00:00
Arun Murthy 5c5ae9c26d Merge -c 1196971 from trunk to branch-0.23 to fix HADOOP-7797.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196972 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:35:05 +00:00
Arun Murthy b634433da9 HADOOP-7798. Fixed jira number in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196967 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:31:32 +00:00
Arun Murthy 0380896236 Merge -c I've attached the presentation.from trunk to branch-0.23 to fix HADOOP-7789.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196964 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:27:03 +00:00
Todd Lipcon da23550208 Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196905 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:02:36 +00:00
Todd Lipcon de2b8a0a61 HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196901 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:00:17 +00:00
Todd Lipcon 854c1e8794 HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196888 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 00:35:23 +00:00
Jitendra Nath Pandey c21071f5b7 Merged r1196434 and r1196386 from trunk for HADOOP-7792 and HDFS-2416.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196812 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 21:31:38 +00:00
Jakob Homan 5ed437781f MAPREDUCE-3139. Merge from trunk to 0.23.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196783 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 19:57:19 +00:00
Tsz-wo Sze 05a029171c Revert the previous commit 1196436 for HDFS-2416.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196439 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 02:51:16 +00:00
Tsz-wo Sze 56278034c1 svn merge -c 1196434 from trunk for HDFS-2416.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196436 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 02:20:44 +00:00
Arun Murthy 60c70eb6d9 Merge -r 1196410:1196412 from trunk to branch-0.23 to fix HADOOP-7789.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196413 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 00:52:20 +00:00
Mahadev Konar 09f1d226ea MAPREDUCE-3332. contrib/raid compile breaks due to changes in hdfs/protocol/datatransfer/Sender#writeBlock related to checksum handling (Hitesh Shah via mahadev) -Merging r1196356 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196366 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 23:10:34 +00:00
Arun Murthy d0cafa7ad8 Merge -c 1196328 from trunk to branch-0.23 to fix HADOOP-7789.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196330 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 22:22:15 +00:00
Konstantin Shvachko fd4a2a6f05 HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196229 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 19:24:33 +00:00
Eli Collins 256b7b1ca9 HADOOP-7786. svn merge -c 1196129 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196136 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 17:08:02 +00:00
Eli Collins 8e799e112a HDFS-2308. svn merge -c 1196113 from trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1196115 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:45:30 +00:00
Arun Murthy 74cc0b509a Merge -c 1195876 from trunk to branch-0.23 to fix HADOOP-7789.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195878 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:55:10 +00:00
Arun Murthy 6b0d46e6d2 Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195874 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:46:58 +00:00
Matthew Foley 5ad7538226 First draft release notes for 0.23.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195861 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 07:52:57 +00:00
Arun Murthy 5ca041a888 Preparing for release 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195839 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 06:03:37 +00:00
Todd Lipcon 19f40f8604 HADOOP-7785. Add equals, hashcode, toString to DataChecksum. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195831 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:25:06 +00:00
Todd Lipcon f6a4c651a0 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195828 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:16:53 +00:00
Suresh Srinivas 63cb9360f1 Fix HDFS-2552 to HDFS-2522
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195824 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:55:49 +00:00
Suresh Srinivas f5614e424b Disable TestDfsOverAvroRpc in 0.23. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195823 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:55:08 +00:00
Thomas White 92fd345d14 Merge -r 1195816:1195817 from trunk to branch-0.23. Fixes: HADOOP-7782.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195821 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:53:00 +00:00
Mahadev Konar ff4146e5bb MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname. (Ravi Gummadi via mahadev) - Merging r1195814 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195815 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:33:40 +00:00
Mahadev Konar 61e69297d9 MAPREDUCE-3316. Rebooted link is not working properly. (Bhallamudi Venkata Siva Kamesh via mahadev) - Merging r1195805 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195806 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 04:09:13 +00:00
Arun Murthy e6f85573e7 Merge -c 1195792 from trunk to branch-0.23 to fix MAPREDUCE-3237.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195793 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 03:19:48 +00:00
Arun Murthy bac6f1592a Fixing CHANGES.txt to reflect 0.23 content.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195767 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:10:13 +00:00
Arun Murthy 76224deb1a Merge -c 1195764 from trunk to branch-0.23 to fix MAPREDUCE-3322.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195765 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:01:54 +00:00
Mahadev Konar 17795f65ea MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev) - Merging r1195761 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195763 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:54:20 +00:00
Tsz-wo Sze 7e7a610988 svn merge -c 1195760 from trunk for HADOOP-7771.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195762 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:53:51 +00:00
Tsz-wo Sze a15090ac43 svn merge -c 1195754 from trunk for HDFS-2038.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195755 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:32:15 +00:00
Arun Murthy d9c2bf148b Merge -c 1195745 from trunk to branch-0.23 to fix MAPREDUCE-3220.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195746 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:05:04 +00:00
Arun Murthy 85ab392795 Merge -c 1195743 from trunk to branch-0.23 to fix MAPREDUCE-3321.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195744 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:59:13 +00:00
Tsz-wo Sze 802e6a10e8 svn merge -c 1195731 from trunk for HDFS-2065.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195736 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:40:36 +00:00
Todd Lipcon e16dd6212e HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195692 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 21:52:52 +00:00
Tsz-wo Sze 611bb588f8 svn merge -c 1195656 from trunk for HDFS-2385.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195660 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 20:40:13 +00:00
Arun Murthy d6d2ff8206 Merge -c 1195579 from trunk to branch-0.23 to fix MAPREDUCE-3275.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195581 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:34:25 +00:00
Arun Murthy 07c755a394 Merge -c 1195575 from trunk to branch-0.23 to fix MAPREDUCE-3035.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195576 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:29:35 +00:00
Amar Kamat 5b201c3fcb MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195548 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 16:19:05 +00:00
Amar Kamat 29ba7087a6 MAPREDUCE-3166. [Rumen] Make Rumen use job history api instead of relying on current history file name format. (Ravi Gummadi via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195540 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 16:02:00 +00:00
Amar Kamat bef5373b02 MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also. (Ravi Gummadi via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195538 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 15:58:57 +00:00
Vinod Kumar Vavilapalli 539db85f7d MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth.
svn merge -c r1195416 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195417 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 11:30:56 +00:00
Vinod Kumar Vavilapalli cee984b9b3 MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth.
svn merge -c r1195383 --ignore-ancestry ../../trunk/


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195387 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 10:00:55 +00:00
Vinod Kumar Vavilapalli 4b4b1c89cc MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth.
svn merge -c r1195349 --ignore-ancestry ../../trunk


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23@1195353 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 06:48:08 +00:00