Commit Graph

5692 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 3ec30a2941 YARN-934. Updated patch for HistoryWriter to split the write operations into a startOp and a finishOp. Contributed by Zhijie Shen.
YARN-947. Updated patch to have separate data object for startOp and finishOp. Contributed by Zhijie Shen.
YARN-956. Updated patch for In-memory Storage after the above two changes.
svn merge --ignore-ancestry -c 1556726 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562182 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:50:28 +00:00
Vinod Kumar Vavilapalli e4d6b2f485 YARN-1007. Enhance History Reader interface for Containers. Contributed by Mayank Bansal.
svn merge --ignore-ancestry -c 1556723 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562180 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:49:41 +00:00
Vinod Kumar Vavilapalli ddd48ba1cb YARN-956. Missed new files in the previous commit.
svn merge --ignore-ancestry -c 1556722 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562179 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:49:12 +00:00
Vinod Kumar Vavilapalli 5f61991d0d YARN-956. Added a testable in-memory HistoryStorage. Contributed by Mayank Bansal.
svn merge --ignore-ancestry -c 1556721 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562178 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:48:43 +00:00
Vinod Kumar Vavilapalli 538334541f YARN-978. Created ApplicationAttemptReport. Contributed by Mayank Bansal.
svn merge --ignore-ancestry -c 1556720 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562177 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:47:55 +00:00
Vinod Kumar Vavilapalli dc513f1f87 YARN-925. Defined a Reader Interface for HistoryStorage. Contributed by Mayank Bansal.
svn merge --ignore-ancestry -c 1556719 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562176 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:45:58 +00:00
Vinod Kumar Vavilapalli 5682c9c945 YARN-934. Defined a Writer Interface for HistoryStorage. Contributed by Zhijie Shen.
svn merge --ignore-ancestry -c 1556711 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562175 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:45:24 +00:00
Vinod Kumar Vavilapalli 2135ca8623 YARN-984. Renamed the incorrectly named applicationhistoryservice.records.pb.impl package to be applicationhistoryservice.records.impl.pb. Contributed by Devaraj K.
svn merge --ignore-ancestry -c 1556693 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562162 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:18:17 +00:00
Vinod Kumar Vavilapalli 7e2dbda737 YARN-947. Implementing the data objects to be used by the History reader and writer interfaces. Contributed by Zhijie Shen.
svn merge --ignore-ancestry -c 1556692 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562159 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:10:23 +00:00
Vinod Kumar Vavilapalli 752daade51 YARN-962. Fixed bug in application-history proto file and renamed it be just a client proto file. Contributed by Zhijie Shen.
svn merge --ignore-ancestry -c 1556690 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562157 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:08:12 +00:00
Vinod Kumar Vavilapalli 2f75fd953d YARN-935. Correcting pom.xml to build applicationhistoryserver module successfully. Contributed by Zhijie Shen.
svn merge --ignore-ancestry -c 1556686 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562156 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:06:47 +00:00
Vinod Kumar Vavilapalli fe75149953 YARN-930. Bootstrapping ApplicationHistoryService module. Contributed by Vinod Kumar Vavilapalli.
svn merge --ignore-ancestry -c 1556683 ../YARN-321


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1562154 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 19:02:50 +00:00
Sanford Ryza 059262e5a5 YARN-1629. IndexOutOfBoundsException in MaxRunningAppsEnforcer (Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561998 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 08:36:19 +00:00
Karthik Kambatla d225ce1ce2 YARN-1642. RMDTRenewer#getRMClient should use ClientRMProxy (kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561992 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 08:30:19 +00:00
Suresh Srinivas c6095c8ed5 HADOOP-10292. Restore HttpServer from branch-2.2 in branch-2. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561967 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 07:50:54 +00:00
Suresh Srinivas afc40e8a66 HADOOP-10255. Merge 1561959 and 1561961 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561966 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 07:47:37 +00:00
Arpit Agarwal 152f1b17c6 HADOOP-9830. Merging r1561951 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561952 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 06:42:51 +00:00
Arpit Agarwal 17acadd167 HDFS-5833. Merging r1561938 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561939 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 05:12:36 +00:00
Michael Stack a6acbd2403 HADOOP-10274 Lower the logging level from ERROR to WARN for UGI.doAs method (Takeshi Miao via stack)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561935 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 04:58:18 +00:00
Colin McCabe 858308553f HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster. (Yongjun Zhang via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561887 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 22:25:26 +00:00
Todd Lipcon 497eb4b402 HADOOP-10288. Explicit reference to Log4JLogger breaks non-log4j users. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561880 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 22:13:51 +00:00
Aaron Myers 9b4403eba9 HADOOP-10250. VersionUtil returns wrong value when comparing two versions. Contributed by Yongjun Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561861 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 21:39:01 +00:00
Arpit Agarwal d1d74049aa HDFS-5297. Merging r1561849 from trunk to branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561854 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 21:19:16 +00:00
Arpit Agarwal 63d3c13f4d HADOOP-10212. Merging r1561838 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561839 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 20:39:45 +00:00
Arpit Agarwal 0d61ef5acb Merging r1561819 from trunk to branch-2 to fix CHANGES.txt for HADOOP-10086 and HADOOP-9982
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561826 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 20:04:52 +00:00
Arpit Agarwal bca2735ffa HADOOP-9982. Merge r1561813 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561815 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 19:53:26 +00:00
Jing Zhao e03c3cbfd9 HDFS-5781. Merge change r1561788 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561796 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 19:05:04 +00:00
Arpit Agarwal 8b1c7bafab HDFS-5825. Merging r1561792 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561793 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 19:02:40 +00:00
Arpit Agarwal be32b2d1ad HADOOP-10086. Merging r1561776 from trunk to branch-2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561777 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 18:36:07 +00:00
Aaron Myers e079120d58 HADOOP-10203. Connection leak in Jets3tNativeFileSystemStore#retrieveMetadata. Contributed by Andrei Savu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561724 13f79535-47bb-0310-9956-ffa450edef68
2014-01-27 16:22:28 +00:00
Todd Lipcon 6266273c61 HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns. Contributed by Ted Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561389 13f79535-47bb-0310-9956-ffa450edef68
2014-01-25 20:21:58 +00:00
Todd Lipcon 7c7a4463fd HDFS-5719. FSImage#doRollback() should close prevState before return. Contributed by Ted Yu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561388 13f79535-47bb-0310-9956-ffa450edef68
2014-01-25 20:19:28 +00:00
Uma Maheswara Rao G e67105e4ce Merge HDFS-5343. When cat command is issued on snapshot files, getting unexpected result. Contributed by Sathish.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561326 13f79535-47bb-0310-9956-ffa450edef68
2014-01-25 15:52:01 +00:00
Kihwal Lee c32beafe02 svn merge -c 1561223 merging from trunk to branch-2 to fix:HDFS-5728. Block recovery will fail if the metafile does not have crc for all chunks of the block. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561224 13f79535-47bb-0310-9956-ffa450edef68
2014-01-24 22:57:56 +00:00
Jason Darrell Lowe 4fe4190b1d svn merge -c 1561110 FIXES: YARN-1575. Public localizer crashes with "Localized unkown resource". Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561112 13f79535-47bb-0310-9956-ffa450edef68
2014-01-24 18:59:54 +00:00
Jason Darrell Lowe a3286bdd51 svn merge -c 1561038 FIXES: Addendum patch for HADOOP-9652 to fix performance problems. Contributed by Andrew Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1561043 13f79535-47bb-0310-9956-ffa450edef68
2014-01-24 15:49:14 +00:00
Uma Maheswara Rao G ad41e7a1c9 Merge HADOOP-10248. Property name should be included in the exception where property value is null. Contributed by Akira AJISAKA.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560907 13f79535-47bb-0310-9956-ffa450edef68
2014-01-24 06:28:50 +00:00
Konstantin Boudnik f3136cd6b9 HADOOP-10167. Mark hadoop-common source as UTF-8 in Maven pom files / refactoring. Contributed by Mikhail Antonov.
Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560832 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 22:31:27 +00:00
Kihwal Lee 95e3ef2ad4 svn merge -c 1560750 merging from trunk to branch-2 to fix:HDFS-5788. listLocatedStatus response can be very large. Contributed by Nathan Roberts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560778 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 18:13:17 +00:00
Daryn Sharp 7bbd687d4d svn merge -c 1560761 FIXES: HDFS-5241. Provide alternate queuing audit logger to reduce logging contention (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560763 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 17:18:31 +00:00
Uma Maheswara Rao G 96a9a59822 Merge HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560732 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 16:39:18 +00:00
Karthik Kambatla b650f912ad YARN-1573. ZK store should use a private password for root-node-acls. (kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560595 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 06:26:23 +00:00
Karthik Kambatla 139b3a2ac4 MAPREDUCE-5723. MR AM container log can be truncated or empty. (Mohammad Kamrul Islam via kasha)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560593 13f79535-47bb-0310-9956-ffa450edef68
2014-01-23 06:09:21 +00:00
Sanford Ryza b227defc4c YARN-1623. Include queue name in RegisterApplicationMasterResponse (Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560555 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 22:45:33 +00:00
Andrew Wang f7014c473c HDFS-5806. Balancer should set soTimeout to avoid indefinite hangs. Contributed by Nathan Roberts.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560549 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 22:35:13 +00:00
Sanford Ryza 0377619e7d YARN-1607. TestRM relies on the scheduler assigning multiple containers in a single node update (Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560534 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 22:08:37 +00:00
Andrew Wang c4194399d3 Merge HDFS-4949 changes from trunk to branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560522 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 21:43:00 +00:00
Alejandro Abdelnur cab665753a HDFS-5703. Add support for HTTPS and swebhdfs to HttpFS. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560505 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 20:39:53 +00:00
Sanford Ryza 700a81d9ba YARN-1624. QueuePlacementPolicy format is not easily readable via a JAXB parser (Aditya Acharya via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560471 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 18:52:25 +00:00
Aaron Myers 31339d3f5e HADOOP-10252. HttpServer can't start if hostname is not specified. Contributed by Jimmy Xiang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1560451 13f79535-47bb-0310-9956-ffa450edef68
2014-01-22 18:13:22 +00:00