Commit Graph

1510 Commits

Author SHA1 Message Date
Eric Yang 9b6671dc29 HADOOP-7704. Reduce number of object created by JMXJsonServlet.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179287 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:09:27 +00:00
Eric Yang c90d7d649b HADOOP-7703. Improved excpetion handling of shutting down web server.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:06:05 +00:00
Vinod Kumar Vavilapalli 9a4e890f4a MAPREDUCE-2738. Added the missing cluster level statisticss on the RM web UI. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179229 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 14:01:32 +00:00
Vinod Kumar Vavilapalli f29bfa0e0e MAPREDUCE-2702. Added a new API in OutputCommitter for recovering the outputs of tasks from a crashed job so as to support MR Application Master recovery. Contributed by Sharad Agarwal and Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 12:15:44 +00:00
Vinod Kumar Vavilapalli f24dcb3449 MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179178 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:56:54 +00:00
Vinod Kumar Vavilapalli 66137cf17c MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179174 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:43:05 +00:00
Tsz-wo Sze 1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:29:05 +00:00
Amar Kamat 45e6fb00af MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. (Ravi Gummadi via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179090 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 08:03:49 +00:00
Konstantin Shvachko ff9d7de705 Move MAPREDUCE-2531 changes to Release 0.22 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 07:39:35 +00:00
Eric Yang a3df6dd38f HADOOP-7720. Added parameter for HBase user to setup config script.
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179025 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 00:37:24 +00:00
Eric Yang 4d81e96398 HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy
user to setup config script. (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179001 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 22:52:14 +00:00
Eric Yang 496b4b976c HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178969 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:48:06 +00:00
Eric Yang cf4fade514 HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178965 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:44:00 +00:00
Eric Yang b7c2431f28 HADOOP-7710. Added hadoop-setup-application.sh for creating
application directory (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178876 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 17:47:21 +00:00
Eric Yang c9aed1f1a7 HADOOP-7681. Fixed security and hdfs audit log4j properties
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178863 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:48:46 +00:00
Eric Yang 266cb1da57 HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178853 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:30:13 +00:00
Vinod Kumar Vavilapalli e979a3ddb1 MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178740 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 09:37:56 +00:00
Eric Yang 97a60315b1 HADOOP-7685. Improved directory ownership check function in
hadoop-setup-conf.sh. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178671 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:58:32 +00:00
Eric Yang 5c4ed07c76 HADOOP-7715. Removed unnecessary security logger configuration. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178662 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:14:19 +00:00
Eric Yang a48e6f2519 MAPREDUCE-3112. Fixed recursive sourcing of HADOOP_OPTS environment
variable. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178657 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:51:13 +00:00
Eric Yang 3edf3579c8 HADOOP-7684. Added init.d script for jobhistory server and
secondary namenode. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178653 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:44:08 +00:00
Arun Murthy 4f97e37648 MAPREDUCE-3138. Add a utility to help applications bridge changes in Context Objects APIs due to MAPREDUCE-954. Contributed by omalley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178650 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:42:37 +00:00
Eric Yang 62682a12e5 HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
(Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178646 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:31:07 +00:00
Eric Yang abc2b45dfa HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178644 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:13:58 +00:00
Sanjay Radia 2d45bfdffd HADOOP-7716 RPC protocol registration on SS does not log the protocol name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178639 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:39:25 +00:00
Eric Yang de03173761 HADOOP-7691. Fixed conflict uid for install packages. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178638 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:36:19 +00:00
Arun Murthy 12743d2169 MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178631 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:21:20 +00:00
Todd Lipcon 93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073.
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 22:05:42 +00:00
Arun Murthy 43b59b894b MAPREDUCE-3134. Added documentation the CapacityScheduler.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178530 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 19:35:41 +00:00
Vinod Kumar Vavilapalli 4ee39ffe6a HADOOP-7542. Reverting the patch to address issues.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178308 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 06:45:10 +00:00
Arun Murthy 7aa8a3c9f8 MAPREDUCE-2889. Added documentation for writing new YARN applications. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177920 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 05:22:50 +00:00
Tsz-wo Sze dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 04:49:00 +00:00
Arun Murthy f3b98a26c4 MAPREDUCE-3113. Ensure bin/yarn and bin/yarn-daemon.sh identify the root of the install properly. Contributed by Xie Xianshan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177874 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 23:58:58 +00:00
Arun Murthy fad230a49d MAPREDUCE-2719. Add a simple, DistributedShell, application to illustrate alternate frameworks on YARN. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177864 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:25:32 +00:00
Arun Murthy dcf9d475e0 MAPREDUCE-3050. Add ability to get resource usage information for applications and nodes. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177859 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:19:17 +00:00
Konstantin Shvachko 960d7643fb MAPREDUCE-2779. JobSplitWriter.java can't handle large job.split file. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177779 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 19:04:56 +00:00
Doug Cutting f48280ac56 HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177757 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 18:01:27 +00:00
Steve Loughran 32431d25ae HADOOP-7469 backporting to 0.23; moving in CHANGES.TXT
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177672 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 14:14:36 +00:00
Steve Loughran ebdc7f800a HADOOP-7469 Add a standard handler for socket connection problems
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177645 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 13:22:05 +00:00
Vinod Kumar Vavilapalli 063e33a862 MAPREDUCE-3098. Fixed RM and MR AM to report YarnApplicationState and application's FinalStatus separately. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177633 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 12:46:32 +00:00
Arun Murthy 964d4a1666 MAPREDUCE-2996. Add uber-ness information to JobHistory. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177531 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 06:47:53 +00:00
Arun Murthy 0b3c654d83 MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177487 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 03:08:35 +00:00
Jitendra Nath Pandey 1ae5b5e338 HDFS-2158. Add JournalSet to manage the set of journals.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177473 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 01:14:37 +00:00
Doug Cutting 7d1897d78d HADOOP-7693. Moving to 0.24 section for now.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177408 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 19:39:31 +00:00
Doug Cutting 47c8528bfa HADOOP-7693. Enhance AvroRpcEngine to support the new #addProtocol introduced in HADOOP-724.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177399 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 19:03:10 +00:00
Vinod Kumar Vavilapalli 71886657f8 MAPREDUCE-3001. Added task-specific counters to AppMaster and JobHistory web-UIs. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177203 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 08:08:49 +00:00
Vinod Kumar Vavilapalli 44090734c9 MAPREDUCE-3114. Fixed invalid ApplicationURL on RM WebUI. Contributed by Subroto Sanyal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177187 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 07:28:29 +00:00
Suresh Srinivas e90a5b4043 HDFS-2371. Refactor BlockSender.java for better readability. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177161 13f79535-47bb-0310-9956-ffa450edef68
2011-09-29 04:40:15 +00:00
Suresh Srinivas e9dd78d9fe HDFS-2355. Federation: enable using the same configuration file across all the nodes in the cluster. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177100 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 22:58:10 +00:00
Steve Loughran c5179b16ec HADOOP-6220
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177051 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 20:37:37 +00:00