Commit Graph

65 Commits

Author SHA1 Message Date
Thomas Graves 01b2040810 MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351762 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 16:17:21 +00:00
Uma Maheswara Rao G f9c938666b HDFS-3389. Document the BKJM usage in Namenode HA. Contributed by Uma Maheswara Rao G and Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349466 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 18:19:46 +00:00
Thomas Graves 358eda0bfa MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346047 13f79535-47bb-0310-9956-ffa450edef68
2012-06-04 17:41:52 +00:00
Robert Joseph Evans 800cfd5c1c HADOOP-8460. Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345304 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 18:18:16 +00:00
Harsh J 1fab229f30 HADOOP-8268. A few pom.xml across Hadoop project may fail XML validation. Contributed by Radim Kolar. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343272 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 14:51:05 +00:00
Todd Lipcon 6c544adeb3 Merge HDFS-3042 (automatic failover) to trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:56:20 +00:00
Eli Collins 260dfa367e HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 21:13:17 +00:00
Todd Lipcon f6c01e2f8e Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 02:14:01 +00:00
Todd Lipcon 9d5799553f HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 01:56:33 +00:00
Robert Joseph Evans 1eb1d0ae4f MAPREDUCE-3812. Lower default allocation sizes, fix allocation configurations and document them (Harsh J via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329282 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 15:26:35 +00:00
Todd Lipcon 2ed825e66c HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325539 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:53:42 +00:00
Todd Lipcon 1b93f8e5c3 MAPREDUCE-4103. Fix HA docs for changes to shell command fencer args. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309533 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 18:46:22 +00:00
Thomas Graves 1f4197984c MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309133 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 20:39:08 +00:00
Robert Joseph Evans 20184e7ddc MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309077 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 18:01:43 +00:00
Robert Joseph Evans 01ce7ba3a4 MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 21:06:16 +00:00
Arun Murthy 67a74198b1 Changed version in trunk to 3.0.0-SNAPSHOT.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 07:37:06 +00:00
Siddharth Seth 4ce5f6553f MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297672 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:52:00 +00:00
Vinod Kumar Vavilapalli 7c1e857176 MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans.
.--This line, and those below, will be ignored--

M    hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
M    hadoop-mapreduce-project/hadoop-yarn/bin/yarn
M    hadoop-mapreduce-project/CHANGES.txt
M    hadoop-mapreduce-project/bin/mapred


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297174 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 19:03:56 +00:00
Arun Murthy d5f4fcef5c MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296902 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:50:58 +00:00
Todd Lipcon 1ba357553a Merge trunk into HA branch.
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 23:47:49 +00:00
Siddharth Seth 3cbb9d20d0 MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295262 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:48:09 +00:00
Thomas Graves 547ded7bfe MAPREDUCE-3920. Revise yarn default port number selection (Dave Thompson via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295162 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:49:27 +00:00
Robert Joseph Evans ffdf980b20 MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294808 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 20:06:53 +00:00
Aaron Myers 833e96534f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:35:32 +00:00
Todd Lipcon 20816218f0 MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244852 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 05:53:25 +00:00
Todd Lipcon db187cf40e Merge trunk into HA branch.
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
Thomas Graves 0bf146b0dd MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242976 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 23:24:08 +00:00
Todd Lipcon c14bb61a82 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
Tsz-wo Sze 03ee90b9eb HADOOP-7923. Automate the updating of version numbers in the doc system.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242485 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 19:47:11 +00:00
Arun Murthy 4f6839f23d MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241250 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:11:26 +00:00
Aaron Myers db7c013877 HDFS-2733. Document HA configuration and CLI. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241183 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 21:18:11 +00:00
Mahadev Konar af6448e543 MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236371 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:10:50 +00:00
Eli Collins 5dfe62d845 HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
Mahadev Konar 8a1719e999 MAPREDUCE-3549. write api documentation for web service apis for RM, NM, mapreduce app master, and job history server (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234222 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:53:02 +00:00
Jitendra Nath Pandey f717c5785e MAPREDUCE-3664. Federation Documentation has incorrect configuration example. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230708 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 19:11:33 +00:00
Arun Murthy 743a5b78e3 MAPREDUCE-3522. Ensure queues inherit ACLs from parent if they aren't explicitly specified. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225618 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 19:06:34 +00:00
Mahadev Konar 6d551b83de MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215065 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 09:09:28 +00:00
Vinod Kumar Vavilapalli 50fa9b89f4 MAPREDUCE-3398. Fixed log aggregation to work correctly in secure mode. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214429 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 19:55:22 +00:00
Tsz-wo Sze 9b1f47226b HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 09:26:33 +00:00
Mahadev Konar e948247715 MAPREDUCE-3485. DISKS_FAILED -101 error code should be defined in same location as ABORTED_CONTAINER_EXIT_STATUS. (Ravi Gummadi via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210192 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:11:08 +00:00
Alejandro Abdelnur ff9bae6b7d MAREDUCE-3477. Hadoop site documentation cannot be built anymore. (jeagles via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208768 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 20:48:47 +00:00
Mahadev Konar ea17da82f7 MAPREDUCE-3121. NodeManager should handle disk-failures (Ravi Gummadi via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208131 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 23:17:54 +00:00
Tsz-wo Sze d3a51478e3 HDFS-2587. Add apt doc for WebHDFS REST API.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205626 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 22:02:19 +00:00
Mahadev Konar 3491205b0a MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202002 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 02:05:25 +00:00
Mahadev Konar 503593af1e MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201925 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 21:59:56 +00:00
Arun Murthy 1112a50ad3 HADOOP-7789. Improvements to site navigation.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195876 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:53:38 +00:00
Arun Murthy d36f847b87 MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195764 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 02:00:58 +00:00
Arun Murthy b3f90c7060 MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195579 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 17:33:29 +00:00
Vinod Kumar Vavilapalli a75c4cf4e4 MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195383 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 09:55:29 +00:00
Thomas White cd77a1668f HADOOP-7763. Add top-level navigation to APT docs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190703 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 00:16:16 +00:00