558cc8c0bf
MAPREDUCE-3982. Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299047 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:13:42 +00:00
1c534d0f9d
MAPREDUCE-3991. Streaming FAQ has some wrong instructions about input files splitting. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299045 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 21:07:33 +00:00
ad3d3f54d5
MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298978 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 18:53:19 +00:00
4001b95cf2
MAPREDUCE-3578. Starting nodemanager as root gives "Unknown -jvm option"
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298941 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 17:37:00 +00:00
13ea1d575c
MAPREDUCE-3975. Default value not set for Configuration parameter mapreduce.job.local.dir (Eric Payne via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297825 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 01:27:02 +00:00
25cceb65ce
MAPREDUCE-3977. LogAggregationService leaks log aggregator objects (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297796 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:44:58 +00:00
c3a4de0ec0
MAPREDUCE-3961. Map/ReduceSlotMillis computation incorrect (Siddharth Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297788 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 23:21:13 +00:00
4ce5f6553f
MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297672 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:52:00 +00:00
1a0e088a19
MAPREDUCE-3974. TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297662 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 19:31:23 +00:00
a98b756c73
MAPREDUCE-3976. TestRMContainerAllocator failing (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297557 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 16:17:41 +00:00
b9fd9e1759
MAPREDUCE-3034. Ensure NodeManager reboots itself on direction from ResourceManager. Contributed by Devaraj K & Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297310 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 00:52:10 +00:00
739f688f5a
MAPREDUCE-3952. In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. (zhenxiao via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297293 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 23:56:46 +00:00
774f809f15
MAPREDUCE-3964. ResourceManager does not have JVM metrics (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297248 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 22:03:09 +00:00
7c1e857176
MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans.
...
.--This line, and those below, will be ignored--
M hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
M hadoop-mapreduce-project/hadoop-yarn/bin/yarn
M hadoop-mapreduce-project/CHANGES.txt
M hadoop-mapreduce-project/bin/mapred
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297174 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 19:03:56 +00:00
b73738d21e
MAPREDUCE-3009. Fixed node link on JobHistory webapp. Contributed by hackaravarthy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297149 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 18:29:29 +00:00
231e39462d
MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used.(ravigummadi)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297052 13f79535-47bb-0310-9956-ffa450edef68
2012-03-05 13:44:01 +00:00
d5f4fcef5c
MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296902 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:50:58 +00:00
6d80dc2a84
MAPREDUCE-3897. Fixed computation of maxActiveAppsPerUser for queues by using capacity and not max-capacity since we are already scaling it by userLimitFactor. Contributed by Eric Payne.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296898 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 23:44:57 +00:00
d41cb76b56
MAPREDUCE-3960. Fix web-proxy to forward request to AM with configured hostname or IP. Contributed by Thomas Graves.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296878 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 21:14:53 +00:00
bd38a29673
MAPREDUCE-3929. Fixed output of 'bin/mapred queue -showacl' command to clarify ACLs for users. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296835 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 17:14:23 +00:00
5f52156aa2
MAPREDUCE-3614. Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed. Contributed by Ravi Prakash.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296747 13f79535-47bb-0310-9956-ffa450edef68
2012-03-04 05:23:16 +00:00
fab57a144d
MAPREDUCE-3792. Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296721 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 23:40:35 +00:00
ce11ff73db
MAPREDUCE-3935. Annotate Counters.Counter and Counters.Group as @Public.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296523 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 00:08:58 +00:00
99bf2902b2
MAPREDUCE-3896. Add user information to the delegation token issued by the history server. (Contributed by Vinod Kumar Vavilapalli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296401 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 19:28:04 +00:00
b2f67b4704
HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync().
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 23:51:19 +00:00
7ae1523865
MAPREDUCE-3885. Avoid an unnecessary copy for all requests/responses in MRs ProtoOverHadoopRpcEngine. (Contributed by Devaraj Das)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295362 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 00:56:53 +00:00
7bf2f9559f
MAPREDUCE-3706. Fix circular redirect error in job-attempts page. Contributed by Robert Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295314 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 22:14:32 +00:00
3cbb9d20d0
MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295262 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:48:09 +00:00
2659fded83
MAPREDUCE-3728. ShuffleHandler can't access results when configured in a secure mode (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295245 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 20:05:10 +00:00
a4ad12dd2d
MAPREDUCE-3933. Failures because MALLOC_ARENA_MAX is not set (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295178 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 16:20:40 +00:00
547ded7bfe
MAPREDUCE-3920. Revise yarn default port number selection (Dave Thompson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295162 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:49:27 +00:00
defa1c5bab
MAPREDUCE-3687. If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code (Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295147 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 15:19:51 +00:00
44a003d8ec
MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294970 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 04:55:29 +00:00
137aa0763f
MAPREDUCE-3930. Fixed an NPE while accessing the AM page/webservice for a task attempt without an assigned container. (Contributed by Robert Joseph Evans)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294901 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 23:50:47 +00:00
ffdf980b20
MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294808 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 20:06:53 +00:00
ab29f5c5f9
MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 17:50:38 +00:00
cfe214220f
MAPREDUCE-3922. Fixed build to not compile 32bit container-executor binary by default on all platforms. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294446 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 02:35:37 +00:00
165cd626c5
MAPREDUCE-2855. Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 01:24:35 +00:00
7475e836dc
MAPREDUCE-3901. Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294417 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 00:32:19 +00:00
dee6ca3d41
Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 21:01:06 +00:00
008cf6a11d
MAPREDUCE-3909
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294219 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:53:06 +00:00
acf8e6f1b5
trailing whitespace on end of title lines
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294216 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:11 +00:00
d6170f00b1
MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs (Jason Lowe via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:44:05 +00:00
f071323343
MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293775 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 08:32:30 +00:00
f3cc891148
MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail. Contributed by John George.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 06:49:21 +00:00
7a082ec2bd
MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293517 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:03:59 +00:00
1de3fa8653
Preparing for 0.23.3 release.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 01:37:07 +00:00
4e64d7b447
MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293469 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:00:17 +00:00
582b97c3e7
MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293456 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:30:47 +00:00
c0572656ce
MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:39:31 +00:00
Vinod Kumar Vavilapalli
Harsh J
Thomas White
Robert Joseph Evans
Siddharth Seth
Aaron Myers
Arun Murthy
Alejandro Abdelnur
Ravi Gummadi
Tsz-wo Sze
Thomas Graves
Steve Loughran