37577852ba
MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. Contributed by Brahma Reddy Battula.
2016-02-19 16:33:17 -08:00
8eee59ce6b
MAPREDUCE-6627. Add machine-readable output to mapred job -history command (rkanter)
2016-02-18 17:58:26 -08:00
a365a3941c
HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter)
2016-02-18 11:09:50 -08:00
2440671a11
MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana.
2016-02-18 14:18:36 +05:30
453e7e0d10
MAPREDUCE-6341. addendum patch to fix typos. Contributed by John Michael Luy.
2016-02-17 14:17:32 +09:00
a0b1f10a30
MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. Contributed by Lin Yiqun.
2016-02-10 03:05:07 +09:00
43e669b22d
MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong
2016-02-02 19:30:45 +00:00
dca0dc8ac2
MAPREDUCE-6431. JobClient should be an AutoClosable (haibochen via rkanter)
2016-01-27 17:11:07 -08:00
f5c8c857be
MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki.
2016-01-22 18:35:43 +09:00
9fbd579ab5
MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt
2016-01-15 16:52:53 +00:00
5cc44d18aa
MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. Contributed by Kai Sasaki.
2016-01-15 00:44:24 +09:00
f657b54281
MAPREDUCE-6473. Job submission can take a long time during Cluster initialization. Contributed by Kuhu Shukla
2016-01-12 23:56:23 +00:00
8c1adeaa26
MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang.
2016-01-11 06:12:19 -08:00
f6f16118d3
MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee)
2016-01-05 15:22:50 -08:00
2a59d01503
MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka)
2015-12-30 01:33:47 +09:00
bee542817d
MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka)
2015-12-30 01:03:12 +09:00
7995a6ea4d
MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
2015-12-21 00:16:14 +09:00
d4e766de93
MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
2015-12-16 15:26:03 -08:00
60fe6d53d9
Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev"
...
This reverts commit fc470840a0
2015-12-16 15:11:38 -08:00
fc470840a0
MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev
2015-12-07 14:15:14 -08:00
7fd00b3db4
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
2015-11-25 17:03:38 -08:00
f634505d48
MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G
2015-11-24 22:07:26 +00:00
cab3c7c889
MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts
2015-11-24 22:01:03 +00:00
6502d59e73
MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du
2015-11-16 17:06:41 -08:00
df68eac825
MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li
2015-11-11 17:26:16 +00:00
cf953b6258
MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G
2015-10-29 18:05:01 +00:00
cb26cd4bee
MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh
2015-10-21 14:01:23 +00:00
0c4af0f998
MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
2015-10-20 17:34:34 -07:00
4aa9b3e75c
MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)
2015-10-09 07:37:39 -07:00
584cf3bb35
MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel.
2015-10-09 10:54:12 +09:00
97a08807ec
MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu
2015-09-24 08:12:07 -07:00
372ad270a0
MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda)
2015-09-18 10:10:32 -07:00
58d1a02b8d
MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
2015-09-17 14:30:18 +00:00
9b685773ec
MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li.
2015-09-05 11:21:03 +09:00
50fa383704
Revert "MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha)"
...
This reverts commit 61bf9cae6f
2015-08-27 10:15:19 -07:00
61bf9cae6f
MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha)
2015-08-22 00:39:04 -07:00
2ba90c93d7
MAPREDUCE-6357. MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute. Contributed by Dustin Cote.
2015-08-21 10:41:54 +09:00
fb1be0b310
MAPREDUCE-6257. Document encrypted spills (Bibin A Chundatt via aw)
2015-08-06 10:13:51 -07:00
93d50b7824
MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu
2015-07-30 23:07:31 -07:00
7e2fe8c9f2
MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa
2015-07-07 10:27:04 -07:00
2ac87df578
MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang
2015-07-01 16:00:03 +00:00
3a72bfd082
MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter)
2015-06-30 16:49:27 -07:00
72d08a0e41
MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov.
2015-06-24 15:29:11 +00:00
41ae7768eb
MAPREDUCE-6406. Update
...
FileOutputCommitter.FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT to match
mapred-default.xml. Contributed by Ray Chiang.
2015-06-23 10:23:44 +05:30
077250d8d7
MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
2015-06-22 21:59:20 +00:00
1babe50a2c
MAPREDUCE-6373. The logger reports total input paths but it is referring
...
to input files. Contributed by Bibin A Chundatt.
2015-06-18 11:42:22 +05:30
6785661e55
MAPREDUCE-6350. JobHistory doesn't support fully-functional search.
...
Contributed by Siqi Li.
2015-06-10 12:40:29 +05:30
025a3a8be0
MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula.
2015-06-08 16:22:03 -07:00
6afe20a7a4
MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang.
2015-06-08 15:06:10 -07:00
6786daab33
MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha)
2015-06-05 09:14:06 -07:00
dbed757cba
HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii.
2015-06-05 01:45:34 +09:00
d90c13e2da
MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera)
2015-06-03 16:50:26 -07:00
107da29ff9
MAPREDUCE-6374. Distributed Cache File visibility should check permission of full path. Contributed by Chang Li
2015-06-03 20:19:27 +00:00
788406e90c
MAPREDUCE-6336. Enable v2 FileOutputCommitter by default. (Siqi Li via gera)
2015-05-27 15:14:46 -07:00
3164e7d838
MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda)
2015-05-27 14:26:03 -07:00
7dba7005b7
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
2015-05-26 12:15:46 -07:00
022f49d59e
MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi.
2015-05-26 23:59:02 +09:00
55ed6558ba
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
2015-05-22 16:45:19 +05:30
6b710a42e0
Fixing MR intermediate spills. Contributed by Arun Suresh.
2015-05-14 16:07:56 -07:00
f24452d14e
MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch.
2015-05-12 12:11:42 -07:00
f4e2b3cc0b
MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du.
2015-05-13 00:28:17 +09:00
444836b3dc
MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma
2015-05-11 22:37:35 +00:00
7e543c27fa
YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.
2015-05-11 05:27:07 -07:00
2edcf931d7
MAPREDUCE-2094. LineRecordReader should not seek into non-splittable, compressed streams.
2015-05-08 14:31:11 -07:00
c39012f4a0
MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in ReduceTask. Contributed by Binglin Chang
2015-05-08 20:48:44 +00:00
bdbd10fde1
MAPREDUCE-2632. Avoid calling the partitioner when the numReduceTasks is 1. (Ravi Teja Ch N V and Sunil G via kasha)
2015-05-08 11:54:37 -07:00
dc2b2ae31f
MAPREDUCE-5981. Log levels of certain MR logs can be changed to DEBUG.
...
Contributed by Varun Saxena.
2015-05-08 21:27:54 +05:30
2401ff76be
MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith.
2015-05-08 15:17:52 +05:30
d18f10ad1b
MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.
2015-05-08 15:59:46 +09:00
d335071398
MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.
2015-05-07 19:39:24 +09:00
551615fa13
MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.
2015-05-05 10:23:13 +09:00
bf70c5ae28
MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu
2015-05-04 20:39:18 +00:00
7dc3c1203d
MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov
2015-05-04 19:02:39 +00:00
bb6ef2984d
MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. Contributed by Ray Chiang.
2015-05-04 15:36:33 +09:00
3ba18362f2
MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs unnecessary null strings. Contributed by Akira AJISAKA.
2015-05-04 15:02:21 +09:00
f1a152cc0a
MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster logs. (Rohit Agarwal via gera)
2015-05-01 18:18:56 -07:00
519092322d
MAPREDUCE-6343. JobConf.parseMaximumHeapSizeMB() fails to parse value greater than 2GB expressed in bytes. (Hao Xia via kasha)
2015-04-28 14:05:26 -07:00
bc1bd7e5c4
MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne
2015-04-28 20:19:05 +00:00
9a3dda3d34
MAPREDUCE-6341. Fix typo in mapreduce tutorial. Contributed by John Michael Luy.
2015-04-28 01:47:37 +09:00
618ba707f0
MAPREDUCE-6057. Remove obsolete entries from mapred-default.xml (Ray Chiang via aw)
2015-04-26 20:31:40 -07:00
e33594dd87
MAPREDUCE-6330. Fix typo in some Task Attempt API's URL. Contributed by Ryu Kobayashi.
2015-04-23 03:21:42 +09:00
89ded89e86
MAPREDUCE-6297. Task Id of the failed task in diagnostics should link to the task page. (Siqi Li via gera)
2015-04-21 13:57:23 -07:00
d50e8f0928
MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regression from MR1 (zxu via rkanter)
2015-04-20 14:14:08 -07:00
bb6dde68f1
YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang
2015-04-16 19:43:37 -07:00
83979e61a4
MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina.
2015-04-10 20:21:00 +09:00
a0795c1e81
MAPREDUCE-4844. Counters / AbstractCounters have constant references not declared final. (Brahma Reddy Battula via gera)
2015-04-03 10:28:52 -07:00
eccb7d46ef
MAPREDUCE-6303. Read timeout when retrying a fetch error can be fatal to a reducer. Contributed by Jason Lowe.
2015-04-02 12:13:03 -07:00
c358368f51
YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.
2015-03-30 10:09:40 -07:00
27d49e6714
MAPREDUCE-6291. Correct mapred queue usage command. Contributed by Brahma Reddy Battula.
2015-03-28 11:58:17 +05:30
05499b1093
MAPREDUCE-6294. Remove an extra parameter described in Javadoc of TockenCache. Contributed by Brahma Reddy Battula.
2015-03-28 00:08:35 +09:00
7e6f384dd7
MAPREDUCE-6242. Progress report log is incredibly excessive in application
...
master. Contributed by Varun Saxena.
2015-03-23 22:51:20 +05:30
4cd54d9a29
MAPREDUCE-5448. Addendum fix to remove deprecation warning by junit.Assert import in TestFileOutputCommitter.
2015-03-22 10:33:15 +05:30
1d5c796d65
MAPREDUCE-5190. Unnecessary condition test in RandomSampler. Contributed by Jingguo Yao.
2015-03-22 10:03:25 +05:30
b46c2bb51a
MAPREDUCE-5448. MapFileOutputFormat#getReaders bug with invisible files/folders. Contributed by Maysam Yabandeh.
2015-03-22 09:45:48 +05:30
433542904a
MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu.
2015-03-22 02:51:02 +05:30
7a678db3ac
MAPREDUCE-6239. Consolidate TestJobConf classes in hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-core. Contributed by Varun Saxena.
2015-03-21 09:43:29 +05:30
8041267f02
MAPREDUCE-4424. 'mapred job -list' command should show the job name as well. Contributed by Avinash Kujur.
2015-03-20 18:46:51 +09:00
91baca145a
MAPREDUCE-6275. Race condition in FileOutputCommitter v2 for user-specified task output subdirs. Contributed by Gera Shegalov and Siqi Li
2015-03-19 21:39:21 +00:00
bb243cea93
MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have @Override annotation. (ozawa)
2015-03-17 14:55:15 +09:00
f222bde273
MAPREDUCE-6100. replace mapreduce.job.credentials.binary with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Contributed by Zhihai Xu.
2015-03-17 11:06:35 +05:30
685dbafbe2
MAPREDUCE-6105. nconsistent configuration in property mapreduce.reduce.shuffle.merge.percent. Contributed by Ray Chiang.
2015-03-17 02:28:09 +05:30
587d8be17b
MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, for debug purposes. Contributed by Plamen Jeliazkov.
2015-03-17 01:03:08 +05:30
9d38520c8e
MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu
2015-03-14 16:44:02 +09:00
aa92b764a7
MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output files. (Siqi Li via gera)
2015-03-10 11:32:08 -07:00
d39bc903a0
Configurable timeout between YARNRunner terminate the application and forcefully kill. Contributed by Eric Payne.
2015-03-10 06:21:59 -07:00
c66c3ac6bf
MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha)
2015-03-04 14:42:07 -08:00
4228de9402
MAPREDUCE-5583. Ability to limit running map and reduce tasks. Contributed by Jason Lowe.
2015-03-03 02:02:28 -08:00
9ae7f9eb7b
MAPREDUCE-5657. Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA.
2015-03-03 18:06:26 +09:00
d1c6accb6f
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
2015-03-03 14:17:52 +09:00
bfbf076b7d
MAPREDUCE-5612. Add javadoc for TaskCompletionEvent.Status. Contributed by Chris Palmer.
2015-02-26 15:05:17 -08:00
1047c883ba
MAPREDUCE-6223. TestJobConf#testNegativeValueForTaskVmem failures. (Varun Saxena via kasha)
2015-02-26 14:24:19 -08:00
9a37247a67
MAPREDUCE-2815. JavaDoc does not generate correctly for MultithreadedMapRunner. Contributed by Chris Palmer.
2015-02-24 12:10:17 -08:00
0d7d508c82
MAPREDUCE-6264. Remove httpclient dependency from hadoop-mapreduce-client. Contributed by Brahma Reddy Battula.
2015-02-24 11:34:26 -08:00
9cedad11d8
Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)"
...
This reverts commit 946456c6d8
2015-02-25 00:32:04 +09:00
946456c6d8
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
2015-02-19 13:06:53 +09:00
4981d082d4
MAPREDUCE-6261. NullPointerException if MapOutputBuffer.flush invoked twice. Contributed by Tsuyoshi OZAWA
2015-02-18 19:28:02 +00:00
8b787e2fdb
MAPREDUCE-6260. Convert site documentation to markdown (Masatake Iwasaki via aw)
2015-02-17 06:52:14 -10:00
814afa46ef
MAPREDUCE-6225. Fix new findbug warnings in hadoop-mapreduce-client-core. Contributed by Varun Saxena
2015-02-16 09:38:05 -08:00
3338f6d907
MAPREDUCE-6256. Removed unused private methods in o.a.h.mapreduce.Job.java. Contributed by Naganarasimha G R.
2015-02-15 10:09:42 +09:00
9b0ba59b82
MAPREDUCE-6221. Stringifier is left unclosed in Chain#getChainElementConf(). Contributed by Ted Yu.
2015-02-13 02:27:54 +09:00
ac8d52bf50
MAPREDUCE-4431. mapred command should print the reason on killing already completed jobs. Contributed by Devaraj K.
2015-02-12 20:35:57 +09:00
b42d09eb62
MAPREDUCE-5335. Rename Job Tracker terminology in ShuffleSchedulerImpl. Contributed by Devaraj K.
2015-02-12 20:08:29 +09:00
76e309ead0
MAPREDUCE-6253. Update use of Iterator to Iterable. Contributed by Ray
...
Chiang.
2015-02-12 13:45:19 +05:30
241336ca2b
MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of reusing conections. Contributed by Kannan Rajah.
2015-02-10 03:52:42 +09:00
9112f093cd
HADOOP-10976. moving the source code of hadoop-tools docs to the directory under hadoop-tools (Masatake Iwasaki via aw)
2015-02-04 17:57:34 -08:00
cc6bbfceae
MAPREDUCE-5988. Fix dead links to the javadocs in mapreduce project. (aajisaka)
2015-02-04 17:46:01 -08:00
bd69fb2d44
MAPREDUCE-5800. Use Job#getInstance instead of deprecated constructors. (aajisaka)
2015-02-03 14:30:09 -08:00
8acc5e9b4b
MAPREDUCE-6143. add configuration for mapreduce speculative execution in MR2 (zxu via rkanter)
2015-02-02 13:51:08 -08:00
56b7ec71a6
MAPREDUCE-6141. History server leveldb recovery store. Contributed by Jason Lowe
2015-01-26 16:28:55 +00:00
a003f71cac
MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. (Gera Shegalov and Karthik Kambatla via gera)
2015-01-21 18:42:03 -08:00
10ac5abb86
MAPREDUCE-6173. Document the configuration of deploying MR over
...
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.
2015-01-13 10:04:31 -08:00
a6ed4894b5
HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)
2015-01-08 14:51:57 +09:00
9886396400
Revert "Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)" because of missing JIRA's number.
...
This reverts commit 2eba7eb9af
2015-01-08 14:35:08 +09:00
2eba7eb9af
Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)
2015-01-08 14:21:30 +09:00
a0aeed100b
MAPREDUCE-6206. TestAggregatedTransferRate fails on non-US systems. Contributed by Jens Rabe
2015-01-06 23:39:43 +00:00
d02fb53750
HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of split. Contributed by Ankit Kamboj
2015-01-06 21:19:10 +00:00
6621c3598e
MAPREDUCE-6149. Document override log4j.properties in MR job. Contributed by Junping Du.
2014-12-30 23:12:51 +05:30
390a7c12f5
MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)
2014-12-19 15:43:48 -08:00
6f1e3667cf
HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha)
2014-12-19 15:00:28 -08:00
af006937e8
MAPREDUCE-6166. Reducers do not validate checksum of map outputs when fetching directly to disk. (Eric Payne via gera)
2014-12-15 19:08:59 -08:00
298d09c9b5
MAPREDUCE-6194. Bubble up final exception in failures during creation of output collectors. Contributed by Varun Saxena.
2014-12-15 14:26:43 +05:30
0bcea111e5
HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be order-independent. (Yitong Zhou via gera)
2014-12-11 13:12:13 -08:00
cb99f43305
MAPREDUCE-5420. Remove mapreduce.task.tmp.dir from mapred-default.xml. Contributed by James Carman. (harsh)
2014-12-11 09:45:49 +05:30
8963515b88
MAPREDUCE-6177. Minor typo in the EncryptedShuffle document about ssl-client.xml. Contributed by Yangping Wu. (harsh)
2014-12-08 15:57:52 +05:30
03ab24aa01
MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
2014-12-03 17:02:14 +00:00
2b30fb1053
MAPREDUCE-6172. TestDbClasses timeouts are too aggressive. Contributed by Varun Saxena
2014-12-01 21:51:05 +00:00
a655973e78
Revert "MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. (Gera Shegalov and Karthik Kambatla via kasha)"
...
This reverts commit a4df9eed05
2014-11-25 16:24:26 -08:00
a4df9eed05
MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. (Gera Shegalov and Karthik Kambatla via kasha)
2014-11-21 18:36:41 -08:00
90194ca1cb
MAPREDUCE-6169. MergeQueue should release reference to the current item from key and value at the end of the iteration to save memory. (Zhihai Xu via kasha)
2014-11-20 15:36:57 -08:00
1a1dcce827
MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak)
2014-11-14 03:45:53 -08:00
177e8090f5
MAPREDUCE-6156. Fetcher - connect() doesn't handle connection refused correctly. Contributed by Junping Du
2014-11-13 15:42:25 +00:00
0abb973f09
HADOOP-7984. Add hadoop --loglevel option to change log level. Contributed by Aikira AJISAKA.
2014-11-12 21:41:19 -08:00
6caa8100d5
HADOOP-11286. Copied LimitInputStream from guava-0.14 to hadoop to avoid issues with newer versions of guava in applications. Contributed by Christopher Tubbs.
2014-11-08 15:39:56 -08:00
8f701ae07a
MAPREDUCE-5958. Wrong reduce task progress if map output is compressed. Contributed by Emilio Coppa and Jason Lowe.
2014-11-06 15:53:40 -06:00
10f9f5101c
MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path. Contributed by Gera Shegalov
2014-11-06 15:10:40 +00:00
ed63b11646
MAPREDUCE-6052. Supported overriding the default container-log4j.properties file per job. Contributed by Junping Du.
2014-11-01 00:47:57 -07:00
3c5f5af118
HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha)
2014-10-28 18:03:00 -07:00
971e91c8c0
MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter.
2014-10-27 21:03:53 -07:00
3b12fd6cfb
YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu
2014-10-22 15:57:46 -07:00
0af1a2b5bc
YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
2014-10-15 15:22:07 -07:00
f19771a24c
MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov
2014-10-15 17:50:31 +00:00
b9edad6403
MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li
2014-10-15 15:52:53 +00:00
e8a31f2e1c
MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)
2014-10-11 22:49:06 -07:00
684170d5ef
MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth.
2014-10-09 22:25:17 -07:00
3f282762d1
MAPREDUCE-6103.Adding reservation APIs to MR resource manager delegate. Contributed by Subru Krishnan and Carlo Curino.
...
(cherry picked from commit aa92dd45f2
2014-10-03 15:42:59 -07:00
5f16c98ad6
MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA
2014-09-26 18:05:26 -07:00
b40f433cf8
MAPREDUCE-5796. Use current version of the archive name in DistributedCacheDeploy document (Akira AJISAKA via aw)
2014-09-26 12:59:20 -07:00
1147b9ae16
MAPREDUCE-6073. Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags (Tsuyoshi OZAWA via aw)
2014-09-26 11:16:12 -07:00
662fc11ae7
MAPREDUCE-5831. Make MR client ignore unknown counters received from AM. Contributed by Junping Du.
2014-09-25 23:45:07 -07:00
6c54308423
MAPREDUCE-6093. minor distcp doc edits (Charles Lamb via aw)
2014-09-25 11:31:48 -07:00
52945a33cc
MAPREDUCE-6086. mapreduce.job.credentials.binary should allow all URIs. (Zhihai Xu via kasha)
2014-09-18 15:46:52 -07:00
2c3da25fd7
MAPREDUCE-5891. Improved shuffle error handling across NM restarts. Contributed by Junping Du
2014-09-18 22:00:11 +00:00
fe2f54d4cb
HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang)
2014-09-18 14:51:08 -07:00
9e28e089c6
MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented. Contributed by Tsuyoshi OZAWA
2014-09-11 16:19:23 +00:00
d989ac0444
MAPREDUCE-5972. Fix typo 'programatically' in job.xml (and a few other places) (Akira AJISAKA via aw)
2014-09-08 13:15:46 -07:00
a18424e724
MAPREDUCE-6063. Correct spill size calculation for spills wrapping the circular buffer. Contributed by zhihai xu.
2014-09-03 17:01:59 -07:00
ea1c6f31c2
HADOOP-11021. Configurable replication factor in the hadoop archive command. Contributed by Zhe Zhang.
2014-08-29 14:44:37 -07:00
48aa3b7274
Fix typos in log messages. Contributed by Ray Chiang
2014-08-28 16:29:35 -07:00
5109157ed1
MAPREDUCE-5130. Add missing job config options to mapred-default.xml (Ray Chiang via Sandy Ryza)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619626 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 23:28:44 +00:00
da4ba50269
HADOOP-10893. isolated classloader on the client side. Contributed by Sangjin Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619604 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 21:38:16 +00:00
e5e9d792c7
MAPREDUCE-5974. Allow specifying multiple MapOutputCollectors with fallback. (Todd Lipcon via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619492 13f79535-47bb-0310-9956-ffa450edef68
2014-08-21 17:37:34 +00:00
ef32d09030
[post-HADOOP-9902] mapred version is missing (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619201 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 18:47:10 +00:00
d2a39b61aa
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1619018 13f79535-47bb-0310-9956-ffa450edef68
2014-08-20 01:22:42 +00:00
0cc08f6da4
Merge from trunk to branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1618700 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:41:31 +00:00
73325f23f6
MAPREDUCE-6012. DBInputSplit creates invalid ranges on Oracle. (Wei Yan via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618694 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 18:25:50 +00:00
f8e871d01b
MAPREDUCE-6024. Shortened the time when Fetcher is stuck in retrying before concluding the failure by configuration. Contributed by Yunjiong Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618677 13f79535-47bb-0310-9956-ffa450edef68
2014-08-18 17:57:48 +00:00
7378af7bca
MAPREDUCE-5878. some standard JDK APIs are not part of system classes defaults. Contributed by Sangjin Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618080 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 23:17:33 +00:00
2d904b3fa3
MAPREDUCE-5906. Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent" (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618007 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 18:07:06 +00:00
e1f15d2cdf
MAPREDUCE-5999. Fix dead link in InputFormat javadoc (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618003 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 17:56:53 +00:00
7557f7bb2d
MAPREDUCE-5998. CompositeInputFormat javadoc is broken (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617995 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 17:18:14 +00:00
6be98091f7
MAPREDUCE-5950. incorrect description in distcp2 document (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617994 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 17:11:39 +00:00
92054f2a06
MAPREDUCE-5597. Missing alternatives in javadocs for deprecated constructors in mapreduce.Job (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617986 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 16:00:18 +00:00
e7b540eced
MAPREDUCE-5363. Fix doc and spelling for TaskCompletionEvent#getTaskStatus and getStatus (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617982 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 15:49:10 +00:00
1e016e6451
MAPREDUCE-4791. Javadoc for KeyValueTextInputFormat should include default separator and how to change it (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617979 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 15:43:28 +00:00
b3df973adb
MAPREDUCE-883. harchive: Document how to unarchive (Akira AJISAKA and Koji Noguchi via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617977 13f79535-47bb-0310-9956-ffa450edef68
2014-08-14 15:39:52 +00:00
e51a5d691b
MAPREDUCE-5943. Separate mapred commands from CommandManual.apt.vm (Akira AJISAKA via aw)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617806 13f79535-47bb-0310-9956-ffa450edef68
2014-08-13 19:34:26 +00:00
041b8326a1
MAPREDUCE-6007. Add support to distcp to preserve raw.* namespace extended attributes. (clamb)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1616657 13f79535-47bb-0310-9956-ffa450edef68
2014-08-08 01:32:18 +00:00
1d3e9ec935
merge from trunk r1613787
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1613788 13f79535-47bb-0310-9956-ffa450edef68
2014-07-27 13:32:51 +00:00
549bcc2c02
MAPREDUCE-6002. Made MR task avoid reporting error to AM when the task process is shutting down. Contributed by Wangda Tan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613743 13f79535-47bb-0310-9956-ffa450edef68
2014-07-27 01:37:51 +00:00
cb20bb6117
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1612403 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 21:44:50 +00:00
c2174a5536
MAPREDUCE-5756. CombineFileInputFormat.getSplits() including directories in its results. Contributed by Jason Dere
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612400 13f79535-47bb-0310-9956-ffa450edef68
2014-07-21 21:24:15 +00:00
56c0bd4d37
Merge from trunk to branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1610853 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 21:10:24 +00:00
b60ef8b91b
MAPREDUCE-5790. Made it easier to enable hprof profile options by default. Contributed by Gera Shegalov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610578 13f79535-47bb-0310-9956-ffa450edef68
2014-07-15 04:49:01 +00:00
95986dd2fb
MAPREDUCE-5890. Support for encrypting Intermediate data and spills in local filesystem. (asuresh via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1609597 13f79535-47bb-0310-9956-ffa450edef68
2014-07-11 00:43:03 +00:00
1355ff6132
MAPREDUCE-5830. Added back the private API HostUtil.getTaskLogUrl(..) for binary compatibility with older clients like Hive 0.13. Contributed by Akira Ajisaka.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604230 13f79535-47bb-0310-9956-ffa450edef68
2014-06-20 18:28:21 +00:00
7b9c074b76
MAPREDUCE-5844. Add a configurable delay to reducer-preemption. (Maysam Yabandeh via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603957 13f79535-47bb-0310-9956-ffa450edef68
2014-06-19 17:22:56 +00:00
bd23a2ff22
MAPREDUCE-5896. InputSplits should indicate which locations have the block cached in memory. (Sandy Ryza via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603670 13f79535-47bb-0310-9956-ffa450edef68
2014-06-18 23:28:50 +00:00
180ac8dc1d
MAPREDUCE-5912. Task.calculateOutputSize does not handle Windows files after MAPREDUCE-5196. Contributed by Remus Rusanu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602282 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 20:02:45 +00:00
fc7c8f9bf2
HADOOP-10686. Writables are not always configured. (Abraham Elmahrek via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602079 13f79535-47bb-0310-9956-ffa450edef68
2014-06-12 07:23:20 +00:00
473e83ab71
MAPREDUCE-5920. Add Xattr option in DistCp docs. Contributed by Yi Liu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601983 13f79535-47bb-0310-9956-ffa450edef68
2014-06-11 18:36:06 +00:00
40ba8c17c1
MAPREDUCE-5777. Support utf-8 text with Byte Order Marker. (Zhihai Xu via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600977 13f79535-47bb-0310-9956-ffa450edef68
2014-06-06 18:37:03 +00:00
806f4d11f2
HADOOP-10602. Documentation has broken "Go Back" hyperlinks. Contributed by Akira AJISAKA.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598337 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 17:26:50 +00:00
61c59c0704
MAPREDUCE-5895. Close streams properly to avoid leakage in TaskLog. Contributed by Kousuke Saruta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598209 13f79535-47bb-0310-9956-ffa450edef68
2014-05-29 07:05:26 +00:00
4bb4de93d6
MAPREDUCE-5862. Line records longer than 2x split size aren't handled correctly. Contributed by bc Wong
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598111 13f79535-47bb-0310-9956-ffa450edef68
2014-05-28 19:37:52 +00:00
1f8bb1001a
MAPREDUCE-5309. 2.0.4 JobHistoryParser can't parse certain failed job history files generated by 2.0.3 history server. Contributed by Rushabh S Shah
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596295 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 15:46:54 +00:00
c9377189a0
MAPREDUCE 5874. Creating MapReduce REST API section. Contributed by Tsuyoshi Ozawa
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595265 13f79535-47bb-0310-9956-ffa450edef68
2014-05-16 16:50:58 +00:00
5bf7ef839b
MAPREDUCE-5821. Avoid unintentional reallocation of byte arrays in segments
...
during merge. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594654 13f79535-47bb-0310-9956-ffa450edef68
2014-05-14 17:51:11 +00:00
f3c3d9e0c6
MAPREDUCE-5652. NM Recovery. ShuffleHandler should handle NM restarts. (Jason Lowe via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594329 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 19:10:48 +00:00
b0e80d1a47
MAPREDUCE-5814. fat jar with *-default.xml may fail when mapreduce.job.classloader=true. Contributed by Gera Shegalov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594326 13f79535-47bb-0310-9956-ffa450edef68
2014-05-13 18:55:05 +00:00
7fe28fc8f9
MAPREDUCE-5636. Convert MapReduce Tutorial document to APT (Akira AJISAKA via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592795 13f79535-47bb-0310-9956-ffa450edef68
2014-05-06 16:17:16 +00:00
bd54137afa
MAPREDUCE-5637. Convert Hadoop Streaming document to APT (Akira AJISAKA via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592789 13f79535-47bb-0310-9956-ffa450edef68
2014-05-06 16:01:21 +00:00
693025a3d4
MAPREDUCE-5638. Port Hadoop Archives document to trunk (Akira AJISAKA via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591107 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 21:23:50 +00:00
bb7ce82816
MAPREDUCE-5812. Make job context available to OutputCommitter.isRecoverySupported(). Contributed by Mohammad Kamrul Islam
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590668 13f79535-47bb-0310-9956-ffa450edef68
2014-04-28 15:18:02 +00:00
a059eadbe9
MAPREDUCE-5639. Port DistCp2 document to trunk (Akira AJISAKA via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590058 13f79535-47bb-0310-9956-ffa450edef68
2014-04-25 15:23:42 +00:00
06c15b6a3e
MAPREDUCE-5852. Prepare MapReduce codebase for JUnit 4.11. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589006 13f79535-47bb-0310-9956-ffa450edef68
2014-04-21 23:44:41 +00:00
28d62bf75b
MAPREDUCE-3191. docs for map output compression incorrectly reference SequenceFile (Chen He via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588009 13f79535-47bb-0310-9956-ffa450edef68
2014-04-16 18:14:53 +00:00
8ca32df08e
HADOOP-10474. Move o.a.h.record to hadoop-streaming. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585886 13f79535-47bb-0310-9956-ffa450edef68
2014-04-09 04:02:46 +00:00
d28be56239
MAPREDUCE-5759. Remove unnecessary conf load in Limits (Sandy Ryza)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583497 13f79535-47bb-0310-9956-ffa450edef68
2014-04-01 00:16:45 +00:00
6015e95941
MAPREDUCE-5795. Fixed MRAppMaster to record the correct job-state after it recovers from a commit during a previous attempt. Contributed by Xuan Gong.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581180 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 02:00:39 +00:00
a90a5c2452
MAPREDUCE-5791. Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently. Contributed by Nikola Vujic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580994 13f79535-47bb-0310-9956-ffa450edef68
2014-03-24 18:57:52 +00:00
a5c08eed16
MAPREDUCE-5787. Added the ability to keep alive shuffle connections in the MapReduce shuffle-handler. Contributed by Rajesh Balamohan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580062 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 21:43:55 +00:00
396c6c63a2
MAPREDUCE-2349. Modified FileInputFormat to be able to issue file and block location calls in parallel. Contributed by Siddharth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579515 13f79535-47bb-0310-9956-ffa450edef68
2014-03-20 02:46:23 +00:00
96e0ca2d27
YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He.
...
MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578135 13f79535-47bb-0310-9956-ffa450edef68
2014-03-16 18:32:05 +00:00
aab466558a
MAPREDUCE-5456. TestFetcher.testCopyFromHostExtraBytes is missing (Jason Lowe via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577313 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 20:48:06 +00:00
2c6ce77c5a
MAPREDUCE-5713. InputFormat and JobConf JavaDoc Fixes (Chen He via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577239 13f79535-47bb-0310-9956-ffa450edef68
2014-03-13 16:49:27 +00:00
98ecd4ffef
MAPREDUCE-5028. Fixed a bug in MapTask that was causing mappers to fail when a large value of io.sort.mb is set. Contributed by Karthik Kambatla.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576170 13f79535-47bb-0310-9956-ffa450edef68
2014-03-11 01:29:56 +00:00
a756de93ef
MAPREDUCE-5773. Provide dedicated MRAppMaster syslog length limit. Contributed by Gera Shegalov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573775 13f79535-47bb-0310-9956-ffa450edef68
2014-03-03 22:02:18 +00:00
658b1bf561
MAPREDUCE-5754. Preserve Job diagnostics in history. Contributed by Gera Shegalov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572269 13f79535-47bb-0310-9956-ffa450edef68
2014-02-26 21:32:34 +00:00
08e6d312e8
MAPREDUCE-5757. ConcurrentModificationException in JobControl.toList. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569038 13f79535-47bb-0310-9956-ffa450edef68
2014-02-17 16:14:58 +00:00
990cffdcfa
YARN-1553. Modified YARN and MR to stop using HttpConfig.isSecure() and
...
instead rely on the http policy framework. And also fix some bugs related
to https handling in YARN web-apps. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568501 13f79535-47bb-0310-9956-ffa450edef68
2014-02-14 20:01:02 +00:00
c122ef9000
MAPREDUCE-5670. CombineFileRecordReader should report progress when moving to the next file. Contributed by Chen He
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568118 13f79535-47bb-0310-9956-ffa450edef68
2014-02-13 23:16:00 +00:00
308f5faf18
MAPREDUCE-5746. Job diagnostics can implicate wrong task for a failed job. (Jason Lowe via kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567666 13f79535-47bb-0310-9956-ffa450edef68
2014-02-12 16:04:18 +00:00
4594b74b85
MAPREDUCE-5699. Allow setting tags on MR jobs (kasha)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565384 13f79535-47bb-0310-9956-ffa450edef68
2014-02-06 18:29:30 +00:00
f51c7ebe75
Add missing file for MAPREDUCE-5732
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562642 13f79535-47bb-0310-9956-ffa450edef68
2014-01-29 23:53:13 +00:00
db80705719
MAPREDUCE-5732. Report proper queue when job has been automatically placed (Sandy Ryza)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562641 13f79535-47bb-0310-9956-ffa450edef68
2014-01-29 23:51:40 +00:00
2a20fe8370
MAPREDUCE-5464. Add analogs of the SLOTS_MILLIS counters that jive with the YARN resource model (Sandy Ryza)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562216 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 20:15:18 +00:00
33a47743a5
HADOOP-10255. Rename HttpServer to HttpServer2 to retain older HttpServer in branch-2 for compatibility. Contributed by Haohui Mai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561959 13f79535-47bb-0310-9956-ffa450edef68
2014-01-28 07:32:52 +00:00
d1963ad4bd
MAPREDUCE-5693. Restore MRv1 behavior for log flush. Contributed by Gera Shegalov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560148 13f79535-47bb-0310-9956-ffa450edef68
2014-01-21 19:23:34 +00:00
f667371746
MAPREDUCE-5650. Job fails when hprof mapreduce.task.profile.map/reduce.params is specified (Gera Shegalov via Sandy Ryza)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559201 13f79535-47bb-0310-9956-ffa450edef68
2014-01-17 17:43:00 +00:00
a6ea460a91
MAPREDUCE-5672. Provide optional RollingFileAppender for container log4j (syslog). Contributed by Gera Shegalov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558948 13f79535-47bb-0310-9956-ffa450edef68
2014-01-16 22:56:09 +00:00
Andrew Wang
Robert Kanter
Varun Vasudev
Tsuyoshi Ozawa
Akira Ajisaka
Jason Lowe
Junping Du
Sangjin Lee
Xuan
Vinod Kumar Vavilapalli
Jian He
Robert Kanter
Karthik Kambatla
Zhihai Xu
Wangda Tan
Allen Wittenauer
Chris Douglas
Devaraj K
cnauroth
Gera Shegalov
Colin Patrick Mccabe
Vinayakumar B
Harsh J
Ravi Prakash
Arun C. Murthy
Kihwal Lee
Zhijie Shen
subru
Sanford Ryza
Charles Lamb
Alejandro Abdelnur
Jonathan Turner Eagles
Haohui Mai
Suresh Srinivas