7bc305db5d
MAPREDUCE-7303. Fix TestJobResourceUploader failures after HADOOP-16878. Contributed by Peter Bacsko.
2020-10-23 04:34:49 +09:00
42e7e0380f
HADOOP-17144. Update Hadoop's lz4 to v1.9.2. Contributed by Hemanth Boyina.
2020-10-18 18:37:46 +05:30
1e3a6efcef
HADOOP-17288. Use shaded guava from thirdparty. ( #2342 ). Contributed by Ayush Saxena.
2020-10-17 12:01:18 +05:30
2e46ef9417
MAPREDUCE-7301: Expose Mini MR Cluster attribute for testing
...
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-10-12 10:57:02 -07:00
c9ea344f98
HADOOP-17125. Use snappy-java in SnappyCodec ( #2297 )
...
This switches the SnappyCodec to use the java-snappy codec, rather than the native one.
To use the codec, snappy-java.jar (from org.xerial.snappy) needs to be on the classpath.
This comesin as an avro dependency, so it is already on the hadoop-common classpath,
as well as in hadoop-common/lib.
The version used is now managed in the hadoop-project POM; initially 1.1.7.7
Contributed by DB Tsai and Liang-Chi Hsieh
2020-10-06 17:07:54 +01:00
4347a5c955
HADOOP-17294. Fix typos existance to existence ( #2357 )
2020-10-06 10:10:44 +09:00
95dfc875d3
MAPREDUCE-7294. Only application master should upload resource to Yarn Shared Cache ( #2223 )
...
Contributed by Zhenzhao Wang <zhenzhaowang@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-09-19 23:10:05 -07:00
4ffe26f9b8
[UI1] Provide a way to hide Tools section in Web UIv1. Contributed by Andras Gyori
2020-08-31 16:00:39 +02:00
82a7505646
YARN-10304. Create an endpoint for remote application log directory path query. Contributed by Andras Gyori
2020-08-25 13:29:12 +02:00
cf4eb75608
MAPREDUCE-7051. Fix typo in MultipleOutputFormat ( #338 )
2020-07-30 13:01:22 +09:00
6bcb24d269
HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein.
2020-07-18 14:33:43 +05:30
98fcffe93f
HADOOP-17101. Replace Guava Function with Java8+ Function
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-07-15 09:53:18 -05:00
80046d1c8a
MAPREDUCE-7285. Junit class missing from hadoop-mapreduce-client-jobclient-*-tests jar. ( #2139 )
2020-07-15 15:24:34 +09:00
3e7b65c3e5
MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails ( #2136 )
2020-07-15 13:46:20 +09:00
f91a8ad88b
HADOOP-17079. Optimize UGI#getGroups by adding UGI#getGroupsSet. ( #2085 )
2020-07-09 11:33:37 -07:00
7e73cad974
MAPREDUCE-7280. MiniMRYarnCluster has hard-coded timeout waiting to start history server, with no way to disable. ( #2065 )
2020-06-30 10:52:25 +09:00
e154084770
HADOOP-17046. Support downstreams' existing Hadoop-rpc implementations using non-shaded protobuf classes ( #2026 )
2020-06-12 23:16:33 +05:30
fbb8775430
Revert "MAPREDUCE-7277. IndexCache totalMemoryUsed differs from cache contents. Contributed by Jon Eagles (jeagles)."
...
This reverts commit e2322e1117
2020-06-08 20:35:27 +00:00
10db97df1c
MAPREDUCE-7278. Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative are false
...
Contributed by Tarun Parimi.
2020-05-28 13:23:01 +10:00
d4e36409d4
MAPREDUCE-6826. Job fails with InvalidStateTransitonException: Invalid event: JOB_TASK_COMPLETED at SUCCEEDED/COMMITTING. Contributed by Bilwa S T.
2020-05-19 11:06:36 +05:30
a3f945fb84
HADOOP-17035. fixed typos (timeout, interruped) ( #2007 )
...
Co-authored-by: Sungpeo Kook <elixir.kook@kakaocorp.com>
2020-05-12 10:50:04 -05:00
263c76b678
HADOOP-17011. Tolerate leading and trailing spaces in fs.defaultFS. Contributed by Ctest
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2020-04-30 14:15:28 -07:00
ab36429559
YARN-10215. Endpoint for obtaining direct URL for the logs. Contributed by Andras Gyori
2020-04-28 18:53:28 +02:00
e2322e1117
MAPREDUCE-7277. IndexCache totalMemoryUsed differs from cache contents. Contributed by Jon Eagles (jeagles).
2020-04-27 19:10:00 +00:00
a1b0697d37
MAPREDUCE-7199. HsJobsBlock reuse JobACLsManager for checkAccess. Contributed by Bilwa S T
2020-04-18 19:42:20 +05:30
053e39e1e4
MAPREDUCE-7273. Fixed Job History server token renewal.
...
Contributed by Peter Bacsko via eyang
2020-04-16 20:17:21 -04:00
11d17417ce
MAPREDUCE-7272. TaskAttemptListenerImpl excessive log messages. Contributed by Ahmed Hussein (ahussein)
2020-04-13 18:20:07 +00:00
e2c87b7917
MAPREDUCE-7266. historyContext doesn't need to be a class attribute inside JobHistoryServer. Contributed by Siddharth Ahuja
2020-04-09 12:38:54 +02:00
ab7495dc7d
MAPREDUCE-7269. TestNetworkedJob fails ( #1940 )
2020-04-06 17:57:37 +09:00
f8e598f278
MAPREDUCE-7268. Fix TestMapreduceConfigFields ( #1935 )
2020-04-03 10:59:07 +09:00
c613296dc8
MAPREDUCE-7241. FileInputFormat listStatus with less memory footprint. Contributed by Zhihua Deng
2020-04-01 07:46:33 -05:00
8914cf9167
Preparing for 3.4.0 development
2020-03-29 23:24:25 +05:30
ea688631b0
MAPREDUCE-7237. Supports config the shuffle's path cache related parameters ( #1397 )
2020-03-16 11:28:36 +09:00
8d6ff87c18
MAPREDUCE-7263. Remove obsolete validateTargetPath() from FrameworkUploader. Contributed by Marton Hudaky
2020-02-12 15:53:33 +01:00
7dac7e1d13
HADOOP-16596. [pb-upgrade] Use shaded protobuf classes from hadoop-thirdparty dependency ( #1635 ). Contributed by Vinayakumar B.
2020-02-07 14:51:24 +05:30
71b2c2ffe9
YARN-10101. Support listing of aggregated logs for containers belonging to an application attempt. Contributed by Adam Antal
2020-02-06 12:25:06 +01:00
b897f6834b
MAPREDUCE-7079: JobHistory#ServiceStop implementation is incorrect. Contributed by Ahmed Hussein (ahussein)
2020-01-29 16:54:45 +00:00
7f3e1e0c07
MAPREDUCE-7260. Cross origin request support for Job history server web UI. Contributed by Adam Antal
2020-01-29 14:42:52 +01:00
08251538fe
MAPREDUCE-7259. testSpeculateSuccessfulWithUpdateEvents fails Intermittently
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-01-28 10:57:33 -06:00
3f01c48106
MAPREDUCE-7262. MRApp helpers block for long intervals (500ms)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-01-27 15:50:13 -06:00
9520b2ad79
YARN-10083. Provide utility to ask whether an application is in final status. Contributed by Adam Antal
2020-01-22 16:25:07 +01:00
b8518e6dab
MAPREDUCE-7247. Modify HistoryServerRest.html content,change The job attempt id‘s datatype from string to int ( #1684 )
2020-01-16 12:53:56 +09:00
a2fdd7c2b5
MAPREDUCE-7256. Fix javadoc error in SimpleExponentialSmoothing. ( #1804 )
2020-01-15 12:09:09 +09:00
13cea0412c
YARN-10028. Integrate the new abstract log servlet to the JobHistory server. Contributed by Adam Antal
2020-01-14 11:00:08 +01:00
93233a7d6e
YARN-9018. Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path. Contributed by Kuhu Shukla (kshukla)
2020-01-09 17:18:44 +00:00
cdd6efd3ab
MAPREDUCE-7252. Handling 0 progress in SimpleExponential task runtime estimator
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-01-08 11:08:13 -06:00
b343e1533b
MAPREDUCE-7255. Fix typo in MapReduce documentaion example ( #1793 )
2020-01-06 12:36:11 +09:00
682e6fdeda
YARN-9052. Replace all MockRM submit method definitions with a builder. Contributed by Szilard Nemeth.
2019-12-05 13:26:23 +05:30
da9aa9c909
MAPREDUCE-7250. FrameworkUploader skip replication check if timeout is 0.
...
Contributed by Peter Bacsko.
2019-12-05 12:32:57 +05:30
304e75a48b
Revert "MAPREDUCE-7250. FrameworkUploader skip replication check if timeout is 0."
...
This reverts commit 8d82c44102
2019-12-05 12:31:13 +05:30
Akira Ajisaka
hemanthboyina
Ayush Saxena
Swaroopa Kadam
Liang-Chi Hsieh
Ikko Ashimine
zz
Szilard Nemeth
Adam Antal
ywheel
Ahmed Hussein
Masatake Iwasaki
Xiaoyu Yao
Vinayakumar B
Eric Badger
Wilfred Spiegelenburg
Surendra Singh Lilhore
Elixir Kook
Mingliang Liu
Eric E Payne
Eric Yang
Wanqiang Ji
Jason Lowe
Brahma Reddy Battula
kevinzhao1661
Sergey Pogorelov
Sunil G
prabhujoseph
prabhujoseph