89 Commits

Author SHA1 Message Date
Akira Ajisaka
f207d9e620
HADOOP-16870. Use spotbugs-maven-plugin instead of findbugs-maven-plugin. Contributed by Ahmed Hussein.
Removed findbugs from the hadoop build images and added spotbugs instead.
Upgraded SpotBugs to 4.2.2 and spotbugs-maven-plugin to 4.2.0.
2021-03-29 09:44:28 +09:00
Akira Ajisaka
f7ed17e636
MAPREDUCE-7323. Remove job_history_summary.py. (#2712)
Reviewed-by: Takanobu Asanuma <tasanuma@apache.org>
(cherry picked from commit 8bca105655d91d949f8aa8daae656f34ed950e78)
2021-02-22 23:17:12 +09:00
Wanqiang Ji
e8699d0bd5
MAPREDUCE-7289. Fix wrong comment in LongLong.java (#2338)
(cherry picked from commit 143bdd41885a43c7bc6e11f0c0d6e5820768aa2c)
2020-09-29 23:09:12 +09:00
Masatake Iwasaki
f4e0c14fe9 Preparing for 2.10.2 development 2020-09-13 14:33:36 +09:00
Akira Ajisaka
7dedf344de MAPREDUCE-6881. Fix warnings from Spotbugs in hadoop-mapreduce. Contributed by Weiwei Yang.
(cherry picked from commit 3ed3062fe3979ff55a411b730a8eee2b2c96d6b3)
2020-08-11 11:19:01 +09:00
Jonathan Hung
d74f64aa99 Setting version to 2.10.1-SNAPSHOT after branch-2 to branch-2.10 rename 2019-12-09 11:49:59 -08:00
Jonathan Hung
108127238b Preparing for 2.11.0 development 2019-10-15 10:01:45 -07:00
Takanobu Asanuma
e3d4f6bfed HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:41:21 +09:00
Akira Ajisaka
cea1b0000c
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:28:54 +09:00
Arun Suresh
71a55bebfb Preparing for 2.10.0 development 2017-10-31 12:51:14 -07:00
Jason Lowe
b94acb6efb MAPREDUCE-6965. QuasiMonteCarlo should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
(cherry picked from commit 908d8e914ef55aca69cb8e725e62bda29d1073cc)
2017-09-22 09:37:09 -05:00
Akira Ajisaka
d80e2f2eae
MAPREDUCE-6966. DistSum should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
(cherry picked from commit c71d13796039815350d3c73c51f9fe48531af0fa)
2017-09-22 15:10:19 +09:00
Akira Ajisaka
9d4de9c556
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergely Novák.
(cherry picked from commit 53be075241f1ba92bfe47e89c2dfc3f0664e2578)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/terasort/TeraOutputFormat.java
2017-09-22 13:29:17 +09:00
Jason Lowe
cf2615961a MAPREDUCE-6964. BaileyBorweinPlouffe should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
(cherry picked from commit b9db0afa1e65d0343ad4e5760c36e042a3e704b0)
2017-09-21 09:39:46 -05:00
Akira Ajisaka
7d747df52d
Revert "MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák."
This reverts commit e61baf94965e25b6a7ab2264523142d066b490b2.
2017-09-21 11:16:48 +09:00
Akira Ajisaka
e61baf9496
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák.
(cherry picked from commit 2018538fdba1a95a6556187569e872fce7f9e1c3)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-examples/src/main/java/org/apache/hadoop/examples/terasort/TeraOutputFormat.java
2017-09-19 11:25:29 +09:00
Sunil G
ec346d6377 YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang. 2017-05-23 07:57:36 +05:30
Daniel Templeton
85261cbe0e MAPREDUCE-6842. Update the links in PiEstimator document (Contributed by Jung Yoo via Daniel Templeton)
(cherry picked from commit 0e58b368f001b3bb4031b923b63dce7c81d42d39)
2017-02-07 13:06:50 -08:00
Daniel Templeton
d1aa844dc6 MAPREDUCE-6715. Fix Several Unsafe Practices (Contributed by Yufei Gu via Daniel Templeton)
(cherry picked from commit 0b8a7c18ddbe73b356b3c9baf4460659ccaee095)
2017-01-05 17:57:14 -08:00
Mingliang Liu
4e0fcff8ab HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
(cherry picked from commit 5af572b6443715b7a741296c1bd520a1840f9a7c)
2016-11-15 11:36:08 -08:00
Wei-Chiu Chuang
13cbf1677e MAPREDUCE-6764. Teragen LOG initialization bug. Contributed by Yufei Gu.
(cherry picked from commit 1360bd2d545134b582e70f2add33a105710dc80b)
2016-08-25 09:51:17 -07:00
Chris Nauroth
752a813283 MAPREDUCE-6672. TestTeraSort fails on Windows. Contributed by Tibor Kiss.
(cherry picked from commit 26ac0f8f0b28758a6404cd7b4b81d79b61d809d9)
2016-04-29 11:33:41 -07:00
Akira Ajisaka
365d236175 MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak.
(cherry picked from commit 80fa70c4e15f16b411cb3691df546499c6a19d4c)
2016-03-17 18:09:20 +09:00
Akira Ajisaka
c2e14d1bbb MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote.
(cherry picked from commit 247a7906092065289ea81139e71badcac6abef1e)
2016-03-11 22:54:40 +09:00
Akira Ajisaka
99f61afcdd Revert "MAPREDUCE-6520. Migrate MR Client test cases part 1."
This reverts commit 7d665f0a987c17dcf8a26113c61a70dee196ee3d.
2016-03-11 22:52:10 +09:00
Akira Ajisaka
7d665f0a98 MAPREDUCE-6520. Migrate MR Client test cases part 1.
(cherry picked from commit ef68b441957c6deb65adae2272d60ac929d00733)
2016-03-11 22:25:29 +09:00
Varun Vasudev
212c519ad3 MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana.
(cherry picked from commit c50d1e54000c76880a041ce5959a2eb23c86bd35)
2016-02-18 14:19:01 +05:30
Vinod Kumar Vavilapalli
b20e77eba3 Preparing for 2.9.0 development: mvn versions:set -DnewVersion=2.9.0 2015-11-25 17:47:22 -08:00
Haohui Mai
ee04add696 HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu. 2015-10-13 15:24:29 -07:00
Devaraj K
b117527bf3 MAPREDUCE-6389. Fix BaileyBorweinPlouffe CLI usage message. Contributed by
Brahma Reddy Battula.

(cherry picked from commit c7729efee8727b59f2c78cd5a3ad23fa84139068)
2015-06-10 21:06:35 +05:30
Devaraj K
37ad3b3fef MAPREDUCE-6383. Pi job (QuasiMonteCarlo) should not try to read the
results file if its job fails. Contributed by Harsh J.

(cherry picked from commit 09b8241e6e369ee00241efcc2e048e710dbcccd1)
2015-06-05 21:23:48 +05:30
Tsuyoshi Ozawa
780d4f416e MAPREDUCE-6366. mapreduce.terasort.final.sync configuration in TeraSort doesn't work. Contributed by Takuya Fukudome.
(cherry picked from commit e82067bfe680ce04acc0153693cce3cd385e5567)
2015-05-13 16:45:46 +09:00
Harsh J
2cd2431289 MAPREDUCE-6287. Deprecated methods in org.apache.hadoop.examples.Sort. Contributed by Chao Zhang.
(cherry picked from commit b375d1fc936913edf4a75212559f160c41043906)
2015-03-23 03:48:55 +05:30
Tsuyoshi Ozawa
ef9aa7c34b MAPREDUCE-6281. Fix javadoc in Terasort. Contributed by Albert Chu.
(cherry picked from commit 1ccbc29708f7e89b9292a861df3bc3b8f4f7febe)
2015-03-20 00:59:43 +09:00
Harsh J
4e80c4cd5e MAPREDUCE-5807. Print usage for TeraSort job. Contributed by Rohith.
(cherry picked from commit 9d72f939759f407796ecb4715c2dc2f0d36d5578)
2015-03-18 17:31:25 +05:30
Tsuyoshi Ozawa
b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli
d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
Tsuyoshi Ozawa
ccde4aed18 MAPREDUCE-5657. Backport '[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments.' Contributed by Akira AJISAKA. 2015-03-09 12:00:04 +09:00
Akira Ajisaka
8d98e5c960 MAPREDUCE-5800. Use Job#getInstance instead of deprecated constructors. (aajisaka)
(cherry picked from commit bd69fb2d44403e930d1fc0868ed1dd2a49dd9659)

Conflicts:
	hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/mapreduce/TestStreamXmlRecordReader.java
2015-02-03 14:35:15 -08:00
Akira Ajisaka
57172c09e2 MAPREDUCE-6231. Grep example job is not working on a fully-distributed cluster. (aajisaka)
(cherry picked from commit fe2188a0420f501ccfcba92e91d4b564ba86103e)
2015-01-30 01:11:22 +09:00
Gera Shegalov
6465931c19 MAPREDUCE-4879. TeraOutputFormat may overwrite an existing output directory. (gera)
(cherry picked from commit 25a04402389dce0222938df4375d4545f8c1f34f)
2014-12-13 18:12:02 -08:00
Haohui Mai
49aacee2cb HADOOP-11372. Fix new findbugs warnings in mapreduce-examples. Contributed by Li Lu. 2014-12-09 10:49:11 -08:00
Arun C. Murthy
adfb830a2b Preparing to release hadoop-2.6.0: Set version in branch-2 to 2.7.0-SNAPSHOT. 2014-11-09 19:19:02 -08:00
Ivan Mitic
b4668f41e8 Revert "MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita."
This reverts commit 767a3fd0b718a1d0b38c030438f0be4f426ba5b5.
2014-10-19 23:50:42 -04:00
Ivan Mitic
767a3fd0b7 MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita.
(cherry picked from commit 7bbda6ef92e9bf4a28e67b8736067b38defab51e)
2014-10-19 19:10:31 -04:00
Karthik Kambatla
9133e3142c Preparing for 2.6.0 development. Updated versions.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1607541 13f79535-47bb-0310-9956-ffa450edef68
2014-07-03 06:11:57 +00:00
Chris Nauroth
91c53d97bd MAPREDUCE-5886. Merging change r1601704 from trunk to branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1601707 13f79535-47bb-0310-9956-ffa450edef68
2014-06-10 17:52:27 +00:00
Jonathan Turner Eagles
53ab439204 MAPREDUCE-5836. Fix typo in RandomTextWriter (Akira AJISAKA via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1587722 13f79535-47bb-0310-9956-ffa450edef68
2014-04-15 20:46:30 +00:00
Arun Murthy
1ccccb8534 Branching for hadoop-2.4 releases, also set version to 2.5.0-SNAPSHOT in branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1569186 13f79535-47bb-0310-9956-ffa450edef68
2014-02-18 04:41:01 +00:00
Arun Murthy
439a690ad1 Setting version to 2.4.0-SNAPSHOT in branch-2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1547165 13f79535-47bb-0310-9956-ffa450edef68
2013-12-02 19:40:42 +00:00