Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,229 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

499 Commits

Author SHA1 Message Date
Guanghao Zhang 4bf833418f HBASE-24876 Fix the flaky job url in hbase-personality.sh (#2253) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-08-13 16:52:29 +08:00
Duo Zhang 7f5f5776b7 HBASE-24841 Change the jenkins job urls in our jenkinsfile (#2227) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-08-11 09:07:30 +08:00
Duo Zhang aab8ce9e01 HBASE-24838 The pre commit job fails to archive surefire reports (#2224) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-08-10 11:13:56 +08:00
pengmq1 2a12fd283e HBASE-24289 Heterogeneous Storage for Date Tiered Compaction (#1730) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-30 15:19:30 +08:00
Nick Dimiduk eb16b4a782 HBASE-24631 Loosen Dockerfile pinned package versions of the "debian-revision" (#1965) 
After a bit of research into [0] and [1], and a bit of
experimentation, it seems we can use a partial wild-card expression
for these version strings. Let's try this for now. If it works out, we
should expand this usage to all the version package numbers, pinning
them to their epic:upstream-version components.

[0]: http://manpages.ubuntu.com/manpages/xenial/en/man5/deb-version.5.html
[1]: http://manpages.ubuntu.com/manpages/xenial/man8/apt-get.8.html

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-25 22:26:06 +08:00
Nick Dimiduk 5c390f0800 HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME 
Signed-off-by: Josh Elser <elserj@apache.org>
 2020-06-03 16:36:54 -07:00
Nick Dimiduk fd7beffcf9 Revert "Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2" 
This reverts commit f66c80b6a6.
 2020-06-03 16:36:54 -07:00
Nick Dimiduk f66c80b6a6
Merge pull request #1847 from ndimiduk/24280-addendum-CHANGE_TARGET-branch-2 
HBASE-24280 ADDENDUM branch on CHANGE_TARGET instead of BRANCH_NAME
 2020-06-03 16:20:49 -07:00
Josh Elser 99a40ddacf HBASE-24280 Skip explicit hadoop3 profile activation on master 
On 2.x branches, we need to explicitly activate profiles for H3. On
master, all H2 support is dropped which means no special profiles are
required for H3 (though, there is still a profile there to encapsulate
H3 logic).

We need to make sure that the yetus invocation can correctly pass down
any profile information into the personality, so we activate the exact
profiles we want.

Closes #1609

Co-authored-by: Istvan Toth <stoty@cloudera.com>
Signed-off-by: stack <stack@apache.org>
 2020-05-29 12:27:58 -04:00
bsglz 22efe67758
HBASE-24451 Remove the HasThread because the related bug had been fixed since jdk7 (#1797) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-29 17:46:03 +05:30
Peter Somogyi b2e9321d97 HBASE-24251 PreCommit build is failing because of can not build docker image; addendum (#1579) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-04-24 13:59:51 +02:00
Duo Zhang 4f0d05b462 HBASE-24253 HBASE-Find-Flaky-Tests job is failing because of can not build docker image (#1578) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-24 19:47:12 +08:00
Duo Zhang a0295662da HBASE-24251 PreCommit build is failing because of can not build docker image (#1575) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-24 16:23:34 +08:00
Duo Zhang 15a46388f1 HBASE-24218 Add hadoop 3.2.x in hadoop check (#1559) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-22 10:52:53 +08:00
Duo Zhang 6e95575669
HBASE-24213 Backport the pre commit changes for HBASE-24169 to all branches (#1548) 
Signed-off-by: stack <stack@apache.org>
 2020-04-22 10:26:10 +08:00
Peter Somogyi 4646f7b52b HBASE-24203 Bump git version in Dockerfile; addendum (#1543) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-04-17 23:32:37 +02:00
Peter Somogyi 55f65dc030 HBASE-24203 Bump git version in Dockerfile (#1538) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-17 13:07:40 +02:00
Michael Stack 62a488b946 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 (#1504) 2020-04-14 17:36:06 -07:00
Michael Stack 9eb49172d0
HBASE-24150 Allow module tests run in parallel (#1464) 
Pass --threads=2 to mvn when yetus runs so some parallelism
when dependencies allow.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-09 14:41:41 -07:00
Michael Stack ed54c35cf0
HBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 (#1451) 
Down jdk8 forked jvm heap from 2800 to 2200 and the jdk11 heap from
3200 to 2200. Down the mvn size from 4G to 3.6G

Change how many puts done by TestMultiRespectsLimits because made
the test run the forked heap over 2.5G in size.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-04-08 10:51:03 -07:00
stack 953c326498 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 
Addendum number 3; set the yetus proclimit.
 2020-04-07 10:22:24 -07:00
stack ba87ffed09 Revert "HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread." 
Revert because applied with wrong JIRA number.

This reverts commit 9c60c5fddb.
 2020-04-07 10:17:48 -07:00
Minwoo Kang af659564f3 HBASE-24130 rat plugin complains about having an unlicensed file (#1445) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-04-07 09:18:27 -07:00
stack 9c60c5fddb HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread. 
Up the nproc in hbase-personality. Add test that prints out env.
 2020-04-07 07:37:48 -07:00
stack 01715fbbf6 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 
Addendum number 2; docker doesn't like the ulimit arg as is.
 2020-04-06 18:24:09 -07:00
Nick Dimiduk 099333079b HBASE-24081 Provide documentation for running Yetus with HBase 
Signed-off-by: stack <stack@apache.org>
 2020-04-06 16:40:24 -07:00
stack 25773c681b HBASE-24126 Up the container nproc uplimit from 10000 to 12500 
ADDENDUM: Add to hbase-personality
 2020-04-06 16:29:46 -07:00
stack ed24998b85 HBASE-24126 Up the container nproc uplimit from 10000 to 12500 2020-04-06 13:44:53 -07:00
stack 4d31af23e8 HBASE-24122 Change machine ulimit-l to ulimit-a so dumps full ulimit rather than just 'max locked memory' 2020-04-06 08:58:16 -07:00
Michael Stack 3030b59e29
HBASE-24113 Upgrade the maven we use from 3.5.4 to 3.6.3 in nightlies (#1430) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-04-05 12:53:44 -07:00
Nick Dimiduk 1df979df18 HBASE-24049 use hadoop-2.10.0 for "packaging and integration" check 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-03 16:59:54 -07:00
stack 97a47ed0ee HBASE-24072 Nightlies reporting OutOfMemoryError: unable to create new native thread 
Set the forkcount down from 0.5C to 0.25C.
 2020-04-01 16:05:59 -07:00
Nick Dimiduk 8d058a9920 HBASE-24071 [JDK11] Remove `unit` filter from nightly and precommit jobs 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-04-01 12:31:18 -07:00
Nick Dimiduk b7e20c0df1 HBASE-24092 Fix links to build reports generated by nightly job 
Signed-off-by: stack <stack@apache.org>
 2020-04-01 12:19:28 -07:00
stack c5a3ab7504 HBASE-22022 nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh check 2020-03-31 09:51:31 -07:00
Nick Dimiduk 593f44c928 HBASE-24078 SpotBugs check automatically skip inapplicable modules 
Without patch, the spotbugs results include warnings for inapplicable
modules:

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 11s   | Maven dependency ordering
|  +1  |    mvninstall  |   2m 47s   | the source passed
|   0  |      spotbugs  |   0m 11s   | branch/hbase-annotations no spotbugs
|      |                |            | output file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 14s   | branch/hbase-assembly no spotbugs output
|      |                |            | file (spotbugsXml.xml)
|   0  |      spotbugs  |   0m 07s   |
|      |                |            | branch/hbase-archetypes/hbase-archetype-bu
|      |                |            | ilder no spotbugs output file
|      |                |            | (spotbugsXml.xml)
+---------------------------------------------------------------------------

With patch,

+---------------------------------------------------------------------------
|      |                |            | Compile Tests
+---------------------------------------------------------------------------
|   0  |        mvndep  |   0m 13s   | Maven dependency ordering
|  +1  |    mvninstall  |   3m 09s   | the source passed
|  +1  |      spotbugs  |  17m 09s   | the source passed
+---------------------------------------------------------------------------

Signed-off-by: stack <stack@apache.org>
 2020-03-31 09:33:01 -07:00
Nihal Jain 6f675e269c HBASE-20467 Precommit personality should only run checkstyle once if we're going to run it at the root 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-03-31 09:33:01 -07:00
Nick Dimiduk c98ec0c22c HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh ADDENDUM 
* Correctly handle the hadoop2 profile.
* Create the output directory if it doesn't exist
 2020-03-26 08:48:03 -07:00
Nick Dimiduk a8606c36c7 HBASE-24045 Support setting `-Dhadoop.profile` in adhoc_run_tests.sh 
Signed-off-by: stack <stack@apache.org>
 2020-03-25 13:48:15 -07:00
Nick Dimiduk aba0737acb HBASE-24002 shadedjars check does not propagate --hadoop-profile 
This implementation is almost surely incorrect. Personality
initialization parses the `--hadoop-profile` argument and sets
`HADOOP_PROFILE`. That value is then used to build an `extras` value
that is passed  along to module initialization. I'm guessing that the
`extras` value need to be honored down in the shadedjars module. I'm
not clear on how to make that work (need to study the interfaces at
play here), so taking the more ham-handed approach of referring to
`HADOOP_PROFILE`. I'm not sure if this will even work, or if it will
only work because the `foo_yetus.sh` scripts happen to use a variable
of the same name.

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
 2020-03-24 09:35:31 -07:00
Duo Zhang 83388609d0
HBASE-24009 Backport the personality changes in HBASE-23989 to all active branches (#1304) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-03-20 14:18:07 +08:00
stack c8d6ee31b8 HBASE-24017 Turn down flakey rerun rate on all but hot branches 
On master branch run twice a day instead of every 4 hours.
 2020-03-18 15:54:10 -07:00
stack df77c029ae HBASE-24016 Change nightly poll from cron @daily to pollSCM @daily; i.e. run nightly if a change ONLY 2020-03-18 14:42:48 -07:00
Nick Dimiduk b942527b60 HBASE-24004 Include hadoop version in Nightly report name 2020-03-17 14:52:13 -07:00
Nick Dimiduk dab736428e HBASE-23978 Dockerfiles reusing stale apt sources info 
Signed-off-by: stack <stack@apache.org>
 2020-03-12 17:28:41 -07:00
Duo Zhang 7eeb6a0815 HBASE-23077 move entirely to spotbugs (#1265) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2020-03-12 11:42:23 +08:00
Nick Dimiduk ebfc1a206c HBASE-23945 Dockerfiles showing hadolint check failures 
Signed-off-by: stack <stack@apache.org>
 2020-03-10 12:33:18 -07:00
Dima Spivak dacceba0c7 HBASE-18418 Remove apache_hbase_topology from dev-support 2020-03-09 09:53:37 -07:00
Nick Dimiduk 84efaed120 HBASE-23946 [JDK11] Yetus should vote -0 for known JDK11 issues (#1246) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-03-09 09:13:06 -07:00
Nick Dimiduk 3e5d3a0ab3 Revert "HBASE-23945 Dockerfiles showing hadolint check failures" 
This reverts commit 4205677eb7.
 2020-03-07 10:42:22 -08:00