Commit Graph

15720 Commits

Author SHA1 Message Date
Michael Stack 4978db8102 Revert "HBASE-21095 The timeout retry logic for several procedures are broken after master restarts"
This reverts commit b82cd670c3.
2018-08-24 12:24:32 -07:00
Allan Yang b82cd670c3 HBASE-21095 The timeout retry logic for several procedures are broken after master restarts 2018-08-24 12:20:43 -07:00
Michael Stack 66add55234 HBASE-21072 Block out HBCK1 in hbase2
Write the hbase-1.x hbck1 lock file to block out hbck1 instances writing
state to an hbase-2.x cluster (could do damage).
Set hbase.write.hbck1.lock.file to false to disable this writing.
2018-08-24 09:22:53 -07:00
Duo Zhang 8a9acd4d2a HBASE-21101 Remove the waitUntilAllRegionsAssigned call after split in TestTruncateTableProcedure 2018-08-24 10:35:10 +08:00
zhangduo bf21a9dc33 HBASE-20193 Move TestCreateTableProcedure.testMRegions to a separated file 2018-08-24 10:09:31 +08:00
Sean Busbey 9a3093a886 HBASE-21076 refactor TestTableResource to ask for a multi-region table instead of relying on a split operation.
Also correct how the test does string conversion for region names that include non-printable characters.

includes addendum.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

(cherry picked from commit 6b18e39f30)
(cherry picked from commit 63f2d3cbdc)
2018-08-22 19:37:28 -05:00
Nihal Jain 1120f33c38 HBASE-20614 REST scan API with incorrect filter text file throws HTTP 503 Service Unavailable error
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-22 16:07:58 -07:00
Duo Zhang 239d12dae8 HBASE-20194 Remove the explicit timeout config for TestTruncateTableProcedure 2018-08-23 06:27:41 +08:00
Allan Yang 16ab716134 HBASE-21041 Memstore's heap size will be decreased to minus zero after flush 2018-08-22 22:54:14 +08:00
Allan Yang c07afa8875 HBASE-21031 Memory leak if replay edits failed during region opening 2018-08-22 22:13:26 +08:00
Andrey Elenskiy 5f03be4675 HBASE-21032 ScanResponses contain only one cell each
Amending-Author: Duo Zhang <zhangduo@apache.org>
2018-08-21 13:31:18 -07:00
Sean Busbey 5a40eae63e HBASE-21058 When testing branches one, the PDF ref guide is named 'book.pdf'
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2018-08-21 09:46:28 -05:00
Sean Busbey 57d8778bf2 HBASE-21074 JDK7 builds need to be done with TLSv1.2.
* for master and branches-2 we skip the jdk7 stuff

Signed-off-by: Michael Stack <stack@apache.org>
2018-08-21 09:15:46 -05:00
Andrew Purtell 798cb1d793 HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal) 2018-08-17 15:02:26 -07:00
Josh Elser 67ad0e6013 HBASE-21062 Correctly use the defaultProvider value on the Providers enum when constructing a WALProvider 2018-08-17 14:55:42 -04:00
Sakthi 48dee7e44d HBASE-20705 Having RPC quota on a table now no longer prevents Space Quota to be recreate/removed
Just added 2 test cases as the subtasks of this jira solves the issue

Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-17 14:09:26 -04:00
Sean Busbey c1c12605ad HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-16 23:17:41 -05:00
Andrew Purtell b49941012a HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal) 2018-08-16 11:42:54 -07:00
Nihal Jain 145c92f3d6 HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 18:08:15 -07:00
Allan Yang ee3507d456 HBASE-21050 Exclusive lock may be held by a SUCCESS state procedure forever
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-08-15 15:39:15 -07:00
Allan Yang e1188d27f5 HBASE-20978 [amv2] Worker terminating UNNATURALLY during MoveRegionProcedure Signed-off-by: Michael Stack <stack@apache.org> Signed-off-by: Duo Zhang <zhangduo@apache.org> 2018-08-14 16:29:58 -07:00
Sean Busbey de1d36f93f HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 346dd32185)
2018-08-14 13:15:04 -05:00
Michael Stack 0d51d54726 HBASE-21044 Disable flakey TestShell list_procedures 2018-08-13 21:48:17 -07:00
Michael Stack 2e5efa690a HBASE-20772 Controlled shutdown fills Master log with the disturbing message 'No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSED'
Look for the particular case where RS does the close of region w/o
involving Master and log special message in this case. Dodgy. But
until we have Master run shutdown of all regions, better than
the message we currently show.
2018-08-13 15:59:39 -07:00
Josh Elser 602b4a6f79 HBASE-21005 Remove local maven repo and fluido-skin jar
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-13 18:29:25 -04:00
Allan Yang 161c018927 HBASE-21029 Miscount of memstore's heap/offheap size if same cell was put 2018-08-13 20:30:23 +08:00
Allan Yang 26828b1860 HBASE-20975 Lock may not be taken or released while rolling back procedure 2018-08-13 20:12:57 +08:00
jingyuntian 95e3dec510 HBASE-20985 add two attributes when we do normalization
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:55:19 +08:00
Duo Zhang 846078f9b0 HBASE-21025 Addendum missed a 'succ = true'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 10:55:18 +08:00
jackbearden 2d12e1ecf0 HBASE-20981. Rollback stateCount accounting thrown-off when exception out of rollbackState
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-11 11:58:12 -07:00
brandboat 873d9f5082 HBASE-21012 Revert the change of serializing TimeRangeTracker
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-08-11 22:28:49 +08:00
Wei-Chiu Chuang 5e12d6a98e HBASE-21018 RS crashed because AsyncFS was unable to update HDFS data encryption key 2018-08-10 19:53:22 -07:00
zhangduo ee164fcbc5 HBASE-21025 Add cache for TableStateManager 2018-08-10 21:11:53 +08:00
brandboat 8a9ba0c65b HBASE-18201 add UT and docs for DataBlockEncodingTool
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:19:36 +08:00
meiyi e222686294 HBASE-20965 Separate region server report requests to new handlers
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-09 18:27:38 +08:00
Sakthi b2fc0f48f6 HBASE-20813 Removed RPC quotas when the associated table/Namespace is dropped off
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-08 13:46:25 -04:00
Bosko Devetak ff89ec17c4 HBASE-21007 Memory leak in HBase REST server
Close the scanner leak in rest server when using the limit number of rows.

Example: when using uris like

        /sometable/*?limit=5&startrow=eGlND&endrow=eGlNE

where the scan range has more rows than the limit, the
rest server will start leaking memmory.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-07 12:40:24 -07:00
jingyuntian 9d594ac86a HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-07 14:03:03 +08:00
Sakthi 7e9f8c60e2 HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-03 11:07:01 -04:00
Mike Drob dff5ba27c3 HBASE-20749 Update to checkstyle 8.11 2018-08-02 14:19:30 -05:00
TAK LON WU 2e1c12ca1b HBASE-20856 PITA having to set WAL provider in two places
With this change if hbase.wal.meta_provider is not explicitly set,
it uses whatever set with hbase.wal.provider. this change avoids a use
case of unexpectedly using two different providers when only
hbase.wal.provider is set to non-default but not hbase.wal.meta_provider.

This change also include document (architecture.adoc) update

Also, this is a port from master to branch-2

Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <Apache9@apache.org>
2018-08-01 14:45:11 -07:00
Michael Stack 88f3148810 HBASE-20989 Minor, miscellaneous logging fixes
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:01 -07:00
Xu Cang 9338eaee65 HBASE-20794 add INFO level log to createTable operation 2018-08-01 11:04:00 -07:00
Michael Stack 0f4e857c7a HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing ADDENDUM: Rather than rollback, just do region reopens.
In split, reopen the parent if recovered.edits and in merge, reopen the
parent region or regions that happened to have recovered.edits on close.
2018-08-01 00:33:12 -07:00
Andrew Purtell daeec8657e HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-07-31 16:06:15 -07:00
zhangduo 1b66839bc4 HBASE-20538 Upgrade our hadoop versions to 2.7.7 and 3.0.3 2018-07-29 20:20:28 +08:00
zhangduo a9346982bf Revert "HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3"
This reverts commit 3dd83adb51.
2018-07-29 20:20:20 +08:00
zhangduo 3dd83adb51 HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3 2018-07-29 20:04:48 +08:00
Alex Leblang 31cbd7ab8f
HBASE-19369 Switch to Builder Pattern In WAL
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).

Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:43:08 -05:00
zhangduo 8bfdb19e85 HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException 2018-07-27 21:30:23 +08:00