c1c12605ad
HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
...
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-16 23:17:41 -05:00
b49941012a
HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal)
2018-08-16 11:42:54 -07:00
145c92f3d6
HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 18:08:15 -07:00
ee3507d456
HBASE-21050 Exclusive lock may be held by a SUCCESS state procedure forever
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-08-15 15:39:15 -07:00
e1188d27f5
HBASE-20978 [amv2] Worker terminating UNNATURALLY during MoveRegionProcedure Signed-off-by: Michael Stack <stack@apache.org> Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-08-14 16:29:58 -07:00
de1d36f93f
HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors
...
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 346dd32185
2018-08-14 13:15:04 -05:00
0d51d54726
HBASE-21044 Disable flakey TestShell list_procedures
2018-08-13 21:48:17 -07:00
2e5efa690a
HBASE-20772 Controlled shutdown fills Master log with the disturbing message 'No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSED'
...
Look for the particular case where RS does the close of region w/o
involving Master and log special message in this case. Dodgy. But
until we have Master run shutdown of all regions, better than
the message we currently show.
2018-08-13 15:59:39 -07:00
602b4a6f79
HBASE-21005 Remove local maven repo and fluido-skin jar
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-13 18:29:25 -04:00
161c018927
HBASE-21029 Miscount of memstore's heap/offheap size if same cell was put
2018-08-13 20:30:23 +08:00
26828b1860
HBASE-20975 Lock may not be taken or released while rolling back procedure
2018-08-13 20:12:57 +08:00
95e3dec510
HBASE-20985 add two attributes when we do normalization
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:55:19 +08:00
846078f9b0
HBASE-21025 Addendum missed a 'succ = true'
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 10:55:18 +08:00
2d12e1ecf0
HBASE-20981. Rollback stateCount accounting thrown-off when exception out of rollbackState
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-11 11:58:12 -07:00
873d9f5082
HBASE-21012 Revert the change of serializing TimeRangeTracker
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-08-11 22:28:49 +08:00
5e12d6a98e
HBASE-21018 RS crashed because AsyncFS was unable to update HDFS data encryption key
2018-08-10 19:53:22 -07:00
ee164fcbc5
HBASE-21025 Add cache for TableStateManager
2018-08-10 21:11:53 +08:00
8a9ba0c65b
HBASE-18201 add UT and docs for DataBlockEncodingTool
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:19:36 +08:00
e222686294
HBASE-20965 Separate region server report requests to new handlers
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-09 18:27:38 +08:00
b2fc0f48f6
HBASE-20813 Removed RPC quotas when the associated table/Namespace is dropped off
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-08 13:46:25 -04:00
ff89ec17c4
HBASE-21007 Memory leak in HBase REST server
...
Close the scanner leak in rest server when using the limit number of rows.
Example: when using uris like
/sometable/*?limit=5&startrow=eGlND&endrow=eGlNE
where the scan range has more rows than the limit, the
rest server will start leaking memmory.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-07 12:40:24 -07:00
9d594ac86a
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-07 14:03:03 +08:00
7e9f8c60e2
HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-03 11:07:01 -04:00
dff5ba27c3
HBASE-20749 Update to checkstyle 8.11
2018-08-02 14:19:30 -05:00
2e1c12ca1b
HBASE-20856 PITA having to set WAL provider in two places
...
With this change if hbase.wal.meta_provider is not explicitly set,
it uses whatever set with hbase.wal.provider. this change avoids a use
case of unexpectedly using two different providers when only
hbase.wal.provider is set to non-default but not hbase.wal.meta_provider.
This change also include document (architecture.adoc) update
Also, this is a port from master to branch-2
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <Apache9@apache.org>
2018-08-01 14:45:11 -07:00
88f3148810
HBASE-20989 Minor, miscellaneous logging fixes
...
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:01 -07:00
9338eaee65
HBASE-20794 add INFO level log to createTable operation
2018-08-01 11:04:00 -07:00
0f4e857c7a
HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing ADDENDUM: Rather than rollback, just do region reopens.
...
In split, reopen the parent if recovered.edits and in merge, reopen the
parent region or regions that happened to have recovered.edits on close.
2018-08-01 00:33:12 -07:00
daeec8657e
HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
2018-07-31 16:06:15 -07:00
1b66839bc4
HBASE-20538 Upgrade our hadoop versions to 2.7.7 and 3.0.3
2018-07-29 20:20:28 +08:00
a9346982bf
Revert "HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3"
...
This reverts commit 3dd83adb51
2018-07-29 20:20:20 +08:00
3dd83adb51
HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3
2018-07-29 20:04:48 +08:00
31cbd7ab8f
HBASE-19369 Switch to Builder Pattern In WAL
...
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).
Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:43:08 -05:00
8bfdb19e85
HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException
2018-07-27 21:30:23 +08:00
35c598db93
HBASE-20921 Possible NPE in ReopenTableRegionsProcedure
2018-07-27 09:31:12 +08:00
1777ea3aae
HBASE-20938 Set version to 2.1.1-SNAPSHOT for branch-2.1
2018-07-25 21:45:09 +08:00
3251554737
HBASE-20867 RS may get killed while master restarts
2018-07-25 18:11:28 +08:00
833657c46d
HBASE-20846 Restore procedure locks when master restarts
2018-07-25 14:37:36 +08:00
78948d987b
HBASE-20873 Update doc for Endpoint-based Export
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-07-25 10:44:58 +08:00
1dbfe92dbf
HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result
2018-07-24 10:39:36 +08:00
44bf7076b7
HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing
2018-07-24 09:51:46 +08:00
af2742fcf2
HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing
2018-07-23 14:35:27 +08:00
9d481f1faa
HBASE-20401 Make MAX_WAIT and waitIfNotFinished in CleanerContext configurable (Contributed by Stephen Wu)
2018-07-23 10:33:26 +08:00
46e5baf670
HBASE-20914 Trim Master memory usage
...
Add (weak reference) interning of ServerNames.
Correct Balancer regions x racks matrix.
Make smaller defaults when creating ArrayDeques.
2018-07-20 10:08:13 -07:00
679698a7f2
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
2018-07-20 11:31:21 +08:00
8461e85880
HBASE-20869 Endpoint-based Export use incorrect user to write to destination
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 20:48:42 +08:00
36c4f62daf
HBASE-20853 Polish "Add defaults to Table Interface so Implementors don't have to"
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 20:48:32 +08:00
9ac26b80b2
HBASE-20907 Fix Intermittent failure on TestProcedurePriority
2018-07-19 12:01:29 +08:00
cecce16fad
HBASE-20875 MemStoreLABImp::copyIntoCell uses 7% CPU when writing
...
Make the #copyCellInto method smaller so it inlines; we do it by
checking for the common type early and then taking a code path
that presumes ByteBufferExtendedCell -- avoids checks.
2018-07-18 20:40:47 -07:00
624a5c6644
HBASE-20884 Replace Base64 with j.u.Base64
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 13:00:40 -05:00
Sean Busbey
Andrew Purtell
Nihal Jain
Allan Yang
Michael Stack
Josh Elser
jingyuntian
Duo Zhang
jackbearden
brandboat
Wei-Chiu Chuang
meiyi
Sakthi
Bosko Devetak
Mike Drob
TAK LON WU
Xu Cang
Alex Leblang
huzheng
Reid Chan
Balazs Meszaros
Yu Li