Commit Graph

15684 Commits

Author SHA1 Message Date
Sean Busbey f9793fafb7 HBASE-20387 turn flaky test tracking infra into per-branch pipeline.
* gather up all the flaky test stuff into a directory
* create Jenkins Pipeline DSL for the report generation and the flaky re-testing
* have the nightly per-branch job consume the results of flaky reporting

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-16 23:16:21 -05:00
Andrew Purtell 1dbd6fa993 HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal) 2018-08-16 11:42:15 -07:00
Sakthi 2cfe1e8aef HBASE-20705 Having RPC quota on a table now no longer prevents Space Quota to be recreate/removed
Just added 2 test cases as the subtasks of this jira solves the issue

Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-16 11:07:37 -04:00
Josh Elser 50a8ea7191 HBASE-21062 Spelling mistake (addendum)
Forgot to change in master before pushing.
2018-08-16 10:35:47 -04:00
Josh Elser 4d7ed0f94c HBASE-21062 Correctly use the defaultProvider value on the Providers enum when constructing a WALProvider 2018-08-16 10:23:03 -04:00
Nihal Jain 092efb4274 HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 17:58:13 -07:00
Allan Yang 159435ee40 HBASE-21050 Exclusive lock may be held by a SUCCESS state procedure forever
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-08-15 15:39:48 -07:00
subrat.mishra 49ae8549cf HBASE-21040 Replace call to printStackTrace() with proper logger call
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-15 08:29:54 -07:00
Allan Yang 1114a1a65e HBASE-20978 [amv2] Worker terminating UNNATURALLY during MoveRegionProcedure Signed-off-by: Michael Stack <stack@apache.org> Signed-off-by: Duo Zhang <zhangduo@apache.org> 2018-08-14 16:30:20 -07:00
Sean Busbey 346dd32185 HBASE-20979 Flaky test reporting should specify what JSON it needs and handle HTTP errors
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-14 13:13:51 -05:00
Michael Stack e705cf1447 HBASE-20772 Controlled shutdown fills Master log with the disturbing message 'No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSED'
Look for the particular case where RS does the close of region w/o
involving Master and log special message in this case. Dodgy. But
until we have Master run shutdown of all regions, better than
the message we currently show.
2018-08-13 15:59:54 -07:00
Josh Elser a2d3f161fe HBASE-21005 Remove local maven repo and fluido-skin jar
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-13 18:21:19 -04:00
Artem Ervits d6e1646bea HBASE-20257 hbase-spark should not depend on com.google.code.findbugs.jsr305
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-13 11:01:44 -07:00
Allan Yang a07e755625 HBASE-20975 Lock may not be taken or released while rolling back procedure 2018-08-13 20:23:04 +08:00
jingyuntian 21e02813fe HBASE-20985 add two attributes when we do normalization
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:43:54 +08:00
Duo Zhang 911a6ef412 HBASE-21025 Addendum missed a 'succ = true'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 10:53:47 +08:00
tedyu 067fbaa5b5 HBASE-21038 SAXParseException when hbase.spark.use.hbasecontext=false (Ajith S) 2018-08-12 09:29:37 -07:00
jackbearden 953e5aa88c HBASE-20981. Rollback stateCount accounting thrown-off when exception out of rollbackState
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-11 11:58:38 -07:00
Michael Stack 695182bfe3 HBASE-20512 document change to running tests on secure clusters
Signed-off-by: Tak Lon (Stephen) Wu
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-11 11:19:57 -07:00
Toshihiro Suzuki 7f3d9f6f9c Add brfrn169 (Toshihiro Suzuki) as a committer 2018-08-12 01:30:29 +09:00
brandboat 699ea4c7d0 HBASE-21012 Revert the change of serializing TimeRangeTracker
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-08-11 22:17:04 +08:00
Wei-Chiu Chuang a3ab9306a6 HBASE-21018 RS crashed because AsyncFS was unable to update HDFS data encryption key 2018-08-10 19:53:41 -07:00
Sahil Aggarwal 86821dee22 HBASE-20753 fix the email address for security related issues in docs
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-10 10:29:36 -05:00
zhangduo 397388316e HBASE-21025 Add cache for TableStateManager 2018-08-10 21:11:40 +08:00
brandboat 28635d6101 HBASE-18201 add UT and docs for DataBlockEncodingTool
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:15:50 +08:00
Mike Drob c6ff1de7e2
HBASE-21027 Inconsistent synchronization in CacheableDeserializerIdManager
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-09 09:29:21 -05:00
meiyi e2fcde2d6f HBASE-20965 Separate region server report requests to new handlers
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-09 18:10:08 +08:00
Mingliang Liu 3f5033f88e HBASE-21026 Fix Backup/Restore command usage bug in book
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-08 12:01:32 -07:00
Reid Chan d921262d38 Revert "HBASE-20965 Separate region server report requests to new handlers"
This reverts commit 48d387413f.
2018-08-08 10:44:50 +08:00
meiyi 48d387413f HBASE-20965 Separate region server report requests to new handlers 2018-08-08 10:39:11 +08:00
Guangxu Cheng b9413839ab HBASE-20845 Support set the consistency for Gets and Scans in thrift2
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-07 13:34:17 -07:00
Bosko Devetak 4329330cf1 HBASE-21007 Memory leak in HBase REST server
Close the scanner leak in rest server when using the limit number of rows.

Example: when using uris like

        /sometable/*?limit=5&startrow=eGlND&endrow=eGlNE

where the scan range has more rows than the limit, the
rest server will start leaking memmory.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-07 12:40:12 -07:00
Sakthi 6f25102997 HBASE-20813 Removed RPC quotas when the associated table/Namespace is dropped off
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-07 13:17:54 -04:00
jingyuntian bd01fa7639 HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-07 10:37:22 +08:00
Sakthi bd30ca62ef HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-03 11:06:50 -04:00
Mike Drob 613d831429
HBASE-20749 Update to checkstyle 8.11 2018-08-02 14:27:07 -05:00
Monani Mihir b3e41c9525 HBASE-19036 Add action in Chaos Monkey to restart Active Namenode
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-02 04:59:51 -07:00
Michael Stack 78164efcf4 Revert "HBASE-20937 Update the support matrix in our ref guide about recent hadoop releases"
Revert. Need discuss on mailing list first.

This reverts commit 1b28903b7b.
2018-08-01 21:07:37 -07:00
Mike Drob 4bcaf495c2
HBASE-20894 Use proto for BucketCache persistence 2018-08-01 16:54:25 -05:00
Daisuke Kobayashi 9b06361a5a HBASE-20550 Document about MasterProcWAL
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-01 13:33:34 -07:00
Vladimir Rodionov d53a976e8d HBASE-20729: B & R BackupLogCleaner must ignore ProcV2 WAL files
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-01 12:33:33 -07:00
TAK LON WU 1d0fca370b HBASE-20856 PITA having to set WAL provider in two places
With this change if hbase.wal.meta_provider is not explicitly set,
it uses whatever set with hbase.wal.provider. this change avoids a use
case of unexpectedly using two different providers when only
hbase.wal.provider is set to non-default but not hbase.wal.meta_provider.

This change also include document (architecture.adoc) update

Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <Apache9@apache.org>
2018-08-01 11:29:15 -07:00
Michael Stack c365c4084e HBASE-20989 Minor, miscellaneous logging fixes
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:59 -07:00
Xu Cang e7b56c3fa8 HBASE-20794 add INFO level log to createTable operation 2018-08-01 11:04:38 -07:00
Michael Stack 1b28903b7b HBASE-20937 Update the support matrix in our ref guide about recent hadoop releases
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-08-01 08:25:02 -07:00
Michael Stack 323907f84f HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing ADDENDUM: Rather than rollback, just do region reopens.
In split, reopen the parent if recovered.edits and in merge, reopen the
parent region or regions that happened to have recovered.edits on close.
2018-08-01 00:33:55 -07:00
Andrew Purtell 5a1e02b6dc HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal) 2018-07-31 15:58:05 -07:00
Wei-Chiu Chuang 7be97980f5 HBASE-20950 Helper method to configure secure DFS cluster for tests
Create a helper method HBaseKerberosUtils#setSecuredConfiguration().
TestSecureExport, TestSaslFanOutOneBlockAsyncDFSOutput,
SecureTestCluster and TestThriftSpnegoHttpServer uses this new helper
method.

Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-31 13:36:17 -07:00
Reid Chan a8e184dc77 HBASE-20886 [Auth] Support keytab login in hbase client
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-31 11:04:40 +08:00
Josh Elser 803b62f0b2 HBASE-20977 Avoid using the word "snapshot" when defining HBase Snapshots
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-07-30 18:12:39 -04:00