Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,323 Commits 95 Branches 866 Tags
Commit Graph

6866 Commits

Author SHA1 Message Date
zhangduo
3dd83adb51 HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3 2018-07-29 20:04:48 +08:00
Alex Leblang
31cbd7ab8f
HBASE-19369 Switch to Builder Pattern In WAL 
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).

Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-07-27 23:43:08 -05:00
zhangduo
8bfdb19e85 HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException 2018-07-27 21:30:23 +08:00
Allan Yang
35c598db93 HBASE-20921 Possible NPE in ReopenTableRegionsProcedure 2018-07-27 09:31:12 +08:00
zhangduo
1777ea3aae HBASE-20938 Set version to 2.1.1-SNAPSHOT for branch-2.1 2018-07-25 21:45:09 +08:00
Allan Yang
3251554737 HBASE-20867 RS may get killed while master restarts 2018-07-25 18:11:28 +08:00
zhangduo
833657c46d HBASE-20846 Restore procedure locks when master restarts 2018-07-25 14:37:36 +08:00
huzheng
1dbfe92dbf HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:39:36 +08:00
Allan Yang
44bf7076b7 HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing 2018-07-24 09:51:46 +08:00
Allan Yang
af2742fcf2 HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing 2018-07-23 14:35:27 +08:00
Reid Chan
9d481f1faa HBASE-20401 Make MAX_WAIT and waitIfNotFinished in CleanerContext configurable (Contributed by Stephen Wu) 2018-07-23 10:33:26 +08:00
Michael Stack
46e5baf670 HBASE-20914 Trim Master memory usage 
Add (weak reference) interning of ServerNames.

Correct Balancer regions x racks matrix.

Make smaller defaults when creating ArrayDeques.
 2018-07-20 10:08:13 -07:00
Allan Yang
679698a7f2 HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool 2018-07-20 11:31:21 +08:00
Yu Li
9ac26b80b2 HBASE-20907 Fix Intermittent failure on TestProcedurePriority 2018-07-19 12:01:29 +08:00
Michael Stack
cecce16fad HBASE-20875 MemStoreLABImp::copyIntoCell uses 7% CPU when writing 
Make the #copyCellInto method smaller so it inlines; we do it by
checking for the common type early and then taking a code path
that presumes ByteBufferExtendedCell -- avoids checks.
 2018-07-18 20:40:47 -07:00
Toshihiro Suzuki
e14b49080b HBASE-20865 CreateTableProcedure is stuck in retry loop in CREATE_TABLE_WRITE_FS_LAYOUT state 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-13 08:31:59 -07:00
Toshihiro Suzuki
881409bd0b HBASE-19572 RegionMover should use the configured default port number and not the one from HConstants 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-07-13 10:46:51 +08:00
Allan Yang
368b1b1060 HBASE-20860 Merged region's RIT state may not be cleaned after master restart 2018-07-12 12:16:49 +08:00
zhangduo
8eab6d7a45 HBASE-20847 Addendum use addFront instead of addBack to add sub procedure 2018-07-12 08:31:40 +08:00
zhangduo
113652eb88 HBASE-20847 The parent procedure of RegionTransitionProcedure may not have the table lock 2018-07-11 17:37:27 +08:00
zhaoyuan
8de69db143 HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations() 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-07-11 11:17:41 +08:00
zhangduo
5e25bc92cf HBASE-20784 Will lose the SNAPSHOT suffix if we get the version of RS from ServerManager 2018-07-10 10:00:15 +08:00
Abhishek Singh Chouhan
dddf15ae6b HBASE-20806 Split style journal for flushes and compactions 2018-07-09 12:42:20 -07:00
Balazs Meszaros
da7fef6bf5
HBASE-20833 Modify pre-upgrade coprocessor validator to support table level coprocessors 
- -jar parameter now accepts multiple jar files and directories of jar files.
- observer classes can be verified by -class option.
- -table parameter was added to check table level coprocessors.
- -config parameter was added to obtain the coprocessor classes from
  HBase cofiguration.
- -scan option was removed.

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-07-09 14:19:12 -05:00
zhangduo
5a40606422 HBASE-20822 TestAsyncNonMetaRegionLocator is flakey 2018-07-09 14:56:45 +08:00
Nihal Jain
927ac8228f HBASE-20808 (Addendum) Remove duplicate calls for cancelling of chores 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-07-07 00:21:08 +08:00
Nihal Jain
3ed9350233 HBASE-20808 Wrong shutdown order between Chores and ChoreService 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-07-07 00:20:08 +08:00
zhangduo
a2db3d27ff HBASE-20849 Set version as 2.1.0 in branch-2.1 in prep for first RC 2018-07-06 15:32:23 +08:00
zhangduo
159f1b4686 Revert "HBASE-20808 Wrong shutdown order between Chores and ChoreService" 
For cutting 2.1.0RC0

This reverts commit ae2c858c5ef30695d939af748cba1080be0ce970.
 2018-07-06 15:29:58 +08:00
Nihal Jain
ae2c858c5e HBASE-20808 Wrong shutdown order between Chores and ChoreService 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2018-07-06 11:38:17 +08:00
Yu Li
d61bb64e93 HBASE-20691 Change the default WAL storage policy back to "NONE"" 
This reverts commit 564c193d61cd1f92688a08a3af6d55ce4c4636d8 and added more doc
about why we choose "NONE" as the default.
 2018-07-04 13:45:54 +08:00
Guangxu Cheng
60ebdd9fd8 HBASE-20474 Show non-RPC tasks on master/regionserver Web UI by default 2018-07-04 10:54:21 +08:00
zhangduo
5dacfe9427 HBASE-20839 Fallback to FSHLog if we can not instantiated AsyncFSWAL when user does not specify AsyncFSWAL explicitly 2018-07-04 10:29:36 +08:00
zhangduo
fedbd00ef1 HBASE-20829 Remove the addFront assertion in MasterProcedureScheduler.doAdd 2018-07-04 09:41:02 +08:00
Ted Yu
927a957390 HBASE-20244 NoSuchMethodException when retrieving private method decryptEncryptedDataEncryptionKey from DFSClient 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-07-03 22:16:04 +08:00
huzheng
ce99588530 HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky 2018-07-03 18:05:17 +08:00
jingyuntian
6b8cd00ec0 HBASE-20193 Basic Replication Web UI - Regionserver 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-07-03 16:10:31 +08:00
Josh Elser
8f9c322cda HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-03 10:14:57 +08:00
Ankit Singhal
d22c6de648 HBASE-20825 Fix pre and post hooks of CloneSnapshot and RestoreSnapshot for Access checks 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-07-03 10:06:13 +08:00
Ankit Singhal
4a80b19d7f HBASE-20817 Infinite loop when executing ReopenTableRegionsProcedure 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-07-02 21:29:09 +08:00
Josh Elser
44573b54c1 HBASE-20792 info:servername and info:sn inconsistent for OPEN region 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-06-29 11:11:22 +08:00
Michael Stack
becb638370 HBASE-20781 Save recalculating families in a WALEdit batch of Cells 
Pass the Set of families through to the WAL rather than recalculate
a Set already known.

Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-27 22:04:22 -07:00
Reid Chan
43c0df51ea HBASE-20732 Shutdown scan pool when master is stopped 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-06-28 12:54:54 +08:00
Sahil Aggarwal
4ba2abf43b
HBASE-19164: Remove UUID.randomUUID in tests. 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-27 10:37:15 -05:00
jingyuntian
bd40cba8dd HBASE-20194 Basic Replication WebUI - Master 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-26 18:29:01 +08:00
zhangduo
07afb7e32f HBASE-20777 RpcConnection could still remain opened after we shutdown the NettyRpcServer 2018-06-26 09:08:05 +08:00
Michael Stack
3f319bef8d HBASE-20780 ServerRpcConnection logging cleanup Get rid of one of the logging lines in ServerRpcConnection by amalgamating all into one new-style log line. 2018-06-25 16:44:07 -07:00
Todd Lipcon
3673bfc241 HBASE-20403. Fix race between prefetch task and non-pread HFile reads 
With prefetch-on-open enabled, the task doing the prefetching was using
non-positional (i.e. streaming) reads. If the main (non-prefetch) thread
was also using non-positional reads, these two would conflict, because
inputstreams are not thread-safe for non-positional reads.

In the case of an encrypted filesystem, this could cause JVM crashes,
etc, as underlying cipher buffers were freed underneath the racing
threads. In the case of a non-encrypted filesystem, less severe errors
would be thrown. The included unit test reproduces the latter case.

(cherry picked from commit 025ddce868eb06b4072b5152c5ffae5a01e7ae30)
Signed-off-by: Todd Lipcon <todd@cloudera.com>
 2018-06-25 12:12:30 -07:00
Michael Stack
d6cea08efe
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do 
General log cleanup; setting stuff that can flood the log to TRACE.
 2018-06-25 12:12:03 -07:00
Michael Stack
7c45f02110 HBASE-20778 Make it so WALPE runs on DFS 2018-06-23 23:34:40 -07:00