668a179882
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:27:07 -07:00
704f8b81bb
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request, fix logging
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:08 -07:00
d39ea25d44
HBASE-21244 Skip persistence when retrying for assignment related procedures
2018-09-28 21:22:23 +08:00
3baafbed52
HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure
2018-09-28 20:20:48 +08:00
86cb8e48ad
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later
2018-09-27 16:24:17 +08:00
1154f81230
HBASE-21232 Show table state in Tables view on Master home page
2018-09-26 10:58:16 -07:00
d7e08317d2
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217
2018-09-26 20:53:56 +08:00
7b2f5950ed
HBASE-21212 Wrong flush time when update flush metric
2018-09-26 19:38:15 +08:00
0e173d38b0
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:20:57 +08:00
08c4d70aaf
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:28 -07:00
b8134fe5b6
HBASE-21221 Ineffective assertion in TestFromClientSide3#testMultiRowMutations
2018-09-25 09:17:26 -07:00
8eaaa63114
HBASE-21217 Revisit the executeProcedure method for open/close region
2018-09-25 17:30:21 +08:00
7ab77518a2
Amend HBASE-20704 Sometimes some compacted storefiles are not archived on region close
...
Forward port small logging improvements from branch-1 version of this change.
2018-09-21 16:12:33 -07:00
3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
98909f4a9d
HBASE-21214 [hbck2] setTableState just sets hbase:meta state, not in-memory state
2018-09-21 16:04:59 -07:00
ddd30a2241
HBASE-21206 Scan with batch size may return incomplete cells
2018-09-20 22:36:24 +08:00
cd161d976e
HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-20 06:57:50 -07:00
dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService
2018-09-19 15:18:16 -07:00
3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
...
Adds 'raw' assigns and unassigns methods to Hbck Service.
Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 10:06:16 -07:00
69431c75c1
HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region - addendum fixes NPE
2018-09-19 07:17:13 -07:00
cebb725a9f
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region - fix flaky test (Ram)
2018-09-18 11:28:23 +05:30
1cf920db43
HBASE-21160 Assertion in TestVisibilityLabelsWithDeletes#testDeleteColumnsWithoutAndWithVisibilityLabels is ignored (liubangchen)
2018-09-17 08:25:11 -07:00
6d7bc0e98b
HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
...
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.
Incorporates bulk of patch made by Allan Yang over on HBASE-21035.
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java
Add a Constructor for case where retries are for ever.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move stuff around so that the first hbase:meta read is the AM#loadMeta.
Previously, checking table state and/or favored nodes could end up
trying to read a meta that was not onlined holding up master startup.
Do similar for the namespace table. Adds new methods isMeta and
isNamespace which check that the regions/tables are online.. if not,
we wait logging with a back-off that assigns need to be run.
Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
cdfe808892
HBASE-20704 Sometimes some compacted storefiles are not archived on region close
2018-09-16 18:26:28 -07:00
9da20a4116
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
...
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-15 18:20:35 +08:00
0075093d21
HBASE-21168 Insecure Randomness in BloomFilterUtil
...
Flagged by Fortify static analysis
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-12 09:51:45 -05:00
5c1b325b51
HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
...
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
c372175da4
HBASE-21021 Result returned by Append operation should be ordered
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:43:52 -07:00
2ab8122a24
HBASE-21172 Addendum fix comment
2018-09-11 17:32:01 +08:00
c59ecfb961
HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure
2018-09-11 15:13:58 +08:00
bea26e98e6
HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 11:06:23 +08:00
2aae247e3f
HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
2018-09-10 21:32:46 +08:00
b09dbb443e
HBASE-21102 - ServerCrashProcedure should select target server where no
...
other replicas exist for the current region (fix compilation issue)
2018-09-10 13:23:53 +05:30
dc3ada2614
HBASE-21102 ServerCrashProcedure should select target server where no
...
other replicas exist for the current region (Ram)
2018-09-10 13:12:02 +05:30
a51c333856
HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck
2018-09-09 10:23:50 +09:00
b04b4b0fd1
HBASE-21144 Addendum fix race when testing whether a procedure is finished
2018-09-08 08:57:56 +08:00
c3419be003
HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0
2018-09-07 23:42:02 +08:00
aab3a8a870
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir; ADDENDUM
...
Address review comments.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-06 17:25:39 -07:00
3ac3249423
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir
2018-09-06 16:52:47 -07:00
b3908a26ff
HBASE-21161 Enable the test added in HBASE-20741 that was removed
...
accidentally (Ram)
2018-09-06 16:51:40 +05:30
a37c40faa5
HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 03:59:44 -07:00
bdc168713d
HBASE-21107 add a metrics for netty direct memory
2018-09-05 16:04:25 -07:00
b62ac3cb11
HBASE-20892 [UI] Start / End keys are empty on table.jsp
2018-09-05 09:09:04 +08:00
c6a65ba63f
HBASE-20741 - Split of a region with replicas creates all daughter regions
...
and its replica in same server (Addendum for duo's comments in RB)
2018-09-04 16:38:09 +05:30
f504c4d797
HBASE-21144 AssignmentManager.waitForAssignment is not stable
2018-09-04 17:07:51 +08:00
83131b1ac4
HBASE-20741 Split of a region with replicas creates all daughter regions
...
and its replica in same server (Ram)
Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:18:51 +05:30
e4c4035ed8
HBASE-20741 Split of a region with replicas creates all daughter regions
...
and its replica in same server (Ram)
Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:08:03 +05:30
245bb44703
HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
...
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:09:21 +08:00
5cca61c4d0
HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:27:23 -07:00
dc79029966
HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime
2018-09-02 18:35:45 +08:00
7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure
2018-08-30 12:23:24 -07:00
98600f1860
HBASE-21128 TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is broken
2018-08-30 10:09:44 +08:00
e903ae5d5e
HBASE-15728 Add Per-Table metrics back
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-29 15:21:00 -07:00
fcd883b5dd
HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
...
Also makes the trace log message length configurable.
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:01:49 -04:00
3afe9fb7e6
HBASE-21017 Revisit the expected states for open/close
2018-08-28 14:49:22 +08:00
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
6dd5383033
HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:20:31 -07:00
9e2732edbb
HBASE-21088 HStoreFile should be closed in HStore#hasReferences
2018-08-27 09:36:44 -07:00
993e74b747
HBASE-21072 Addendum do not write lock file when running TestHBaseFsckReplication
2018-08-27 21:03:32 +08:00
f05f116327
HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online
2018-08-26 13:57:44 +09:00
409e742ac3
Revert "HBASE-21017 Add debug log for finding out race where we update region state to OPEN accidentally"
...
This reverts commit a452487a9b
2018-08-25 15:21:55 +08:00
86b35b2687
HBASE-21072 Block out HBCK1 in hbase2
...
Write the hbase-1.x hbck1 lock file to block out hbck1 instances writing
state to an hbase-2.x cluster (could do damage).
Set hbase.write.hbck1.lock.file to false to disable this writing.
2018-08-24 09:26:43 -07:00
a452487a9b
HBASE-21017 Add debug log for finding out race where we update region state to OPEN accidentally
2018-08-24 11:48:04 +08:00
aac1a70147
HBASE-21095 The timeout retry logic for several procedures are broken after master restarts
2018-08-24 10:07:31 +08:00
780670ede1
HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
2018-08-23 11:48:27 -07:00
72b36e1d9a
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-08-24 00:22:22 +08:00
6a5b4f2a5c
HBASE-21101 Remove the waitUntilAllRegionsAssigned call after split in TestTruncateTableProcedure
2018-08-23 18:06:03 +08:00
2d911fdc2f
HBASE-20943 Add offline/online region count into metrics
2018-08-22 16:27:10 -07:00
91edbf592a
HBASE-20193 Move TestCreateTableProcedure.testMRegions to a separated file
2018-08-23 07:01:05 +08:00
b0af08bf9b
HBASE-21094 Remove the explicit timeout config for TestTruncateTableProcedure
...
(cherry picked from commit 74ea011169
2018-08-22 11:30:05 -05:00
899982c02d
Revert "HBASE-20194 Remove the explicit timeout config for TestTruncateTableProcedure"
...
This reverts commit 74ea011169
2018-08-22 11:30:05 -05:00
77a6bf3b33
HBASE-21041 Memstore's heap size will be decreased to minus zero after flush
2018-08-22 23:19:11 +08:00
4a52ddb75e
HBASE-21031 Memory leak if replay edits failed during region opening
2018-08-22 22:42:01 +08:00
064388b478
Revert "HBASE-21093 Increase the dispatch delay for testing DDL procedures"
...
This reverts commit c01d4d3a35
2018-08-22 21:48:03 +08:00
74ea011169
HBASE-20194 Remove the explicit timeout config for TestTruncateTableProcedure
2018-08-22 14:27:11 +08:00
c01d4d3a35
HBASE-21093 Increase the dispatch delay for testing DDL procedures
2018-08-22 14:26:35 +08:00
50055dbf04
HBASE-20666 Unsuccessful table creation leaves entry in hbase:rsgroup table
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-21 18:54:36 -07:00
a42556553a
HBASE-21032 ScanResponses contain only one cell each
...
Amending-Author: Duo Zhang <zhangduo@apache.org>
2018-08-21 13:32:05 -07:00
bb3494134e
HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region
2018-08-21 06:12:09 +08:00
7db116ae1b
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region - addendum
2018-08-19 14:24:06 -07:00
d159b1f8bb
HBASE-21056 Findbugs false positive: BucketCache.persistToFile may fail to clean up java.io.OutputStream
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-17 21:29:32 -05:00
e8eb366514
HBASE-20940 HStore.cansplit should not allow split to happen if it has references (Vishal Khandelwal)
2018-08-17 15:01:44 -07:00
1dbd6fa993
HBASE-21047 Object creation of StoreFileScanner thru constructor and close may leave refCount to -1 (Vishal Khandelwal)
2018-08-16 11:42:15 -07:00
2cfe1e8aef
HBASE-20705 Having RPC quota on a table now no longer prevents Space Quota to be recreate/removed
...
Just added 2 test cases as the subtasks of this jira solves the issue
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-16 11:07:37 -04:00
50a8ea7191
HBASE-21062 Spelling mistake (addendum)
...
Forgot to change in master before pushing.
2018-08-16 10:35:47 -04:00
4d7ed0f94c
HBASE-21062 Correctly use the defaultProvider value on the Providers enum when constructing a WALProvider
2018-08-16 10:23:03 -04:00
092efb4274
HBASE-20469 Directory used for sidelining old recovered edits files should be made configurable
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-15 17:58:13 -07:00
49ae8549cf
HBASE-21040 Replace call to printStackTrace() with proper logger call
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-15 08:29:54 -07:00
e705cf1447
HBASE-20772 Controlled shutdown fills Master log with the disturbing message 'No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSED'
...
Look for the particular case where RS does the close of region w/o
involving Master and log special message in this case. Dodgy. But
until we have Master run shutdown of all regions, better than
the message we currently show.
2018-08-13 15:59:54 -07:00
21e02813fe
HBASE-20985 add two attributes when we do normalization
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:43:54 +08:00
911a6ef412
HBASE-21025 Addendum missed a 'succ = true'
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 10:53:47 +08:00
699ea4c7d0
HBASE-21012 Revert the change of serializing TimeRangeTracker
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-08-11 22:17:04 +08:00
a3ab9306a6
HBASE-21018 RS crashed because AsyncFS was unable to update HDFS data encryption key
2018-08-10 19:53:41 -07:00
397388316e
HBASE-21025 Add cache for TableStateManager
2018-08-10 21:11:40 +08:00
28635d6101
HBASE-18201 add UT and docs for DataBlockEncodingTool
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-08-10 11:15:50 +08:00
c6ff1de7e2
HBASE-21027 Inconsistent synchronization in CacheableDeserializerIdManager
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-08-09 09:29:21 -05:00
e2fcde2d6f
HBASE-20965 Separate region server report requests to new handlers
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-09 18:10:08 +08:00
d921262d38
Revert "HBASE-20965 Separate region server report requests to new handlers"
...
This reverts commit 48d387413f
2018-08-08 10:44:50 +08:00
48d387413f
HBASE-20965 Separate region server report requests to new handlers
2018-08-08 10:39:11 +08:00
6f25102997
HBASE-20813 Removed RPC quotas when the associated table/Namespace is dropped off
...
Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-07 13:17:54 -04:00
bd01fa7639
HBASE-20986 Separate the config of block size when we do log splitting and write Hlog
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-07 10:37:22 +08:00
bd30ca62ef
HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-03 11:06:50 -04:00
b3e41c9525
HBASE-19036 Add action in Chaos Monkey to restart Active Namenode
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-02 04:59:51 -07:00
4bcaf495c2
HBASE-20894 Use proto for BucketCache persistence
2018-08-01 16:54:25 -05:00
1d0fca370b
HBASE-20856 PITA having to set WAL provider in two places
...
With this change if hbase.wal.meta_provider is not explicitly set,
it uses whatever set with hbase.wal.provider. this change avoids a use
case of unexpectedly using two different providers when only
hbase.wal.provider is set to non-default but not hbase.wal.meta_provider.
This change also include document (architecture.adoc) update
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <Apache9@apache.org>
2018-08-01 11:29:15 -07:00
c365c4084e
HBASE-20989 Minor, miscellaneous logging fixes
...
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:59 -07:00
e7b56c3fa8
HBASE-20794 add INFO level log to createTable operation
2018-08-01 11:04:38 -07:00
323907f84f
HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing ADDENDUM: Rather than rollback, just do region reopens.
...
In split, reopen the parent if recovered.edits and in merge, reopen the
parent region or regions that happened to have recovered.edits on close.
2018-08-01 00:33:55 -07:00
5a1e02b6dc
HBASE-20935 HStore.removeCompactedFiles should log in case it is unable to delete a file (Vishal Khandelwal)
2018-07-31 15:58:05 -07:00
7be97980f5
HBASE-20950 Helper method to configure secure DFS cluster for tests
...
Create a helper method HBaseKerberosUtils#setSecuredConfiguration().
TestSecureExport, TestSaslFanOutOneBlockAsyncDFSOutput,
SecureTestCluster and TestThriftSpnegoHttpServer uses this new helper
method.
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-31 13:36:17 -07:00
a8e184dc77
HBASE-20886 [Auth] Support keytab login in hbase client
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-31 11:04:40 +08:00
df256223d6
HBASE-20538 Upgrade our hadoop versions to 2.7.7 and 3.0.3
2018-07-29 20:18:40 +08:00
e8cd3c4b95
Revert "HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3"
...
This reverts commit 336fd14e26
2018-07-29 20:18:23 +08:00
336fd14e26
HBASE-20538 Upgrade our hadoop-two.version to 2.7.7 and 3.0.3
2018-07-29 20:04:57 +08:00
e963694259
HBASE-19369 Switch to Builder Pattern In WAL
...
This patch switches to the builder pattern by adding a helper method.
It also checks to ensure that the pattern is available (i.e. that
HBase is running on a hadoop version that supports it).
Amending-Author: Mike Drob <mdrob@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-27 23:42:33 -05:00
7178a98258
HBASE-20939 There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedException
2018-07-27 17:27:12 +08:00
80b40a3b58
HBASE-20921 Possible NPE in ReopenTableRegionsProcedure
2018-07-27 09:36:50 +08:00
d43e28dc82
Revert "HBASE-20949 Add logs for debugging"
...
This reverts commit 8b8de1f8a7
2018-07-27 08:40:46 +08:00
8b8de1f8a7
HBASE-20949 Add logs for debugging
2018-07-26 22:43:14 +08:00
a392c017ed
HBASE-20932 Effective MemStoreSize::hashCode()
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-25 14:40:45 -07:00
ba5d1c1f28
HBASE-20649 Validate HFiles do not have PREFIX_TREE DataBlockEncoding
...
Amending-Author: Balazs Meszaros <balazs.meszaros@cloudera.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-25 09:00:00 -05:00
44f6ef1c90
HBASE-20867 RS may get killed while master restarts
2018-07-25 18:16:28 +08:00
f3f17fa111
HBASE-20846 Restore procedure locks when master restarts
2018-07-25 14:37:26 +08:00
3a3855aade
HBASE-20928 Rewrite calculation of midpoint in binarySearch functions to prevent overflow
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-24 08:16:30 -07:00
a888af3dc9
HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result
2018-07-24 10:29:24 +08:00
b631727bdf
HBASE-20878 Data loss if merging regions while ServerCrashProcedure executing
2018-07-24 10:00:28 +08:00
4804483f7e
HBASE-20893 Data loss if splitting region while ServerCrashProcedure executing
2018-07-23 14:48:43 +08:00
37de961f20
HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region
2018-07-22 20:50:51 -07:00
4613f3e8c7
HBASE-20401 Make MAX_WAIT and waitIfNotFinished in CleanerContext configurable (Contributed by Stephen Wu)
2018-07-23 10:30:01 +08:00
682aa69677
HBASE-19893 restore_snapshot is broken in master branch when region splits
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-21 07:37:10 -07:00
eb906e20ee
HBASE-20908 Infinite loop on regionserver if region replica are reduced
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-20 13:05:11 -07:00
067388bfd9
HBASE-20914 Trim Master memory usage
...
Add (weak reference) interning of ServerNames.
Correct Balancer regions x racks matrix.
Make smaller defaults when creating ArrayDeques.
2018-07-20 10:08:55 -07:00
03e596c669
HBASE-20870 Wrong HBase root dir in ITBLL's Search Tool
2018-07-20 12:17:21 +08:00
e66a6603e3
HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:33:09 -07:00
b4eacdabd6
HBASE-20901 Reducing region replica has no effect
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 13:38:32 -07:00
950d6e6fb0
HBASE-6028 Start/Stop compactions at region server level
...
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 06:20:44 -07:00
7e599428d3
HBASE-20823. Fix wrong param name in javadoc
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-19 18:26:18 +08:00
619e0fdab8
HBASE-20907 Fix Intermittent failure on TestProcedurePriority
2018-07-19 12:00:55 +08:00
2bf5e46a33
HBASE-20875 MemStoreLABImp::copyIntoCell uses 7% CPU when writing
...
Make the #copyCellInto method smaller so it inlines; we do it by
checking for the common type early and then taking a code path
that presumes ByteBufferExtendedCell -- avoids checks.
2018-07-18 20:41:19 -07:00
2997b6d071
HBASE-20879 Compacting memstore config should handle lower case
2018-07-13 11:19:45 -07:00
ce82fd0f47
HBASE-19572 RegionMover should use the configured default port number and not the one from HConstants
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-13 10:44:35 +08:00
3fc23fe930
HBASE-20865 CreateTableProcedure is stuck in retry loop in CREATE_TABLE_WRITE_FS_LAYOUT state
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-12 00:15:26 -07:00
51527f551b
HBASE-20860 Merged region's RIT state may not be cleaned after master restart
2018-07-12 10:12:07 +08:00
4a08135dd8
HBASE-20847 Addendum use addFront instead of addBack to add sub procedure
2018-07-12 08:31:05 +08:00
a838f7631f
HBASE-20847 The parent procedure of RegionTransitionProcedure may not have the table lock
2018-07-11 17:34:35 +08:00
1804b6d059
HBASE-20542-ADDENDUM: fix TestHStore
2018-07-11 11:25:49 +03:00
1e0650955a
HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 10:52:06 +08:00
d7561cee50
HBASE-20784 Will lose the SNAPSHOT suffix if we get the version of RS from ServerManager
2018-07-10 09:59:41 +08:00
ad5b4af2c4
HBASE-20833 Modify pre-upgrade coprocessor validator to support table level coprocessors
...
- -jar parameter now accepts multiple jar files and directories of jar files.
- observer classes can be verified by -class option.
- -table parameter was added to check table level coprocessors.
- -config parameter was added to obtain the coprocessor classes from
HBase cofiguration.
- -scan option was removed.
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-07-09 11:00:36 -05:00
59867eeeeb
HBASE-20806 Split style journal for flushes and compactions
2018-07-09 18:25:34 +05:30
b5222f88b2
HBASE-20822 TestAsyncNonMetaRegionLocator is flakey
2018-07-09 14:56:37 +08:00
3bca01854a
HBASE-20842 Infinite loop when replaying remote wals
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-08 09:35:45 +08:00
361be53344
HBASE-20808 (Addendum) Remove duplicate calls for cancelling of chores
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:17:10 +08:00
1ade4d2f44
HBASE-20808 Wrong shutdown order between Chores and ChoreService
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-06 11:35:03 +08:00
ec8947f226
HBASE-20691 Change the default WAL storage policy back to "NONE""
...
This reverts commit 564c193d61
2018-07-04 13:43:48 +08:00
ee3990e42c
HBASE-20474 Show non-RPC tasks on master/regionserver Web UI by default
2018-07-04 10:53:02 +08:00
4366720bd1
HBASE-20839 Fallback to FSHLog if we can not instantiated AsyncFSWAL when user does not specify AsyncFSWAL explicitly
2018-07-04 10:29:24 +08:00
0f23784182
HBASE-20244 NoSuchMethodException when retrieving private method decryptEncryptedDataEncryptionKey from DFSClient
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-03 22:15:18 +08:00
0454878e71
HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky
2018-07-03 17:56:34 +08:00
66ad9fdef8
HBASE-20193 Basic Replication Web UI - Regionserver
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-03 15:47:14 +08:00
380350d5bc
HBASE-20829 Remove the addFront assertion in MasterProcedureScheduler.doAdd
2018-07-03 15:43:20 +08:00
13e4578be8
HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-03 10:14:34 +08:00
cfdabe9267
HBASE-20817 Infinite loop when executing ReopenTableRegionsProcedure
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-07-02 21:26:14 +08:00
d822ee3a7c
HBASE-20542: Better heap utilization for IMC with MSLABs
2018-07-01 15:31:31 +03:00
112d050609
HBASE-20829 TestSyncReplicationStandbyKillRS is flakey - add error log for debugging
2018-07-01 18:14:10 +08:00
34e23fe425
HBASE-20825 Fix pre and post hooks of CloneSnapshot and RestoreSnapshot for Access checks
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-06-29 16:33:02 -04:00
bb8826ca5f
HBASE-20357 AccessControlClient API Enhancement
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-06-28 22:48:58 -07:00
fe75f90be2
HBASE-20792 info:servername and info:sn inconsistent for OPEN region
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-06-29 11:10:40 +08:00
78e7dd6537
HBASE-19722 Meta query statistics metrics source
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:23 -07:00
0789e15b5e
HBASE-20790 Fix the style issues on branch HBASE-19064 before merging back to master
2018-06-28 18:08:43 +08:00
a84cdbd579
HBASE-20783 Addendum fix broken TestSyncReplicationStandBy
2018-06-28 18:08:43 +08:00
44ca13fe07
HBASE-20569 NPE in RecoverStandbyProcedure.execute
2018-06-28 18:08:43 +08:00
7448b045cc
HBASE-20660 Reopen regions using ReopenTableRegionsProcedure
2018-06-28 18:08:43 +08:00
05295abd5b
HBASE-20637 Polish the WAL switching when transiting from A to S
2018-06-28 18:08:43 +08:00
f67763ffa0
HBASE-20424 Allow writing WAL to local and remote cluster concurrently
2018-06-28 18:08:43 +08:00
603110719d
HBASE-20576 Check remote WAL directory when creating peer and transiting peer to A
2018-06-28 18:08:43 +08:00
8a264dfc00
HBASE-19865 Add UT for sync replication peer in DA state
2018-06-28 18:08:43 +08:00
ae6c90b4ec
HBASE-20426 Give up replicating anything in S state
2018-06-28 18:08:43 +08:00
5b6c0d2777
HBASE-20432 Cleanup related resources when remove a sync replication peer
2018-06-28 18:08:43 +08:00
1bea678ef8
HBASE-20458 Support removing a WAL from LogRoller
2018-06-28 18:08:43 +08:00
2d203c4479
HBASE-20434 Also remove remote wals when peer is in DA state
2018-06-28 18:08:43 +08:00
b281328228
HBASE-20456 Support removing a ReplicationSourceShipper for a special wal group
2018-06-28 18:08:43 +08:00
66cced16dc
HBASE-20425 Do not write the cluster id of the current active cluster when writing remote WAL
2018-06-28 18:08:43 +08:00
fe339860b5
HBASE-19782 Reject the replication request when peer is DA or A state
2018-06-28 18:08:43 +08:00
d91784e666
HBASE-20370 Also remove the wal file in remote cluster when we finish replicating a file
2018-06-28 18:08:43 +08:00
d57c80c415
HBASE-20163 Forbid major compaction when standby cluster replay the remote wals
2018-06-28 18:08:43 +08:00
2389c09d75
HBASE-19079 Support setting up two clusters with A and S stat
2018-06-28 18:08:43 +08:00
c7d1085fa2
HBASE-19999 Remove the SYNC_REPLICATION_ENABLED flag
2018-06-28 18:07:44 +08:00
183b8d0581
HBASE-19973 Implement a procedure to replay sync replication wal for standby cluster
2018-06-28 18:07:44 +08:00
45794d4156
HBASE-19943 Only allow removing sync replication peer which is in DA state
2018-06-28 18:07:44 +08:00
0c97cda2a9
HBASE-19990 Create remote wal directory when transitting to state S
2018-06-28 18:07:44 +08:00
a41c549ca4
HBASE-19082 Reject read/write from client but accept write from replication in state S
2018-06-28 18:07:44 +08:00
39dd81a7c6
HBASE-19957 General framework to transit sync replication state
2018-06-28 18:07:44 +08:00
00e54aae24
HBASE-19935 Only allow table replication for sync replication for now
2018-06-28 18:07:44 +08:00
1481bd9481
HBASE-19864 Use protobuf instead of enum.ordinal to store SyncReplicationState
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
d8842dc3d4
HBASE-19857 Complete the procedure for adding a sync replication peer
2018-06-28 18:07:44 +08:00
2acebac00e
HBASE-19781 Add a new cluster state flag for synchronous replication
2018-06-28 18:07:44 +08:00
274b813e12
HBASE-19747 Introduce a special WALProvider for synchronous replication
2018-06-28 18:07:44 +08:00
b4a1dbf768
HBASE-19078 Add a remote peer cluster wal directory config for synchronous replication
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
b3dea0378e
HBASE-19083 Introduce a new log writer which can write to two HDFSes
2018-06-28 18:07:44 +08:00
ramie-raufdeen
xcang
zhangduo
Allan Yang
Michael Stack
Zach York
Mingliang Liu
tedyu
Andrew Purtell
Guangxu Cheng
openinx
tianjingyun
Umesh Agashe
Vasudevan
Francis Liu
Mike Drob
Tyler Mi
Nihal Jain
Toshihiro Suzuki
Huaxiang Sun
Reid Chan
David Manning
krish.dey
liubangchen
Jinghan Xu
Sean Busbey
Andrey Elenskiy
Sakthi
Josh Elser
subrat.mishra
brandboat
Wei-Chiu Chuang
meiyi
Monani Mihir
TAK LON WU
Alex Leblang
Peter Somogyi
Saurabh Singh
Ankit Singhal
Ankit
Mohit Goel
jack-altiscale
Yu Li
eshcar
zhaoyuan
Balazs Meszaros
Abhishek Singh Chouhan
Guanghao Zhang
Ted Yu
huzheng
Pankaj