Commit Graph

7533 Commits

Author SHA1 Message Date
stack 4565e9f43b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:07:10 -07:00
stack d23236a452 HBASE-22751 table.jsp fails if ugly regions in table 2019-07-29 15:14:41 -07:00
stack 8b1952a42a HBASE-22751 table.jsp fails if ugly regions in table 2019-07-29 15:06:22 -07:00
Venkatesh Sridharan 4a83de75c7 HBASE-22313 Add method to FsDelegation token to accept token kind (#199)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 11:18:48 +02:00
meiyi 8bd90f2e55 HBASE-22580 Add a table attribute to make user scan snapshot feature configurable for table (#336) 2019-07-29 10:03:54 +08:00
Guanghao Zhang 4c4f0184e0 HBASE-22709 Add a chore thread in master to do hbck checking (#404)
Signed-off-by: stack <stack@apache.org>
2019-07-27 18:31:33 +08:00
Guanghao Zhang da4d72c2d4 HBASE-22742 [HBCK2] Add more log for hbck operations at master side
Signed-off-by: stack <stack@apache.org>
2019-07-27 12:39:43 +08:00
stack f7ac3badbc HBASE-22382 Refactor tests in TestFromClientSide; ADDENDUM to fix tests 2019-07-26 13:41:50 -07:00
linkaline 9f961ea1d8 HBASE-22733 TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakey (#408)
Signed-off-by: stack <stack@apache.org>
2019-07-25 11:11:46 -07:00
Jan Hentschel 62710d5835 HBASE-22594 Clean up for backup examples (#315)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-25 15:45:35 +08:00
meiyi ff9589c9ab HBASE-22578 HFileCleaner should not delete empty ns/table directories used for user san snapshot feature (#337) 2019-07-25 10:52:23 +08:00
Andor Molnár ed72cd7c1a HBASE-22382 Refactor tests in TestFromClientSide (#385)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-25 10:41:06 +08:00
Guanghao Zhang 73b2bd5185 HBASE-22721 Refactor HBaseFsck: move the inner class out
Signed-off-by: stack <stack@apache.org>
2019-07-25 08:13:30 +08:00
Jeongdae Kim f61e987c6a
HBASE-22715 All scan requests should be handled by scan handler threads in RWQueueRpcExecutor (#393)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java
2019-07-24 11:56:54 -07:00
syedmurtazahassan 169abb48c4
HBASE-22603 Javadoc Warnings related to @link tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 14:33:01 +02:00
syedmurtazahassan fa4466d345 HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
Signed-off-by: Reid Chan <reidchan@apache.org>
Co-authored-by: Reid Chan <reidchan@apache.org>
2019-07-23 11:17:42 +08:00
Reid Chan be5e3de8af Revert "HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize"
Reason: Deprecated a wrong parameter.

This reverts commit e95bdf415c.
2019-07-23 11:07:41 +08:00
syedmurtazahassan e95bdf415c HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
* Deprecated old attribute and introduced a new one

* Removed unnecessary import

* Added two import configs and removed one

Signed-off-by: Reid Chan <reidchan@apache.org>
2019-07-23 10:42:41 +08:00
Viraj Jasani 3a72ccefbd
HBASE-22648 Snapshot TTL (#371)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotDescriptionUtils.java
2019-07-22 15:08:20 -07:00
Toshihiro Suzuki 15671e5002 HBASE-22690 Deprecate / Remove OfflineMetaRepair in hbase-2+
Signed-off-by: stack <stack@apache.org>
2019-07-22 23:24:47 +09:00
openinx 6fb03e63b6 HBASE-22663 The HeapAllocationRatio in WebUI is not accurate because all of the heap allocation will happen in another separated allocator named HEAP (#365) 2019-07-20 23:36:21 +08:00
Geoffrey Jacoby 439da96a1c
HBASE-22622 WALKey Extended Attributes (#352)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-19 15:31:12 -07:00
linkaline b9b7b6e734 HBASE-21426 TestEncryptionKeyRotation.testCFKeyRotation is flaky (#375)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-19 09:43:42 +08:00
Guanghao 4c89354f3b HBASE-22673 Avoid to expose protobuf stuff in Hbck interface
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-19 08:10:38 +08:00
sreenivasulureddy 2fa6d062f5 HBASE-22537 Split happened Replica region can not be deleted after deleting table successfully and restarting RegionServer
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-18 15:26:10 +01:00
Guanghao Zhang 22a991e8b6 HBASE-22527 [hbck2] Add a master web ui to show the problematic regions (addendum) 2019-07-18 17:51:27 +08:00
Guanghao Zhang 9e59b7ff5e HBASE-22527 [hbck2] Add a master web ui to show the problematic regions 2019-07-18 08:26:31 +08:00
Guanghao db4cd6bd45 HBASE-22704 Avoid NPE when access table.jsp and snapshot.jsp but master not finish initialization (#389) 2019-07-18 08:26:20 +08:00
stack d904344421 HBASE-7191 HBCK - Add offline create/fix hbase.version and hbase.id
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-17 07:52:32 -07:00
linkaline abf3d183cd HBASE-20368 Fix RIT stuck when a rsgroup has no online servers but AM's pendingAssginQueue is cleared (#354)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-17 22:11:24 +08:00
Viraj Jasani 6c834b974c
HBASE-22643 : Delete region without archiving only if regiondir is present
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-07-16 17:41:24 -07:00
Duo Zhang 5333d8f1b4 HBASE-22684 The log rolling request maybe canceled immediately in LogRoller due to a race (#378)
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-15 21:52:55 +08:00
syedmurtazahassan 955e643e1d
HBASE-22586 Javadoc Warnings related to @param tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 16:56:53 +02:00
Duo Zhang 3eda33a048 HBASE-22681 The 'assert highestUnsyncedTxid < entry.getTxid();' in AbstractFWAL.append may fail when using AsyncFSWAL (#376)
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-07-13 22:16:34 +08:00
syedmurtazahassan b6e66699a9
HBASE-22571 Javadoc Warnings related to @return tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 13:48:45 +02:00
Andrew Purtell 19d8e33798
HBASE-22686 ZkSplitLogWorkerCoordination doesn't allow a regionserver to pick up all of the split work it is capable of (#377)
Signed-off-by: Xu Cang <xcang@apache.org>
2019-07-12 18:12:39 -07:00
Reid Chan 8222631ee3 HBASE-22656 [Metrics] Table metrics 'BatchPut' and 'BatchDelete' are never updated
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-07 23:26:02 +08:00
openinx f84edde148 HBASE-22582 The Compaction writer may access the lastCell whose memory has been released when appending fileInfo in the final (#341) 2019-07-04 14:30:37 +08:00
haxiaolin 5087fddedf HBASE-22403 Balance in RSGroup should consider throttling and a failure affects the whole
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-04 08:51:55 +08:00
Guanghao 78f704796e HBASE-22624 Should sanity check table configuration when clone snapshot to a new table 2019-07-03 18:28:48 +08:00
Andor Molnár 2f8ad5a51f HBASE-13798 TestFromClientSide* don't close the Table 2019-07-02 11:29:01 +02:00
Mate Szalay-Beko ede6a0a97b HBASE-22637 fix flaky test in TestMetaTableMetrics
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-07-02 09:37:01 +02:00
Bing Xiao 12c933ac51 HBASE-21751 WAL creation fails during region open may cause region assign forever fail
Signed-off-by: Allan Yang <allan163@apache.org>
    Signed-off-by: Michael Stack <stack@apache.org>
2019-07-01 22:19:42 -07:00
syedmurtazahassan 8fa7800389 HBASE-22572 Javadoc Warnings: @link reference not found (#306)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:18:11 -07:00
Bing Xiao 49a4eeab3b HBASE-22169 Open region failed cause memory leak
Signed-off-by: stack <stack@apache.org>
2019-07-01 13:51:33 -07:00
Duo Zhang f812352c4e HBASE-22632 SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store files for unknown column families (#344)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-06-27 21:57:11 +08:00
openinx 345f80ea5f HBASE-20060 Add details of off heap memstore into book. (#334) 2019-06-27 16:54:48 +08:00
huzheng 6a3aa789d8 HBASE-22612 Address the final overview reviewing comments of HBASE-21879 2019-06-26 15:40:23 +08:00
openinx af0e23c359 HBASE-22547 Align the config keys and add document for offheap read in HBase Book. (#301) 2019-06-25 22:25:30 +08:00
openinx 4f1b5ab54e HBASE-22531 The HFileReaderImpl#shouldUseHeap return the incorrect true when disabled BlockCache (#304) 2019-06-25 22:22:23 +08:00
openinx 3199175932 HBASE-22491 Separate the heap HFileBlock and offheap HFileBlock because the heap block won't need refCnt and save into prevBlocks list before shipping (#268) 2019-06-25 22:22:16 +08:00
openinx 915d7b2fa4 HBASE-22463 Some paths in HFileScannerImpl did not consider block#release which will exhaust the ByteBuffAllocator (#257) 2019-06-25 22:17:07 +08:00
openinx 1f5cf41345 HBASE-22422 Retain an ByteBuff with refCnt=0 when getBlock from LRUCache (#242) 2019-06-25 22:15:02 +08:00
huzheng 9e5fc2b379 HBASE-22435 Add a UT to address the HFileBlock#heapSize() in TestHeapSize 2019-06-25 22:14:57 +08:00
huzheng b00360731a HBASE-22412 Improve the metrics in ByteBuffAllocator 2019-06-25 22:14:50 +08:00
huzheng 02c528ab5a HBASE-22090 The HFileBlock#CacheableDeserializer should pass ByteBuffAllocator to the newly created HFileBlock 2019-06-25 22:14:42 +08:00
huzheng d7009d258c HBASE-21921 Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure 2019-06-25 22:14:36 +08:00
huzheng b3a01b512c HBASE-22122 Change to release mob hfile's block after rpc server shipped response to client 2019-06-25 22:14:23 +08:00
huzheng 39a6a357ff HBASE-21937 Make the Compression#decompress can accept ByteBuff as input 2019-06-25 22:11:51 +08:00
huzheng bb40caf7a8 HBASE-22211 Remove the returnBlock method because we can just call HFileBlock#release directly 2019-06-25 22:11:33 +08:00
huzheng fc460136e0 HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one 2019-06-25 22:07:16 +08:00
Mike Drob 92fc520cb0 HBASE-20894 Use proto for BucketCache persistence 2019-06-25 22:00:58 +08:00
huzheng bd8260c07e HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray 2019-06-25 21:28:02 +08:00
huzheng 081dc03e12 HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap 2019-06-25 21:23:54 +08:00
huzheng 0d294d23a9 HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block 2019-06-25 21:16:48 +08:00
huzheng f97f6e3e6a HBASE-22016 Rewrite the block reading methods by using hbase.nio.ByteBuff 2019-06-25 21:13:30 +08:00
huzheng 287e014b44 HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input. (addendum) 2019-06-25 21:13:23 +08:00
huzheng 259f8610ca HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input. 2019-06-25 21:13:07 +08:00
huzheng c19592a971 HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool 2019-06-25 21:12:37 +08:00
Duo Zhang 974e1086d7 HBASE-22617 Recovered WAL directories not getting cleaned up (#330)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-25 17:32:39 +08:00
Andrew Purtell 581198ef54
HBASE-22616 responseTooXXX logging for Multi should characterize the component ops (#329)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-24 18:04:59 -07:00
meiyi d0cb77ce8a HBASE-21995 Add a coprocessor to set HDFS ACL for hbase granted user 2019-06-24 11:33:25 +08:00
virajjasani 183aae30c5
HBASE-22520 Avoid possible NPE while performing seekBefore in Hal… (#281)
HBASE-22520 Avoid possible NPE while performing seekBefore in HalfStoreFileReader
2019-06-20 15:02:29 -07:00
Mingliang Liu bc737d1ed9
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low
This is a forward port HBASE-21000 from branch-1.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-20 12:44:14 -07:00
Reid Chan d30a7ca758 HBASE-22596 [Chore] Separate the execution period between CompactionChecker and PeriodicMemStoreFlusher
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-20 10:59:07 +08:00
Duo Zhang 10bd49edaf
HBASE-22600 Document that LoadIncrementalHFiles will be removed in 3.0.0 (#321)
Signed-off-by: huzheng <openinx@gmail.com>
2019-06-19 22:43:06 +08:00
Artem Ervits 97393a0c90 HBASE-22561 modify HFilePrettyPrinter to accept non-rootdir directories
Signed-off-by: huzheng <openinx@gmail.com>
2019-06-19 15:37:11 +08:00
Jan Hentschel 6cff25cc23
HBASE-22344 Documented the deprecation of public and limited private APIs (#208)
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:29:51 +02:00
Reid Chan e2d891172a HBASE-22559 [RPC] set guard against CALL_QUEUE_HANDLER_FACTOR_CONF_KEY
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-14 14:39:04 +08:00
Andrew Purtell d3fba8c0c5
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo)
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-13 17:45:28 -07:00
Murtaza Hassan a2b22a6807
HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation 2019-06-13 23:14:58 +02:00
Josh Elser 08287f5706 HBASE-22562 Remove dead code: skipControl
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-06-13 15:46:58 -04:00
Sergey Shelukhin 89ea709cba HBASE-22408 add dead and unknown server open regions metric to AM
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-10 15:46:45 -07:00
zhangduo e948402840 HBASE-22552 Rewrite TestEndToEndSplitTransaction.testCanSplitJustAfterASplit 2019-06-10 14:50:18 +08:00
zhangduo b89120682f HBASE-22551 TestMasterOperationsForRegionReplicas is flakey 2019-06-10 07:54:43 +08:00
Jan Hentschel aa210dda47
HBASE-22373 Moved maven-eclipse-plugin to eclipse profile 2019-06-10 00:52:16 +02:00
WenFeiYi a316f0b25b HBASE-22284 optimization StringBuilder.append of AbstractMemStore.toString #182 2019-06-09 14:32:38 -07:00
zhangduo 657f263d74 HBASE-22548 Split TestAdmin1 2019-06-09 20:26:13 +08:00
stack 8328d245b2 HBASE-22546 TestRegionServerHostname#testRegionServerHostname fails reliably for me 2019-06-05 20:54:48 -07:00
Daisuke Kobayashi 3139db5b1f HBASE-22160 Add sorting functionality in regionserver web UI for user
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
2019-06-05 11:06:41 +09:00
Sakthi afa263d739 HBASE-22536 TestForeignExceptionSerialization fails when run on JDK11
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 2280c8f4a88350278447515deb0811c42d0bb476)
2019-06-04 11:29:51 -05:00
zhangduo 09465f48a8 HBASE-22524 Refactor TestReplicationSyncUpTool 2019-06-04 08:19:00 +08:00
meiyi 17ea99c83d HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set 2019-06-03 17:51:28 +08:00
Guanghao 14041b39f2 HBASE-22523 Refactor RegionStates#getAssignmentsByTable to make it easy to understand 2019-06-02 21:37:12 +08:00
Josh Elser a584241e6f HBASE-22511 Add some more rs-status paths to RS UI links
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-05-31 14:42:59 -04:00
Duo Zhang 6641f11aed HBASE-22502 Purge the logs when we reach the EOF for the last wal file when replication 2019-05-31 15:37:29 +08:00
Guanghao cc127dd325 HBASE-22503 Failed to upgrade to 2.2+ as the global permission which storaged in zk is not right 2019-05-31 09:11:47 +08:00
Andrew Purtell d06c3af980
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:08:32 -07:00
Clay Baenziger 89260f4f3e HBASE-22487 getMostLoadedRegions is unused
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-30 18:34:50 +02:00
Duo Zhang e4057c5555 HBASE-22472 The newly split TestReplicationStatus* tests are flaky 2019-05-30 21:53:43 +08:00
Jingyun Tian 34514ccf0a HBASE-22454 refactor WALSplitter 2019-05-30 10:50:25 +08:00
Guanghao 78319fab87 HBASE-22488 Cleanup the explicit timeout value for test methods 2019-05-29 14:13:15 +08:00
Guanghao b0354644f8 HBASE-22486 Fix flaky test TestLockManager 2019-05-29 10:59:23 +08:00
Guanghao 8829b6f28f HBASE-22485 Fix failed ut TestClusterRestartFailover 2019-05-29 10:59:11 +08:00
Josh Elser 4f05b22880 HBASE-22467 UI fixes to enable Knox proxying
Closes #261

Signed-off-by: Sean Busbey <busbey@apache.org>
2019-05-28 16:32:29 -04:00
Artem Ervits e9e680f3d1 HBASE-22469 replace md5 checksum in saveVersion script with sha512
Signed-off-by: Josh Elser <elserj@apache.org>
2019-05-28 15:06:37 -04:00
binlijin ca8c4568b7 HBASE-22441 BucketCache NullPointerException in cacheBlock 2019-05-27 17:15:23 +08:00
zhangduo 3e59a547ae HBASE-22473 Split TestSCP 2019-05-27 08:26:26 +08:00
Duo Zhang 63ca0dc001 HBASE-22456 Polish TestSplitTransitionOnCluster 2019-05-26 14:14:28 +08:00
Duo Zhang 73a62c0906 HBASE-22455 Split TestReplicationStatus 2019-05-25 14:45:00 +08:00
Puleya7 cd385b18c4 HBASE-22440. Override getWalGroupsReplicationStatus to avoid NPE
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-05-23 13:41:56 +08:00
binlijin df6df68900 HBASE-22445 Add file info when throw exceptions in HFileReaderImpl 2019-05-22 20:09:50 +08:00
binlijin e3c27d33a7 HBASE-22447 Check refCount before free block in BucketCache 2019-05-22 19:16:48 +08:00
Andrew Purtell 2c55bd9344
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:38:42 -07:00
Duo Zhang 5f79378f79 HBASE-22400 Remove the adapter code in async fs implementation for hadoop-2.7.x 2019-05-18 14:07:18 +08:00
stack 64f5857c2d Revert "HBASE-22169 Open region failed cause memory leak"
This reverts commit 006170654b.
2019-05-17 16:53:14 -07:00
Bing Xiao 006170654b HBASE-22169 Open region failed cause memory leak
Signed-off-by: stack <stack@apache.org>
2019-05-17 15:09:05 -07:00
Sakthi f5486efdfe HBASE-21991 [Addendum] Mark LossCounting as Private
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-05-17 14:40:56 +08:00
Guanghao af9ada68f1 HBASE-22404 Open/Close region request may be executed twice when master restart 2019-05-16 09:23:39 +08:00
Wellington Chevreuil 9a1ed0b9dc
HBASE-21784 Dump replication queue should show list of wal files ordered chronologically
Change-Id: I18c372406290e2b1e2b5503e2c87adcb9bf6fe91

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-14 14:08:26 -07:00
Andrew Purtell cc0b70db1f
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225)
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-14 12:51:51 -07:00
zhangduo 912bbab1bf HBASE-21658 Addendum fix infinite wait when there are no meta locations yet 2019-05-14 08:13:02 +08:00
Caroline Zhou e4c4433787
HBASE-22378. HBase Canary fails with TableNotFoundException when table deleted during Canary run
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-13 12:29:12 -07:00
zhangduo 4b4c3ba6e7 HBASE-22365 Region may be opened on two RegionServers 2019-05-13 15:47:44 +08:00
Puleya7 164924c7df
HBASE-22392. Remove extra/useless +
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-05-12 21:31:02 +02:00
zhangduo ee1ebac4c2 HBASE-21658 Should get the meta replica number from zk instead of config at client side 2019-05-11 09:31:46 +08:00
Artem Ervits bbfb8ef80c HBASE-21536 Fix completebulkload usage instructions
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-10 10:31:41 +02:00
Xu Cang 911c67e251
HBASE-22274 Cell size limit check on append considers cell's previous size
change
2019-05-09 22:32:45 -07:00
chenyang 33d97cd040 HBASE-22324:loss a mass of data when the sequenceId of cells greater than Integer.Max
Signed-off-by: huzheng <openinx@gmail.com>
2019-05-09 15:44:00 +08:00
Andrew Purtell 91d8aac2ba
HBASE-22375 Promote AccessChecker to LimitedPrivate(Coprocessor) 2019-05-08 18:14:43 -07:00
Yu Li 07c71d630c HBASE-21777 Only log compaction pressure throughput when changed or traced (addendum)
Fix the findbugs warning
2019-05-09 01:00:41 +08:00
ramkrish86 5099ef216c HBASE-22072 High read/write intensive regions may cause long crash (#214)
* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class
2019-05-08 15:53:57 +05:30
Bahram Chehrazy 82fd46e04b HBASE-22360 Abort timer doesn't set when abort is called during graceful shutdown process
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-05-07 15:50:09 -07:00
Tak Lon (Stephen) Wu a591c60368 HBASE-21777 Only log compaction pressure throughput when changed or traced
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-05-08 02:40:07 +08:00
z-york 3cc8b36fd3 HBASE-21070 Add Test for SnapshotFileCache for HBase backed by S3 (#209)
SnapshotFileCache depends on getting the last modified time of the
snapshot directory, however, S3 FileSystem's do not update the
last modified time of the top 'folder' when objects are added/removed.
This commit adds a test for the previously fixed SnapshotFileCache.
2019-05-06 16:49:34 -07:00
zhangduo 36aef03613 HBASE-22343 Make procedure retry interval configurable in test 2019-05-04 13:27:52 +08:00
zhangduo d507ae9ff6 HBASE-22190 SnapshotFileCache may fail to load the correct snapshot file list when there is an on-going snapshot operation 2019-05-04 13:09:46 +08:00
Sergey Shelukhin 703da6ffbc HBASE-22354 master never sets abortRequested, and thus abort timeout doesn't work for it
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-02 18:09:18 -07:00
zhangduo 401cae4016 HBASE-22350 Rewrite TestClientOperationTimeout so we do not timeout when creating table 2019-05-02 17:26:40 +02:00
Peter Somogyi 32462d5690 HBASE-22340 Corrupt KeyValue is silently ignored (#207) 2019-05-02 11:22:05 +02:00
Andrew Purtell b06ad82b9e
HBASE-22301 Consider rolling the WAL if the HDFS write pipeline is slow 2019-05-01 17:42:53 -07:00
Thiruvel Thirumoolan 38c3178c18
HBASE-21883 Enhancements to Major Compaction tool
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-30 17:29:25 -07:00
Sakthi 018dadc3c1 HBASE-22054: Space Quota: Compaction is not working for super user in case of NO_WRITES_COMPACTIONS
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-30 13:41:08 -04:00
zhangduo f1a00b9d57 HBASE-22236 AsyncNonMetaRegionLocator should not cache HRegionLocation with null location 2019-04-30 17:18:56 +08:00
Duo Zhang 37c0ab30c7 HBASE-22322 Use special pause for CallQueueTooBigException 2019-04-30 10:07:47 +08:00
chfeng 04b4c9973a
HBASE-21815 Make isTrackingMetrics and getMetrics of ScannerContext public
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-29 13:02:58 -07:00
Sakthi c3e490f75c HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-04-29 14:44:51 +08:00
Duo Zhang 940f374a07 HBASE-22317 Support reading from meta replicas 2019-04-28 15:59:11 +08:00
Zach York aa9f36ae53
HBASE-22291 Fix recovery of recovered.edits files under root dir
When trying to recover a recovered.edits file under the root directory,
it is possible to get a WrongFS exception.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-04-25 18:11:24 -07:00
Sean Busbey 4862a596ef HBASE-22083 move eclipse settings into a profile.
Signed-off-by: stack <stack@apache.org>

 Conflicts:
	hbase-backup/pom.xml
	hbase-hadoop-compat/pom.xml
	hbase-protocol/pom.xml
2019-04-25 14:38:38 -05:00