Commit Graph

3764 Commits

Author SHA1 Message Date
Elliott Clark a4a235b8d1 HBASE-13170 Allow block cache to be external
Summary: Add MemcachedBlockCache

Test Plan: Tested locally with PE and running memcached.

Subscribers: rajesh.nishtala, ndimiduk

Differential Revision: https://reviews.facebook.net/D34635
2015-03-27 13:15:27 -07:00
Sameet Agarwal ba6345f7d1 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:48:01 -07:00
Elliott Clark 5d2c33158c HBASE-13342 Fix incorrect interface annotations 2015-03-27 00:19:15 -07:00
Andrew Purtell b6b1e3b86e HBASE-13332 Fix the usage of doAs/runAs in Visibility Controller tests (Srikanth Srungarapu) 2015-03-26 21:54:29 -07:00
zhangduo a78effcdc6 HBASE-13295 TestInfoServers hung 2015-03-27 11:58:17 +08:00
nke 18256fc954 HBASE-8725 Add total time RPC call metrics
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-26 11:11:53 -07:00
Andrew Purtell 5a58116bb5 HBASE-13294 Fix the critical ancient loopholes in security testing infrastructure (Srikanth Srungarapu) 2015-03-25 11:21:28 -07:00
Matteo Bertozzi 5e1fc2587c HBASE-13311 TestQuotaThrottle flaky on slow machine 2015-03-25 18:19:53 +00:00
stack 8579c6dd49 HBASE-13248 Make HConnectionImplementation top-level class 2015-03-25 07:25:44 -07:00
Elliott Clark e78aeb24e0 HBASE-13331 Exceptions from DFS client can cause CatalogJanitor to delete referenced files
Summary:
CatalogJanitor#checkDaughterInFs assumes that there are no references
whenever HRegionFileSystem.openRegionFromFileSystem throws IOException.
Well Hadoop and HBase throw IOExceptions whenever someone looks in their general direction.

This patch explicitly checks if the directory exists. If it doesn't then it allows references to be
deleted. All other exceptions cause CatalogJanitor to assume there are references

Test Plan: Unit tests.

Differential Revision: https://reviews.facebook.net/D35829
2015-03-24 19:52:10 -07:00
tedyu 227ace9100 HBASE-13327 Use Admin in ConnectionCache (Solomon Duskis) 2015-03-24 18:13:51 -07:00
Mikhail Antonov 8cb4f89c01 HBASE-13273 Make Result.EMPTY_RESULT read-only; currently it can be modified
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-03-24 12:33:02 -07:00
Matteo Bertozzi fcc09dcd38 HBASE-13321 Fix flaky TestHBaseFsck 2015-03-24 16:39:17 +00:00
Matteo Bertozzi 80d230e1fb HBASE-13314 Fix NPE in HMaster.getClusterStatus() 2015-03-24 09:28:06 +00:00
zhangduo 6e9ded51fb HBASE-13310 Fix high priority findbugs warnings 2015-03-24 06:50:04 +08:00
Matteo Bertozzi 845f5de121 HBASE-13309 Some tests do not reset EnvironmentEdgeManager 2015-03-22 10:40:49 +00:00
zhangduo a9b73b600e HBASE-13308 Fix flaky TestEndToEndSplitTransaction 2015-03-21 20:43:53 +08:00
Andrew Purtell 8dfed5dc88 HBASE-13303 Fix size calculation of results on the region server 2015-03-20 17:24:50 -07:00
Matteo Bertozzi 0915191167 HBASE-13282 Fix the minor issues of running Canary on kerberized environment (Srikanth Srungarapu) 2015-03-20 21:26:53 +00:00
Liu Shaohui f4eb7191be HBASE-13199 ADDENDUM Some small improvements on canary tool (Shaohui Liu) 2015-03-20 15:22:14 -05:00
stack f57dca5e1b HBASE-13198 Remove HConnectionManager (Mikhail Antonov) 2015-03-20 09:41:48 -07:00
Ashish Singhi 2bf904f216 HBASE-13241 Add tests for group level grants 2015-03-19 21:39:12 +00:00
Esteban Gutierrez b728e66708 TestEnableTableHandler.testDeleteForSureClearsAllTableRowsFromMeta - ADDENDUM 2015-03-19 20:35:12 +00:00
Matteo Bertozzi 6a95dd3551 HBASE-13285 Fix flaky getRegions() in TestAccessController.setUp() 2015-03-19 17:54:46 +00:00
zhangduo 27cf749af8 HBASE-13280 TestSecureRPC failed 2015-03-19 21:36:06 +08:00
Matteo Bertozzi 535ebbfde9 HBASE-13235 Revisit the security auditing semantics (Srikanth Srungarapu) 2015-03-19 07:01:21 +00:00
Liu Shaohui cf7ef936d2 HBASE-13199 Some small improvements on canary tool (Shaohui Liu) 2015-03-19 10:44:35 +08:00
Liu Shaohui 602e11cc74 HBASE-13216 Add version info in RPC connection header (Shaohui Liu) 2015-03-19 10:30:55 +08:00
Liu Shaohui 6709feeb65 HBASE-13200 Improper configuration can leads to endless lease recovery during failover (He Liangliang) 2015-03-19 10:07:25 +08:00
Matteo Bertozzi f9a17edc25 HBASE-13253 LoadIncrementalHFiles unify hfiles discovery 2015-03-17 19:38:39 +00:00
Andrey Stepachev ed026c2e6f HBASE-13176 Flakey TestZooKeeper test. 2015-03-17 14:51:39 +00:00
zhangduo 7b7b0bf9dd HBASE-13258 addendum add log and reduce testCount in TestHRegion.testWritesWhileGetting 2015-03-17 21:43:37 +08:00
zhangduo 2b08653a79 HBASE-13258 Promote TestHRegion to LargeTests 2015-03-17 16:02:27 +08:00
Jonathan M Hsieh 65ad19ddf7 HBASE-12908 Typos in MemstoreFlusher javadocs (Edvin Malinovskis) 2015-03-17 00:36:00 -07:00
tedyu 47787f2c3a HBASE-13254 EnableTableHandler#prepare would not throw TableNotFoundException during recovery (Stephen Jiang) 2015-03-16 17:50:16 -07:00
stack a75a2ace4f HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:26:34 -07:00
stack c5aca1919d HBASE-12586 Task 6 & 7 from HBASE-9117, delete all public HTable constructors and delete ConnectionManager#{delete,get}Connection (Mikhail Antonov) 2015-03-16 11:20:14 -07:00
tedyu 76ba53004b HBASE-13246 Correct the assertion for namespace permissions in tearDown method of TestAccessController (Ashish Singhi) 2015-03-16 06:47:56 -07:00
zhangduo b7e2daa1db HBASE-13244 addendum add InterfaceAudience annotation back for HBaseKerberosUtils 2015-03-16 15:18:20 +08:00
zhangduo 0505b7941e HBASE-13244 Test delegation token generation with kerberos enabled 2015-03-15 23:02:51 +08:00
tedyu 01bc979ea2 HBASE-13239 HBase grant at specific column level does not work for Groups 2015-03-14 20:21:37 -07:00
zhangduo df238346d2 HBASE-13242 TestPerColumnFamilyFlush.testFlushingWhenLogRolling hung 2015-03-15 08:01:05 +08:00
Josh Elser 72855c584e HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-13 22:35:52 -05:00
Matteo Bertozzi d2d4ef14f4 HBASE-13227 LoadIncrementalHFile should skip non-files inside a possible family-dir 2015-03-13 17:22:54 +00:00
Esteban Gutierrez 6152d36c87 HBASE-13224 Minor formatting issue when logging a namespace scope in AuthResult#toContextString 2015-03-13 10:44:17 +00:00
zhangduo bb0068893d HBASE-13194 TableNamespaceManager not ready cause MasterQuotaManager initialization fail 2015-03-13 11:13:55 +08:00
Enis Soztutar d45efa7208 HBASE-13169 ModifyTable increasing the region replica count should also auto-setup RRRE 2015-03-12 13:39:55 -07:00
tedyu 7a3ea23704 HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 18:24:12 -07:00
stack 9c83fa7b52 HBASE-13167 The check for balancerCutoffTime is buggy (Mikhail Antonov) 2015-03-11 15:54:53 -07:00
Enis Soztutar c938267db3 HBASE-13063 Allow to turn off memstore replication for region replicas - ADDENDUM for turning of primary flush tigger when this is enabled 2015-03-11 14:56:54 -07:00
Devaraj Das 2adec36b2f HBASE-13192. IntegrationTestBulkLoad doesn't wait for table modification sometimes leading to spurious test failures. 2015-03-11 13:55:01 -07:00
Matteo Bertozzi b5bfbc8a9f HBASE-13206 Fix TableLock tableName log format 2015-03-11 18:27:18 +00:00
stack b436db7d70 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer; ADDENDUM 2015-03-10 22:17:08 -07:00
stack 09e9c92d76 HBASE-13114 [UNITTEST] TestEnableTableHandler.testDeleteForSureClearsAllTableRowsFromMeta
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/handler/TestEnableTableHandler.java
2015-03-10 14:51:42 -07:00
Matteo Bertozzi 7fa1a6b968 HBASE-13181 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently 2015-03-10 17:21:34 +00:00
Matteo Bertozzi cbf03787ea HBASE-13063 Allow to turn off memstore replication for region replicas 2015-03-10 10:02:04 +00:00
Matteo Bertozzi eeb8c846d9 HBASE-13182 Test NamespaceAuditor/AccessController create/delete table is flaky 2015-03-10 09:07:30 +00:00
zhangduo 105f9b3282 HBASE-12405 addendum fix HRegion heap size 2015-03-10 15:01:11 +08:00
zhangduo 9b53a1c214 HBASE-12405 WAL accounting by Store 2015-03-10 13:00:02 +08:00
Enis Soztutar 21b27c8650 Revert "HBASE-13169 ModifyTable increasing the region replica count should also auto-setup RRRE"
This reverts commit be25b0d595.
2015-03-09 19:56:02 -07:00
Enis Soztutar be25b0d595 HBASE-13169 ModifyTable increasing the region replica count should also auto-setup RRRE 2015-03-09 18:49:40 -07:00
Andrew Purtell 9aa8f0672e HBASE-13183 Make ZK tickTime configurable in standalone HBase (Alex Araujo) 2015-03-09 18:34:49 -07:00
Enis Soztutar 5025d3aa91 HBASE-13121 Async wal replication for region replicas and dist log replay does not work together 2015-03-09 15:49:09 -07:00
Matteo Bertozzi fb5e6b3f75 HBASE-13179 TestMasterObserver deleteTable is flaky 2015-03-09 19:47:27 +00:00
Andrey Stepachev 948746ce4e HBASE-12990 MetaScanner should be replaced by MetaTableAccessor 2015-03-09 10:39:59 +00:00
Misty Stanley-Jones aed88cf382 HBASE-13135 Move replication ops mgmt stuff from Javadoc to Ref Guide 2015-03-09 09:30:21 +10:00
tedyu 76cbf7da65 HBASE-12931 The existing KeyValues in memstore are not removed completely after inserting cell into memStore (ChiaPing Tsai) 2015-03-07 08:26:43 -08:00
Enis Soztutar 95fc53f105 HBASE-12706 Support multiple port numbers in ZK quorum string (Stephen Yuan Jiang) 2015-03-06 16:46:17 -08:00
Lars Hofhansl 5845f72ad6 Revert "HBASE-13082 Coarsen StoreScanner locks to RegionScanner."
This reverts commit ec1eff9b69.
Revert due to test failures.
2015-03-06 15:24:29 -08:00
stack 9159c82fbf HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer 2015-03-06 14:35:08 -08:00
Enis Soztutar 4ac42a2f56 HBASE-12562 Handling memory pressure for secondary region replicas 2015-03-06 14:32:05 -08:00
Lars Hofhansl ec1eff9b69 HBASE-13082 Coarsen StoreScanner locks to RegionScanner. 2015-03-06 12:44:24 -08:00
tedyu 6d4a4a48fe HBASE-13164 Update TestUsersOperationsWithSecureHadoop to use MiniKdc (Duo Zhang) 2015-03-06 06:40:10 -08:00
Victoria Dudin d58cce1694 HBASE-13128 Make HBCK's lock file retry creation and deletion
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-05 15:29:14 -08:00
Enis Soztutar be2ad98b1c HBASE-12180 Fix and reenable TestRegionReplicaReplicationEndpoint 2015-03-05 14:59:38 -08:00
stack 4570451f7c HBASE-13076 Table can be forcibly enabled in AssignmentManager during table disabling (Andrey Stepachev) 2015-03-05 11:47:02 -08:00
tedyu c15e684bf9 HBASE-13155 Fix TestPrefixTree (Duo Zhang) 2015-03-05 06:55:36 -08:00
stack 74837d9b1f Revert " HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer"
OVERCOMMIT. REVERT.

This reverts commit 55f8f56ad2.
2015-03-04 22:58:02 -08:00
stack 55f8f56ad2 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer
Rename ByteBufferReservoir as BoundedByteBufferPool
2015-03-04 22:44:20 -08:00
Lars Hofhansl 0bdab85b06 HBASE-13109 Fix Javadoc warning; and some misc checkstyle warnings 2015-03-04 18:02:04 -08:00
Jonathan Lawlor de9791e91e HBASE-11544: [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Signed-off-by: stack <stack@apache.org>
2015-03-04 17:34:48 -08:00
Misty Stanley-Jones 39425a8558 HBASE-11670 Generate PDF of Reference Guide 2015-03-05 09:31:11 +10:00
Enis Soztutar d1ca560ff7 HBASE-11580 Failover handling for secondary region replicas - ADDENDUM for javadoc fixes 2015-03-04 14:22:07 -08:00
Lars Hofhansl 464e7ce685 HBASE-13109 Make better SEEK vs SKIP decisions during scanning. 2015-03-04 14:03:47 -08:00
Jeffrey Zhong 883d6fd8e5 HBASE-11571 Bulk load handling from secondary region replicas 2015-03-03 15:17:18 -08:00
Enis Soztutar 9899aab12b HBASE-11580 Failover handling for secondary region replicas 2015-03-03 11:48:12 -08:00
zhangduo 3897ab05a4 HBASE-13145 TestNamespaceAuditor.testRegionMerge is flaky
Signed-off-by: stack <stack@apache.org>
2015-03-03 10:30:27 -08:00
stack 5fc3d6ed0d HBASE-13136 TestSplitLogManager.testGetPreviousRecoveryMode is flakey 2015-03-02 17:29:22 -08:00
stack b9f8616177 HBASE-13138 Clean up TestMasterObserver (debug, trying to figure why fails) 2015-03-02 10:53:45 -08:00
Ramkrishna 4fb6f91cba HBASE-13123 - Minor bug in ROW bloom filter (Ram) 2015-03-02 11:45:21 +05:30
tedyu 4980bfe642 HBASE-13134 mutateRow and checkAndMutate apis don't throw region level exceptions (Francis Liu) 2015-03-01 20:22:07 -08:00
stack 70ecf18817 HBASE-NPE when running TestSplitLogManager (Andrey Stepachev and Zhangduo) 2015-03-01 19:54:10 -08:00
stack dd78f459e8 HBASE-13130 Add timeouts on TestMasterObserver, a frequent zombie show 2015-02-28 15:27:12 -08:00
Sameet Agarwal daf6858a7a HBASE-12924 HRegionServer#MovedRegionsCleaner Chore does not start
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-02-28 10:36:56 -08:00
Enis Soztutar bec2b0d320 HBASE-13119 FileLink should implement equals 2015-02-27 18:09:29 -08:00
zhangduo d1619bceb3 HBASE-13097 Use same EventLoopGroup for different AsyncRpcClients if possible
Signed-off-by: stack <stack@apache.org>
2015-02-27 08:34:46 -08:00
Andrew Purtell 1c957b65b1 HBASE-13106 Ensure endpoint-only table coprocessors can be dynamically loaded 2015-02-25 16:37:46 -08:00
Elliott Clark 7195f62114 HBASE-13102 Fix Pseudo-distributed Mode which was broken in 1.0.0 2015-02-25 15:51:35 -08:00
Nick Dimiduk c651271f57 HBASE-13086 Show ZK root node on Master WebUI 2015-02-24 19:04:12 -08:00
Ashish Singhi 913ea2c222 HBASE-13048 Use hbase.crypto.wal.algorithm in SecureProtobufLogReader while decrypting the data
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-24 18:18:07 -08:00
zhangduo d34620b8b6 HBASE-13084 Add labels to VisibilityLabelsCache asynchronously causes TestShell flakey
Signed-off-by: stack <stack@apache.org>
2015-02-24 17:01:05 -08:00
stack 4a74f5e829 HBASE-13083 Master can be dead-locked while assigning META. (Andrey Stepachev) 2015-02-23 21:17:01 -08:00
zhangduo b20675f5af HBASE-12953 RegionServer is not functionally working with AysncRpcClient in secure mode
Signed-off-by: stack <stack@apache.org>
2015-02-23 20:38:19 -08:00
Enis Soztutar e405017a31 HBASE-12561 Replicas of regions can be cached from different instances of the table in MetaCache 2015-02-23 11:06:17 -08:00
Enis Soztutar 78da65c412 HBASE-12714 RegionReplicaReplicationEndpoint should not set the RPC Codec 2015-02-22 21:55:09 -08:00
Enis Soztutar 21b366afe1 HBASE-11842 Integration test for async wal replication to secondary regions 2015-02-22 21:29:12 -08:00
Rajeshbabu Chintaguntla 7792dee0c3 HBASE-13054 Provide more tracing information for locking/latching events.(Rajeshbabu) 2015-02-21 12:13:10 +05:30
stack 47d081407e HBASE-13001 NullPointer in master logs for table.jsp (Vikas Vishwakarma) 2015-02-20 22:36:42 -08:00
stack 7af56998c5 HBASE-13032 Migration of states should be performed once META is assigned and onlined (Andrey Stepachev) 2015-02-20 21:57:30 -08:00
tedyu 9a311303a8 HBASE-13057 Provide client utility to easily enable and disable table replication (Ashish Singhi) 2015-02-20 10:18:47 -08:00
tedyu 229b0774c0 HBASE-13070 Fix TestCacheOnWrite (Duo Zhang) 2015-02-20 08:35:29 -08:00
Sean Busbey 365054c110 HBASE-13075 TableInputFormatBase spuriously warning about multiple initializeTable calls 2015-02-19 13:59:27 -06:00
tedyu 18402cc850 HBASE-13072 BucketCache.evictBlock returns true if block does not exist (Duo Zhang) 2015-02-19 08:28:13 -08:00
Ashish Singhi 31f17b17f0 HBASE-13002 Make encryption cipher configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-18 11:42:20 -08:00
stack 39f549aaec HBASE-13056 Refactor table.jsp code to remove repeated code and make it easier to add new checks (Vikas Vishwakarma) 2015-02-18 11:35:14 -08:00
Devaraj Das 14bb352b02 HBASE-13036. Meta scanner should use its own threadpool 2015-02-18 10:23:02 -08:00
tedyu d64ce31063 HBASE-13061 RegionStates can remove wrong region from server holdings (Andrey Stepachev) 2015-02-18 06:23:59 -08:00
Abhishek Kumar 7b045d143a HBASE-13050 Empty Namespace validation
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-02-18 08:33:19 +01:00
tedyu b92ff24b0e HBASE-12948 Calling Increment#addColumn on the same column multiple times produces wrong result (hongyu bi) 2015-02-17 12:39:00 -08:00
stack 54d70e61bf HBASE-13040 Possible failure of TestHMasterRPCException (Zhang Duo) 2015-02-17 12:10:18 -08:00
stack d3621d24de HBASE-13041 TestEnableTableHandler should not call AssignmentManager#assign concurrently with master (Andrey Stepachev) 2015-02-16 21:00:00 -08:00
stack 0d880c99b5 HBASE-13047 Add "HBase Configuration" link missing on the table details pages (Vikas Vishwakarma) 2015-02-16 20:49:02 -08:00
tedyu 3e35bbdee4 HBASE-13055 HRegion FIXED_OVERHEAD missed one boolean (Duo Zhang) 2015-02-16 17:26:06 -08:00
Andrew Purtell 9b2e4ed064 HBASE-13044 Configuration option for disabling coprocessor loading 2015-02-15 11:02:40 -08:00
Sean Busbey 332515ed34 HBASE-13028 Cleanup MapReduce InputFormats 2015-02-14 14:13:36 -06:00
Lars Hofhansl 6f904fe4ca HBASE-12971 Replication stuck due to large default value for replication.source.maxretriesmultiplier. 2015-02-13 22:18:51 -08:00
Aditya Kishore f286797fbf HBASE-13010 HFileOutputFormat2 partitioner's path is hard-coded as '/tmp'
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-13 18:35:33 -08:00
Sean Busbey c96df5e240 HBASE-13027 Ensure extension of TableInputFormatBase works.
* move mapreduce version of TableInputFormat tests out of mapred
* add ability to get runnable job via MR test shims
* correct the javadoc example for current APIs.
* add tests the run a job based on the extending TableInputFormatBase (as given in the javadocs)
* add tests that run jobs based on the javadocs from 0.98
* fall back to our own Connection if ussers of the deprecated table configuration have a managed connection.
2015-02-13 18:41:04 -06:00
stack 421036c1c4 HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn -- ADDENDUM 2015-02-13 15:54:33 -08:00
stack 3babad30e6 HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn 2015-02-13 15:24:38 -08:00
Matteo Bertozzi a98898cf41 HBASE-13037 LoadIncrementalHFile should try to verify the content of unmatched families 2015-02-13 20:15:17 +01:00
Enis Soztutar 3e10e6e1a6 HBASE-11569 Flush / Compaction handling from secondary region replicas 2015-02-13 11:08:24 -08:00
Ashish Singhi 16ed345191 HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-12 14:50:01 -08:00
tedyu e0160d6937 HBASE-13029 Table state should be deleted from META as a last operation in DeleteTableHandler (Andrey Stepachev) 2015-02-12 14:02:54 -08:00
Andrew Purtell fc2e849cd3 HBASE-13008 Better default for hbase.regionserver.regionSplitLimit parameter (Srikanth Srungarapu) 2015-02-12 10:13:38 -08:00
tedyu 3dd220f8fd HBASE-13018 WALSplitter should not try to get table states while splitting META (Andrey Stepachev) 2015-02-11 12:45:54 -08:00
stack dec0ec2290 HBASE-13016 Clean up remnants of table states stored in table descriptors (Andrey Stepachev) 2015-02-11 11:09:03 -08:00
Ramkrishna f04850810e HBASE-13003 - Get tests in TestHFileBlockIndex back (Zhangduo) 2015-02-11 10:38:54 +05:30
stack 9c66afbae7 HBASE-12978 Region goes permanently offline (WAS: hbase:meta has a row missing hregioninfo and it causes my long-running job to fail) 2015-02-10 17:03:29 -08:00
Andrew Purtell f9cf565f1d HBASE-9910 TestHFilePerformance and HFilePerformanceEvaluation should be merged in a single HFile performance test class (Vikas Vishwakarma)
Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-02-10 16:11:08 -08:00
stack fa852c4ce6 HBASE-12035 Keep table state in META (Andrey Stepachev) 2015-02-10 14:20:47 -08:00
tedyu a3f495f20d HBASE-13004 Make possible to explain why HBaseTestingUtility.waitFor fails (Andrey Stepachev) 2015-02-10 07:33:52 -08:00
Sean Busbey 3d692cf044 HBASE-12997 print wal pipeline on low replication. 2015-02-09 23:02:16 -06:00
Enis Soztutar f97c00fd99 HBASE-12998 Compilation with Hdfs-2.7.0-SNAPSHOT is broken after HDFS-7647 2015-02-09 18:17:33 -08:00
Andrew Purtell 1e6afa2f3c HBASE-12973 RegionCoprocessorEnvironment should provide HRegionInfo directly 2015-02-09 17:57:40 -08:00
Esteban Gutierrez 1f830bea89 HBASE-12984: SSL cannot be used by the InfoPort in branch-1 2015-02-09 16:43:37 -08:00
stack eea9873cef HBASE-12985 Javadoc warning and findbugs fixes to get us green again 2015-02-07 17:05:11 -08:00
Jeffrey Zhong 3f4427739d HBASE-11567 Write bulk load COMMIT events to WAL (Alex Newman, Jeffrey Zhong) 2015-02-06 18:07:30 -08:00
Andrew Purtell 7f4146bf4d Revert "HBASE-12891 Parallel execution for Hbck checkRegionConsistency"
This reverts commit eddd5739a1.
2015-02-06 16:52:04 -08:00
stack 2f2faa68d1 HBASE-12966 NPE in HMaster while recovering tables in Enabling state; ADDENDUM 2015-02-06 16:01:43 -08:00
rahulgidwani eddd5739a1 HBASE-12891 Parallel execution for Hbck checkRegionConsistency
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-06 15:14:18 -08:00
Esteban Gutierrez 3b56d2a0bc HBASE-12956 Binding to 0.0.0.0 is broken after HBASE-10569
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-02-06 14:35:20 -08:00
stack 57319c536a HBASE-12980 Delete of a table may not clean all rows from hbase:meta 2015-02-06 14:06:59 -08:00
Jesse Yates 75148385ee HBASE-12979 Use setters instead of return values for handing back statistics from HRegion methods 2015-02-06 13:24:20 -08:00
stack 96cdc7987e HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned 2015-02-04 22:56:40 -08:00
tedyu 8aeb3acaf9 HBASE-12966 NPE in HMaster while recovering tables in Enabling state (Andrey Stepachev) 2015-02-04 14:53:55 -08:00
Victoria Dudin 4f472062a4 HBASE-12961 Fix negative values in read and write region server metrics. 2015-02-04 10:32:09 -08:00
Ramkrishna 37ef793fab HBASE-12962 - TestHFileBlockIndex.testBlockIndex() commented out during
HBASE-10531 (Ram)
2015-02-04 11:42:55 +05:30
tedyu fd0bb89fdf HBASE-12957 Revert accidental checkin of unrelated test 2015-02-03 21:20:42 -08:00
tedyu 4388fed830 HBASE-12957 region_mover#isSuccessfulScan may be extremely slow on region with lots of expired data (Hongyu Bi) 2015-02-03 20:06:23 -08:00
stack 7861e518ef HBASE-7332 [webui] HMaster webui should display the number of regions a table has. (Andrey Stepachev) 2015-02-03 09:24:54 -08:00
Devaraj Das cf5ad96fcc HBASE-10942. support parallel request cancellation for multi-get (Nicolas Liochon & Devaraj Das) 2015-02-02 23:01:31 -08:00
zhangduo eb351b9ff8 HBASE-8329 Limit compaction speed
Signed-off-by: stack <stack@apache.org>
2015-02-02 22:19:05 -08:00
stack da30c72b73 HBASE-12951 TestHCM.testConnectionClose is flakey when using AsyncRpcClient as client implementation; ADDENDUM -- Remove flakey marking from TestHCM 2015-02-02 20:51:51 -08:00
stack 825871431e HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask 2015-01-30 19:12:17 -08:00
stack 538388c2b5 HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks (Jonathan Lawlor) 2015-01-29 19:26:26 -08:00
Lars Hofhansl 9c37d5dab7 HBASE-12859; Addendum 2015-01-29 14:10:59 -08:00
Lars Hofhansl 1270e590d1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:58:27 -08:00
tedyu 6bfa8ea977 HBASE-12936 Quota support for namespace should take region merge into account 2015-01-29 09:12:24 -08:00
Devaraj Das 7c8aa2e963 HBASE-11574. Addendum that should fix a unit test (TestMetaWithReplicas#testChangingReplicaCount) that fails once in a while 2015-01-29 00:27:08 -08:00
Ashish Singhi 070e2dd89a HBASE-12831 Changing the set of vis labels a user has access to doesn't generate an audit log event
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-01-28 16:29:45 -06:00
Devaraj Das 6b20a0f831 HBASE-11574. hbase:meta's regions can be replicated 2015-01-27 16:40:29 -08:00
Enis Soztutar 0f6faaf5fc HBASE-12916 No access control for replicating WAL entries (Liu Shaohui) 2015-01-27 15:33:29 -08:00
tedyu f7df0990c2 HBASE-12929 TableMapReduceUtil.initTableMapperJob unnecessarily limits the types of outputKeyClass and outputValueClass (Will Temperley) 2015-01-27 07:58:11 -08:00
Matteo Bertozzi b866e01a98 HBASE-12925 Use acl cache for doing access control checks in prepare and clean phases of Bulkloading (Srikanth Srungarapu) 2015-01-27 12:47:46 +00:00
tedyu aaeafca920 HBASE-7847 Use zookeeper multi to clear znodes (Rakesh R) 2015-01-26 21:40:39 -08:00
Enis Soztutar 2fb19fb951 HBASE-11908 Region replicas should be added to the meta table at the time of table creation 2015-01-26 19:55:47 -08:00
rahulgidwani a85cb0f89a HBASE-12627 Add back snapshot batching facility
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-26 18:44:25 -08:00
tedyu 1b9367d465 HBASE-12917 HFilePerformanceEvaluation Scan tests fail with StackOverflowError due to recursive call in createCell function (Vikas Vishwakarma) 2015-01-26 15:25:02 -08:00
Elliott Clark 45fdc0e835 HBASE-12892 Add a class to allow taking a snapshot from the command line 2015-01-25 17:18:50 -08:00
Jurriaan Mous 854f13afa1 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>
2015-01-24 18:05:39 -08:00
Enis Soztutar e05341d01d HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum for failing test in branch-1.0) 2015-01-24 17:57:04 -08:00
tedyu 8261d84290 HBASE-8410 Basic quota support for namespaces (Vandana) 2015-01-24 10:36:49 -08:00
tedyu 74adb11f4c HBASE-10499 In write heavy scenario one of the regions does not get flushed causing RegionTooBusyException (Ram and Ted) 2015-01-23 09:43:01 -08:00
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Rajeshbabu Chintaguntla e13b9938a1 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down-addendum(Rajeshbabu) 2015-01-23 12:41:45 +05:30
Andrew Purtell 71ab4ddb19 HBASE-12731 Heap occupancy based client pushback 2015-01-22 17:33:21 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
anoopsjohn 833feefbf9 HBASE-12745 Visibility Labels: support visibility labels for user groups. (Jerry He) 2015-01-22 11:36:17 +05:30
Enis Soztutar 8b7a20f4ee HBASE-12393 The regionserver web will throw exception if we disable block cache (ChiaPing Tsai) 2015-01-21 17:22:10 -08:00
Enis Soztutar 8793383b66 HBASE-12774 Fix the inconsistent permission checks for bulkloading. (Srikanth Srungarapu) 2015-01-21 17:03:55 -08:00
Enis Soztutar 735fe20029 HBASE-12864 IntegrationTestTableSnapshotInputFormat fails 2015-01-21 16:21:42 -08:00
tedyu e87a69d9c0 HBASE-12886 Correct tag option name in PerformanceEvaluation (Jerry He) 2015-01-21 12:30:51 -08:00
Nick Dimiduk 9bdb81f0a1 HBASE-12887 Cleanup many checkstyle errors in o.a.h.h.client 2015-01-20 12:44:36 -08:00
Nick Dimiduk 3e777898aa HBASE-12881 TestFastFail is not compatible with surefire.rerunFailingTestsCount 2015-01-20 09:29:42 -08:00
rahulgidwani f71b980d37 HBASE-11195 Potentially improve block locality during major compaction for old regions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-19 17:33:17 -08:00
Andrew Purtell 53815afc10 HBASE-12878 Incorrect HFile path in TestHFilePerformance print output (Vikas Vishwakarma) 2015-01-19 12:46:44 -08:00
Andrew Purtell 03e17168c3 HBASE-12840 Improve unit test coverage of the client pushback mechanism 2015-01-17 11:50:26 -08:00
Enis Soztutar a55bd21340 HBASE-12862 Uppercase wals in RegionServer webUI 2015-01-16 11:12:14 -08:00
zhangduo 7309bb4317 HBASE-12863 Master info port on RS UI is always 0
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-01-16 10:45:38 -08:00
Matteo Bertozzi 621b33f2f9 HBASE-12773 Add warning message when user is trying to bulkload a large HFile (Srikanth Srungarapu) 2015-01-15 23:13:47 +00:00
tedyu eafc07a06d HBASE-12848 Utilize Flash storage for WAL 2015-01-15 08:52:30 -08:00
Enis Soztutar 51575197de HBASE-12844 ServerManager.isServerReacable() should sleep between retries 2015-01-14 15:45:46 -08:00
Rajeshbabu Chintaguntla 7e872a81a9 HBASE-12847 TestZKLessSplitOnCluster frequently times out in 0.98 builds(Rajeshbabu) 2015-01-15 00:00:37 +05:30
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
stack 608025ae67 HBASE-7541 Convert all tests that use HBaseTestingUtility.createMultiRegions to HBA.createTable (Jonathan Lawlor) 2015-01-13 22:10:12 -08:00
Nick Dimiduk 9b7f36b8cf HBASE-11983 HRegion constructors should not create HLog 2015-01-13 15:07:59 -08:00
Virag Kothari 4ac457a7bc HBASE-12480 Regions in FAILED_OPEN/FAILED_CLOSE should be processed on master failover 2015-01-13 11:03:16 -08:00
tedyu 72a6a670ac HBASE-12849 LoadIncrementalHFiles should use unmanaged connection in branch-1 2015-01-13 10:51:56 -08:00
tedyu e5f3dd682f HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:02:06 -08:00
Andrew Purtell e52d8f85c4 HBASE-12838 After HBASE-5162 RSRpcServices accidentally applies mutations twice 2015-01-12 11:45:36 -08:00
Rajeshbabu Chintaguntla 5b850caa80 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down(Rajeshbabu) 2015-01-12 01:04:26 +05:30
tedyu f6a017ce63 HBASE-12798 Map Reduce jobs should not create Tables in setConf() (Solomon Duskis) 2015-01-10 14:23:03 -08:00
tedyu 988cba762a HBASE-12834 Promote ScanType to LimitedPrivate 2015-01-09 15:35:14 -08:00
Nick Dimiduk 4bfd35aabc HBASE-12825 CallRunner exception messages should include destination host:port 2015-01-08 18:40:01 -08:00
Enis Soztutar 4d7c65ae84 HBASE-12824 CompressionTest fails with org.apache.hadoop.hbase.io.hfile.AbstractHFileReader: Not seeked to a key/value 2015-01-08 15:51:30 -08:00
Nick Dimiduk dde713ee4e HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:17:00 -08:00
tedyu 4ea490b63a HBASE-12811 [AccessController] NPE while scanning a table with user not having READ permission on the namespace (Ashish) 2015-01-08 09:06:12 -08:00
tedyu ee32eebeab HBASE-12819 ExportSnapshot doesn't close FileSystem instances 2015-01-08 08:51:25 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
tedyu 645fbd7d87 HBASE-12817 Data missing while scanning using PREFIX_TREE data block encoding (Duo Zhang) 2015-01-07 18:45:09 -08:00
Virag Kothari 7dce0d5c45 HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2015-01-07 10:57:47 -08:00
tedyu 45fc2bdd86 HBASE-10528 DefaultBalancer selects plans to move regions onto draining nodes (Churro Morales) 2015-01-06 12:33:28 -08:00
Sean Busbey 26e3e1b300 HBASE-12339 WALPerformanceEvaluation should have a log roller. 2015-01-06 08:22:48 -06:00
Lars Hofhansl 7774f964e6 HBASE-12779 SplitTransaction: Add metrics. 2015-01-05 17:13:58 -08:00
tedyu 2452d3861f HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:45:52 -08:00
tedyu 5b53a187d2 HBASE-12793 [hbck] closeRegionSilentlyAndWait() should log cause of IOException and retry until hbase.hbck.close.timeout expires (Esteban) 2015-01-05 15:05:35 -08:00
tedyu 37e1bb61f4 HBASE-12785 Use FutureTask to timeout the attempt to get the lock for hbck 2015-01-05 14:09:58 -08:00
Enis Soztutar 24bcebdeeb HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:14:40 -08:00
tedyu 2ba6053163 HBASE-12804 ImportTsv fails to delete partition files created by it (Ashish) 2015-01-05 09:29:00 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Enis Soztutar 820f629423 HBASE-12028 Abort the RegionServer, when it's handler threads die (Alicia Ying Shu) 2015-01-02 13:07:57 -08:00
Sean Busbey a90e64c637 HBASE-12719 test provider to remove just the hdfs interactions from fshlog.
* Adds a provider that takes a config to determine if we actually do syncs, appends, and file rolls.
  - required relaxing some members of FSHLog from private to protected.
* Fixes DisabledWALProvider so it can be used as hbase.wal.provider in the wal perf eval tool.
2014-12-31 16:01:07 -06:00
Aditya Kishore 8514e2b20e HBASE-12775: CompressionTest ate my HFile 2014-12-30 16:14:59 -08:00
stack 305267b8e2 HBASE-12270 A bug in the bucket cache, with cache blocks on write enabled (Liu Shaohui) 2014-12-30 14:43:19 -08:00
Jurriaan Mous baa2d05374 HBASE-12740 Improve performance of TestHBaseFsck
Signed-off-by: stack <stack@apache.org>
2014-12-30 14:29:46 -08:00
stack 734324e80f Revert "HBASE-12740 Improve performance of TestHBaseFsck"
Undo because Jurriaan Mous did update in meantime.

This reverts commit 042743fff0.
2014-12-30 12:19:57 -08:00
stack c6002ccd38 HBASE-12772 TestPerColumnFamilyFlush failing -- ADDENDUM 2014-12-30 11:37:31 -08:00
Jurriaan Mous 042743fff0 HBASE-12740 Improve performance of TestHBaseFsck
Signed-off-by: stack <stack@apache.org>
2014-12-30 10:37:43 -08:00
tedyu 57b1efaabe HBASE-12607 TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 2014-12-30 09:33:54 -08:00
Lars Hofhansl 0513a21dc8 HBASE-12776 SpliTransaction: Log number of files to be split. 2014-12-29 20:38:09 -08:00
xieliang c24810eebe HBASE-12767 Fix a StoreFileScanner NPE in reverse scan flow 2014-12-30 11:55:11 +08:00
stack 02b0332650 HBASE-12772 TestPerColumnFamilyFlush failing 2014-12-29 15:47:20 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
Elliott Clark e5ca773f78 HBASE-12429 Add port to ClusterManager's actions. 2014-12-29 10:22:52 -08:00
stack 8dac7f9e6c HBASE-12762 Region with no hfiles will have the highest locality cost in LocalityCostFunction (cuijianwei) 2014-12-29 07:44:46 -08:00
tedyu fbdaf62bf8 HBASE-12716 A bug in RegionSplitter.UniformSplit algorithm (Weichen Ye) 2014-12-28 07:48:24 -08:00
tedyu 9abab54d8e HBASE-12764 TestPerColumnFamilyFlush#testCompareStoreFileCount may fail due to new table not available 2014-12-27 21:10:47 -08:00
stack 317d137452 HBASE-12763 Make it so there must be WALs for a server to be marked dead 2014-12-27 13:09:40 -08:00