Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,354 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

4934 Commits

Author SHA1 Message Date
Apekshit Sharma 064271da16 HBASE-14743 Add metrics around HeapMemoryManager. (Reid Chan) 
Change-Id: I60b2435355b3e605e7d91cbf5aca5d2988f26f33
 2016-07-25 13:45:50 -07:00
anoopsjohn 2df0ef549a HBASE-16205 When Cells are not copied to MSLAB, deep clone it while adding to Memstore. 2016-07-25 22:58:32 +05:30
Phil Yang 6dbce2a8cb HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2016-07-25 22:26:19 +08:00
Stephen Yuan Jiang bdd7782f05 HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang) 2016-07-23 14:47:11 -07:00
Stephen Yuan Jiang cd0b85e0a8 Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue) 2016-07-22 20:09:03 -07:00
Joseph Hwang 744248c131 HBASE-16096 Properly remove the replication queue and peer znodes after calling ReplicationSourceManager.removePeer(). 
Signed-off-by: Elliott Clark <eclark@apache.org>
 2016-07-22 18:11:41 -07:00
Joseph Hwang 03fe257a64 HBASE-16221 Have ThriftScanner update the ConnectionCache's last used time overtime getScannerRow() to keep the connection alive for long lived scanners 
Signed-off-by: Elliott Clark <eclark@apache.org>
 2016-07-22 17:58:39 -07:00
Matteo Bertozzi cc766df28b HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun) 2016-07-22 15:28:04 -07:00
Jerry He 519f87fc2b HBASE-15291 Revert due to race condition resulting in closed FileSystem error 2016-07-21 18:51:47 -07:00
Gary Helmling 65834a1ced HBASE-16217 Pass through the calling user in ObserverContext 2016-07-21 16:45:09 -07:00
stack 9d740f7b8b HBASE-16263 Move all to do w/ protobuf -- *.proto files and generated classes -- under hbase-protocol 
Signed-off-by: stack <stack@apache.org>
 2016-07-21 10:02:05 -07:00
Jerry He ce657d5911 HBASE-13701 Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load -- addendum 2016-07-20 13:28:01 -07:00
Jerry He 70f330dc84 Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load 2016-07-19 19:53:10 -07:00
Enis Soztutar 5051ab4e70 HBASE-16244 LocalHBaseCluster start timeout should be configurable (Siddharth Wagle) 2016-07-19 14:12:47 -07:00
Stephen Yuan Jiang 638ca24f01 HBASE-14552 (addendum) Procedure V2: Reimplement DispatchMergingRegionHandler (add nonce support) (Stephen Yuan Jiang) 2016-07-19 08:49:23 -07:00
zhangduo 515c499f95 HBASE-16110 AsyncFS WAL doesn't work with Hadoop 2.8+ 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-07-18 06:54:20 -05:00
Phil Yang a1cc2c4bfe HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely 
(cherry picked from commit a8dfd8c436)
 2016-07-18 06:48:17 -05:00
Sean Busbey a0aa017ae9 Revert "Replication queue's lock will live forever if RS acquiring the lock has died prematurely" 
This reverts commit a8dfd8c436.
 2016-07-18 06:47:56 -05:00
chenheng cf0f4f72d9 HBASE-16076 Cannot configure split policy in HBase shell 2016-07-18 10:28:05 +08:00
Phil Yang a8dfd8c436 Replication queue's lock will live forever if RS acquiring the lock has died prematurely 2016-07-18 09:32:36 +08:00
tedyu 9bc7ecfb9d HBASE-16235 Addendum uses hfile count of 20 (ChiaPing) 2016-07-16 16:07:11 -07:00
Jerry He 60847a2d76 HBASE-3727 MultiHFileOutputFormat (yi liang) 2016-07-15 21:07:12 -07:00
tedyu 66c68f8ea3 HBASE-16235 TestSnapshotFromMaster#testSnapshotHFileArchiving will fail if there are too many hfiles (ChiaPing Tsai) 2016-07-15 15:07:14 -07:00
Stephen Yuan Jiang 3978aa3af0 HBASE-13823 Procedure V2: remove unnecessaery operaions on AssignmentManager#recoverTableInDisablingState() and recoverTableInEnablingState() (Stephen Yuan Jiang) 2016-07-15 12:26:31 -07:00
Stephen Yuan Jiang f04eeecffc HBASE-14552 Procedure V2: Reimplement DispatchMergingRegionHandler (Stephen Yuan Jiang) 2016-07-15 07:06:53 -07:00
Stephen Yuan Jiang 28d8609e5d HBASE-16233 Procedure V2: Support acquire/release shared table lock concurrently (Stephen Yuan Jiang) 2016-07-14 21:32:59 -07:00
zhangduo 243fe287b9 HBASE-16219 addendum move MasterMetaBootstrap to the right place 2016-07-15 09:58:17 +08:00
Matteo Bertozzi a55af38689 HBASE-16219 Move meta bootstrap out of HMaster 2016-07-14 06:14:53 -07:00
Enis Soztutar a07892558b HBASE-16095 Add priority to TableDescriptor and priority region open thread pool 2016-07-13 18:19:59 -07:00
Yu Li 3b3c3dc02d HBASE-16195 Should not add chunk into chunkQueue if not using chunk pool in HeapMemStoreLAB 2016-07-13 09:33:24 +08:00
Andrew Purtell 911706a873 HBASE-16220 Demote log level for "HRegionFileSystem - No StoreFiles for" messages to TRACE 2016-07-12 15:44:06 -07:00
Joseph Hwang f292048ffd HBASE-16208 Check that the row exists before attempting to remove a queue from TableBasedReplicationQueuesImpl 
Signed-off-by: Elliott Clark <eclark@apache.org>
 2016-07-12 14:50:07 -07:00
Joseph Hwang 90ba723dc6 HBASE-16214 Add in a UI description for the Replication Table 
Signed-off-by: Elliott Clark <eclark@apache.org>
 2016-07-12 12:21:55 -07:00
Matteo Bertozzi 2650711e94 HBASE-16207 can't restore snapshot without "Admin" permission 2016-07-12 05:50:06 -07:00
Joseph Hwang ccf293d7fb HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint 
Signed-off-by: Mikhail Antonov <antonov@apache.org>
 2016-07-11 17:34:12 -07:00
Gary Helmling 3b5fbf8d73 HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh) 2016-07-11 10:33:22 -07:00
Yu Li 356c130702 HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells, addendum 2016-07-11 22:44:32 +08:00
tedyu 0875c35781 HBASE-16185 TestReplicationSmallTests fails in master branch (Phil Yang) 2016-07-10 23:28:32 -07:00
Yu Li 9cf012cd00 HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells 2016-07-10 13:45:17 +08:00
stack 496fd9837a HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove 
TimeRangeTracker as point of contention when many threads reading a StoreFile
 Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken
 scanning because of a side effect of a clean up in  HBASE-15650 to make
 TimeRange construction consistent exposed a latent issue in
 TimeRange#compare. See HBASE-16074 for more detail.

Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
 2016-07-08 18:20:31 -07:00
Yu Li 3c39cbd92c HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 02:02:00 +08:00
Yu Li 1578a045b6 Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication" 
This reverts commit a33097e067.
 2016-07-09 02:01:43 +08:00
stack 5e0d97e0e9 HBASE-16171 Fix the potential problems in TestHCM.testConnectionCloseAllowsInterrupt (Colin Ma) 2016-07-08 10:18:36 -07:00
Yu Li a33097e067 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication 2016-07-09 01:05:10 +08:00
anoopsjohn 581d2b7de5 HBASE-16162 Compacting Memstore : unnecessary push of active segments to pipeline. 2016-07-06 18:54:35 +05:30
Elliott Clark ae92668dd6 HBASE-16087 Replication shouldn't start on a master if if only hosts system tables 2016-07-05 13:50:37 -07:00
tedyu 20a99b4c06 HBASE-16144 Revert - test failure in TestMultiSlaveReplication#testMultiSlaveReplication seems to be related 2016-07-05 13:19:33 -07:00
Andrew Purtell 318751cfd6 HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal) 2016-07-05 11:13:48 -07:00
tedyu d016338e45 HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai) 2016-07-05 10:21:27 -07:00
tedyu b5cdb38dc7 HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely (Phil Yang) 2016-07-05 07:16:12 -07:00
Yu Li 7f44dfd85f HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin) 2016-07-04 21:45:04 +08:00
zhangduo 6944a17ad4 HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted 2016-07-04 19:26:27 +08:00
anoopsjohn d22c23c396 HBASE-16163 Compacting Memstore : CompactionPipeline#addFirst can use LinkedList#addFirst. 2016-07-03 21:35:29 +05:30
anoopsjohn 97f2294bfd HBASE-16164 Missing close of new compacted segments in few occasions which might leak MSLAB chunks from pool. 2016-07-02 11:42:08 +05:30
chenheng 561eb82968 HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block 2016-07-02 09:04:15 +08:00
tedyu fe75edb556 HBASE-16157 Revert - ChiaPing has new fix 2016-07-01 13:00:05 -07:00
tedyu d92a99da0e HBASE-16125 RegionMover uses hardcoded, Unix-style tmp folder - breaks Windows (Vladimir Rodionov) 2016-07-01 10:02:25 -07:00
tedyu 5a7c9939cb HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai) 2016-07-01 09:43:39 -07:00
tedyu cc73c03118 HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy) 2016-07-01 03:41:17 -07:00
anoopsjohn 139f0ed53c HBASE-16155 Compacting Memstore : Few log improvements. 2016-07-01 10:14:07 +05:30
stack d1d8cc71c9 HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda) 2016-06-30 15:03:32 -07:00
Ramkrishna e2566eb0ee HBASE-16153 Correct the config name 
'hbase.memestore.inmemoryflush.threshold.factor' (Ram)
 2016-06-30 17:44:08 +05:30
Jonathan M Hsieh e1d130946b HBASE-16117 Fix Connection leak in mapred.TableOutputFormat 2016-06-29 17:18:43 -07:00
tedyu 42106b89b1 HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan) 2016-06-29 16:34:44 -07:00
Ramkrishna 9b1ecb31f0 HBASE-16143 Change MemstoreScanner constructor to accept 
List<KeyValueScanner> (Ram)
 2016-06-29 23:10:55 +05:30
Jonathan M Hsieh 727394c2e9 HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1 2016-06-29 08:51:00 -07:00
tedyu 6fb0dd07a8 HBASE-16139 Use CellUtil instead of KeyValueUtil in Import (NIDHI GAMBHIR) 2016-06-29 02:45:00 -07:00
Jingcheng Du 432868b038 HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum 2016-06-29 16:31:23 +08:00
tedyu 394e7224a9 HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy) 2016-06-28 17:42:51 -07:00
Matteo Bertozzi 8bc4d4131c HBASE-16121 Require only MasterServices to the ServerManager constructor 2016-06-28 07:42:40 -07:00
Jingcheng Du e768c4afac HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. 2016-06-28 13:45:41 +08:00
tedyu 13cf4fb3fc HBASE-16052 Improve HBaseFsck Scalability (Ben Lau) 2016-06-27 13:24:35 -07:00
tedyu 424b789e03 HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan) 2016-06-27 06:41:00 -07:00
tedyu ba9286911f HBASE-16109 Add Interface audience annotation to a few classes 2016-06-27 06:29:04 -07:00
Elliott Clark fc4b8aa89d HBASE-16089 Add on FastPath for CoDel 2016-06-25 12:57:15 -07:00
Matteo Bertozzi e8599a2921 HBASE-16103 Procedure v2 - TestCloneSnapshotProcedure relies on execution order 2016-06-24 09:09:59 -07:00
Ramkrishna 99dc300d37 HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the 
Puts (Ram)
 2016-06-24 15:09:53 +05:30
Jingcheng Du 518faa735b HBASE-15353 Add metric for number of CallQueueTooBigException's 2016-06-24 13:00:06 +08:00
chenheng 68c1b34dbc HBASE-16040 Remove configuration "hbase.replication" 2016-06-24 10:41:35 +08:00
Gary Helmling f4cec2e202 HBASE-16085 Add a metric for failed compactions 2016-06-23 15:38:58 -07:00
tedyu 9cd097cfac HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges() 2016-06-23 07:28:35 -07:00
Matteo Bertozzi d66316fd80 HBASE-16068 Procedure v2 - use consts for conf properties in tests 2016-06-22 22:48:07 -07:00
Ramkrishna c1a559a666 HBASE-16070 Mapreduce Serialization classes do not have Interface audience 
(Ram)
 2016-06-23 10:22:24 +05:30
tedyu d297ecdf3c HBASE-16083 Addendum fixes config property names in tests (Joseph Hwang) 2016-06-22 17:31:57 -07:00
tedyu 0ea4d2f461 HBASE-16083 revert Addendum - Joseph discovered the mistake first 2016-06-22 17:31:24 -07:00
tedyu da09fd0781 HBASE-16083 Addendum fixes config property names in tests 2016-06-22 16:35:37 -07:00
Joseph Hwang f3b3a7c9b5 HBASE-16080 Fix flakey test TestTableBasedReplicationSourceManager.cleanupFailoverQueues(). 
Instead of running the primary test in a separate thread and hoping it finishes in time, just run the test in the primary thread.

Signed-off-by: Elliott Clark <eclark@apache.org>
 2016-06-22 12:26:35 -07:00
tedyu 6fc71c5d31 HBASE-16049 TestRowProcessorEndpoint is failing on Apache Builds (Guanghao Zhang) 2016-06-22 12:24:07 -07:00
tedyu 2846113b59 HBASE-16012 Major compaction can't work due to obsolete scanner read point in RegionServer (Guanghao Zhang) 2016-06-22 02:08:45 -07:00
Joseph Hwang 152594560e HBASE-16036 Made Replication Table creation non-blocking. 
All ReplicationTableBase method's that need to access the Replication Table will block until it is created though.
Also refactored ReplicationSourceManager so that abandoned queue adoption is run in the background too so that it does not block HRegionServer initialization.

Signed-off-by: Elliott Clark <eclark@apache.org>
 2016-06-21 13:05:50 -07:00
tedyu b006e41a37 HBASE-16051 TestScannerHeartbeatMessages fails on some machines (Phil Yang) 2016-06-21 07:32:30 -07:00
Yu Li 471f942ec8 HBASE-16032 Possible memory leak in StoreScanner 2016-06-21 20:06:33 +08:00
tedyu 3de0c63105 HBASE-16035 Nested AutoCloseables might not all get closed (Sean Mackrory) 2016-06-20 16:25:50 -07:00
Matteo Bertozzi 313a3d23a8 HBASE-14644 Region in transition metric is broken -- addendum (Huaxiang Sun) 2016-06-20 10:46:25 -07:00
tedyu be56b5ae71 HBASE-16059 Region normalizer fails to trigger merge action where one of the regions is empty 2016-06-20 10:40:50 -07:00
tedyu 095a82584e HBASE-16062 Improper error handling in WAL Reader/Writer creation (Vladimir Rodionov) 2016-06-20 07:34:26 -07:00
Ramkrishna 71c8cd5b1f HBASE-16042 Add support in PE tool for InMemory Compaction (Ram) 2016-06-20 16:29:24 +05:30
stack 01684c3417 HBASE-16023 Fastpath for the FIFO rpcscheduler AMENDMENT 2016-06-20 08:34:32 +01:00
Yu Li 4421fdf981 HBASE-16066 Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster, addendum to HBASE-15467 2016-06-19 17:25:26 +08:00
Enis Soztutar 6717f0e388 HBASE-16058 TestHRegion fails on 1.4 builds 2016-06-17 18:41:51 -07:00