Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,134 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

4789 Commits

Author SHA1 Message Date
Stephen Yuan Jiang de1b5ff776 HBASE-15955 Disable action in CatalogJanitor#setEnabled should wait for active cleanup scan to finish (Stephen Yuan Jiang) 2016-06-03 15:49:23 -07:00
Joseph Hwang 21e98271c3 HBASE-15883 Adding WAL files and tracking offsets in HBase. 
Implemented ReplicationQueuesHBaseImpl that tracks WAL offsets and replication queues in an HBase table.
Only wrote the basic tracking methods, have not implemented claimQueue() or HFileRef methods yet.
Wrote a basic unit test for ReplicationQueueHBaseImpl that tests the implemented functions on a single Region Server

Signed-off-by: Elliott Clark <elliott@fb.com>
Signed-off-by: Elliott Clark <eclark@apache.org>
 2016-06-03 15:23:10 -07:00
Apekshit 9a53d8b385 HBASE-15929 There are two tests named TestRegionServerMetrics. This causes slight issues when parsing console output for hanging tests and flaky tests analysis. Moving .../hbase/TestRegionServerMetrics.java to .../hbase/regionserver/TestRegionServerReadRequestMetrics.java. (Apekshit) 
Change-Id: I379c15fe2c2c01bed53bddf7619d5f2a07c5640e
 2016-06-03 15:13:49 -07:00
Apekshit b557f0bec6 HBASE-15949 Cleanup TestRegionServerMetrics. 
@Before and @After to setup/teardown tables using @Rule to set table name based on testname.
Refactor out copy-pasted code fragments to single function.
(Apekshit)

Change-Id: Ic22e5027cc3952bab5ec30070ed20e98017db65a
 2016-06-03 14:27:24 -07:00
Matteo Bertozzi f0c159b5fe HBASE-15927 Remove HMaster.assignRegion() 2016-06-03 12:36:25 -07:00
Ashish Singhi 0cbce07626 HBASE-15888 Extend HBASE-12769 for bulk load data replication 2016-06-03 18:42:00 +05:30
Lars Hofhansl fc890a2ecb HBASE-15881 Allow BZIP2 compression. 2016-06-02 12:19:02 -07:00
tedyu 7e5d530870 HBASE-15727 Canary Tool for Zookeeper (churro morales) 2016-06-02 10:15:08 -07:00
tedyu cd2588001c HBASE-15933 Addendum - make merge decision when sizes of both regions are known 2016-06-02 09:30:36 -07:00
tedyu cfe868d56e HBASE-15933 NullPointerException may be thrown from SimpleRegionNormalizer#getRegionSize() 2016-06-02 01:55:28 -07:00
Apekshit 1a27278624 HBASE-15915 Set timeouts on hanging tests. Tests run: 8, Time elapsed: 94.191 sec - in org.apache.hadoop.hbase.master.procedure.TestMasterFailoverWithProcedures Tests run: 103, Time elapsed: 69.057 sec - in org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 103, Time elapsed: 67.957 sec - in org.apache.hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush Tests run: 5, Time elapsed: 34.629 sec - in org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster Tests run: 9, Time elapsed: 82.913 sec - in org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient Tests run: 9, Time elapsed: 80.458 sec - in org.apache.hadoop.hbase.snapshot.TestMobFlushSnapshotFromClient (Apekshit) 
Change-Id: Ia7b986ca6276ff5498f588c0b1b9c570e2a9d798

Signed-off-by: stack <stack@apache.org>
 2016-05-30 21:13:55 -07:00
Daniel Vimont e6d613de70 HBASE-15835 - Prevent HBaseTestingUtility#startMiniCluster from throwing _HMasterAddress already in use_ RuntimeException when another HBase thread is running 
Signed-off-by: stack <stack@apache.org>
 2016-05-30 20:05:19 -07:00
Jurriaan Mous a1f0c1cbb3 HBASE-15875 Remove HTable references and HTableInterface 
Signed-off-by: stack <stack@apache.org>
 2016-05-30 19:56:54 -07:00
Jurriaan Mous cdd532da8a HBASE-15610 Remove deprecated HConnection for 2.0 thus removing all PB references for 2.0 
Signed-off-by: stack <stack@apache.org>
 2016-05-29 07:50:55 -07:00
Sean Mackrory f4470af95d HBASE-15891. Closeable resources potentially not getting closed if exception is thrown. 
Signed-off-by: stack <stack@apache.org>
 2016-05-28 21:32:22 -07:00
Sean Mackrory 3b6e6e6c25 HBASE-15889. String case conversions are locale-sensitive, used without locale 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-05-28 10:41:31 -07:00
Mikhail Antonov 60c8f76a9d HBASE-15908 Checksum verification is broken due to incorrect passing of ByteBuffers in DataChecksum (Mikhail Antonov and Appy) 2016-05-28 03:14:52 -07:00
Gary Helmling da0d74cd27 HBASE-15830 SASL encryption doesn't work with AsyncRpcChannelImpl (Colin Ma) 2016-05-26 21:58:27 -07:00
Enis Soztutar 43d1a999fe HBASE-15837 Memstore size accounting is wrong if postBatchMutate() throws exception 2016-05-26 11:12:17 -07:00
Apekshit 94696d4067 HBASE-14635 Fix flaky test TestSnapshotCloneIndependence 
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
 2016-05-25 21:14:06 -07:00
Joseph Hwang b3362ccb0c HBASE-15471 Added in Priority, General, and Replication queue sizes for RegionServers to the Web UI 
Changed UI labels so that queue "size" refers to size in bytes and queue "length" refers to number of items in queue.

Signed-off-by: Elliott Clark <elliott@fb.com>
 2016-05-25 15:10:48 -07:00
tedyu fa74baeb40 HBASE-15884 NPE in StoreFileScanner#skipKVsNewerThanReadpoint during reverse scan (Sergey Soldatov) 2016-05-25 08:58:28 -07:00
tedyu 39dc19236e HBASE-15806 revert due to discussion on security 2016-05-24 02:08:11 -07:00
tedyu c03ea895c4 HBASE-15806 An endpoint-based export tool (ChiaPing Tsai) 2016-05-23 10:51:25 -07:00
Jurriaan Mous 7130a222ce HBASE-15876 Remove doBulkLoad(Path hfofDir, final HTable table) though it has not been through a full deprecation cycle 
Signed-off-by: stack <stack@apache.org>
 2016-05-23 10:25:22 -07:00
tedyu ae42c65cfd HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig) 2016-05-21 21:15:10 -07:00
Jerry He 56e4b85d06 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:06:05 -07:00
tedyu 0671cba65f HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang) 2016-05-21 04:03:00 -07:00
anoopsjohn 0e52ac2464 HBASE-15228 Add the methods to RegionObserver to trigger start/complete restoring WALs. (Toshihiro Suzuki) 2016-05-21 09:56:28 +05:30
tedyu 2bb07e209e HBASE-15529 Revert due to TestRegionRebalancing failing 2016-05-20 12:56:17 -07:00
Gary Helmling 4793988aef HBASE-15856 Don't cache unresolved addresses for connections 2016-05-20 09:36:11 -07:00
tedyu 58798fc091 HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang) 2016-05-20 07:44:05 -07:00
Matteo Bertozzi d34f5d4b96 HBASE-15865 Move TestTableDeleteFamilyHandler and TestTableDescriptorModification handler tests to procedure 2016-05-20 07:03:11 -07:00
Matteo Bertozzi 7a84ee262f HBASE-15864 Reuse the testing helper to wait regions in transition 2016-05-20 06:48:38 -07:00
eshcar a27504c701 HBASE-14920: Compacting memstore 
Signed-off-by: stack <stack@apache.org>
 2016-05-20 03:41:43 -07:00
Jerry He af5146ee04 HBASE-15465 userPermission returned by getUserPermission() for the selected namespace does not have namespace set (li xiang) 2016-05-19 20:35:58 -07:00
tedyu a050e1d9f8 HBASE-15847 VerifyReplication prefix filtering (Geoffrey Jacoby) 2016-05-19 06:38:27 -07:00
Vincent 460b41c800 HBASE-15617 Canary in regionserver mode might not enumerate all regionservers 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2016-05-18 16:25:29 -07:00
Stephen Yuan Jiang 8aa8abfcb6 HBASE-15850 Localize the configuration change in testCheckTableLocks to reduce flakiness of TestHBaseFsck test suite (Stephen Yuan Jiang) 2016-05-18 13:22:41 -07:00
Matteo Bertozzi 5ac54e6abb HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:48:26 -07:00
Jerry He 393bcd69f9 HBASE-15841 Performance Evaluation tool total rows may not be set correctly 2016-05-18 12:09:13 -07:00
Enis Soztutar c1ada0a373 HBASE-15824 LocalHBaseCluster gets bind exception in master info port - ADDENDUM 2016-05-18 11:36:10 -07:00
Phil Yang 3bd9220f0c HBASE-15593 Time limit of scanning should be offered by client 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2016-05-18 19:13:15 +08:00
Ramkrishna 7b5d5394c0 HBASE-15784 Misuse core/maxPoolSize of LinkedBlockingQueue in 
ThreadPoolExecutor (Jingcheng Du)
 2016-05-18 12:40:43 +05:30
zhangduo b2b3b1fa4d Revert "HBASE-15593 Time limit of scanning should be offered by client (Phil Yang)" 
This reverts commit e47bfb9078.
 2016-05-18 13:08:50 +08:00
stack e47bfb9078 HBASE-15593 Time limit of scanning should be offered by client (Phil Yang) 2016-05-17 12:49:31 -07:00
Elliott Clark 9269b8199e HBASE-15840 WAL.proto compilation broken for cpp 2016-05-17 12:04:14 -07:00
tedyu 838c306c0a HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 11:01:26 -07:00
tedyu 00e61d2cfd HBASE-15842 SnapshotInfo should display ownership information 2016-05-16 20:34:04 -07:00
Enis Soztutar c3223a59ff HBASE-15824 LocalHBaseCluster gets bind exception in master info port 2016-05-16 10:32:43 -07:00
Sean Busbey e0aff10901 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase. 
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
 2016-05-16 00:50:14 -05:00
Mikhail Antonov 2482062d34 HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang) 2016-05-15 20:37:26 -07:00
Apekshit 60e19f60a9 HBASE-13532 Make UnknownScannerException less scary by giving more information in the exception string. (Apekshit) 
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
 2016-05-13 15:00:23 -07:00
Jerry He acca95fb50 HBASE-15808 Reduce potential bulk load intermediate space usage and waste 2016-05-12 15:43:48 -07:00
zhangduo 1267f76e9a HBASE-15813 Rename DefaultWALProvider to a more specific name and clean up unnecessary reference to it 2016-05-12 11:27:00 +08:00
tedyu c867858c44 HBASE-15812 Revert pending investigation on whether metrics dump can be re-implemented 2016-05-11 09:39:20 -07:00
tedyu f3fee82ac4 HBASE-15812 HttpServer fails to come up against hadoop trunk 2016-05-11 09:00:27 -07:00
Jurriaan Mous a11091c49c HBASE-15798 Add Async RpcChannels to all RpcClients 
Signed-off-by: stack <stack@apache.org>
 2016-05-10 07:44:51 -07:00
Matteo Bertozzi 8604f9eebb HBASE-15415 Improve Master WebUI snapshot information (huaxiang sun) 2016-05-09 20:20:49 -07:00
Apekshit 11740570c1 HBASE-15236 Inconsistent cell reads over multiple bulk-loaded HFiles. In KeyValueHeap, if two cells are same i.e. have same key and timestamp, then instead of directly using seq id to determine newer one, we should use StoreFile.Comparater.SEQ_ID because that's what is used to determine order of hfiles. In this patch, we assign each scanner an order based on it's index in storefiles list, which is then used in KeyValueHeap to disambiguate between same cells. Changes the getSequenceId() in KeyValueScanner class to getScannerOrder(). Testing: Adds unit test to TestKeyValueHeap. Manual testing: Three cases (Tables t, t2, t3 in the jira description), single region, 2 hfiles with same seq id, timestamps and duplicate KVs. Made sure that returned kv was same for get and scan. (Apekshit) 
Change-Id: I22600c91c0a51fb63eb17db73472839d2f13957c

Signed-off-by: stack <stack@apache.org>
 2016-05-09 16:57:06 -07:00
Esteban Gutierrez a6e29676db HBASE-15612: Minor improvements to CellCounter and RowCounter documentation 
Signed-off-by: stack <stack@apache.org>
 2016-05-09 14:12:43 -07:00
Enis Soztutar b75b226804 HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB 2016-05-09 10:25:49 -07:00
zhangduo 05378cbf69 HBASE-15609 Addendum fix compilation error 2016-05-09 20:45:04 +08:00
Ramkrishna 97ad33c691 HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and 
any such public facing class for 2.0 (Ram)
 2016-05-09 14:56:00 +05:30
Apekshit 48b77dbcbc HBASE-11625 - Verifies data before building HFileBlock. - Adds HFileBlock.Header class which contains information about location of fields. Testing: Adds CorruptedFSReaderImpl to TestChecksum. 
Change-Id: I107e9636b28abb6b15ec329e885f1e31b1b1b988

Signed-off-by: stack <stack@apache.org>
 2016-05-08 17:33:04 -07:00
Matteo Bertozzi 99e2deb86f HBASE-15778 replace master.am and master.sm direct access with getter calls 2016-05-07 05:19:15 -07:00
Matteo Bertozzi 513ca3483f HBASE-15776 Replace master.am.getTableStateManager() with the direct master.getTableStateManager() 2016-05-06 19:30:45 -07:00
Gary Helmling 86ca09e0e5 HBASE-15773 Improvements to CellCounter job 2016-05-06 11:08:18 -07:00
Matteo Bertozzi d90f0571e6 HBASE-15781 Remove unused TableEventHandler and TotesHRegionInfo 2016-05-06 10:05:42 -07:00
Ashish Singhi 34e9a6ff30 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:26:17 +05:30
Ramkrishna bec81b1977 HBASE-15608 Remove PB references from SnapShot related Exceptions (ram) 2016-05-06 17:06:25 +05:30
zhangduo 0d252918f6 HBASE-15743 Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput 2016-05-06 08:55:58 +08:00
tedyu 532b914f08 HBASE-15759 RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint 2016-05-05 15:20:37 -07:00
tedyu c716a75416 HBASE-15767 upgrade httpclient to 4.3.6 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-05-05 15:41:26 -05:00
Alex Moundalexis 0bf065a5d5 HBASE-15768 fix capitalization of ZooKeeper usage 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2016-05-05 15:35:44 -05:00
Stephen Yuan Jiang b7ce55f001 HBASE-15575 Rename table DDL *Handler methods in MasterObserver to more meaningful names (Stephen Yuan Jiang) 2016-05-05 11:44:22 -07:00
tedyu efcf94def7 HBASE-15563 'counter' may overflow in BoundedGroupingStrategy (Matt Warhaftig) 2016-05-05 10:28:33 -07:00
Matteo Bertozzi c0ce47d1cb HBASE-15755 SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked 2016-05-05 07:24:29 -07:00
Gary Helmling d23d600d76 HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:09:57 -07:00
Enis Soztutar 29eb3e8bcc HBASE-15613 TestNamespaceCommand times out 2016-05-04 11:37:03 -07:00
Ramkrishna 809ed326f0 HBASE-15760 TestBlockEvictionFromClient#testParallelGetsAndScanWithWrappedRegionScanner 
fails in master branch (Ram)
 2016-05-04 22:07:11 +05:30
Matteo Bertozzi a8a2c516a0 HBASE-15763 Isolate Wal related stuff from MasterFileSystem 2016-05-04 07:59:44 -07:00
zhangduo 6abe1879dd HBASE-15754 Add testcase for AES encryption 2016-05-04 09:40:57 +08:00
Yu Li 082d193455 HBASE-15675 Add more details about region on table.jsp 2016-05-03 20:18:48 +08:00
tedyu c77a153001 HBASE-15752 ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job 2016-05-03 01:57:25 -07:00
Ramkrishna c06a976a98 HBASE-15607 Remove PB references from Admin for 2.0 (Ram) 2016-05-03 10:51:46 +05:30
chenheng d77972ff16 HBASE-15714 We are calling checkRow() twice in doMiniBatchMutation() 2016-05-03 09:42:41 +10:00
Mikhail Antonov 58c4c3d174 HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:23:07 -07:00
Mikhail Antonov bbc7b90335 HBASE-15281 Allow the FileSystem inside HFileSystem to be wrapped (Rajesh Nishtala) 2016-05-02 13:24:51 -07:00
anoopsjohn d1130582d5 HBASE-15735 Tightening of the CP contract. 2016-05-02 09:48:51 +05:30
Jurriaan Mous 15631a76f5 HBASE-15744 Port over small format/text improvements from HBASE-13784 
(Jurriaan Mous)

Signed-off-by: stack <stack@apache.org>
 2016-05-01 19:48:43 -07:00
chenheng ccd8888b4b Revert "HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response" 
This reverts commit 01c0448ccd.
 2016-04-30 11:37:05 +08:00
chenheng 01c0448ccd HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response 2016-04-30 09:27:32 +08:00
tedyu c236409c3b HBASE-15357 TableInputFormatBase getSplitKey does not handle signed bytes correctly (Nathan Schile) 2016-04-29 17:08:25 -07:00
Mikhail Antonov 730b077666 HBASE-15551 Make call queue too big exception use servername 2016-04-29 10:25:29 -07:00
anoopsjohn 4706303186 HBASE-15706 HFilePrettyPrinter should print out nicely formatted tags. (huaxiang sun) 2016-04-29 09:23:57 +05:30
tedyu 8a28c23431 HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor 2016-04-28 09:19:12 -07:00
Ramkrishna 889d89a74c HBASE-15697 Excessive TestHRegion running time on branch-1 (Ram) 2016-04-28 14:24:39 +05:30
tedyu 9343ef438f HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:00:11 -07:00
chenheng e8b37422c3 HBASE-15720 Print row locks at the debug dump page 2016-04-28 11:40:29 +08:00