Commit Graph

4373 Commits

Author SHA1 Message Date
tedyu 34ca6f5069 HBASE-15873 ACL for snapshot restore / clone is not enforced 2016-05-22 19:13:13 -07:00
tedyu 6738dbadac HBASE-15802 ConnectionUtils should use ThreadLocalRandom instead of Random (Matt Warhaftig) 2016-05-22 06:47:59 -07:00
Jerry He b7de663580 HBASE-14818 user_permission does not list namespace permissions (li xiang) 2016-05-21 20:32:20 -07:00
tedyu 01d77bf37b HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang) 2016-05-21 14:39:41 -07:00
tedyu 108a130f38 HBASE-15529 Revert due to TestRegionRebalancing failing 2016-05-20 12:56:48 -07:00
tedyu b91a6199e9 HBASE-15529 Override needBalance in StochasticLoadBalancer (Guanghao Zhang) 2016-05-20 10:20:44 -07:00
Gary Helmling df40739ae7 HBASE-15856 Don't cache unresolved addresses for connections 2016-05-20 10:02:05 -07:00
Matteo Bertozzi 6dbc8ebec1 HBASE-15865 Move TestTableDeleteFamilyHandler and TestTableDescriptorModification handler tests to procedure 2016-05-20 07:15:48 -07:00
Matteo Bertozzi 233264bc17 HBASE-15864 Reuse the testing helper to wait regions in transition 2016-05-20 06:49:14 -07:00
Jerry He d038b762a5 HBASE-15465 userPermission returned by getUserPermission() for the selected namespace does not have namespace set (li xiang) 2016-05-19 20:38:24 -07:00
tedyu 696a51d344 HBASE-15847 VerifyReplication prefix filtering (Geoffrey Jacoby) 2016-05-19 10:43:49 -07:00
Vincent 5eed14272b HBASE-15617 Canary in regionserver mode might not enumerate all regionservers
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-05-18 18:42:17 -07:00
Matteo Bertozzi e5eea96ca6 HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:51:17 -07:00
Jerry He a9972355c4 HBASE-15841 Performance Evaluation tool total rows may not be set correctly 2016-05-18 12:15:18 -07:00
Enis Soztutar 49359a4ee3 HBASE-15824 LocalHBaseCluster gets bind exception in master info port - ADDENDUM 2016-05-18 11:36:16 -07:00
Stephen Yuan Jiang 0078522549 HBASE-15850 Localize the configuration change in testCheckTableLocks to reduce flakiness of TestHBaseFsck test suite (Stephen Yuan Jiang) 2016-05-18 07:13:39 -07:00
tedyu ce43e33876 HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 13:26:45 -07:00
stack c0fcce2bde HBASE-15593 Time limit of scanning should be offered by client (Phil Yang) 2016-05-17 12:51:03 -07:00
Elliott Clark 89146d85ac HBASE-15840 WAL.proto compilation broken for cpp 2016-05-17 12:04:31 -07:00
tedyu cadebe691f HBASE-15842 SnapshotInfo should display ownership information 2016-05-16 20:34:41 -07:00
Enis Soztutar c96227eed1 HBASE-15824 LocalHBaseCluster gets bind exception in master info port 2016-05-16 10:35:45 -07:00
Sean Busbey e365191896 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:53:45 -05:00
Mikhail Antonov 0042d6d4c8 HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang) 2016-05-15 20:49:00 -07:00
Apekshit 92f415976e HBASE-13532 Make UnknownScannerException less scary by giving more information in the exception string. (Apekshit)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-13 15:03:36 -07:00
Apekshit a6f8214e9b HBASE-15236 Inconsistent cell reads over multiple bulk-loaded HFiles. In KeyValueHeap, if two cells are same i.e. have same key and timestamp, then instead of directly using seq id to determine newer one, we should use StoreFile.Comparater.SEQ_ID because that's what is used to determine order of hfiles. In this patch, we assign each scanner an order based on it's index in storefiles list, which is then used in KeyValueHeap to disambiguate between same cells. Changes the getSequenceId() in KeyValueScanner class to getScannerOrder(). Testing: Adds unit test to TestKeyValueHeap. Manual testing: Three cases (Tables t, t2, t3 in the jira description), single region, 2 hfiles with same seq id, timestamps and duplicate KVs. Made sure that returned kv was same for get and scan. (Apekshit)
Change-Id: I22600c91c0a51fb63eb17db73472839d2f13957c

Signed-off-by: stack <stack@apache.org>
2016-05-12 21:31:13 -07:00
Jerry He cadc4cf15b HBASE-15808 Reduce potential bulk load intermediate space usage and waste 2016-05-12 15:22:56 -07:00
Matteo Bertozzi 98d13c745c HBASE-15415 Improve Master WebUI snapshot information (huaxiang sun) 2016-05-09 20:22:07 -07:00
Apekshit 2f282aca15 HBASE-11625 - Verifies data before building HFileBlock. - Adds HFileBlock.Header class which contains information about location of fields. Testing: Adds CorruptedFSReaderImpl to TestChecksum.
Change-Id: I6777f2ddf8922691c84ca86d0cffa9a37dc879ae

Signed-off-by: stack <stack@apache.org>
2016-05-09 16:29:47 -07:00
Enis Soztutar d07d316113 HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB 2016-05-09 10:25:57 -07:00
Gary Helmling e44c360350 HBASE-15773 Improvements to CellCounter job 2016-05-06 11:18:24 -07:00
Ashish Singhi 0964884b92 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:28:06 +05:30
tedyu 3a7552a9f3 HBASE-15563 'counter' may overflow in BoundedGroupingStrategy (Matt Warhaftig) 2016-05-05 10:29:10 -07:00
Matteo Bertozzi 686a31fbde HBASE-15755 SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked 2016-05-05 07:28:52 -07:00
Gary Helmling b36222831d HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:37:39 -07:00
Enis Soztutar 12da71b824 HBASE-15613 TestNamespaceCommand times out 2016-05-04 11:37:09 -07:00
tedyu a7b31f74db HBASE-15752 ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job 2016-05-03 07:01:08 -07:00
chenheng 0ee3ca2a78 HBASE-15714 We are calling checkRow() twice in doMiniBatchMutation() 2016-05-03 22:34:09 +10:00
Yu Li 330b3b281a HBASE-15675 Add more details about region on table.jsp 2016-05-03 20:29:49 +08:00
Mikhail Antonov 7e0e86072a HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:27:13 -07:00
Mikhail Antonov 36d634d353 HBASE-15281 Allow the FileSystem inside HFileSystem to be wrapped (Rajesh Nishtala) 2016-05-02 13:26:37 -07:00
tedyu 57ca428c54 HBASE-15357 TableInputFormatBase getSplitKey does not handle signed bytes correctly (Nathan Schile) 2016-04-29 20:55:47 -07:00
Mikhail Antonov e6bcf95da5 HBASE-15551 Make call queue too big exception use servername 2016-04-29 10:26:18 -07:00
tedyu c512750914 HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor 2016-04-28 09:21:22 -07:00
Vasudevan 2b0913eea4 HBASE-15697 Excessive TestHRegion running time on branch-1 (Ram) 2016-04-28 14:18:33 +05:30
tedyu 4f2d8dc328 HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:03:34 -07:00
chenheng 5f5cdaae9a HBASE-15720 Print row locks at the debug dump page 2016-04-28 11:46:06 +08:00
tedyu 4ba57cb935 HBASE-15707 ImportTSV bulk output does not support tags with hfile.format.version=3 (huaxiang sun) 2016-04-27 13:40:54 -07:00
stack 6b78409eb2 HBASE-15477 Purge 'next block header' from cached blocks
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body.  We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).

This patch undoes this over-persisting.

Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.

There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.

Adds loads of documentation.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
  (write) Add writing from a ByteBuff.

M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
  (toString) Add one so ByteBuff looks like ByteBuffer when you click on
  it in IDE

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
  Remove support for version 1 blocks.

  Cleaned up handling of metadata added when we serialize a block to
  caches. Metadata is smaller now.

  When we serialize (used when caching), do not persist the next blocks
  header if present.

  Removed a bunch of methods, a few of which had overlapping
  functionality and others that exposed too much of our internals.
  Also removed a bunch of constructors and unified the constructors we
  had left over making them share a common init method.
  Shutdown access to defines that should only be used internally here.

  Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
  about metadata saved to caches; was unclear previously what EXTRA was
  about.

  Renamed static final declarations as all uppercase.

  (readBlockDataInternal): Redid. Couldn't make sense of it previously.
  Undid heavy-duty parse of header by constructing HFileBlock. Other
  cleanups. Its 1/3rd the length it used to be. More to do in here.

Signed-off-by: stack <stack@apache.org>
2016-04-27 10:41:47 -07:00
Gary Helmling 4272178b1f HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable 2016-04-26 23:02:24 -07:00
Phil Yang d5acbdd1e4 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:52:12 -07:00