Commit Graph

4750 Commits

Author SHA1 Message Date
Matteo Bertozzi 5ac54e6abb HBASE-15843 Replace RegionState.getRegionInTransition() Map with a Set 2016-05-18 12:48:26 -07:00
Jerry He 393bcd69f9 HBASE-15841 Performance Evaluation tool total rows may not be set correctly 2016-05-18 12:09:13 -07:00
Enis Soztutar c1ada0a373 HBASE-15824 LocalHBaseCluster gets bind exception in master info port - ADDENDUM 2016-05-18 11:36:10 -07:00
Phil Yang 3bd9220f0c HBASE-15593 Time limit of scanning should be offered by client
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-05-18 19:13:15 +08:00
Ramkrishna 7b5d5394c0 HBASE-15784 Misuse core/maxPoolSize of LinkedBlockingQueue in
ThreadPoolExecutor (Jingcheng Du)
2016-05-18 12:40:43 +05:30
zhangduo b2b3b1fa4d Revert "HBASE-15593 Time limit of scanning should be offered by client (Phil Yang)"
This reverts commit e47bfb9078.
2016-05-18 13:08:50 +08:00
stack e47bfb9078 HBASE-15593 Time limit of scanning should be offered by client (Phil Yang) 2016-05-17 12:49:31 -07:00
Elliott Clark 9269b8199e HBASE-15840 WAL.proto compilation broken for cpp 2016-05-17 12:04:14 -07:00
tedyu 838c306c0a HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 11:01:26 -07:00
tedyu 00e61d2cfd HBASE-15842 SnapshotInfo should display ownership information 2016-05-16 20:34:04 -07:00
Enis Soztutar c3223a59ff HBASE-15824 LocalHBaseCluster gets bind exception in master info port 2016-05-16 10:32:43 -07:00
Sean Busbey e0aff10901 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:50:14 -05:00
Mikhail Antonov 2482062d34 HBASE-15615 Wrong sleep time when RegionServerCallable need retry (Guanghao Zhang) 2016-05-15 20:37:26 -07:00
Apekshit 60e19f60a9 HBASE-13532 Make UnknownScannerException less scary by giving more information in the exception string. (Apekshit)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-05-13 15:00:23 -07:00
Jerry He acca95fb50 HBASE-15808 Reduce potential bulk load intermediate space usage and waste 2016-05-12 15:43:48 -07:00
zhangduo 1267f76e9a HBASE-15813 Rename DefaultWALProvider to a more specific name and clean up unnecessary reference to it 2016-05-12 11:27:00 +08:00
tedyu c867858c44 HBASE-15812 Revert pending investigation on whether metrics dump can be re-implemented 2016-05-11 09:39:20 -07:00
tedyu f3fee82ac4 HBASE-15812 HttpServer fails to come up against hadoop trunk 2016-05-11 09:00:27 -07:00
Jurriaan Mous a11091c49c HBASE-15798 Add Async RpcChannels to all RpcClients
Signed-off-by: stack <stack@apache.org>
2016-05-10 07:44:51 -07:00
Matteo Bertozzi 8604f9eebb HBASE-15415 Improve Master WebUI snapshot information (huaxiang sun) 2016-05-09 20:20:49 -07:00
Apekshit 11740570c1 HBASE-15236 Inconsistent cell reads over multiple bulk-loaded HFiles. In KeyValueHeap, if two cells are same i.e. have same key and timestamp, then instead of directly using seq id to determine newer one, we should use StoreFile.Comparater.SEQ_ID because that's what is used to determine order of hfiles. In this patch, we assign each scanner an order based on it's index in storefiles list, which is then used in KeyValueHeap to disambiguate between same cells. Changes the getSequenceId() in KeyValueScanner class to getScannerOrder(). Testing: Adds unit test to TestKeyValueHeap. Manual testing: Three cases (Tables t, t2, t3 in the jira description), single region, 2 hfiles with same seq id, timestamps and duplicate KVs. Made sure that returned kv was same for get and scan. (Apekshit)
Change-Id: I22600c91c0a51fb63eb17db73472839d2f13957c

Signed-off-by: stack <stack@apache.org>
2016-05-09 16:57:06 -07:00
Esteban Gutierrez a6e29676db HBASE-15612: Minor improvements to CellCounter and RowCounter documentation
Signed-off-by: stack <stack@apache.org>
2016-05-09 14:12:43 -07:00
Enis Soztutar b75b226804 HBASE-15740 Replication source.shippedKBs metric is undercounting because it is in KB 2016-05-09 10:25:49 -07:00
zhangduo 05378cbf69 HBASE-15609 Addendum fix compilation error 2016-05-09 20:45:04 +08:00
Ramkrishna 97ad33c691 HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
any such public facing class for 2.0 (Ram)
2016-05-09 14:56:00 +05:30
Apekshit 48b77dbcbc HBASE-11625 - Verifies data before building HFileBlock. - Adds HFileBlock.Header class which contains information about location of fields. Testing: Adds CorruptedFSReaderImpl to TestChecksum.
Change-Id: I107e9636b28abb6b15ec329e885f1e31b1b1b988

Signed-off-by: stack <stack@apache.org>
2016-05-08 17:33:04 -07:00
Matteo Bertozzi 99e2deb86f HBASE-15778 replace master.am and master.sm direct access with getter calls 2016-05-07 05:19:15 -07:00
Matteo Bertozzi 513ca3483f HBASE-15776 Replace master.am.getTableStateManager() with the direct master.getTableStateManager() 2016-05-06 19:30:45 -07:00
Gary Helmling 86ca09e0e5 HBASE-15773 Improvements to CellCounter job 2016-05-06 11:08:18 -07:00
Matteo Bertozzi d90f0571e6 HBASE-15781 Remove unused TableEventHandler and TotesHRegionInfo 2016-05-06 10:05:42 -07:00
Ashish Singhi 34e9a6ff30 HBASE-15669 HFile size is not considered correctly in a replication request 2016-05-06 17:26:17 +05:30
Ramkrishna bec81b1977 HBASE-15608 Remove PB references from SnapShot related Exceptions (ram) 2016-05-06 17:06:25 +05:30
zhangduo 0d252918f6 HBASE-15743 Add Transparent Data Encryption support for FanOutOneBlockAsyncDFSOutput 2016-05-06 08:55:58 +08:00
tedyu 532b914f08 HBASE-15759 RegionObserver.preStoreScannerOpen() doesn't have acces to current readpoint 2016-05-05 15:20:37 -07:00
tedyu c716a75416 HBASE-15767 upgrade httpclient to 4.3.6
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:41:26 -05:00
Alex Moundalexis 0bf065a5d5 HBASE-15768 fix capitalization of ZooKeeper usage
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:35:44 -05:00
Stephen Yuan Jiang b7ce55f001 HBASE-15575 Rename table DDL *Handler methods in MasterObserver to more meaningful names (Stephen Yuan Jiang) 2016-05-05 11:44:22 -07:00
tedyu efcf94def7 HBASE-15563 'counter' may overflow in BoundedGroupingStrategy (Matt Warhaftig) 2016-05-05 10:28:33 -07:00
Matteo Bertozzi c0ce47d1cb HBASE-15755 SnapshotDescriptionUtils and SnapshotTestingUtils do not have any Interface audience marked 2016-05-05 07:24:29 -07:00
Gary Helmling d23d600d76 HBASE-15741 Provide backward compatibility for HBase coprocessor service names 2016-05-04 12:09:57 -07:00
Enis Soztutar 29eb3e8bcc HBASE-15613 TestNamespaceCommand times out 2016-05-04 11:37:03 -07:00
Ramkrishna 809ed326f0 HBASE-15760 TestBlockEvictionFromClient#testParallelGetsAndScanWithWrappedRegionScanner
fails in master branch (Ram)
2016-05-04 22:07:11 +05:30
Matteo Bertozzi a8a2c516a0 HBASE-15763 Isolate Wal related stuff from MasterFileSystem 2016-05-04 07:59:44 -07:00
zhangduo 6abe1879dd HBASE-15754 Add testcase for AES encryption 2016-05-04 09:40:57 +08:00
Yu Li 082d193455 HBASE-15675 Add more details about region on table.jsp 2016-05-03 20:18:48 +08:00
tedyu c77a153001 HBASE-15752 ClassNotFoundException is encountered when custom WAL codec is not found in WALPlayer job 2016-05-03 01:57:25 -07:00
Ramkrishna c06a976a98 HBASE-15607 Remove PB references from Admin for 2.0 (Ram) 2016-05-03 10:51:46 +05:30
chenheng d77972ff16 HBASE-15714 We are calling checkRow() twice in doMiniBatchMutation() 2016-05-03 09:42:41 +10:00
Mikhail Antonov 58c4c3d174 HBASE-15703 Deadline scheduler needs to return to the client info about skipped calls, not just drop them 2016-05-02 15:23:07 -07:00
Mikhail Antonov bbc7b90335 HBASE-15281 Allow the FileSystem inside HFileSystem to be wrapped (Rajesh Nishtala) 2016-05-02 13:24:51 -07:00
anoopsjohn d1130582d5 HBASE-15735 Tightening of the CP contract. 2016-05-02 09:48:51 +05:30
Jurriaan Mous 15631a76f5 HBASE-15744 Port over small format/text improvements from HBASE-13784
(Jurriaan Mous)

Signed-off-by: stack <stack@apache.org>
2016-05-01 19:48:43 -07:00
chenheng ccd8888b4b Revert "HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response"
This reverts commit 01c0448ccd.
2016-04-30 11:37:05 +08:00
chenheng 01c0448ccd HBASE-15278 AsyncRPCClient hangs if Connection closes before RPC call response 2016-04-30 09:27:32 +08:00
tedyu c236409c3b HBASE-15357 TableInputFormatBase getSplitKey does not handle signed bytes correctly (Nathan Schile) 2016-04-29 17:08:25 -07:00
Mikhail Antonov 730b077666 HBASE-15551 Make call queue too big exception use servername 2016-04-29 10:25:29 -07:00
anoopsjohn 4706303186 HBASE-15706 HFilePrettyPrinter should print out nicely formatted tags. (huaxiang sun) 2016-04-29 09:23:57 +05:30
tedyu 8a28c23431 HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor 2016-04-28 09:19:12 -07:00
Ramkrishna 889d89a74c HBASE-15697 Excessive TestHRegion running time on branch-1 (Ram) 2016-04-28 14:24:39 +05:30
tedyu 9343ef438f HBASE-15676 FuzzyRowFilter fails and matches all the rows in the table if the mask consists of all 0s (Matt Warhaftig) 2016-04-27 21:00:11 -07:00
chenheng e8b37422c3 HBASE-15720 Print row locks at the debug dump page 2016-04-28 11:40:29 +08:00
Gary Helmling ce318a2906 HBASE-15658 Avoid excess meta cache clearing for RegionServerCallable 2016-04-26 22:54:13 -07:00
tedyu ebb5d421f9 HBASE-15707 ImportTSV bulk output does not support tags with hfile.format.version=3 (huaxiang sun) 2016-04-26 11:21:29 -07:00
Phil Yang 53d7316075 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:51:29 -07:00
tedyu dce59294ff HBASE-15634 TestDateTieredCompactionPolicy#negativeForMajor is flaky (Duo Zhang and Ted Yu) 2016-04-26 09:23:54 -07:00
tedyu 793d976d87 HBASE-14252 RegionServers fail to start when setting hbase.ipc.server.callqueue.scan.ratio to 0 (Yubao Liu and Ted Yu) 2016-04-25 13:26:47 -07:00
zhangduo 1eac103ead HBASE-15628 Implement an AsyncOutputStream which can work with any FileSystem implementation 2016-04-25 22:20:27 +08:00
zhangduo 3cfe363f13 HBASE-15699 Can not sync AsyncFSWAL if no edit is appended 2016-04-25 13:17:26 +08:00
Enis Soztutar 106fe99a9a HBASE-15670 Add missing Snapshot.proto to the maven profile for compiling protobuf 2016-04-22 11:34:49 -07:00
Matteo Bertozzi 1ecb10ce07 HBASE-15688 Use MasterServices directly instead of casting to HMaster when possible 2016-04-22 10:15:58 -07:00
Enis Soztutar 4c0587134a HBASE-15671 Add per-table metrics on memstore, storefile and regionsize (Alicia Ying Shu) 2016-04-21 13:33:26 -07:00
chenheng 03f3c392a3 HBASE-15674 HRegionLocator#getAllRegionLocations should put the results in cache 2016-04-21 14:19:39 +08:00
zhangduo 58f175f0ea HBASE-15368 Add pluggable window support 2016-04-21 12:02:16 +08:00
Andrew Purtell 2c26fe37ac HBASE-15614 Report metrics from JvmPauseMonitor 2016-04-20 17:37:34 -07:00
Enis Soztutar 18d70bc680 HBASE-15518 Add Per-Table metrics back (Alicia Ying Shu) 2016-04-20 14:35:45 -07:00
stack 6dd938c20b HBASE-15640 L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit 2016-04-20 14:14:37 -07:00
stack fa215a67e2 HBASE-15385 PREFETCH_BLOCKS_ON_OPEN in HColumnDescriptor is ignored 2016-04-20 09:38:30 -07:00
tedyu 3e1bdccc53 HBASE-15679 Assertion on wrong variable in TestReplicationThrottler#testThrottling 2016-04-20 07:11:17 -07:00
stack 954a41790c HBASE-15672 hadoop.hbase.security.visibility.TestVisibilityLabelsWithDeletes fails (Anoop Sam John) 2016-04-19 17:10:48 -07:00
Apekshit 501030d204 HBASE-15673 Fix latency metrics for multiGet. - Also fixes some stuff in help text. (Apekshit)
Change-Id: I49d76896d5cc070b9f60dadf6746865e98fbbbd0

Signed-off-by: stack <stack@apache.org>
2016-04-19 16:12:43 -07:00
zhangduo bd3b9753a9 HBASE-15665 Support using different StoreFileComparators for different CompactionPolicies 2016-04-19 19:35:17 +08:00
Gábor Lipták 6d7a7fa3aa HBASE-13372 Add unit tests for SplitTransaction and RegionMergeTransaction listeners
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-04-18 17:04:56 -07:00
Ashish Singhi 70687c18bb HBASE-15668 HFileReplicator fails to replicate other hfiles in the request when a hfile in not found in FS anywhere 2016-04-18 22:17:02 +05:30
zhangduo f2e0aca2b6 HBASE-15664 Use Long.MAX_VALUE instead of HConstants.FOREVER in CompactionPolicy 2016-04-18 20:10:31 +08:00
tedyu e9211e415a HBASE-15287 mapreduce.RowCounter returns incorrect result with binary row key inputs (Matt Warhaftig) 2016-04-16 12:46:21 -07:00
stack d815211f5a HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile
Refactor so we use the immutable, unsynchronized TimeRange when doing
    time-based checks at read time rather than use heavily synchronized
    TimeRangeTracker; let TimeRangeTracker be for write-time only.

    While in here, changed the Segment stuff so that when an immutable
    segment, it uses TimeRange rather than TimeRangeTracker too.

    M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
      Make allTime final.
      Add a includesTimeRange method copied from TimeRangeTracker.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
      Change name of a few methods so they match TimeRange methods that do
      same thing.
      (getTimeRangeTracker, getTimeRange, toTimeRange) add utility methods

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ImmutableSegment.java
      Change ImmutableSegment so it uses a TimeRange rather than
      TimeRangeTracker.. it is read-only. Redo shouldSeek, getMinTimestamp,
      updateMetaInfo, and getTimeRangeTracker so we use TimeRange-based
      implementations instead of TimeRangeTracker implementations.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MutableSegment.java
      Implement shouldSeek, getMinTimestamp, updateMetaInfo, and
      getTimeRangeTracker using TimeRangeTracker.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Segment.java
      Make methods that were using TimeRangeTracker abstract and instead
      have the implementations do these methods how they want either using
      TimeRangeTracker when a mutable segment or TimeRange when an immutable
      segment.

    M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
      Change Reader to use TimeRange-based checks instead of
      TimeRangeTracker.

    Signed-off-by: stack <stack@apache.org>
2016-04-15 10:13:42 -07:00
Matteo Bertozzi 3e42f82600 HBASE-15622 Superusers does not consider the keytab credentials 2016-04-15 08:28:39 -07:00
chenheng a9f1c4a871 HBASE-15406 Split / merge switch left disabled after early termination of hbck 2016-04-15 14:09:52 +08:00
Apekshit 7efb9edecb HBASE-15296 Break out writer and reader from StoreFile. Done using Intellij15 Refactor > Move. (Apekshit)
Change-Id: Ie719569cc3393e0b5361e9d462c3cf125ad5144e

Signed-off-by: stack <stack@apache.org>
2016-04-13 22:43:03 -07:00
Elliott Clark 5a7c8dcb68 HBASE-15504 Fix Balancer in 1.3 not moving regions off overloaded regionserver 2016-04-13 18:07:00 -07:00
Apekshit 8f9e46a640 HBASE-15405 Fix PE logging and wrong defaults in help message. (Apekshit)
Change-Id: Ib3007fae8d05e651b62bf4c15352ed43ea79e739
2016-04-13 12:10:33 -07:00
Matteo Bertozzi ae7e5e29f9 HBASE-15481 Add pre/post roll to WALObserver
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-04-13 00:43:51 -05:00
Stephen Yuan Jiang 543e7081f5 HBASE-15636 hard coded wait time out value in HBaseTestingUtility#waitUntilAllRegionsAssigned might cause test failure (Stephen Yuan Jiang) 2016-04-12 16:46:39 -07:00
Matteo Bertozzi d03cdc795c HBASE-15621 Suppress Hbase SnapshotHFile cleaner error messages when a snaphot is going on (Huaxiang Sun) 2016-04-12 12:17:55 -07:00
Matteo Bertozzi 0f23e61ec5 HBASE-15632 Undo the checking of lastStoreFlushTimeMap.isEmpty() introduced in HBASE-13145 (Huaxiang Sun) 2016-04-12 11:35:18 -07:00
tedyu ff9c92e168 HBASE-14985 TimeRange constructors should set allTime when appropriate (Geoffrey Jacoby) 2016-04-11 16:59:45 -07:00
Matteo Bertozzi 8964573394 HBASE-15627 Miss space and closing quote in AccessController#checkSystemOrSuperUser (Huaxiang Sun) 2016-04-11 08:28:26 -07:00
tedyu 8541fe4ad1 HBASE-15093 Replication can report incorrect size of log queue for the global source when multiwal is enabled (Ashu Pachauri) 2016-04-11 08:17:20 -07:00
Vasudevan a395922ad5 HBASE-15605 Remove PB references from HCD and HTD for 2.0 (Ram) 2016-04-11 14:12:07 +05:30
Jerry He 80df1cb7b6 HBASE-15591 ServerCrashProcedure not yielding 2016-04-10 17:02:39 -07:00