Commit Graph

253 Commits

Author SHA1 Message Date
Ramkrishna 6c5eec249c HBASE-17484 Add non cached version of OffheapKV for write path (Ram) 2017-02-07 21:27:33 +05:30
Michael Stack 9ec0ec4922 HBASE-17350 Fixup of regionserver group-based assignment
Renamed move_rsgroup_servers as move_servers_rsgroup
Renamed move_rsgroup_tables as move_tables_rsgroup

Minor changes to help text in rsgroup commands making them all same.
Made LOG from RSGroupAdminServer all talk of 'rsgroup' rather than
'group' to be consistent.

Fix for table.jsp where it would fail to display regions because no
type for the protobuf record specified.

Fix it so that move of an offline server to 'default' rsgroup is like
moving the reference to the server to trash (keeps the 'default' group
consistently 'dynamic' regards its server-list).

Fixed another issue where we were stuck in a loop because regions
were in FAILED_OPEN state because no server to assign too so we'd
never recover (a vagary of the current state of Master assignement
but no less a possibility in real world deploys).

Make it so servers are sorted when we list them; its what operator
would expect.
2017-02-06 13:09:57 -08:00
Enis Soztutar c64a1d1994 HBASE-9774 HBase native metrics and metric collection for coprocessors 2017-01-25 11:47:35 -08:00
Jan Hentschel 55a1aa1e73 HBASE-10699 Set capacity on ArrayList where possible and use isEmpty instead of size() == 0
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:58:20 -08:00
tedyu 665fe3eef1 HBASE-17331 Avoid busy waiting in ThrottledInputStream (ChiaPing Tsai) 2016-12-18 08:15:15 -08:00
Xiang Li 004f0abb46 HBASE-14882: Provide a Put API that adds the provided family, qualifier, value without copying
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2016-12-05 13:16:46 +05:30
anoopsamjohn 86e17858f7 HBASE-15786 Create DBB backed MSLAB pool. 2016-11-24 20:47:41 +05:30
anoopsamjohn c3685760f0 HBASE-15788 Use Offheap ByteBuffers from BufferPool to read RPC requests. 2016-11-14 23:05:05 +05:30
Michael Stack 0998af01df Revert "Revert "HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang)""
This is a revert of a revert, i.e. puts back the change only I added
HBaseCommonTestingUtility#getRandomDir from branch-1 too since
missing in master branch.

This reverts commit 9afcb4366d.
2016-11-08 12:55:48 -08:00
Apekshit Sharma 52241c90e4 HBASE-16982 Better integrate Apache CLI in AbstractHBaseTool.
- processOldArgs() in AbstractHBaseTool will make it possible to change existing tools to use Apache CLI in a backward compatible manner.
- Changes ExportSnapshot tool as a proof-of-concept
- Update version of Apache CLI from 1.2 to 1.3.1

Change-Id: I4bb2e7da4f2ed0e12e28621ab16459309fa36d03
2016-11-08 12:21:29 -08:00
Ramkrishna 9875c699af HBASE-16880 Correct the javadoc/behaviour of the APIs in ByteBufferUtils
(Ram)
2016-10-25 10:52:57 +05:30
Ramkrishna 3584537b07 HBASE-16463 Improve transparent table/CF encryption with Commons Crypto
(Dapeng Sun)
2016-10-24 16:22:30 +05:30
anoopsamjohn b644e0fb8d HBASE-16134 Introduce Cell extension for server side. 2016-09-27 22:55:45 +05:30
tedyu 3896d9ed0a HBASE-16692 Make ByteBufferUtils#equals safer and correct (binlijin) 2016-09-25 06:37:40 -07:00
Jerry He 50b051ade1 HBASE-16257 Move staging dir to be under hbase root dir 2016-09-23 10:07:58 -07:00
Matteo Bertozzi 2acd788dce HBASE-16082 Procedure v2 - Move out helpers from MasterProcedureScheduler 2016-08-30 09:44:35 -07:00
Jerry He 70f330dc84 Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load 2016-07-19 19:53:10 -07:00
Jerry He 632969787a HBASE-14548 Expand how table coprocessor jar and dependency path can be specified (Xiang Li) 2016-07-09 18:01:49 -07:00
anoopsjohn 17bcf14fea HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts. 2016-06-14 19:03:54 +05:30
Apekshit 1a27278624 HBASE-15915 Set timeouts on hanging tests. Tests run: 8, Time elapsed: 94.191 sec - in org.apache.hadoop.hbase.master.procedure.TestMasterFailoverWithProcedures Tests run: 103, Time elapsed: 69.057 sec - in org.apache.hadoop.hbase.regionserver.TestHRegion Tests run: 103, Time elapsed: 67.957 sec - in org.apache.hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush Tests run: 5, Time elapsed: 34.629 sec - in org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster Tests run: 9, Time elapsed: 82.913 sec - in org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient Tests run: 9, Time elapsed: 80.458 sec - in org.apache.hadoop.hbase.snapshot.TestMobFlushSnapshotFromClient (Apekshit)
Change-Id: Ia7b986ca6276ff5498f588c0b1b9c570e2a9d798

Signed-off-by: stack <stack@apache.org>
2016-05-30 21:13:55 -07:00
tedyu 838c306c0a HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 11:01:26 -07:00
Sean Busbey e0aff10901 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:50:14 -05:00
anoopsjohn cadfb21f4b HBASE-15064 BufferUnderflowException after last Cell fetched from an HFile Block served from L2 offheap cache - Addendum. 2016-03-23 15:03:50 +05:30
Jonathan M Hsieh f658f3ef83 HBASE-15356 Remove unused imports (Youngjoon Kim) 2016-03-03 11:42:38 -08:00
zhangduo 69e442efe4 HBASE-15365 Do not write to '/tmp' in TestHBaseConfiguration 2016-03-02 11:05:36 +08:00
Elliott Clark 630a65825e HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:34:05 -08:00
ramkrishna 3ba1a7fd23 HBASE-13259 mmap() based BucketCache IOEngine (Zee Chen & Ram) 2016-02-23 17:03:38 +05:30
stack 6f8c7dca13 HBASE-15279 OrderedBytes.isEncodedValue does not check for int8 and int16 types (Robert Yokota) 2016-02-17 22:10:15 -08:00
ramkrishna 0de221a19d HBASE-14841 Allow Dictionary to work with BytebufferedCells (Ram) 2016-01-29 10:06:20 +05:30
anoopsjohn a9b671b31f HBASE-12593 Tags to work with ByteBuffer. 2016-01-06 21:28:06 +05:30
anoopsjohn 7cd09bfb91 HBASE-15064 BufferUnderflowException after last Cell fetched from an HFile Block served from L2 offheap cache. 2016-01-06 10:25:32 +05:30
stack 46303dfd75 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-05 14:35:27 -08:00
stack a82f7fc94a Revert "HBASE-14888 ClusterSchema: Add Namespace Operations"
This reverts commit c5f3d17ae3.
2016-01-03 07:15:18 -08:00
stack c5f3d17ae3 HBASE-14888 ClusterSchema: Add Namespace Operations 2016-01-02 16:16:56 -08:00
anoopsjohn f01a388a35 HBASE-15063 Bug in MultiByteBuf#toBytes. (deepankar) 2016-01-01 23:11:59 +05:30
anoopsjohn cf458d3023 HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 18:01:16 +05:30
Gary Helmling c1e0fcc26d HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 15:52:27 -08:00
Elliott Clark cd5ddc5fec HBASE-14922 Delayed flush doesn't work causing flush storms. 2015-12-04 16:54:01 -08:00
tedyu 2317ec583d HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:08:38 -08:00
stack 5898b95329 HBASE-14860 Improve BoundedByteBufferPool; make lockless 2015-11-24 17:06:46 -08:00
Gary Helmling 8b67df6948 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:13:51 -08:00
stack d8f2ac3e6e HBASE-14860 Improve BoundedByteBufferPool; make lockless (Hiroshi Ikeda) 2015-11-21 20:32:13 -08:00
Enis Soztutar cf81b45f37 HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov) 2015-11-18 19:33:11 -08:00
Elliott Clark a591df1073 HBASE-14708 Use copy on write Map for region location cache
Summary:
Create and use a copy on write map for region location.

  - Create a copy on write map backed by a sorted array.
  - Create a test for both comparing each with a jdk provided map.
  - Change MetaCache to use the new map.

Test Plan:
  - org.apache.hadoop.hbase.client.TestFromClientSide
  - TestHCM

Differential Revision: https://reviews.facebook.net/D49545
2015-11-17 10:52:43 -08:00
Matteo Bertozzi 36a196722c HBASE-14669 remove unused import and fix javadoc 2015-10-22 09:25:26 -07:00
stack 71b38d60bb HBASE-14637 Loosen TestChoreService assert AND have TestDataBlockEncoders do less work (and add timeouts) 2015-10-17 16:14:45 -07:00
Nicolas Liochon b63155eac7 HBASE-14268 Improve KeyLocker - add missing files 2015-10-13 11:22:28 +02:00
stack 99e99f3b54 HBASE-14268 Improve KeyLocker (Hiroshi Ikeda) 2015-10-12 23:13:56 -07:00
stack b9639d1e82 HBASE-14590 Shorten ByteBufferedCell#getXXXPositionInByteBuffer method name (Anoop Sam John) 2015-10-12 12:33:28 -07:00
Matteo Bertozzi 715e8b0de1 HBASE-14347 Add a switch to DynamicClassLoader to disable it (huaxiang sun) 2015-10-05 16:17:07 -07:00
anoopsjohn b014ba1243 HBASE-14480 Small optimization in SingleByteBuff. 2015-10-05 12:00:19 +05:30
ramkrishna d81fba59cf HBASE-12298 Support BB usage in PrefixTree (Ram) 2015-09-18 10:44:02 +05:30
Nick Dimiduk a11bb2a933 HBASE-14382 TestInterfaceAudienceAnnotations should hadoop-compt module resources 2015-09-09 11:08:28 -07:00
stack d31aedb998 HBASE-13127 Add timeouts on all tests so less zombie sightings 2015-08-24 12:49:55 -07:00
anoopsjohn d49b1f60f4 HBASE-14202 Reduce garbage we create. 2015-08-11 21:51:17 +05:30
ramkrishna 7a9e10dc11 HBASE-14188 - Read path optimizations after HBASE-11425 profiling (Ram) 2015-08-06 16:49:49 +05:30
Sean Busbey 1b0b67fb7c HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
ramkrishna 3f80e0ea4f HBASE-14063 Use BufferBackedCell in read path after HBASE-12213 and
HBASE-12295 (ram)
2015-07-27 16:55:46 +05:30
anoopsjohn cceee1b0c3 HBASE-14116 Change ByteBuff.getXXXStrictlyForward to relative position based reads. 2015-07-21 09:01:20 +05:30
anoopsjohn 0f614a1c44 HBASE-12374 Change DBEs to work with new BB based cell. 2015-07-20 23:28:45 +05:30
ramkrishna 834f87b23d HBASE-12213 HFileBlock backed by Array of ByteBuffers (Ram) 2015-07-17 13:27:29 +05:30
ramkrishna a3d30892b4 HBASE-14047 - Cleanup deprecated APIs from Cell class (Ashish Singhi) 2015-07-13 22:06:16 +05:30
anoopsjohn bff911a8e8 HBASE-13387 Add ByteBufferedCell an extension to Cell - addendum. 2015-07-10 15:03:07 +05:30
anoopsjohn d07ff5ec5a HBASE-13387 Add ByteBufferedCell an extension to Cell. 2015-07-09 15:35:24 +05:30
ramkrishna 1b75fd2bd6 HBASE-14011 - MultiByteBuffer position based reads does not work correctly
(Ram)
2015-07-03 07:58:48 +05:30
anoopsjohn 8ae4b374e3 HBASE-13916 Create MultiByteBuffer an aggregation of ByteBuffers. 2015-06-18 22:38:10 +05:30
Dave Latham 293506c7cd HBASE-13639 SyncTable - rsync for HBase tables
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-06-12 16:00:00 -07:00
anoopsjohn 81b9abab0c HBASE-13778 BoundedByteBufferPool incorrectly increasing runningAverage buffer length. 2015-05-28 11:52:41 +05:30
ramkrishna eeb11b5327 HBASE-13393 - Optimize memstore flushing to avoid writing tag information
to hfiles when no tags are present. (Ram)
2015-05-28 10:00:59 +05:30
ramkrishna 977f867439 HBASE-10800 - Use CellComparator instead of KVComparator (Ram) 2015-05-05 11:38:10 +05:30
Andrew Purtell 1c4b47f856 HBASE-12415 Add add(byte[][] arrays) to Bytes (Jean-Marc Spaggiari) 2015-05-01 18:12:36 -07:00
Usha Kuchibhotla 94a00bea07 HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-04-28 09:20:34 -05:00
stack 2759fd0cdb HBASE-13575 TestChoreService has to make sure that the opened ChoreService is closed for each unit test (Stephen Yuan Jiang) 2015-04-27 14:23:57 -07:00
unknown 57f9c82128 HBASE-13410 - Bug in KeyValueUtil.oswrite() for non Keyvalue cases 2015-04-07 10:29:12 +05:30
Apekshit(Appy) Sharma e252c30645 HBASE-6919 Remove unnecessary throws IOException from Bytes.readVLong.
Added readAsVLong() to deprecate readVLong() which was throwing IOException. Added test for readAsVLong().

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-04-03 21:25:37 -05:00
Mikhail Antonov 578df6dfc0 HBASE-13252 Get rid of managed connections and connection caching
Signed-off-by: stack <stack@apache.org>
2015-04-02 12:00:42 -07:00
tedyu bd837d47f7 HBASE-12413 Mismatch in the equals and hashcode methods of KeyValue (Jingcheng Du and Gariel Reid) 2015-03-28 06:31:28 -07:00
stack f57dca5e1b HBASE-13198 Remove HConnectionManager (Mikhail Antonov) 2015-03-20 09:41:48 -07:00
stack 9159c82fbf HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer 2015-03-06 14:35:08 -08:00
stack 74837d9b1f Revert " HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer"
OVERCOMMIT. REVERT.

This reverts commit 55f8f56ad2.
2015-03-04 22:58:02 -08:00
stack 55f8f56ad2 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer
Rename ByteBufferReservoir as BoundedByteBufferPool
2015-03-04 22:44:20 -08:00
Ashish Singhi 31f17b17f0 HBASE-13002 Make encryption cipher configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-18 11:42:20 -08:00
stack 8aa4eeb1c8 HBASE-13007 Fix the test timeouts being caused by ChoreService (Jonathan Lawlor); ADDENDUM 2015-02-11 20:46:41 -08:00
stack a8d325eed8 HBASE-13007 Fix the test timeouts being caused by ChoreService (Jonathan Lawlor) 2015-02-10 21:19:14 -08:00
stack 9c66afbae7 HBASE-12978 Region goes permanently offline (WAS: hbase:meta has a row missing hregioninfo and it causes my long-running job to fail) 2015-02-10 17:03:29 -08:00
tedyu ede20aa288 HBASE-13004 Addendum fixes timeout value in message (Andrey Stepachev) 2015-02-10 09:43:31 -08:00
tedyu a3f495f20d HBASE-13004 Make possible to explain why HBaseTestingUtility.waitFor fails (Andrey Stepachev) 2015-02-10 07:33:52 -08:00
tedyu 9d6b237ae8 HBASE-12992 TestChoreService doesn't close services, that can break test on slow virtual hosts (Andrey Stepachev) 2015-02-09 12:15:23 -08:00
stack ac175b1bd9 HBASE-12982 Adding timeouts to TestChoreService 2015-02-06 19:45:39 -08:00
tedyu d3eedb24e1 HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks - add new files 2015-01-29 21:11:33 -08:00
tedyu fbdaf62bf8 HBASE-12716 A bug in RegionSplitter.UniformSplit algorithm (Weichen Ye) 2014-12-28 07:48:24 -08:00
Devaraj Das ca0c1774c9 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas 2014-12-06 18:18:03 -08:00
stack 58b6b24c29 HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-28 20:50:02 -08:00
Enis Soztutar 882324dbcc HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 11:44:46 -08:00
stack 889333a6fd HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key 2014-10-29 11:33:49 -07:00
stack c450298c44 HBASE-12307 Remove unused Imports in hbase-client and hbase-common 2014-10-21 21:53:04 -07:00
anoopsjohn c01d9981d8 HBASE-12202 Support DirectByteBuffer usage in HFileBlock. 2014-10-21 17:57:55 +05:30
Elliott Clark f75785af51 HBASE-12218 Make HBaseCommonTestingUtil#deleteDir try harder 2014-10-09 11:57:52 -07:00
stack 2bc28ebb03 HBASE-12133 Add FastLongHistogram for metric computation; ADDENDUM TO FIX BROKE COMPILE 2014-10-02 11:53:53 -07:00
stack 0e1e64b821 HBASE-12133 Add FastLongHistogram for metric computation (Yi Deng) 2014-10-02 10:38:56 -07:00