Commit Graph

873 Commits

Author SHA1 Message Date
Guanghao Zhang 9f25836d99 HBASE-17958 Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP 2017-05-03 21:39:30 +08:00
Vikas Vishwakarma a2e4e0a1eb HBASE-17877 Improve HBase's byte[] comparator.
Signed-off-by: Lars Hofhansl <larsh@apache.org>
2017-04-27 13:27:02 -07:00
Colm O hEigeartaigh 439711e0a0 HBASE-17944 - Removed unused JDK version parsing from ClassSize.
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-21 09:29:07 -05:00
Jerry He b6a2c02b93 HBASE-17869 UnsafeAvailChecker wrongly returns false on ppc 2017-04-06 16:13:52 -07:00
Yi Liang cc700ef4c1 HBASE-17821: The CompoundConfiguration#toString is wrong
Signed-off-by: CHIA-PING TSAI <chia7712@gmail.com>
2017-03-31 15:13:58 +08:00
Chia-Ping Tsai 006bfc7054 HBASE-17623 Reuse the bytes array when building the hfile block 2017-03-25 23:51:14 +08:00
Andrew Purtell d7666b6066 HBASE-17780 BoundedByteBufferPool "At capacity" messages are not actionable 2017-03-14 13:23:47 -07:00
Ashu Pachauri 20cb390529 HBASE-15429 Add split policy for busy regions
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 17:33:53 -08:00
Andrew Purtell ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
Ashu Pachauri 4b8195f22c HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-24 15:31:36 -08:00
Zach York 8f6388503b HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)

Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
Sean Busbey 3d4639f34d HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
Signed-off-by: Michael Stack <stack@apache.org>

 Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
2017-02-01 10:38:29 -06:00
Michael Stack 6130ea4d54 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun) 2017-01-09 13:35:20 -08:00
rahul gidwani 667c5eb3a0 HBASE-16710 Add ZStandard Codec to Compression.java
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-05 10:47:12 -08:00
Phil Yang 29e390c808 HBASE-17314 Limit total buffered size for all replication sources 2016-12-23 12:17:39 +08:00
Phil Yang dd0206ff31 Revert "HBASE-17314 Limit total buffered size for all replication sources"
This reverts commit e9444ed077.
2016-12-22 19:08:17 +08:00
Phil Yang e9444ed077 HBASE-17314 Limit total buffered size for all replication sources 2016-12-21 13:10:29 +08:00
binlijin 4c7f0f2436 HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding 2016-12-20 12:28:04 +08:00
Jonathan M Hsieh 9da0d5d00e HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 09:10:03 -08:00
Yu Li 4068a8b4d4 HBASE-17114 Add an option to set special retry pause when encountering CallQueueTooBigException 2016-12-01 16:48:46 +08:00
Guanghao Zhang f26b3bf5ba HBASE-17178 Add region balance throttling
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-11-30 18:07:02 +08:00
tedyu 97276da9a7 HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang) 2016-11-08 06:35:12 -08:00
tedyu 05b010cacb HBASE-16832 Reduce the default number of versions in Meta table for branch-1 (binlijin) 2016-10-14 13:53:39 -07:00
Gary Helmling 4f29c23038 HBASE-16146 Remove thread local usage in Counter 2016-10-11 14:47:02 -07:00
Jonathan M Hsieh ecc1c294f5 HBASE-12088 Addendum - fix spacing 2016-09-21 20:58:34 -07:00
Jonathan M Hsieh 13d6acbc7f HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:52:19 -07:00
Phil Yang 069d1f73fa HBASE-16388 Prevent client threads being blocked by only one slow region server
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:28:20 -07:00
tedyu ac1ee77f40 HBASE-16612 Use array to cache Types for KeyValue.Type.codeToType (Phil Yang) 2016-09-13 12:44:36 -07:00
tedyu 8ad14bac67 HBASE-16616 Rpc handlers stuck on ThreadLocalMap.expungeStaleEntry (Tomu Tsuruhara) 2016-09-12 16:29:24 -07:00
binlijin ad67fd0816 HBASE-16530 Reduce DBE code duplication
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-09 16:25:56 +08:00
Andrew Purtell abbb36f625 Amend HBASE-16538 Changes the way version information is stored during build
Generated Version class needs an interface audience annotation
2016-09-02 19:54:14 -07:00
Apekshit Sharma 84ad592748 HBASE-16538 Changes the way version information is stored during build.
Instead of writing package-info.java with VersionAnnotation, saveVersion.sh now writes Version.java with static members.

Change-Id: I009f440fa049f409e10cb3f1c3afb483bc2aa876
2016-09-02 16:20:10 -07:00
tedyu 9907a7e2a2 HBASE-16502 Reduce garbage in BufferedDataBlockEncoder - addendum adopts Hiroshi's suggestion (binlijin) 2016-08-30 18:06:24 -07:00
Matteo Bertozzi 57c6384b09 HBASE-16522 Procedure v2 - Cache system user and avoid IOException 2016-08-30 15:35:08 -07:00
Apekshit Sharma e46a073ed2 HBASE-16101 Tool to microbenchmark procedure WAL performance.
Change-Id: I8ec158319395d2ec8e36641a3beab2694f7b6aef
2016-08-30 13:32:42 -07:00
anoopsamjohn c899897bc8 HBASE-16213 A new HFileBlock structure for fast random get. (binlijin) 2016-08-29 12:11:46 +05:30
Matteo Bertozzi 35fa341913 HBASE-16508 Move UnexpectedStateException to common 2016-08-26 18:37:59 -07:00
tedyu b59f18c2af HBASE-16502 Reduce garbage in BufferedDataBlockEncoder (binlijin) 2016-08-25 20:39:42 -07:00
Ramkrishna e7cd7fffbf HBASE-16444 CellUtil#estimatedSerializedSizeOfKey() should consider
KEY_INFRASTRUCTURE_SIZ (Ram)
2016-08-23 10:58:50 +05:30
Apekshit Sharma a8909f5cba HBASE-16467 Move AbstractHBaseTool to hbase-common.
Change-Id: Ifb81c15b89b308f53e6ee8a76e18189b5b526cd3
2016-08-22 16:32:46 -07:00
stack cf9878f77e HBASE-16363 Correct javadoc for qualifier length and value (Xiang Li) 2016-08-10 17:53:37 -07:00
Phil Yang 441bc050b9 HBASE-9465 Push entries to peer clusters serially
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00
Vivek ec99838b9c HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Table.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/client/HTableWrapper.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2016-08-06 10:38:41 -07:00
Sean Busbey a5f98c3f9e HBASE-16321 ensure no findbugs-jsr305
Signed-off-by: Esteban Gutierrez <esteban@apache.org>

 Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-rsgroup/pom.xml
	hbase-server/pom.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/ObserverContext.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
	hbase-spark/pom.xml
	src/main/asciidoc/_chapters/developer.adoc
2016-08-05 14:08:50 -05:00
zhangduo dc56aa2d4f HBASE-16225 Refactor ScanQueryMatcher 2016-08-02 14:04:49 +08:00
stack d54bcfb1e2 HBASE-16256 Purpose of EnvironmentEdge, EnvironmentEdgeManager (Sai Teja Ranuva) 2016-07-29 16:34:53 -07:00
zhangduo e06bbe4804 HBASE-16280 Use hash based map in SequenceIdAccounting 2016-07-26 16:36:46 +08:00
Jerry He fe915e10d6 HBASE-14548 Expand how table coprocessor jar and dependency path can be specified (Xiang Li) 2016-07-09 18:18:22 -07:00
stack 9563ab4ca1 HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
 Call through to next constructor (if minStamp was 0, we'd skip setting
 allTime=true). Add asserts that timestamps are not < 0 cos it messes
 us up if they are (we already were checking for < 0 on construction but
 assert passed in timestamps are not < 0).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
 Add constructor override that takes a TimeRangeTracker (set when flushing
 but not when compacting)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
 Add override creating an HFile in tmp that takes a TimeRangeTracker

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
 Add override for HFile Writer that takes a TimeRangeTracker Take it on
 construction instead of having it passed by a setter later (flags and
 reference set by the setter were not volatile... could have been prob
 in concurrent case)

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
 Log WARN if bad initial TimeRange value (and then 'fix' it)

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
 A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
 Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
 Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
Andrew Purtell 8efc6148b9 HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-07-05 10:34:27 -07:00
stack f4d7cd5f58 HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda) 2016-06-30 15:04:36 -07:00
Elliott Clark e721aa1a8a HBASE-16061 Allow logging to a buffered console 2016-06-17 17:09:18 -07:00
Enis Soztutar ff5dbf584e HBASE-15950 Fix memstore size estimates to be more tighter 2016-06-15 14:19:28 -07:00
stack 867150333c HBASE-15994 Allow selection of RpcSchedulers
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:25:38 -07:00
stack e90a6db20b Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
This reverts commit d49b883825.
2016-06-08 20:25:09 -07:00
stack d49b883825 HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:06:22 -07:00
Sean Mackrory 878b1ea721 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
Lars Hofhansl 9f343b5871 HBASE-15881 Allow BZIP2 compression. 2016-06-03 15:33:05 -07:00
tedyu ce43e33876 HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig) 2016-05-17 13:26:45 -07:00
Sean Busbey e365191896 HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:53:45 -05:00
Jonathan M Hsieh 137d891fbc HBASE-15791 Improve javadoc around ScheduledChore 2016-05-09 09:57:31 -07:00
Ramkrishna 94c4d568b5 HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
any such public facing class for 2.0 (Ram)
2016-05-09 14:57:39 +05:30
Junegunn Choi 615d77722c HBASE-15528 Clean up outdated entries in hbase-default.xml
Signed-off-by: Enis Soztutar <enis@apache.org>

Conflicts:
	src/main/asciidoc/_chapters/hbase-default.adoc
2016-05-03 21:21:20 -07:00
tedyu c512750914 HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor 2016-04-28 09:21:22 -07:00
stack 6b78409eb2 HBASE-15477 Purge 'next block header' from cached blocks
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body.  We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).

This patch undoes this over-persisting.

Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.

There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.

Adds loads of documentation.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
  (write) Add writing from a ByteBuff.

M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
  (toString) Add one so ByteBuff looks like ByteBuffer when you click on
  it in IDE

M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
  Remove support for version 1 blocks.

  Cleaned up handling of metadata added when we serialize a block to
  caches. Metadata is smaller now.

  When we serialize (used when caching), do not persist the next blocks
  header if present.

  Removed a bunch of methods, a few of which had overlapping
  functionality and others that exposed too much of our internals.
  Also removed a bunch of constructors and unified the constructors we
  had left over making them share a common init method.
  Shutdown access to defines that should only be used internally here.

  Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
  about metadata saved to caches; was unclear previously what EXTRA was
  about.

  Renamed static final declarations as all uppercase.

  (readBlockDataInternal): Redid. Couldn't make sense of it previously.
  Undid heavy-duty parse of header by constructing HFileBlock. Other
  cleanups. Its 1/3rd the length it used to be. More to do in here.

Signed-off-by: stack <stack@apache.org>
2016-04-27 10:41:47 -07:00
Phil Yang d5acbdd1e4 HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:52:12 -07:00
stack 27446a5c4a HBASE-15392 Single Cell Get reads two HFileBlocks
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares
if no non-default stopRow.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
optimize Add doc on what is being optimized. Also, if a Get Scan, do not
optimize else we'll keep going after our row is DONE.
Another place to make use of the Get Scan fact is when we are DONE.. if
Get Scan, we can close out the scan.

Signed-off-by: stack <stack@apache.org>
2016-04-22 09:07:09 -07:00
stack 0b65f2002b HBASE-15366 Add doc, trace-level logging, and test around No change in operation, just adding doc., and some helpful logging
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
 Make it emit its toString in format that matches the way we log
 elsewhere
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
 Capitalize statics.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
 Verify and cleanup documentation of hfileblock format at head of class.
 Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
 Connect how we serialize and deserialize... done in different places
 and one way when pulling from HDFS and another when pulling from cache
 (TO BE FIXED). Shut down a load of public access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
 Add trace-level logging

Signed-off-by: stack <stack@apache.org>
2016-04-21 10:56:07 -07:00
Enis Soztutar 1e6d7e811d HBASE-15683 Min latency in latency histograms are emitted as Long.MAX_VALUE 2016-04-21 10:44:08 -07:00
stack fd49923350 HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile
Refactor so we use the immutable, unsynchronized TimeRange when doing
time-based checks at read time rather than use heavily synchronized
TimeRangeTracker; let TimeRangeTracker be for write-time only.

While in here, changed the Segment stuff so that when an immutable
segment, it uses TimeRange rather than TimeRangeTracker too.

M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
  Make allTime final.
  Add a includesTimeRange method copied from TimeRangeTracker.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
  Change name of a few methods so they match TimeRange methods that do
  same thing.
  (getTimeRangeTracker, getTimeRange, toTimeRange) add utility methods

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
  Change Reader to use TimeRange-based checks instead of
  TimeRangeTracker.
2016-04-15 16:56:05 -07:00
tedyu 043ffd1db1 HBASE-15187 Integrate CSRF prevention filter to REST gateway 2016-04-15 13:46:30 -07:00
tedyu e31361dcb8 HBASE-14985 TimeRange constructors should set allTime when appropriate (Geoffrey Jacoby) 2016-04-11 17:58:38 -07:00
Junegunn Choi c8190d7e2e HBASE-15569 Make Bytes.toStringBinary faster
Signed-off-by: stack <stack@apache.org>
2016-03-31 21:27:11 -07:00
Elliott Clark 295e5cbcf0 HBASE-15460 Fix infer issues in hbase-common
Summary: Fix issues found by static analysis

Test Plan: Unit test pass

Differential Revision: https://reviews.facebook.net/D55551
2016-03-21 11:55:51 -07:00
tedyu 1cb82d9118 HBASE-15439 getMaximumAllowedTimeBetweenRuns in ScheduledChore ignores the TimeUnit (Jingcheng Du) 2016-03-14 07:10:34 -07:00
Andrew Purtell e8063d4f17 Amend HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe
"Object cannot be cast to boolean" in UnsafeAvailChecker
2016-03-11 17:37:39 -08:00
anoopsjohn 75547a42b9 HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe. 2016-03-11 09:38:24 +05:30
Matteo Bertozzi 46bf3c3275 HBASE-15113 Procedure v2 - Speedup eviction of sys operation results 2016-03-08 11:08:05 -08:00
Stephen Yuan Jiang 0a025a1aca HBASE-15413 Procedure-V2: print out ProcedureInfo during trace (Stephen Yuan Jiang) 2016-03-07 20:45:43 -08:00
zhangduo 12853268e1 HBASE-15365 Do not write to '/tmp' in TestHBaseConfiguration
Conflicts:
	hbase-common/src/test/java/org/apache/hadoop/hbase/TestHBaseConfiguration.java
2016-03-02 11:26:13 +08:00
Mikhail Antonov 998e339d6e HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
stack 46ffa85982 HBASE-15351 Fix description of hbase.bucketcache.size in hbase-default.xml 2016-02-26 13:53:59 -08:00
Elliott Clark 7c290e922a HBASE-15222 Addendum - Use less contended classes for metrics 2016-02-25 09:34:47 -08:00
Mikhail Antonov 04a3b27330 HBASE-15136 Explore different queuing behaviors while busy 2016-02-24 20:42:23 -08:00
Elliott Clark 3352173ec8 HBASE-15222 Use less contended classes for metrics
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.

Test Plan: unit tests

Reviewers:

Subscribers:

Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:47:00 -08:00
stack b4f747f52e HBASE-12133 Add FastLongHistogram for metric computation (Yi Deng) 2016-02-24 14:35:22 -08:00
stack 5e7fecc15b HBASE-15279 OrderedBytes.isEncodedValue does not check for int8 and int16 types (Robert Yokota) 2016-02-17 22:10:35 -08:00
Jonathan M Hsieh 2e1a3ef644 HBASE-15283 Revert to IOException in TimeRange constructor to maintain API compat in 1.x line
[branch-1 and branch-1.2 only] HBASE-14355 changed the type of exception thrown if an invalid TimeRange is specified.  This reverts to 1.1.x semantics.
2016-02-17 15:57:54 -08:00
Matteo Bertozzi 455e09c325 HBASE-15100 ProcedureInfo constructor should be InterfaceAudience.Private (addendum) 2016-02-17 15:40:39 -08:00
Enis Soztutar 73d6778820 HBASE-15177 Reduce garbage created under high load
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2016-02-04 13:26:22 -08:00
Enis Soztutar f1e7c06539 HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/security/SecureBulkLoadUtil.java
2016-02-02 17:06:20 -08:00
Matteo Bertozzi 931e1b03ab HBASE-15100 Master WALProcs are deleted out of order ending up with older wals not removed 2016-01-22 16:15:58 -08:00
stack a9c008344f HBASE-15091 Forward-port to 1.2 HBASE-15031 "Fix merge of MVCC and SequenceID performance regression in branch-1.0" 2016-01-21 10:26:46 -08:00
stack 44dc9d1162 HBASE-15098 Normalizer switch in configuration is not used 2016-01-20 09:36:46 -08:00
Gary Helmling 17130e4d2f HBASE-15111 hbase version should write to stdout
Signed-off-by: Sean Busbey <busbey@cloudera.com>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/util/VersionInfo.java
2016-01-19 22:50:37 -06:00
stack d6654ea7ea HBASE-15118 Fix findbugs complaint in hbase-server 2016-01-18 15:37:53 -08:00
stack 546adefcd6 HBASE-15087 Fix hbase-common findbugs complaints 2016-01-14 17:18:16 -08:00
Matteo Bertozzi 3c2229a9a8 HBASE-14837 Procedure v2 - Procedure Queue Improvement 2016-01-14 09:25:06 -08:00
tedyu c2256bd2ae HBASE-15026 The default value of "hbase.regions.slop" in docs is obsolete (Tianyin Xu) 2015-12-25 15:41:52 -08:00
Jonathan M Hsieh 03e1451070 HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags 2015-12-25 12:24:47 -08:00
anoopsjohn 4a7565af9c HBASE-14940 Make our unsafe based ops more safe. 2015-12-24 07:56:27 +05:30
chenheng f7b67ca763 HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests 2015-12-23 10:35:48 +08:00
Enis Soztutar 1b66f474b5 HBASE-14977 ChoreService.shutdown may result in ConcurrentModificationException - ADDENDUM to fix extra concurrency issues 2015-12-22 02:04:32 -08:00
anoopsjohn a93c0e822e HBASE-14999 Remove ref to org.mortbay.log.Log. 2015-12-17 23:33:39 +05:30
Enis Soztutar 31d73a4bde HBASE-14977 ChoreService.shutdown may result in ConcurrentModificationException (Vladimir Rodionov) 2015-12-15 11:57:33 -08:00
ramkrishna 65117d3d04 HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi) 2015-12-10 13:10:41 +05:30
Gary Helmling 5dec5ad250 HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection 2015-12-09 16:47:25 -08:00
stack d955cb3280 Revert "Revert "HBASE-14922 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl""
This reverts commit 693e1dee4c.
2015-12-05 14:29:31 -08:00
stack 693e1dee4c Revert "HBASE-1422 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl"
Pushed with wrong JIRA number. Revert to fix.

This reverts commit 7d0c08fbcd.
2015-12-05 14:29:12 -08:00
stack 7d0c08fbcd HBASE-1422 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl 2015-12-05 11:39:59 -08:00
Elliott Clark 9cf2d641ff HBASE-14922 Delayed flush doesn't work causing flush storms. -- ADD 2015-12-04 18:37:40 -08:00
Elliott Clark 85167849ab HBASE-14922 Delayed flush doesn't work causing flush storms. 2015-12-04 16:53:56 -08:00
Enis Soztutar edb8edfeb3 HBASE-14904 Mark Base[En|De]coder LimitedPrivate and fix binary compat issue
Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/codec/BaseDecoder.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/codec/BaseEncoder.java
2015-12-03 18:27:20 -08:00
tedyu 66adeb3048 HBASE-14894 Fix misspellings of threshold in log4j.properties files for tests (Youngjoon Kim) 2015-11-28 10:10:27 -08:00
Gary Helmling 07b07300b8 HBASE-14821 Allow configuration overrides in TableOutputFormat 2015-11-24 12:15:25 -08:00
Enis Soztutar 8a69dd5b08 HBASE-14468 Compaction improvements: FIFO compaction policy (Vladimir Rodionov) 2015-11-18 19:27:15 -08:00
Elliott Clark 4d5ac316b6 HBASE-14708 Use copy on write Map for region location cache
Summary:
Create and use a copy on write map for region location.

  - Create a copy on write map backed by a sorted array.
  - Create a test for both comparing each with a jdk provided map.
  - Change MetaCache to use the new map.

Test Plan:
  - org.apache.hadoop.hbase.client.TestFromClientSide
  - TestHCM

Differential Revision: https://reviews.facebook.net/D49545
2015-11-17 11:01:52 -08:00
zhangduo f8ee447c55 HBASE-14806 Missing sources.jar for several modules when building HBase
Conflicts:
	hbase-common/pom.xml
2015-11-17 08:55:24 +08:00
stack 336eb92016 HBASE-14355 Scan different TimeRange for each column family 2015-11-13 22:44:05 -08:00
Elliott Clark 2b84c40f01 HBASE-14765 Remove snappy profile 2015-11-05 10:21:14 -08:00
Gary Helmling 85f2aee070 HBASE-14700 Support a permissive mode for secure clusters to allow SIMPLE auth clients 2015-10-30 20:06:23 -07:00
anoopsjohn de89172244 HBASE-14557 MapReduce WALPlayer issue with NoTagsKeyValue. 2015-10-30 21:19:12 +05:30
Enis Soztutar 87c97c231a HBASE-14680 Two configs for snapshot timeout and better defaults (Heng Chen)
Conflicts:
	hbase-common/src/main/resources/hbase-default.xml
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/DisabledTableSnapshotHandler.java
2015-10-27 15:06:37 -07:00
Andrew Purtell 53a8ce5fab HBASE-14705 Javadoc for KeyValue constructor is not correct (Jean-Marc Spaggiari) 2015-10-27 14:39:14 -07:00
Ben Lau 288a274052 HBASE-14283 Reverse scan doesn’t work with HFile inline index/bloom blocks
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-10-26 15:13:07 -07:00
stack 4f8387959a HBASE-14266 RegionServers have a lock contention of Configuration.getProps 2015-10-24 15:37:55 -07:00
stack 9e3c381bee HBASE-14657 Remove unneeded API from EncodedSeeker (Heng Chen) 2015-10-22 21:32:51 -07:00
stack 836afcc901 HBASE-14637 Loosen TestChoreService assert AND have TestDataBlockEncoders do less work (and add timeouts) 2015-10-17 16:27:23 -07:00
Elliott Clark f4a4c3a489 HBASE-14597 Fix Groups cache in multi-threaded env 2015-10-16 15:19:19 -07:00
tedyu be04ede5b9 HBASE-14594 Use new DNS API introduced in HADOOP-12437 (Josh Elser) 2015-10-14 14:24:24 -07:00
stack 11066d0459 HBASE-14598 ByteBufferOutputStream grows its HeapByteBuffer beyond JVM limitations (Ian Friedman) 2015-10-14 13:13:35 -07:00
stack 4588620a04 HBASE-14268 Improve KeyLocker; ADDENDUM: FIX JAVADOC WARNING 2015-10-14 09:59:07 -07:00
Nicolas Liochon 56ecbc1a2c HBASE-14268 Improve KeyLocker - add missing files 2015-10-13 08:06:27 -07:00
stack 98f1387f86 HBASE-14268 Improve KeyLocker (Hiroshi Ikeda) 2015-10-12 23:14:16 -07:00
Enis Soztutar bbbb52cfbf HBASE-14501 NPE in replication with TDE
Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValue.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/KeyValueUtil.java
2015-10-12 20:44:35 -07:00
anoopsjohn 5dba2c71f7 HBASE-13819 Make RPC layer CellBlock buffer a DirectByteBuffer. 2015-10-13 07:59:11 +05:30
Stephen Yuan Jiang a6d90bcc97 HBASE-14432 Procedure V2 - enforce ACL on procedure admin tasks (Stephen Yuan Jiang) 2015-10-06 09:11:38 -07:00
Matteo Bertozzi 12e8076fba HBASE-14347 Add a switch to DynamicClassLoader to disable it (huaxiang sun) 2015-10-05 16:17:30 -07:00
smaddineni 373c75dde6 HBASE-13770 Programmatic JAAS configuration option for secure zookeeper may be broken
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/HQuorumPeer.java
2015-10-02 18:00:47 -07:00
Elliott Clark cca2ba4d93 HBASE-14512 Cache UGI groups
Summary:
Don't create a user for every call. Instead create one user per connection.
Then inside of SecureHadoopUser cache the groupNames. This allows HBase to cache
empty groups.  This is needed since it's much more likely that HBase will be accessed
by a user that's not present on the posix /etc/group file.

Test Plan: Unit Tests

Differential Revision: https://reviews.facebook.net/D47751
2015-09-30 12:52:50 -07:00
stack 4812d9a178 HBASE-14465 Backport 'Allow rowlock to be reader/write' to branch-1 2015-09-30 11:48:46 -07:00
Apekshit(Appy) Sharma efc51bced6 HBASE-14469 Fix comment, validation and logging in HeapMemorySizeUtil.getGlobalMemStoreLowerMark 2015-09-24 19:15:33 -07:00
Stephen Yuan Jiang e38fd84d3f HBASE-14107 Administrative Task: Provide an API to List all procedures (Stephen Yuan Jiang) 2015-09-24 07:17:23 -07:00
Nick Dimiduk 364b977269 HBASE-14382 TestInterfaceAudienceAnnotations should hadoop-compt module resources 2015-09-09 11:11:08 -07:00
Lars Hofhansl 16d4ed6337 HBASE-12988 [Replication]Parallel apply edits across regions. 2015-09-04 13:23:36 -07:00
stack 5dcb3d85a1 HBASE-14224 Fix coprocessor handling of duplicate classes 2015-08-24 14:12:57 -07:00
stack 95682e7b7d HBASE-13127 Add timeouts on all tests so less zombie sightings 2015-08-24 13:38:03 -07:00
Andrew Purtell 234a4632a4 HBASE-13996 Add write sniffing in canary (Liu Shaohui)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java

Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-08-21 22:57:28 -07:00
Sean Busbey 71fbd4ac63 HBASE-14251 ensure javadoc jars have LICENSE/NOTICE that match content. 2015-08-20 11:20:47 -05:00
Jerry He d322ebadf5 HBASE-13706 CoprocessorClassLoader should not exempt Hive classes 2015-08-08 22:06:41 -07:00