210b90604b
HBASE-20619 TestWeakObjectPool occasionally times out
...
Remove too-stringent timeout already removed from this test in master branch.
2018-05-22 12:24:05 -07:00
6685b62abe
HBASE-20459 Majority of scan CPU time in HBase-1 spent in size estimation.
2018-04-21 10:02:07 -07:00
ba7a936f74
Revert "HBASE-9465 Push entries to peer clusters serially"
...
This reverts commit 441bc050b9
2018-02-23 14:42:15 +08:00
0a284d2b76
Revert "HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)"
...
This reverts commit 97276da9a7
2018-02-23 14:42:04 +08:00
f35bcd2fe3
HBASE-19858 Backport HBASE-14061 (Support CF-level Storage Policy) to branch-1
...
HBASE-14061 Support CF-level Storage Policy
HBASE-14061 Support CF-level Storage Policy (addendum)
HBASE-14061 Support CF-level Storage Policy (addendum2)
HBASE-15172 Support setting storage policy in bulkload
HBASE-17538 HDFS.setStoragePolicy() logs errors on local fs
HBASE-18015 Storage class aware block placement for procedure v2 WALs
HBASE-18017 Reduce frequency of setStoragePolicy failure warnings
Default storage policy if not configured cannot be "NONE"
HBASE-19016 Coordinate storage policy property name for table schema and bulkload
Fix checkstyle warnings
Addressed additional review feedback on backport
2018-02-01 17:10:39 -08:00
71862094d7
HBASE-19877 hbase-common and hbase-zookeeper don't add the log4j.properties to the resource path for testing
2018-01-29 16:52:01 +08:00
528eb10826
HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 20:15:01 +08:00
1fe75f98d3
HBASE-19421 branch-1 does not compile against Hadoop 3.0.0
2017-12-04 15:48:38 -08:00
fb3fee3414
HBASE-19383 [1.2] java.lang.AssertionError: expected:<2> but was:<1> at
...
org.apache.hadoop.hbase.TestChoreService.testTriggerNowFailsWhenNotScheduled(TestChoreService.java:707)
2017-11-29 20:45:31 -08:00
c179d5144f
HBASE-19239 Fix findbugs and error-prone issues
...
Fixes for hbase-common
2017-11-17 15:20:45 -08:00
f9833a7802
HBASE-12091 Optionally ignore edits for dropped tables for replication.
2017-11-14 16:33:12 -08:00
ef3b59cb7a
HBASE-19232 Fix shaded-check-invariants (check-jar-contents) failure on branch-1
2017-11-13 10:37:20 -08:00
6961526573
HBASE-12350 Backport error-prone build support to branch-1 and branch-2
2017-11-09 15:34:09 -08:00
d099263e13
HBASE-19129 TestChoreService is flaky
...
Increase the delta to compensate for environmental variance.
2017-10-31 00:08:31 +00:00
64328caef0
HBASE-15631 Backport Regionserver Groups (HBASE-6721) to branch-1 (Francis Liu and Andrew Purtell)
2017-10-23 17:10:33 -07:00
aa50971947
Revert "HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned"
...
This reverts commit 256fc63007
2017-10-09 17:06:14 -05:00
d5033fd350
HBASE-18743 HFiles in use by a table which has the same name and namespace with a default table cloned from snapshot may be deleted when that snapshot and default table are deleted (wenbang)
2017-09-04 07:52:57 -07:00
433b42b41c
HBASE-18461 Build broken If the username contains a backslash
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-08-31 08:46:39 -07:00
aec4bf6bae
HBASE-15947 Classes used only for tests included in main code base
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-08-30 10:53:31 +08:00
9c26a42ab1
HBASE-18656 First issues found by error-prone
2017-08-24 13:04:45 -05:00
3feb87b005
HBASE-18431 Mitigate compatibility concerns between branch-1.3 and branch-1.4
...
- Refactor TableName into its own proto module and fix up users
- Move SnapshotDescription from Snapshot.proto back to HBase.proto
- Restore FastLongHistogram and TestFastLongHistogram;
deprecate FastLongHistogram
- Move DeleteQueryTracker back to o.a.h.h.regionserver
2017-08-16 11:34:18 -07:00
c7e1d67df7
HBASE-18023 Update row threshold warning from 1k to 5k (addendum)
2017-07-25 18:39:44 -04:00
26247996d2
HBASE-15816 Provide client with ability to set priority on Operations
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-07-21 17:12:25 -07:00
9036556a33
HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when configuring hbase.bucketcache.bucket.sizes.
2017-07-20 23:00:48 +05:30
1b8fb0a8d8
HBASE-18365 Eliminate the findbugs warnings for hbase-common
2017-07-13 19:35:18 +08:00
3dd55fa0c0
Set versions on branch-1 to 1.5.0-SNAPSHOT
2017-07-03 18:01:15 -07:00
3381c6c453
HBASE-17931 Assign system tables to servers with highest version
2017-07-03 11:35:31 +08:00
743f454d25
HBASE-18023 Log multi-* requests for more than threshold number of rows
...
Signed-off-by: Josh Elser <elserj@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2017-06-30 18:45:36 -07:00
940f4107b0
HBASE-18226 Disable reverse DNS lookup at HMaster and use the hostname provided by RegionServer (Duo Xu)
2017-06-21 18:23:30 -07:00
c6e587c5ac
HBASE-16242 Manually resolve transitive Apache Avro dependency to consistently be ver 1.7.7.
...
Signed-off-by: Jerry He <jerryjch@apache.org>
Conflicts:
hbase-common/pom.xml
hbase-spark/pom.xml
pom.xml
2017-06-19 15:58:43 -05:00
316e02e3d8
HBASE-18219 Fix typo in constant HConstants.HBASE_CLIENT_MEAT_REPLICA_SCAN_TIMEOUT
2017-06-14 16:03:54 -07:00
256fc63007
HBASE-17678 FilterList with MUST_PASS_ONE may lead to redundant cells returned
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-06-13 20:28:04 +08:00
d6e85b0511
Revert "FilterList with MUST_PASS_ONE may lead to redundant cells returned" miss issue number
...
This reverts commit c71da858ad
2017-06-13 20:27:28 +08:00
c71da858ad
FilterList with MUST_PASS_ONE may lead to redundant cells returned
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-06-12 23:55:25 -07:00
a3c3f1012d
HBASE-18060 Backport to branch-1 HBASE-9774 HBase native metrics and metric collection for coprocessors
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-05-24 13:20:44 -07:00
c03f003f4f
HBASE-18035 Meta replica does not give any primaryOperationTimeout to primary meta region (huaxiang sun)
2017-05-21 06:39:33 -07:00
300c5388f2
HBASE-18058 Zookeeper retry sleep time should have an upper limit (Allan Yang)
2017-05-19 10:58:38 -07:00
292226690a
HBASE-18043 Institute a hard limit for individual cell size that cannot be overridden by clients
2017-05-15 18:03:24 -07:00
9f25836d99
HBASE-17958 Avoid passing unexpected cell to ScanQueryMatcher when optimize SEEK to SKIP
2017-05-03 21:39:30 +08:00
a2e4e0a1eb
HBASE-17877 Improve HBase's byte[] comparator.
...
Signed-off-by: Lars Hofhansl <larsh@apache.org>
2017-04-27 13:27:02 -07:00
439711e0a0
HBASE-17944 - Removed unused JDK version parsing from ClassSize.
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2017-04-21 09:29:07 -05:00
b6a2c02b93
HBASE-17869 UnsafeAvailChecker wrongly returns false on ppc
2017-04-06 16:13:52 -07:00
cc700ef4c1
HBASE-17821: The CompoundConfiguration#toString is wrong
...
Signed-off-by: CHIA-PING TSAI <chia7712@gmail.com>
2017-03-31 15:13:58 +08:00
006bfc7054
HBASE-17623 Reuse the bytes array when building the hfile block
2017-03-25 23:51:14 +08:00
d7666b6066
HBASE-17780 BoundedByteBufferPool "At capacity" messages are not actionable
2017-03-14 13:23:47 -07:00
20cb390529
HBASE-15429 Add split policy for busy regions
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-03-09 17:33:53 -08:00
ccf1f17d78
HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
...
Conflicts:
hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
4b8195f22c
HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri)
...
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-24 15:31:36 -08:00
8f6388503b
HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
...
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
3d4639f34d
HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
...
Signed-off-by: Michael Stack <stack@apache.org>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
2017-02-01 10:38:29 -06:00
6130ea4d54
HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun)
2017-01-09 13:35:20 -08:00
667c5eb3a0
HBASE-16710 Add ZStandard Codec to Compression.java
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-05 10:47:12 -08:00
29e390c808
HBASE-17314 Limit total buffered size for all replication sources
2016-12-23 12:17:39 +08:00
dd0206ff31
Revert "HBASE-17314 Limit total buffered size for all replication sources"
...
This reverts commit e9444ed077
2016-12-22 19:08:17 +08:00
e9444ed077
HBASE-17314 Limit total buffered size for all replication sources
2016-12-21 13:10:29 +08:00
4c7f0f2436
HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding
2016-12-20 12:28:04 +08:00
9da0d5d00e
HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn)
2016-12-01 09:10:03 -08:00
4068a8b4d4
HBASE-17114 Add an option to set special retry pause when encountering CallQueueTooBigException
2016-12-01 16:48:46 +08:00
f26b3bf5ba
HBASE-17178 Add region balance throttling
...
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-11-30 18:07:02 +08:00
97276da9a7
HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang)
2016-11-08 06:35:12 -08:00
05b010cacb
HBASE-16832 Reduce the default number of versions in Meta table for branch-1 (binlijin)
2016-10-14 13:53:39 -07:00
4f29c23038
HBASE-16146 Remove thread local usage in Counter
2016-10-11 14:47:02 -07:00
ecc1c294f5
HBASE-12088 Addendum - fix spacing
2016-09-21 20:58:34 -07:00
13d6acbc7f
HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms
2016-09-21 20:52:19 -07:00
069d1f73fa
HBASE-16388 Prevent client threads being blocked by only one slow region server
...
Signed-off-by: stack <stack@apache.org>
2016-09-14 09:28:20 -07:00
ac1ee77f40
HBASE-16612 Use array to cache Types for KeyValue.Type.codeToType (Phil Yang)
2016-09-13 12:44:36 -07:00
8ad14bac67
HBASE-16616 Rpc handlers stuck on ThreadLocalMap.expungeStaleEntry (Tomu Tsuruhara)
2016-09-12 16:29:24 -07:00
ad67fd0816
HBASE-16530 Reduce DBE code duplication
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-09-09 16:25:56 +08:00
abbb36f625
Amend HBASE-16538 Changes the way version information is stored during build
...
Generated Version class needs an interface audience annotation
2016-09-02 19:54:14 -07:00
84ad592748
HBASE-16538 Changes the way version information is stored during build.
...
Instead of writing package-info.java with VersionAnnotation, saveVersion.sh now writes Version.java with static members.
Change-Id: I009f440fa049f409e10cb3f1c3afb483bc2aa876
2016-09-02 16:20:10 -07:00
9907a7e2a2
HBASE-16502 Reduce garbage in BufferedDataBlockEncoder - addendum adopts Hiroshi's suggestion (binlijin)
2016-08-30 18:06:24 -07:00
57c6384b09
HBASE-16522 Procedure v2 - Cache system user and avoid IOException
2016-08-30 15:35:08 -07:00
e46a073ed2
HBASE-16101 Tool to microbenchmark procedure WAL performance.
...
Change-Id: I8ec158319395d2ec8e36641a3beab2694f7b6aef
2016-08-30 13:32:42 -07:00
c899897bc8
HBASE-16213 A new HFileBlock structure for fast random get. (binlijin)
2016-08-29 12:11:46 +05:30
35fa341913
HBASE-16508 Move UnexpectedStateException to common
2016-08-26 18:37:59 -07:00
b59f18c2af
HBASE-16502 Reduce garbage in BufferedDataBlockEncoder (binlijin)
2016-08-25 20:39:42 -07:00
e7cd7fffbf
HBASE-16444 CellUtil#estimatedSerializedSizeOfKey() should consider
...
KEY_INFRASTRUCTURE_SIZ (Ram)
2016-08-23 10:58:50 +05:30
a8909f5cba
HBASE-16467 Move AbstractHBaseTool to hbase-common.
...
Change-Id: Ifb81c15b89b308f53e6ee8a76e18189b5b526cd3
2016-08-22 16:32:46 -07:00
cf9878f77e
HBASE-16363 Correct javadoc for qualifier length and value (Xiang Li)
2016-08-10 17:53:37 -07:00
441bc050b9
HBASE-9465 Push entries to peer clusters serially
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-08-09 15:26:15 +08:00
ec99838b9c
HBASE-15866 Split hbase.rpc.timeout into *.read.timeout and *.write.timeout
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Table.java
hbase-server/src/main/java/org/apache/hadoop/hbase/client/HTableWrapper.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestHCM.java
2016-08-06 10:38:41 -07:00
a5f98c3f9e
HBASE-16321 ensure no findbugs-jsr305
...
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
hbase-rsgroup/pom.xml
hbase-server/pom.xml
hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/ObserverContext.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSTableDescriptors.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
hbase-spark/pom.xml
src/main/asciidoc/_chapters/developer.adoc
2016-08-05 14:08:50 -05:00
dc56aa2d4f
HBASE-16225 Refactor ScanQueryMatcher
2016-08-02 14:04:49 +08:00
d54bcfb1e2
HBASE-16256 Purpose of EnvironmentEdge, EnvironmentEdgeManager (Sai Teja Ranuva)
2016-07-29 16:34:53 -07:00
e06bbe4804
HBASE-16280 Use hash based map in SequenceIdAccounting
2016-07-26 16:36:46 +08:00
fe915e10d6
HBASE-14548 Expand how table coprocessor jar and dependency path can be specified (Xiang Li)
2016-07-09 18:18:22 -07:00
9563ab4ca1
HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken scanning because of a side effect of a clean up in HBASE-15650 to make TimeRange construction consistent exposed a latent issue in TimeRange#compare. See HBASE-16074 for more detail.
...
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Call through to next constructor (if minStamp was 0, we'd skip setting
allTime=true). Add asserts that timestamps are not < 0 cos it messes
us up if they are (we already were checking for < 0 on construction but
assert passed in timestamps are not < 0).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
Add constructor override that takes a TimeRangeTracker (set when flushing
but not when compacting)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
Add override creating an HFile in tmp that takes a TimeRangeTracker
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Add override for HFile Writer that takes a TimeRangeTracker Take it on
construction instead of having it passed by a setter later (flags and
reference set by the setter were not volatile... could have been prob
in concurrent case)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Log WARN if bad initial TimeRange value (and then 'fix' it)
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 14:23:23 -07:00
8efc6148b9
HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java
Amending-Author: Andrew Purtell <apurtell@apache.org>
2016-07-05 10:34:27 -07:00
f4d7cd5f58
HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda)
2016-06-30 15:04:36 -07:00
e721aa1a8a
HBASE-16061 Allow logging to a buffered console
2016-06-17 17:09:18 -07:00
ff5dbf584e
HBASE-15950 Fix memstore size estimates to be more tighter
2016-06-15 14:19:28 -07:00
867150333c
HBASE-15994 Allow selection of RpcSchedulers
...
Adds logging by the RpcExecutors of their run configs
Adds a FifoRpcSchedulerFactory so you can try Fifo scheduler.
2016-06-08 20:25:38 -07:00
e90a6db20b
Revert "HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler"
...
This reverts commit d49b883825
2016-06-08 20:25:09 -07:00
d49b883825
HBASE-15994 Allow selection of RpcSchedulers Adds logging by the RpcExecutors of their run configs Changes the default RpcSchedulerFactory from SimpleRpcSchedulerFactory.class to RpcSchedulerFactoryImpl.class. RpcSchedulerFactoryImpl.class. defaults to using SimpleRpcSchedulerFactory.class and the SimpleRpcScheduler, as has been default up to this, unless you set "hbase.region.server.rpc.scheduler.class" to org.apache.hadoop.hbase.ipc.FifoRpcScheduler
...
Signed-off-by: stack <stack@apache.org>
2016-06-08 20:06:22 -07:00
878b1ea721
HBASE-15889. String case conversions are locale-sensitive, used without locale
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
9f343b5871
HBASE-15881 Allow BZIP2 compression.
2016-06-03 15:33:05 -07:00
ce43e33876
HBASE-15769 Perform validation on cluster key for add_peer (Matt Warhaftig)
2016-05-17 13:26:45 -07:00
e365191896
HBASE-15780 Make AuthUtil public and rely on it for talking to secure HBase.
...
Signed-off-by: Gary Helmling <garyh@apache.org>
Signed-off-by: Mikhail Antonov <antonov@apache.org>
Signed-off-by: stack <stack@apache.org>
2016-05-16 00:53:45 -05:00
137d891fbc
HBASE-15791 Improve javadoc around ScheduledChore
2016-05-09 09:57:31 -07:00
94c4d568b5
HBASE-15609 Remove PB references from Result, DoubleColumnInterpreter and
...
any such public facing class for 2.0 (Ram)
2016-05-09 14:57:39 +05:30
615d77722c
HBASE-15528 Clean up outdated entries in hbase-default.xml
...
Signed-off-by: Enis Soztutar <enis@apache.org>
Conflicts:
src/main/asciidoc/_chapters/hbase-default.adoc
2016-05-03 21:21:20 -07:00
c512750914
HBASE-15686 Add override mechanism for the exempt classes when dynamically loading table coprocessor
2016-04-28 09:21:22 -07:00
6b78409eb2
HBASE-15477 Purge 'next block header' from cached blocks
...
When we read from HDFS, we overread to pick up the next blocks header.
Doing this saves a seek as we move through the hfile; we save having to
do an explicit seek just to read the block header every time we need to
read the body. We used to read in the next header as part of the
current blocks buffer. This buffer was then what got persisted to
blockcache; so we were over-persisting: our block plus the next blocks'
header (33 bytes).
This patch undoes this over-persisting.
Removes support for version 1 blocks (0.2 was added in hbase-0.92.0).
Not needed any more.
There is an open question on whether checksums should be persisted
when caching. The code seems to say no but if cache is SSD backed or
backed by anything that does not do error correction, we'll want
checksums.
Adds loads of documentation.
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockType.java
(write) Add writing from a ByteBuff.
M hbase-common/src/main/java/org/apache/hadoop/hbase/nio/ByteBuff.java
(toString) Add one so ByteBuff looks like ByteBuffer when you click on
it in IDE
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Remove support for version 1 blocks.
Cleaned up handling of metadata added when we serialize a block to
caches. Metadata is smaller now.
When we serialize (used when caching), do not persist the next blocks
header if present.
Removed a bunch of methods, a few of which had overlapping
functionality and others that exposed too much of our internals.
Also removed a bunch of constructors and unified the constructors we
had left over making them share a common init method.
Shutdown access to defines that should only be used internally here.
Renamed all to do w/ 'EXTRA' and 'extraSerialization' to instead talk
about metadata saved to caches; was unclear previously what EXTRA was
about.
Renamed static final declarations as all uppercase.
(readBlockDataInternal): Redid. Couldn't make sense of it previously.
Undid heavy-duty parse of header by constructing HFileBlock. Other
cleanups. Its 1/3rd the length it used to be. More to do in here.
Signed-off-by: stack <stack@apache.org>
2016-04-27 10:41:47 -07:00
d5acbdd1e4
HBASE-15645 hbase.rpc.timeout is not used in operations of HTable
...
Signed-off-by: stack <stack@apache.org>
2016-04-26 10:52:12 -07:00
27446a5c4a
HBASE-15392 Single Cell Get reads two HFileBlocks
...
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
moreRowsMayExistAfterCell Exploit the fact a Scan is a Get Scan. Also save compares
if no non-default stopRow.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java
optimize Add doc on what is being optimized. Also, if a Get Scan, do not
optimize else we'll keep going after our row is DONE.
Another place to make use of the Get Scan fact is when we are DONE.. if
Get Scan, we can close out the scan.
Signed-off-by: stack <stack@apache.org>
2016-04-22 09:07:09 -07:00
0b65f2002b
HBASE-15366 Add doc, trace-level logging, and test around No change in operation, just adding doc., and some helpful logging
...
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileContext.java
Make it emit its toString in format that matches the way we log
elsewhere
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
Capitalize statics.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlock.java
Verify and cleanup documentation of hfileblock format at head of class.
Explain what 'EXTRA_SERIALIZATION_SPACE' is all about.
Connect how we serialize and deserialize... done in different places
and one way when pulling from HDFS and another when pulling from cache
(TO BE FIXED). Shut down a load of public access.
M hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderImpl.java
Add trace-level logging
Signed-off-by: stack <stack@apache.org>
2016-04-21 10:56:07 -07:00
1e6d7e811d
HBASE-15683 Min latency in latency histograms are emitted as Long.MAX_VALUE
2016-04-21 10:44:08 -07:00
fd49923350
HBASE-15650 Remove TimeRangeTracker as point of contention when many threads reading a StoreFile
...
Refactor so we use the immutable, unsynchronized TimeRange when doing
time-based checks at read time rather than use heavily synchronized
TimeRangeTracker; let TimeRangeTracker be for write-time only.
While in here, changed the Segment stuff so that when an immutable
segment, it uses TimeRange rather than TimeRangeTracker too.
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Make allTime final.
Add a includesTimeRange method copied from TimeRangeTracker.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Change name of a few methods so they match TimeRange methods that do
same thing.
(getTimeRangeTracker, getTimeRange, toTimeRange) add utility methods
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Change Reader to use TimeRange-based checks instead of
TimeRangeTracker.
2016-04-15 16:56:05 -07:00
043ffd1db1
HBASE-15187 Integrate CSRF prevention filter to REST gateway
2016-04-15 13:46:30 -07:00
e31361dcb8
HBASE-14985 TimeRange constructors should set allTime when appropriate (Geoffrey Jacoby)
2016-04-11 17:58:38 -07:00
c8190d7e2e
HBASE-15569 Make Bytes.toStringBinary faster
...
Signed-off-by: stack <stack@apache.org>
2016-03-31 21:27:11 -07:00
295e5cbcf0
HBASE-15460 Fix infer issues in hbase-common
...
Summary: Fix issues found by static analysis
Test Plan: Unit test pass
Differential Revision: https://reviews.facebook.net/D55551
2016-03-21 11:55:51 -07:00
1cb82d9118
HBASE-15439 getMaximumAllowedTimeBetweenRuns in ScheduledChore ignores the TimeUnit (Jingcheng Du)
2016-03-14 07:10:34 -07:00
e8063d4f17
Amend HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe
...
"Object cannot be cast to boolean" in UnsafeAvailChecker
2016-03-11 17:37:39 -08:00
75547a42b9
HBASE-15322 Operations using Unsafe path broken for platforms not having sun.misc.Unsafe.
2016-03-11 09:38:24 +05:30
46bf3c3275
HBASE-15113 Procedure v2 - Speedup eviction of sys operation results
2016-03-08 11:08:05 -08:00
0a025a1aca
HBASE-15413 Procedure-V2: print out ProcedureInfo during trace (Stephen Yuan Jiang)
2016-03-07 20:45:43 -08:00
12853268e1
HBASE-15365 Do not write to '/tmp' in TestHBaseConfiguration
...
Conflicts:
hbase-common/src/test/java/org/apache/hadoop/hbase/TestHBaseConfiguration.java
2016-03-02 11:26:13 +08:00
998e339d6e
HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT
2016-02-28 16:23:29 -08:00
46ffa85982
HBASE-15351 Fix description of hbase.bucketcache.size in hbase-default.xml
2016-02-26 13:53:59 -08:00
7c290e922a
HBASE-15222 Addendum - Use less contended classes for metrics
2016-02-25 09:34:47 -08:00
04a3b27330
HBASE-15136 Explore different queuing behaviors while busy
2016-02-24 20:42:23 -08:00
3352173ec8
HBASE-15222 Use less contended classes for metrics
...
Summary:
Use less contended things for metrics.
For histogram which was the largest culprit we use FastLongHistogram
For atomic long where possible we now use counter.
Test Plan: unit tests
Reviewers:
Subscribers:
Differential Revision: https://reviews.facebook.net/D54381
2016-02-24 14:47:00 -08:00
b4f747f52e
HBASE-12133 Add FastLongHistogram for metric computation (Yi Deng)
2016-02-24 14:35:22 -08:00
5e7fecc15b
HBASE-15279 OrderedBytes.isEncodedValue does not check for int8 and int16 types (Robert Yokota)
2016-02-17 22:10:35 -08:00
2e1a3ef644
HBASE-15283 Revert to IOException in TimeRange constructor to maintain API compat in 1.x line
...
[branch-1 and branch-1.2 only] HBASE-14355 changed the type of exception thrown if an invalid TimeRange is specified. This reverts to 1.1.x semantics.
2016-02-17 15:57:54 -08:00
455e09c325
HBASE-15100 ProcedureInfo constructor should be InterfaceAudience.Private (addendum)
2016-02-17 15:40:39 -08:00
73d6778820
HBASE-15177 Reduce garbage created under high load
...
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java
2016-02-04 13:26:22 -08:00
f1e7c06539
HBASE-15129 Set default value for hbase.fs.tmp.dir rather than fully depend on hbase-default.xml (Yu Li)
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/security/SecureBulkLoadUtil.java
2016-02-02 17:06:20 -08:00
931e1b03ab
HBASE-15100 Master WALProcs are deleted out of order ending up with older wals not removed
2016-01-22 16:15:58 -08:00
a9c008344f
HBASE-15091 Forward-port to 1.2 HBASE-15031 "Fix merge of MVCC and SequenceID performance regression in branch-1.0"
2016-01-21 10:26:46 -08:00
44dc9d1162
HBASE-15098 Normalizer switch in configuration is not used
2016-01-20 09:36:46 -08:00
17130e4d2f
HBASE-15111 hbase version should write to stdout
...
Signed-off-by: Sean Busbey <busbey@cloudera.com>
Conflicts:
hbase-common/src/main/java/org/apache/hadoop/hbase/util/VersionInfo.java
2016-01-19 22:50:37 -06:00
d6654ea7ea
HBASE-15118 Fix findbugs complaint in hbase-server
2016-01-18 15:37:53 -08:00
546adefcd6
HBASE-15087 Fix hbase-common findbugs complaints
2016-01-14 17:18:16 -08:00
3c2229a9a8
HBASE-14837 Procedure v2 - Procedure Queue Improvement
2016-01-14 09:25:06 -08:00
c2256bd2ae
HBASE-15026 The default value of "hbase.regions.slop" in docs is obsolete (Tianyin Xu)
2015-12-25 15:41:52 -08:00
03e1451070
HBASE-15035 bulkloading hfiles with tags that require splits do not preserve tags
2015-12-25 12:24:47 -08:00
4a7565af9c
HBASE-14940 Make our unsafe based ops more safe.
2015-12-24 07:56:27 +05:30
f7b67ca763
HBASE-14684 Try to remove all MiniMapReduceCluster in unit tests
2015-12-23 10:35:48 +08:00
1b66f474b5
HBASE-14977 ChoreService.shutdown may result in ConcurrentModificationException - ADDENDUM to fix extra concurrency issues
2015-12-22 02:04:32 -08:00
a93c0e822e
HBASE-14999 Remove ref to org.mortbay.log.Log.
2015-12-17 23:33:39 +05:30
31d73a4bde
HBASE-14977 ChoreService.shutdown may result in ConcurrentModificationException (Vladimir Rodionov)
2015-12-15 11:57:33 -08:00
65117d3d04
HBASE-13153 Bulk Loaded HFile Replication (Ashish Singhi)
2015-12-10 13:10:41 +05:30
5dec5ad250
HBASE-14866 VerifyReplication and ReplicationAdmin should use full peer configuration for peer connection
2015-12-09 16:47:25 -08:00
d955cb3280
Revert "Revert "HBASE-14922 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl""
...
This reverts commit 693e1dee4c
2015-12-05 14:29:31 -08:00
693e1dee4c
Revert "HBASE-1422 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl"
...
Pushed with wrong JIRA number. Revert to fix.
This reverts commit 7d0c08fbcd
2015-12-05 14:29:12 -08:00
7d0c08fbcd
HBASE-1422 Delayed flush doesn't work causing flush storms; addendum by Lars Hofhansl
2015-12-05 11:39:59 -08:00
9cf2d641ff
HBASE-14922 Delayed flush doesn't work causing flush storms. -- ADD
2015-12-04 18:37:40 -08:00
85167849ab
HBASE-14922 Delayed flush doesn't work causing flush storms.
2015-12-04 16:53:56 -08:00
Andrew Purtell
Lars Hofhansl
Sean Busbey
Chia-Ping Tsai
Peter Somogyi
Michael Stack
tedyu
Guangxu Cheng
Sean Mackrory
Mike Drob
Josh Elser
rgidwani
anoopsamjohn
Phil Yang
David Harju
huzheng
zhangduo
Vincent
Guanghao Zhang
Vikas Vishwakarma
Colm O hEigeartaigh
Jerry He
Yi Liang
Ashu Pachauri
Zach York
binlijin
Jonathan M Hsieh
Yu Li
Guanghao Zhang
Gary Helmling
Phil Yang
Apekshit Sharma
Matteo Bertozzi
Ramkrishna
Vivek
Elliott Clark
Enis Soztutar
Junegunn Choi
Stephen Yuan Jiang
Mikhail Antonov
chenheng
ramkrishna