17882 Commits

Author SHA1 Message Date
Bo Cui
078e2619ea HubSpot Backport: HBASE-23340 hmaster /hbase/replication/rs session expired (hbase replication default value is true, we don't use ) causes logcleaner can not clean oldWALs, which resulits in oldWALs too large (more than 2TB) (#2779)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
    Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-08-24 18:05:12 -04:00
clarax
1b256f6a7a HBASE-26309 Balancer tends to move regions to the server at the end o… (#3812)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-08 16:42:27 -04:00
Bryan Beaudreault
9a0d069af7 HubSpot Backport: HBASE-27188 Report maxStoreFileCount in jmx (#4609)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-03 09:55:48 -04:00
Bryan Beaudreault
91c7ede9df HubSpot Backport: HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-29 15:35:27 -04:00
Bryan Beaudreault
c6e14f9061 HubSpot Backport: HBASE-27229 BucketCache statistics should not count evictions by hfile (#4639)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-28 11:18:20 -04:00
Bryan Beaudreault
4e944f21b2 HubSpot Backport: HBASE-27225 Add BucketAllocator bucket size statistic logging (#4637) (addendum)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-25 23:01:04 -04:00
chenglei
96e7283949 HubSpot Backport: HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-25 23:00:58 -04:00
Bryan Beaudreault
a9d4d6e9e8 Hubspot Backport: HBASE-27224 HFile tool statistic sampling produces misleading results 2022-07-21 13:16:00 -04:00
Bryan Beaudreault
9ca1073fd5 HubSpot Backport: HBASE-27225 Add BucketAllocator bucket size statistic logging 2022-07-21 13:15:39 -04:00
Bryan Beaudreault
e4ce632d59 HubSpot Backport: HBASE-27053 IOException during caching of uncompressed block to the block cache (#4610)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: wenwj0 <wenweijian2@huawei.com>
2022-07-16 21:33:20 -04:00
Bryan Beaudreault
7023542cce HubSpot Backport: HBASE-27078 Allow configuring a separate timeout for meta scans (#4585)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-12 17:42:51 -04:00
Bryan Beaudreault
9d85d622a1 HubSpot Backport: HBASE-27149 Server should close scanner if client times out before results are ready (#4604)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:49:33 -04:00
Xiaolin Ha
e21e95974d HubSpot Backport: HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-07-11 18:25:04 -04:00
chenglei
aee754f018 Hubspot Backport: HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4265) 2022-07-11 18:13:12 -04:00
Istvan Toth
421db7914a HubSpot Backport: HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 18:13:07 -04:00
Bryan Beaudreault
cf3fe854b5 HubSpot Backport: HBASE-27186 Report block cache size metrics separately for L1 and L2 2022-07-11 10:16:32 -04:00
Duo Zhang
979e75e013 HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit b1691a53185efcafc1d2a15767a88825f4d7b625)
2022-07-08 08:12:09 -04:00
Bryan Beaudreault
679e40e068 HBASE-27048 Server side scanner time limit should account for time in queue (#4562)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-06 15:22:24 -04:00
Bryan Beaudreault
588ad6b6eb HubSpot Backport: HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse 2022-07-01 16:13:45 -04:00
Chris Ayoub
6867507ba6
Merge pull request #18 from HubSpot/revert-17-hubspot-2-c8
Revert "Upload RPMs to OS-based repos"
2022-06-28 08:00:26 -07:00
Chris Ayoub
4b3e970d1e Revert "Upload RPMs to OS-based repos (#17)"
This reverts commit ed527a81b048881d4c0a080e53454a537728ccb0.
2022-06-28 11:00:08 -04:00
Chris Ayoub
ed527a81b0
Upload RPMs to OS-based repos (#17) 2022-06-28 10:33:17 -04:00
Bryan Beaudreault
629a00559b HBASE-27060 Allow sharing connections between AggregationClient instances (#4566)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-24 11:41:02 -04:00
Bryan Beaudreault
f4752de8d8 HBASE-26945 Quotas causes too much load on meta for large clusters (#4576)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-24 08:09:03 -04:00
Bryan Beaudreault
3c3927c60f HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4575)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-24 08:09:03 -04:00
Ruanhui
a9918c504b HBASE-26942 cache region locations when getAllRegionLocations (#4357)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-06-24 08:09:03 -04:00
Bri Augenreich
23239e7eef
Fix client bundle metrics dep issues (#14)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-06-16 16:58:17 -04:00
Bryan Beaudreault
0a222c8fa8 Revert "HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)"
This reverts commit 35ec27d079cdb0fe8882486534dd95c95748884f.
2022-06-12 15:00:28 -04:00
Bryan Beaudreault
56edc758ec
Shade hadoop compat classes so they can be loaded in hadoop jobs (#13) 2022-06-09 09:51:39 -04:00
Bryan Beaudreault
12f40b6d6f
Add AggregationClient to client bundle (#12) 2022-06-06 12:15:06 -04:00
Bryan Beaudreault
a246b68ca5 HubSpot Backport: HBASE-27038 CellComparator should extend Serializable 2022-06-06 08:57:43 -04:00
Bryan Beaudreault
fe19a63d13
Add client bundles for hbase2 (#11)
* Add hubspot client bundles

* add cdh5 mode and build the client bundles using cdh5 hadoop and java8 for now
2022-05-31 10:55:55 -04:00
Bryan Beaudreault
129f8f904b HubSpot Backport: HBASE-26990 Add default implementation for BufferedMutator interface setters 2022-04-29 10:40:27 -04:00
Bri Augenreich
e827cfbbb6
HubSpot Backport: HBASE-26581 Add metrics for failed replication edits
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-04-27 08:41:36 -04:00
Bryan Beaudreault
58676a928e HubSpot Backport: HBASE-26891 Make MetricsConnection scope configurable (#4365)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:20 -04:00
Bryan Beaudreault
b95fe05bcb HubSpot Backport: HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:14 -04:00
huaxiangsun
bd859293cc HubSpot Backport: HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008)
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-12 13:59:49 -04:00
Sean Busbey
559593825a HubSpot Backport: HBASE-26871 addendum. use the jar command from JAVA_HOME (#4297) 2022-03-31 07:51:37 -04:00
Sean Busbey
3fa920c885 HubSpot Backport: HBASE-26871 shaded mapreduce and shaded byo-hadoop client artifacts contain no classes (#4279)
- revert poms for both modules
- add a test to the shaded artifact validation that checks for java classes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-31 07:51:27 -04:00
Bryan Beaudreault
fa033e4ac6 HubSpot Backport: HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Xiaolin Ha
35ec27d079 HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Andrew Purtell
954004af49 HubSpot Backport: HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184)
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:59:50 -04:00
Bryan Beaudreault
44c62c58ba fix 2022-03-26 12:59:50 -04:00
Xiaolin Ha
e81f6ced7b HubSpot Backport: HBASE-26552 Introduce retry to logroller to avoid abort (#4170)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:33:31 -04:00
Bryan Beaudreault
35f86757c9 HubSpot Backport: HBASE-26876 Use toStringBinary for rowkey in RegionServerCallable error string (#4269)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:26:01 -04:00
Bryan Beaudreault
9e54eeedd0 HubSpot Backport: HBASE-26875 RpcRetryingCallerImpl translateException ignores return value of recursive call (#4270)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-25 12:25:16 -04:00
Bryan Beaudreault
4f67229b2b HubSpot Backport: HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-25 12:25:12 -04:00
Michael Stack
30a299eb55 HubSpot Backport: HBASE-21065 Try ROW_INDEX_V1 encoding on meta table
Set encoding and blooms on meta as default. Also shutdown access to the
initial meta schema creating method; get from TableDescriptors if you
need access to schema or edit it as you would any other table if you
want to edit it.
2022-03-24 07:18:52 -04:00
Baiqiang Zhao
a0a9da8bcf HubSpot Backport: HBASE-25687 Backport "HBASE-25681 Add a switch for server/table query… (#3074)
Signed-off-by: stack <stack@apache.org>
2022-03-17 14:41:44 -04:00
Wei-Chiu Chuang
c01cc7cb6a HubSpot Backport: HBASE-21946 Use ByteBuffer pread instead of byte[] pread in HFileBlock when applicable (#3434)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 4a3c7d73b04928ca0d63b7117186ddb9757997f2)
2022-03-17 14:16:41 -04:00