17872 Commits

Author SHA1 Message Date
Bryan Beaudreault
7023542cce HubSpot Backport: HBASE-27078 Allow configuring a separate timeout for meta scans (#4585)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-12 17:42:51 -04:00
Bryan Beaudreault
9d85d622a1 HubSpot Backport: HBASE-27149 Server should close scanner if client times out before results are ready (#4604)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:49:33 -04:00
Xiaolin Ha
e21e95974d HubSpot Backport: HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-07-11 18:25:04 -04:00
chenglei
aee754f018 Hubspot Backport: HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4265) 2022-07-11 18:13:12 -04:00
Istvan Toth
421db7914a HubSpot Backport: HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 18:13:07 -04:00
Bryan Beaudreault
cf3fe854b5 HubSpot Backport: HBASE-27186 Report block cache size metrics separately for L1 and L2 2022-07-11 10:16:32 -04:00
Duo Zhang
979e75e013 HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit b1691a53185efcafc1d2a15767a88825f4d7b625)
2022-07-08 08:12:09 -04:00
Bryan Beaudreault
679e40e068 HBASE-27048 Server side scanner time limit should account for time in queue (#4562)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-06 15:22:24 -04:00
Bryan Beaudreault
588ad6b6eb HubSpot Backport: HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse 2022-07-01 16:13:45 -04:00
Chris Ayoub
6867507ba6
Merge pull request #18 from HubSpot/revert-17-hubspot-2-c8
Revert "Upload RPMs to OS-based repos"
2022-06-28 08:00:26 -07:00
Chris Ayoub
4b3e970d1e Revert "Upload RPMs to OS-based repos (#17)"
This reverts commit ed527a81b048881d4c0a080e53454a537728ccb0.
2022-06-28 11:00:08 -04:00
Chris Ayoub
ed527a81b0
Upload RPMs to OS-based repos (#17) 2022-06-28 10:33:17 -04:00
Bryan Beaudreault
629a00559b HBASE-27060 Allow sharing connections between AggregationClient instances (#4566)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-24 11:41:02 -04:00
Bryan Beaudreault
f4752de8d8 HBASE-26945 Quotas causes too much load on meta for large clusters (#4576)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-24 08:09:03 -04:00
Bryan Beaudreault
3c3927c60f HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4575)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-24 08:09:03 -04:00
Ruanhui
a9918c504b HBASE-26942 cache region locations when getAllRegionLocations (#4357)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-06-24 08:09:03 -04:00
Bri Augenreich
23239e7eef
Fix client bundle metrics dep issues (#14)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-06-16 16:58:17 -04:00
Bryan Beaudreault
0a222c8fa8 Revert "HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)"
This reverts commit 35ec27d079cdb0fe8882486534dd95c95748884f.
2022-06-12 15:00:28 -04:00
Bryan Beaudreault
56edc758ec
Shade hadoop compat classes so they can be loaded in hadoop jobs (#13) 2022-06-09 09:51:39 -04:00
Bryan Beaudreault
12f40b6d6f
Add AggregationClient to client bundle (#12) 2022-06-06 12:15:06 -04:00
Bryan Beaudreault
a246b68ca5 HubSpot Backport: HBASE-27038 CellComparator should extend Serializable 2022-06-06 08:57:43 -04:00
Bryan Beaudreault
fe19a63d13
Add client bundles for hbase2 (#11)
* Add hubspot client bundles

* add cdh5 mode and build the client bundles using cdh5 hadoop and java8 for now
2022-05-31 10:55:55 -04:00
Bryan Beaudreault
129f8f904b HubSpot Backport: HBASE-26990 Add default implementation for BufferedMutator interface setters 2022-04-29 10:40:27 -04:00
Bri Augenreich
e827cfbbb6
HubSpot Backport: HBASE-26581 Add metrics for failed replication edits
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-04-27 08:41:36 -04:00
Bryan Beaudreault
58676a928e HubSpot Backport: HBASE-26891 Make MetricsConnection scope configurable (#4365)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:20 -04:00
Bryan Beaudreault
b95fe05bcb HubSpot Backport: HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:14 -04:00
huaxiangsun
bd859293cc HubSpot Backport: HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008)
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-12 13:59:49 -04:00
Sean Busbey
559593825a HubSpot Backport: HBASE-26871 addendum. use the jar command from JAVA_HOME (#4297) 2022-03-31 07:51:37 -04:00
Sean Busbey
3fa920c885 HubSpot Backport: HBASE-26871 shaded mapreduce and shaded byo-hadoop client artifacts contain no classes (#4279)
- revert poms for both modules
- add a test to the shaded artifact validation that checks for java classes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-31 07:51:27 -04:00
Bryan Beaudreault
fa033e4ac6 HubSpot Backport: HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Xiaolin Ha
35ec27d079 HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Andrew Purtell
954004af49 HubSpot Backport: HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184)
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:59:50 -04:00
Bryan Beaudreault
44c62c58ba fix 2022-03-26 12:59:50 -04:00
Xiaolin Ha
e81f6ced7b HubSpot Backport: HBASE-26552 Introduce retry to logroller to avoid abort (#4170)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:33:31 -04:00
Bryan Beaudreault
35f86757c9 HubSpot Backport: HBASE-26876 Use toStringBinary for rowkey in RegionServerCallable error string (#4269)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:26:01 -04:00
Bryan Beaudreault
9e54eeedd0 HubSpot Backport: HBASE-26875 RpcRetryingCallerImpl translateException ignores return value of recursive call (#4270)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-25 12:25:16 -04:00
Bryan Beaudreault
4f67229b2b HubSpot Backport: HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-25 12:25:12 -04:00
Michael Stack
30a299eb55 HubSpot Backport: HBASE-21065 Try ROW_INDEX_V1 encoding on meta table
Set encoding and blooms on meta as default. Also shutdown access to the
initial meta schema creating method; get from TableDescriptors if you
need access to schema or edit it as you would any other table if you
want to edit it.
2022-03-24 07:18:52 -04:00
Baiqiang Zhao
a0a9da8bcf HubSpot Backport: HBASE-25687 Backport "HBASE-25681 Add a switch for server/table query… (#3074)
Signed-off-by: stack <stack@apache.org>
2022-03-17 14:41:44 -04:00
Wei-Chiu Chuang
c01cc7cb6a HubSpot Backport: HBASE-21946 Use ByteBuffer pread instead of byte[] pread in HFileBlock when applicable (#3434)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 4a3c7d73b04928ca0d63b7117186ddb9757997f2)
2022-03-17 14:16:41 -04:00
Bryan Beaudreault
0c21465878 Revert "Upstream Callers (#15)"
See HBasePlanning/issues/806 for details

This reverts commit 8cc6bfb5b22b2b16f2618f02b3aeb15d98d050f0.
2022-03-15 12:11:10 -04:00
Bryan Beaudreault
374ed22789 HubSpot Backport: HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on 2022-03-09 17:48:17 -05:00
Bryan Beaudreault
8a27821582 HubSpot Backport: HBASE-26784 Use HIGH_QOS for ResultScanner.close requests (#4163)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-08 08:52:13 -05:00
Charles Connell
866ae91111
Merge pull request #6 from HubSpot/blazar-provides
Give hbase-assembly a name in Blazar
2022-03-03 11:47:59 -05:00
Charles Connell
5cb5b3ed3e Give hbase-assembly a name in Blazar 2022-03-03 11:07:39 -05:00
Bri Augenreich
4a38b00588
HubSpot Backport: HBASE-26308 Sum of multiplier of cost functions is not populated properly when we have a shortcut for trigger 2022-03-03 10:21:07 -05:00
Bryan Beaudreault
814065d0d9 HubSpot Backport: HBASE-26731 Add metrics for active and expired scanners 2022-03-01 16:38:09 -05:00
Bri Augenreich
c7e6f80fc5
Merge pull request #4 from HubSpot/HBASE-26745-hubspot-2
HBASE-26745 Include Balancer Cost metrics in jmx endpoint
2022-02-28 20:10:26 -05:00
Briana Augenreich
a9f7907f9d HubSpot Backport: HBASE-26745 Include Balancer Cost metrics in jmx endpoint 2022-02-28 13:48:22 -05:00
Bryan Beaudreault
60e936a463 HubSpot Backport HBASE-26727 Fix CallDroppedException reporting 2022-02-13 19:22:32 -05:00