Commit Graph

17873 Commits

Author SHA1 Message Date
Bryan Beaudreault e4ce632d59 HubSpot Backport: HBASE-27053 IOException during caching of uncompressed block to the block cache (#4610)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: wenwj0 <wenweijian2@huawei.com>
2022-07-16 21:33:20 -04:00
Bryan Beaudreault 7023542cce HubSpot Backport: HBASE-27078 Allow configuring a separate timeout for meta scans (#4585)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-12 17:42:51 -04:00
Bryan Beaudreault 9d85d622a1 HubSpot Backport: HBASE-27149 Server should close scanner if client times out before results are ready (#4604)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:49:33 -04:00
Xiaolin Ha e21e95974d HubSpot Backport: HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-07-11 18:25:04 -04:00
chenglei aee754f018 Hubspot Backport: HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4265) 2022-07-11 18:13:12 -04:00
Istvan Toth 421db7914a HubSpot Backport: HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 18:13:07 -04:00
Bryan Beaudreault cf3fe854b5 HubSpot Backport: HBASE-27186 Report block cache size metrics separately for L1 and L2 2022-07-11 10:16:32 -04:00
Duo Zhang 979e75e013 HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit b1691a5318)
2022-07-08 08:12:09 -04:00
Bryan Beaudreault 679e40e068 HBASE-27048 Server side scanner time limit should account for time in queue (#4562)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-06 15:22:24 -04:00
Bryan Beaudreault 588ad6b6eb HubSpot Backport: HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse 2022-07-01 16:13:45 -04:00
Chris Ayoub 6867507ba6
Merge pull request #18 from HubSpot/revert-17-hubspot-2-c8
Revert "Upload RPMs to OS-based repos"
2022-06-28 08:00:26 -07:00
Chris Ayoub 4b3e970d1e Revert "Upload RPMs to OS-based repos (#17)"
This reverts commit ed527a81b0.
2022-06-28 11:00:08 -04:00
Chris Ayoub ed527a81b0
Upload RPMs to OS-based repos (#17) 2022-06-28 10:33:17 -04:00
Bryan Beaudreault 629a00559b HBASE-27060 Allow sharing connections between AggregationClient instances (#4566)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-24 11:41:02 -04:00
Bryan Beaudreault f4752de8d8 HBASE-26945 Quotas causes too much load on meta for large clusters (#4576)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-24 08:09:03 -04:00
Bryan Beaudreault 3c3927c60f HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4575)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-24 08:09:03 -04:00
Ruanhui a9918c504b HBASE-26942 cache region locations when getAllRegionLocations (#4357)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-06-24 08:09:03 -04:00
Bri Augenreich 23239e7eef
Fix client bundle metrics dep issues (#14)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-06-16 16:58:17 -04:00
Bryan Beaudreault 0a222c8fa8 Revert "HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)"
This reverts commit 35ec27d079.
2022-06-12 15:00:28 -04:00
Bryan Beaudreault 56edc758ec
Shade hadoop compat classes so they can be loaded in hadoop jobs (#13) 2022-06-09 09:51:39 -04:00
Bryan Beaudreault 12f40b6d6f
Add AggregationClient to client bundle (#12) 2022-06-06 12:15:06 -04:00
Bryan Beaudreault a246b68ca5 HubSpot Backport: HBASE-27038 CellComparator should extend Serializable 2022-06-06 08:57:43 -04:00
Bryan Beaudreault fe19a63d13
Add client bundles for hbase2 (#11)
* Add hubspot client bundles

* add cdh5 mode and build the client bundles using cdh5 hadoop and java8 for now
2022-05-31 10:55:55 -04:00
Bryan Beaudreault 129f8f904b HubSpot Backport: HBASE-26990 Add default implementation for BufferedMutator interface setters 2022-04-29 10:40:27 -04:00
Bri Augenreich e827cfbbb6
HubSpot Backport: HBASE-26581 Add metrics for failed replication edits
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-04-27 08:41:36 -04:00
Bryan Beaudreault 58676a928e HubSpot Backport: HBASE-26891 Make MetricsConnection scope configurable (#4365)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:20 -04:00
Bryan Beaudreault b95fe05bcb HubSpot Backport: HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:14 -04:00
huaxiangsun bd859293cc HubSpot Backport: HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008)
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-12 13:59:49 -04:00
Sean Busbey 559593825a HubSpot Backport: HBASE-26871 addendum. use the jar command from JAVA_HOME (#4297) 2022-03-31 07:51:37 -04:00
Sean Busbey 3fa920c885 HubSpot Backport: HBASE-26871 shaded mapreduce and shaded byo-hadoop client artifacts contain no classes (#4279)
- revert poms for both modules
- add a test to the shaded artifact validation that checks for java classes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-31 07:51:27 -04:00
Bryan Beaudreault fa033e4ac6 HubSpot Backport: HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Xiaolin Ha 35ec27d079 HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Andrew Purtell 954004af49 HubSpot Backport: HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184)
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:59:50 -04:00
Bryan Beaudreault 44c62c58ba fix 2022-03-26 12:59:50 -04:00
Xiaolin Ha e81f6ced7b HubSpot Backport: HBASE-26552 Introduce retry to logroller to avoid abort (#4170)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:33:31 -04:00
Bryan Beaudreault 35f86757c9 HubSpot Backport: HBASE-26876 Use toStringBinary for rowkey in RegionServerCallable error string (#4269)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:26:01 -04:00
Bryan Beaudreault 9e54eeedd0 HubSpot Backport: HBASE-26875 RpcRetryingCallerImpl translateException ignores return value of recursive call (#4270)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-25 12:25:16 -04:00
Bryan Beaudreault 4f67229b2b HubSpot Backport: HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-25 12:25:12 -04:00
Michael Stack 30a299eb55 HubSpot Backport: HBASE-21065 Try ROW_INDEX_V1 encoding on meta table
Set encoding and blooms on meta as default. Also shutdown access to the
initial meta schema creating method; get from TableDescriptors if you
need access to schema or edit it as you would any other table if you
want to edit it.
2022-03-24 07:18:52 -04:00
Baiqiang Zhao a0a9da8bcf HubSpot Backport: HBASE-25687 Backport "HBASE-25681 Add a switch for server/table query… (#3074)
Signed-off-by: stack <stack@apache.org>
2022-03-17 14:41:44 -04:00
Wei-Chiu Chuang c01cc7cb6a HubSpot Backport: HBASE-21946 Use ByteBuffer pread instead of byte[] pread in HFileBlock when applicable (#3434)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 4a3c7d73b0)
2022-03-17 14:16:41 -04:00
Bryan Beaudreault 0c21465878 Revert "Upstream Callers (#15)"
See HBasePlanning/issues/806 for details

This reverts commit 8cc6bfb5b2.
2022-03-15 12:11:10 -04:00
Bryan Beaudreault 374ed22789 HubSpot Backport: HBASE-26814 Default StoreHotnessProtector to off, with logs to guide when to turn it on 2022-03-09 17:48:17 -05:00
Bryan Beaudreault 8a27821582 HubSpot Backport: HBASE-26784 Use HIGH_QOS for ResultScanner.close requests (#4163)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-08 08:52:13 -05:00
Charles Connell 866ae91111
Merge pull request #6 from HubSpot/blazar-provides
Give hbase-assembly a name in Blazar
2022-03-03 11:47:59 -05:00
Charles Connell 5cb5b3ed3e Give hbase-assembly a name in Blazar 2022-03-03 11:07:39 -05:00
Bri Augenreich 4a38b00588
HubSpot Backport: HBASE-26308 Sum of multiplier of cost functions is not populated properly when we have a shortcut for trigger 2022-03-03 10:21:07 -05:00
Bryan Beaudreault 814065d0d9 HubSpot Backport: HBASE-26731 Add metrics for active and expired scanners 2022-03-01 16:38:09 -05:00
Bri Augenreich c7e6f80fc5
Merge pull request #4 from HubSpot/HBASE-26745-hubspot-2
HBASE-26745 Include Balancer Cost metrics in jmx endpoint
2022-02-28 20:10:26 -05:00
Briana Augenreich a9f7907f9d HubSpot Backport: HBASE-26745 Include Balancer Cost metrics in jmx endpoint 2022-02-28 13:48:22 -05:00