Commit Graph

17890 Commits

Author SHA1 Message Date
Bryan Beaudreault 64fdb95b09
Temporary fix: Clone scan to avoid modifying user object from scan internals. See https://issues.apache.org/jira/browse/HBASE-27402 (#26) 2022-10-01 09:55:40 -04:00
Bryan Beaudreault 5c60f1d86d Hubspot Backport: HBASE-27391 Downgrade ERROR log to DEBUG in ConnectionUtils.updateStats 2022-09-27 17:13:22 -04:00
huaxiangsun 495f11417a HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' Addendum (#4665)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-09-23 20:25:21 -04:00
huaxiangsun 4742658551 HBASE-27251 Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to 'File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo' (#4663)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-09-23 20:25:21 -04:00
Bri Augenreich d33b0cacd6
Remove unneeded deps from hbase server (#25) 2022-09-23 15:23:20 -04:00
Bri Augenreich f15bb84670
Remove http exclusion for hbase server (#24) 2022-09-23 14:14:01 -04:00
Bryan Beaudreault db67519e6c
Add protobufs from hbase-endpoint (#23) 2022-09-23 13:20:42 -04:00
Bryan Beaudreault eca219a9e6 Quick fix - remove unused RegionInfo.UNDEFINED, which according to https://issues.apache.org/jira/browse/HBASE-24896 is causing static initializer deadlock 2022-09-21 09:35:46 -04:00
Bo Cui 078e2619ea HubSpot Backport: HBASE-23340 hmaster /hbase/replication/rs session expired (hbase replication default value is true, we don't use ) causes logcleaner can not clean oldWALs, which resulits in oldWALs too large (more than 2TB) (#2779)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
    Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-08-24 18:05:12 -04:00
clarax 1b256f6a7a HBASE-26309 Balancer tends to move regions to the server at the end o… (#3812)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-08-08 16:42:27 -04:00
Bryan Beaudreault 9a0d069af7 HubSpot Backport: HBASE-27188 Report maxStoreFileCount in jmx (#4609)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-08-03 09:55:48 -04:00
Bryan Beaudreault 91c7ede9df HubSpot Backport: HBASE-27257 Remove unnecessary usage of CachedBlocksByFile from RS UI (#4667)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-29 15:35:27 -04:00
Bryan Beaudreault c6e14f9061 HubSpot Backport: HBASE-27229 BucketCache statistics should not count evictions by hfile (#4639)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-28 11:18:20 -04:00
Bryan Beaudreault 4e944f21b2 HubSpot Backport: HBASE-27225 Add BucketAllocator bucket size statistic logging (#4637) (addendum)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-07-25 23:01:04 -04:00
chenglei 96e7283949 HubSpot Backport: HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-07-25 23:00:58 -04:00
Bryan Beaudreault a9d4d6e9e8 Hubspot Backport: HBASE-27224 HFile tool statistic sampling produces misleading results 2022-07-21 13:16:00 -04:00
Bryan Beaudreault 9ca1073fd5 HubSpot Backport: HBASE-27225 Add BucketAllocator bucket size statistic logging 2022-07-21 13:15:39 -04:00
Bryan Beaudreault e4ce632d59 HubSpot Backport: HBASE-27053 IOException during caching of uncompressed block to the block cache (#4610)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: wenwj0 <wenweijian2@huawei.com>
2022-07-16 21:33:20 -04:00
Bryan Beaudreault 7023542cce HubSpot Backport: HBASE-27078 Allow configuring a separate timeout for meta scans (#4585)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-12 17:42:51 -04:00
Bryan Beaudreault 9d85d622a1 HubSpot Backport: HBASE-27149 Server should close scanner if client times out before results are ready (#4604)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 22:49:33 -04:00
Xiaolin Ha e21e95974d HubSpot Backport: HBASE-26175 MetricsHBaseServer should record all kinds of Exceptions (#4248)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2022-07-11 18:25:04 -04:00
chenglei aee754f018 Hubspot Backport: HBASE-26869 RSRpcServices.scan should deep clone cells when RpcCallContext is null (#4265) 2022-07-11 18:13:12 -04:00
Istvan Toth 421db7914a HubSpot Backport: HBASE-26777 BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepC… (#4139)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-11 18:13:07 -04:00
Bryan Beaudreault cf3fe854b5 HubSpot Backport: HBASE-27186 Report block cache size metrics separately for L1 and L2 2022-07-11 10:16:32 -04:00
Duo Zhang 979e75e013 HBASE-27146 Avoid CellUtil.cloneRow in MetaCellComparator (#4571)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Reviewed-by: SiCheng-Zheng <643463623@qq.com>
(cherry picked from commit b1691a5318)
2022-07-08 08:12:09 -04:00
Bryan Beaudreault 679e40e068 HBASE-27048 Server side scanner time limit should account for time in queue (#4562)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-07-06 15:22:24 -04:00
Bryan Beaudreault 588ad6b6eb HubSpot Backport: HBASE-27170 ByteBuffAllocator leak when decompressing blocks near minSizeForReservoirUse 2022-07-01 16:13:45 -04:00
Chris Ayoub 6867507ba6
Merge pull request #18 from HubSpot/revert-17-hubspot-2-c8
Revert "Upload RPMs to OS-based repos"
2022-06-28 08:00:26 -07:00
Chris Ayoub 4b3e970d1e Revert "Upload RPMs to OS-based repos (#17)"
This reverts commit ed527a81b0.
2022-06-28 11:00:08 -04:00
Chris Ayoub ed527a81b0
Upload RPMs to OS-based repos (#17) 2022-06-28 10:33:17 -04:00
Bryan Beaudreault 629a00559b HBASE-27060 Allow sharing connections between AggregationClient instances (#4566)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-24 11:41:02 -04:00
Bryan Beaudreault f4752de8d8 HBASE-26945 Quotas causes too much load on meta for large clusters (#4576)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-24 08:09:03 -04:00
Bryan Beaudreault 3c3927c60f HBASE-26790 getAllRegionLocations can cache locations with null hostname (#4575)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-24 08:09:03 -04:00
Ruanhui a9918c504b HBASE-26942 cache region locations when getAllRegionLocations (#4357)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-06-24 08:09:03 -04:00
Bri Augenreich 23239e7eef
Fix client bundle metrics dep issues (#14)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-06-16 16:58:17 -04:00
Bryan Beaudreault 0a222c8fa8 Revert "HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)"
This reverts commit 35ec27d079.
2022-06-12 15:00:28 -04:00
Bryan Beaudreault 56edc758ec
Shade hadoop compat classes so they can be loaded in hadoop jobs (#13) 2022-06-09 09:51:39 -04:00
Bryan Beaudreault 12f40b6d6f
Add AggregationClient to client bundle (#12) 2022-06-06 12:15:06 -04:00
Bryan Beaudreault a246b68ca5 HubSpot Backport: HBASE-27038 CellComparator should extend Serializable 2022-06-06 08:57:43 -04:00
Bryan Beaudreault fe19a63d13
Add client bundles for hbase2 (#11)
* Add hubspot client bundles

* add cdh5 mode and build the client bundles using cdh5 hadoop and java8 for now
2022-05-31 10:55:55 -04:00
Bryan Beaudreault 129f8f904b HubSpot Backport: HBASE-26990 Add default implementation for BufferedMutator interface setters 2022-04-29 10:40:27 -04:00
Bri Augenreich e827cfbbb6
HubSpot Backport: HBASE-26581 Add metrics for failed replication edits
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
2022-04-27 08:41:36 -04:00
Bryan Beaudreault 58676a928e HubSpot Backport: HBASE-26891 Make MetricsConnection scope configurable (#4365)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:20 -04:00
Bryan Beaudreault b95fe05bcb HubSpot Backport: HBASE-26807 Unify CallQueueTooBigException special pause with CallDroppedException (#4273)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-23 21:18:14 -04:00
huaxiangsun bd859293cc HubSpot Backport: HBASE-26590 Hbase-client Meta lookup performance regression between hbase-1 and hbase-2 (#4008)
Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-12 13:59:49 -04:00
Sean Busbey 559593825a HubSpot Backport: HBASE-26871 addendum. use the jar command from JAVA_HOME (#4297) 2022-03-31 07:51:37 -04:00
Sean Busbey 3fa920c885 HubSpot Backport: HBASE-26871 shaded mapreduce and shaded byo-hadoop client artifacts contain no classes (#4279)
- revert poms for both modules
- add a test to the shaded artifact validation that checks for java classes

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-31 07:51:27 -04:00
Bryan Beaudreault fa033e4ac6 HubSpot Backport: HBASE-26783 ScannerCallable doubly clears meta cache on retries (#4147)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Xiaolin Ha 35ec27d079 HubSpot Backport: HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-26 12:59:50 -04:00
Andrew Purtell 954004af49 HubSpot Backport: HBASE-26715 Blocked on SyncFuture in AsyncProtobufLogWriter#write (#4184)
Co-authored-by: Bryan Beaudreault <bbeaudreault@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-26 12:59:50 -04:00