209b6f74c7
HBASE-16317 revert all ESAPI changes
...
Revert "HBASE-15270 Use appropriate encoding for "filter" field in TaskMonitorTmpl.jamon."
This reverts commit bba4f107c168b300173f4b3e38705c3826894f89
2016-08-03 20:47:02 -07:00
81b06b3bdd
HBASE-16350 Undo server abort from HBASE-14968
2016-08-03 19:37:58 -07:00
bcf2738a01
HBASE-16301 Trigger flush without waiting when compaction is disabled on a table (huaxiang sun)
2016-08-02 18:46:07 -07:00
e63fb6c025
HBASE-16319 Fix TestCacheOnWrite after HBASE-16288
2016-08-02 16:53:32 -07:00
eef6a4834a
HBASE-16284 Unauthorized client can shutdown the cluster
2016-08-02 11:21:31 -07:00
b35cf8f93a
HBASE-16225 Refactor ScanQueryMatcher
2016-08-02 14:01:28 +08:00
78361243c8
HBASE-16296 Reverse scan performance degrades when using filter lists (Ted Yu)
2016-08-01 17:41:10 -07:00
aa0235f98c
HBASE-16288 HFile intermediate block level indexes might recurse forever creating multi TB files
2016-08-01 11:08:56 -07:00
7e6f562754
HBASE-16234 Expect and handle nulls when assigning replicas(Yi Liang)
2016-08-01 11:21:13 +08:00
3729320099
HBASE-16209 Removed unnecessary method and method calls from AssignmentManager and AssignmentManager UI (addendum)
...
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-07-29 16:05:00 -07:00
fe44383619
HBASE-16209 provide an ExponentialBackOffPolicy sleep between failed region open requests
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-29 09:47:00 -07:00
2b1cbeb28d
HBASE-16300 LruBlockCache.CACHE_FIXED_OVERHEAD should calculate LruBlockCache size correctly
...
Signed-off-by: Yu Li <liyu@apache.org>
2016-07-29 14:29:01 +08:00
66fb697f81
HBASE-16275 Change ServerManager#onlineServers from ConcurrentHashMap to ConcurrentSkipListMap (Huaxiang Sun)
2016-07-28 11:13:58 -07:00
64804a0497
HBASE-16293 TestSnapshotFromMaster#testSnapshotHFileArchiving flakey (Huaxiang Sun)
2016-07-28 10:42:30 -07:00
00c2a5da7b
HBASE-16286 When TagRewriteCell are not copied to MSLAB, deep clone it while adding to Memstore.
2016-07-27 22:29:26 +05:30
bcf409e11f
HBASE-16280 Use hash based map in SequenceIdAccounting
2016-07-26 11:31:32 +08:00
0da8119fbc
HBASE-16281 TestMasterReplication is flaky
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-26 10:54:46 +08:00
abfd584fe6
HBASE-14743 Add metrics around HeapMemoryManager. (Reid Chan)
...
Change-Id: I7305f7b7034b216930b5fb5c57de9ba5eabf96d8
Signed-off-by: Apekshit Sharma <appy@apache.org>
2016-07-25 14:32:38 -07:00
eff38ccf8c
Revert HBASE-14743 because of wrong attribution. Since I added commit message to the raw patch, it's making me as author instead of Reid. I should have used --author flag to set Reid as author.
...
This reverts commit 064271da16
2016-07-25 14:32:38 -07:00
064271da16
HBASE-14743 Add metrics around HeapMemoryManager. (Reid Chan)
...
Change-Id: I60b2435355b3e605e7d91cbf5aca5d2988f26f33
2016-07-25 13:45:50 -07:00
2df0ef549a
HBASE-16205 When Cells are not copied to MSLAB, deep clone it while adding to Memstore.
2016-07-25 22:58:32 +05:30
6dbce2a8cb
HBASE-16266 Do not throw ScannerTimeoutException when catch UnknownScannerException
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-07-25 22:26:19 +08:00
bdd7782f05
HBASE-16008 A robust way deal with early termination of HBCK (Stephen Yuan Jiang)
2016-07-23 14:47:11 -07:00
cd0b85e0a8
Revert HBASE-15406: Split / merge switch left disabled after early termination of hbck (HBASE-16008 will address this issue)
2016-07-22 20:09:03 -07:00
744248c131
HBASE-16096 Properly remove the replication queue and peer znodes after calling ReplicationSourceManager.removePeer().
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 18:11:41 -07:00
03fe257a64
HBASE-16221 Have ThriftScanner update the ConnectionCache's last used time overtime getScannerRow() to keep the connection alive for long lived scanners
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-22 17:58:39 -07:00
cc766df28b
HBASE-16272 Overflow in ServerName's compareTo method (Huaxiang Sun)
2016-07-22 15:28:04 -07:00
519f87fc2b
HBASE-15291 Revert due to race condition resulting in closed FileSystem error
2016-07-21 18:51:47 -07:00
65834a1ced
HBASE-16217 Pass through the calling user in ObserverContext
2016-07-21 16:45:09 -07:00
9d740f7b8b
HBASE-16263 Move all to do w/ protobuf -- *.proto files and generated classes -- under hbase-protocol
...
Signed-off-by: stack <stack@apache.org>
2016-07-21 10:02:05 -07:00
ce657d5911
HBASE-13701 Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load -- addendum
2016-07-20 13:28:01 -07:00
70f330dc84
Consolidate SecureBulkLoadEndpoint into HBase core as default for bulk load
2016-07-19 19:53:10 -07:00
5051ab4e70
HBASE-16244 LocalHBaseCluster start timeout should be configurable (Siddharth Wagle)
2016-07-19 14:12:47 -07:00
638ca24f01
HBASE-14552 (addendum) Procedure V2: Reimplement DispatchMergingRegionHandler (add nonce support) (Stephen Yuan Jiang)
2016-07-19 08:49:23 -07:00
515c499f95
HBASE-16110 AsyncFS WAL doesn't work with Hadoop 2.8+
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-07-18 06:54:20 -05:00
a1cc2c4bfe
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely
...
(cherry picked from commit a8dfd8c436
2016-07-18 06:48:17 -05:00
a0aa017ae9
Revert "Replication queue's lock will live forever if RS acquiring the lock has died prematurely"
...
This reverts commit a8dfd8c436
2016-07-18 06:47:56 -05:00
cf0f4f72d9
HBASE-16076 Cannot configure split policy in HBase shell
2016-07-18 10:28:05 +08:00
a8dfd8c436
Replication queue's lock will live forever if RS acquiring the lock has died prematurely
2016-07-18 09:32:36 +08:00
9bc7ecfb9d
HBASE-16235 Addendum uses hfile count of 20 (ChiaPing)
2016-07-16 16:07:11 -07:00
60847a2d76
HBASE-3727 MultiHFileOutputFormat (yi liang)
2016-07-15 21:07:12 -07:00
66c68f8ea3
HBASE-16235 TestSnapshotFromMaster#testSnapshotHFileArchiving will fail if there are too many hfiles (ChiaPing Tsai)
2016-07-15 15:07:14 -07:00
3978aa3af0
HBASE-13823 Procedure V2: remove unnecessaery operaions on AssignmentManager#recoverTableInDisablingState() and recoverTableInEnablingState() (Stephen Yuan Jiang)
2016-07-15 12:26:31 -07:00
f04eeecffc
HBASE-14552 Procedure V2: Reimplement DispatchMergingRegionHandler (Stephen Yuan Jiang)
2016-07-15 07:06:53 -07:00
28d8609e5d
HBASE-16233 Procedure V2: Support acquire/release shared table lock concurrently (Stephen Yuan Jiang)
2016-07-14 21:32:59 -07:00
243fe287b9
HBASE-16219 addendum move MasterMetaBootstrap to the right place
2016-07-15 09:58:17 +08:00
a55af38689
HBASE-16219 Move meta bootstrap out of HMaster
2016-07-14 06:14:53 -07:00
a07892558b
HBASE-16095 Add priority to TableDescriptor and priority region open thread pool
2016-07-13 18:19:59 -07:00
3b3c3dc02d
HBASE-16195 Should not add chunk into chunkQueue if not using chunk pool in HeapMemStoreLAB
2016-07-13 09:33:24 +08:00
911706a873
HBASE-16220 Demote log level for "HRegionFileSystem - No StoreFiles for" messages to TRACE
2016-07-12 15:44:06 -07:00
f292048ffd
HBASE-16208 Check that the row exists before attempting to remove a queue from TableBasedReplicationQueuesImpl
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 14:50:07 -07:00
90ba723dc6
HBASE-16214 Add in a UI description for the Replication Table
...
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-12 12:21:55 -07:00
2650711e94
HBASE-16207 can't restore snapshot without "Admin" permission
2016-07-12 05:50:06 -07:00
ccf293d7fb
HBASE-16081 Wait for Replication Tasks to complete before killing the ThreadPoolExecutor inside of HBaseInterClusterReplicationEndpoint
...
Signed-off-by: Mikhail Antonov <antonov@apache.org>
2016-07-11 17:34:12 -07:00
3b5fbf8d73
HBASE-16160 Support RPC encryption with direct ByteBuffers (Colin Ma via garyh)
2016-07-11 10:33:22 -07:00
356c130702
HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells, addendum
2016-07-11 22:44:32 +08:00
0875c35781
HBASE-16185 TestReplicationSmallTests fails in master branch (Phil Yang)
2016-07-10 23:28:32 -07:00
9cf012cd00
HBASE-16194 Should count in MSLAB chunk allocation into heap size change when adding duplicate cells
2016-07-10 13:45:17 +08:00
496fd9837a
HBASE-16176 Bug fixes/improvements on HBASE-15650 Remove
...
TimeRangeTracker as point of contention when many threads reading a StoreFile
Fixes HBASE-16074 ITBLL fails, reports lost big or tiny families broken
scanning because of a side effect of a clean up in HBASE-15650 to make
TimeRange construction consistent exposed a latent issue in
TimeRange#compare. See HBASE-16074 for more detail.
Also change HFile Writer constructor so we pass in the TimeRangeTracker, if one,
on construction rather than set later (the flag and reference were not volatile
so could have made for issues in concurrent case). And make sure the construction
of a TimeRange from a TimeRangeTracer on open of an HFile Reader never makes a
bad minimum value, one that would preclude us reading any values from a file
(set min to 0)
M hbase-common/src/main/java/org/apache/hadoop/hbase/io/TimeRange.java
Call through to next constructor (if minStamp was 0, we'd skip setting
allTime=true). Add asserts that timestamps are not < 0 cos it messes
us up if they are (we already were checking for < 0 on construction but
assert passed in timestamps are not < 0).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
Add constructor override that takes a TimeRangeTracker (set when flushing
but not when compacting)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Store.java
Add override creating an HFile in tmp that takes a TimeRangeTracker
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
Add override for HFile Writer that takes a TimeRangeTracker Take it on
construction instead of having it passed by a setter later (flags and
reference set by the setter were not volatile... could have been prob
in concurrent case)
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/TimeRangeTracker.java
Log WARN if bad initial TimeRange value (and then 'fix' it)
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestTimeRangeTracker.java
A few tests to prove serialization works as expected and that we'll get a bad min if not constructed properly.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ScanQueryMatcher.java
Handle OLDEST_TIMESTAMP explictly. Don't expect TimeRange to do it.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestQueryMatcher.java
Refactor from junit3 to junit4 and add test for this weird case.
2016-07-08 18:20:31 -07:00
3c39cbd92c
HBASE-16201 NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 02:02:00 +08:00
1578a045b6
Revert "NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication"
...
This reverts commit a33097e067
2016-07-09 02:01:43 +08:00
5e0d97e0e9
HBASE-16171 Fix the potential problems in TestHCM.testConnectionCloseAllowsInterrupt (Colin Ma)
2016-07-08 10:18:36 -07:00
a33097e067
NPE in RpcServer causing intermittent UT failure of TestMasterReplication#testHFileCyclicReplication
2016-07-09 01:05:10 +08:00
581d2b7de5
HBASE-16162 Compacting Memstore : unnecessary push of active segments to pipeline.
2016-07-06 18:54:35 +05:30
ae92668dd6
HBASE-16087 Replication shouldn't start on a master if if only hosts system tables
2016-07-05 13:50:37 -07:00
20a99b4c06
HBASE-16144 Revert - test failure in TestMultiSlaveReplication#testMultiSlaveReplication seems to be related
2016-07-05 13:19:33 -07:00
318751cfd6
HBASE-16091 Canary takes lot more time when there are delete markers in the table (Vishal Khandelwal)
2016-07-05 11:13:48 -07:00
d016338e45
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-05 10:21:27 -07:00
b5cdb38dc7
HBASE-16144 Replication queue's lock will live forever if RS acquiring the lock has died prematurely (Phil Yang)
2016-07-05 07:16:12 -07:00
7f44dfd85f
HBASE-16132 Scan does not return all the result when regionserver is busy (binlijin)
2016-07-04 21:45:04 +08:00
6944a17ad4
HBASE-16135 PeerClusterZnode under rs of removed peer may never be deleted
2016-07-04 19:26:27 +08:00
d22c23c396
HBASE-16163 Compacting Memstore : CompactionPipeline#addFirst can use LinkedList#addFirst.
2016-07-03 21:35:29 +05:30
97f2294bfd
HBASE-16164 Missing close of new compacted segments in few occasions which might leak MSLAB chunks from pool.
2016-07-02 11:42:08 +05:30
561eb82968
HBASE-15844 We should respect hfile.block.index.cacheonwrite when write intermediate index Block
2016-07-02 09:04:15 +08:00
fe75edb556
HBASE-16157 Revert - ChiaPing has new fix
2016-07-01 13:00:05 -07:00
d92a99da0e
HBASE-16125 RegionMover uses hardcoded, Unix-style tmp folder - breaks Windows (Vladimir Rodionov)
2016-07-01 10:02:25 -07:00
5a7c9939cb
HBASE-16157 The incorrect block cache count and size are caused by removing duplicate block key in the LruBlockCache (ChiaPing Tsai)
2016-07-01 09:43:39 -07:00
cc73c03118
HBASE-16108 RowCounter should support multiple key ranges (Konstantin Ryakhovskiy)
2016-07-01 03:41:17 -07:00
139f0ed53c
HBASE-16155 Compacting Memstore : Few log improvements.
2016-07-01 10:14:07 +05:30
d1d8cc71c9
HBASE-16150 Remove ConcurrentIndex (Hiroshi Ikeda)
2016-06-30 15:03:32 -07:00
e2566eb0ee
HBASE-16153 Correct the config name
...
'hbase.memestore.inmemoryflush.threshold.factor' (Ram)
2016-06-30 17:44:08 +05:30
e1d130946b
HBASE-16117 Fix Connection leak in mapred.TableOutputFormat
2016-06-29 17:18:43 -07:00
42106b89b1
HBASE-16114 Get regionLocation of required regions only for MR jobs (Thiruvel Thirumoolan)
2016-06-29 16:34:44 -07:00
9b1ecb31f0
HBASE-16143 Change MemstoreScanner constructor to accept
...
List<KeyValueScanner> (Ram)
2016-06-29 23:10:55 +05:30
727394c2e9
HBASE-16140 bump owasp.esapi from 2.1.0 to 2.1.0.1
2016-06-29 08:51:00 -07:00
6fb0dd07a8
HBASE-16139 Use CellUtil instead of KeyValueUtil in Import (NIDHI GAMBHIR)
2016-06-29 02:45:00 -07:00
432868b038
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache. - Addendum
2016-06-29 16:31:23 +08:00
394e7224a9
HBASE-16122 PerformanceEvaluation should provide user friendly hint when client threads argument is missing (Konstantin Ryakhovskiy)
2016-06-28 17:42:51 -07:00
8bc4d4131c
HBASE-16121 Require only MasterServices to the ServerManager constructor
2016-06-28 07:42:40 -07:00
e768c4afac
HBASE-15976 RegionServerMetricsWrapperRunnable will be failure when disable blockcache.
2016-06-28 13:45:41 +08:00
13cf4fb3fc
HBASE-16052 Improve HBaseFsck Scalability (Ben Lau)
2016-06-27 13:24:35 -07:00
424b789e03
HBASE-14007 Writing to table through MR should fail upfront if table does not exist/is disabled (Thiruvel Thirumoolan)
2016-06-27 06:41:00 -07:00
ba9286911f
HBASE-16109 Add Interface audience annotation to a few classes
2016-06-27 06:29:04 -07:00
fc4b8aa89d
HBASE-16089 Add on FastPath for CoDel
2016-06-25 12:57:15 -07:00
e8599a2921
HBASE-16103 Procedure v2 - TestCloneSnapshotProcedure relies on execution order
2016-06-24 09:09:59 -07:00
99dc300d37
HBASE-16055 PutSortReducer loses any Visibility/acl attribute set on the
...
Puts (Ram)
2016-06-24 15:09:53 +05:30
518faa735b
HBASE-15353 Add metric for number of CallQueueTooBigException's
2016-06-24 13:00:06 +08:00
68c1b34dbc
HBASE-16040 Remove configuration "hbase.replication"
2016-06-24 10:41:35 +08:00
f4cec2e202
HBASE-16085 Add a metric for failed compactions
2016-06-23 15:38:58 -07:00
9cd097cfac
HBASE-16090 ResultScanner is not closed in SyncTable#finishRemainingHashRanges()
2016-06-23 07:28:35 -07:00
Nick Dimiduk
Enis Soztutar
Andrew Purtell
Deokwoo Han
zhangduo
chenheng
Joseph Hwang
Yu Sun
Matteo Bertozzi
anoopsjohn
Phil Yang
Reid Chan
Apekshit Sharma
Stephen Yuan Jiang
Jerry He
Gary Helmling
stack
Sean Busbey
tedyu
Yu Li
Elliott Clark
Ramkrishna
Jonathan M Hsieh
Jingcheng Du