Commit Graph

332 Commits

Author SHA1 Message Date
Michael Stack c1f974bbee HBASE-501 Empty region server address in info:server entry and a startcode of -1 in .META.
M conf/hbase-default.xml
Add hbase.hbasemaster.maxregionopen property.
M src/java/org/apache/hadoop/hbase/HStore.java
Change way we log. Do way less. Just emit sums of edits applied
and skipped rather than individual edits.
M src/java/org/apache/hadoop/hbase/HRegionServer.java
Make sleeper instance a local rather than data member.
(reportForDuty): Take a sleeper instance.
(run): Removed redundant wrap of a 'for' by a 'while'.
(constructor): If IOE, do not offline the region. Seen to be
an overreaction.
M src/java/org/apache/hadoop/hbase/HLog.java
Don't output map of all files being cleaned everytime a new
entry is added; instead just log new entry. Remove emission
of every 10k edits.
M src/java/org/apache/hadoop/hbase/HMaster.java
Up default for maxregionopen. Was seeing that playing edits
could take a long time (mostly because we used log every
edit) but no harm in this being longer. On REPORT_CLOSE,
emit region info, not just region so can see the properties
(W/o, made it hard to figure who was responsible for offlining).
Add logging of attempt # in shutdown processing.
Add logging of state flags passed to the close region. Helps
debugging. Also in close offline ONLY if we are NOT reassigning
the region (jimk find).
M src/java/org/apache/hadoop/hbase/util/Sleeper.java
Add logging of extraordinary sleeps or calculated periods
(suspicion is that we're sleeping way longer on loaded machies
and the regionserver appears hung).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636849 13f79535-47bb-0310-9956-ffa450edef68
2008-03-13 19:37:21 +00:00
Bryan Duxbury 8c815c72f4 HBASE-443 Move internal classes out of HStore
-Moved out classes Memcache, StoreFileScanner, MapFileCompactionReader, and HStoreScanner, and interface CompactionReader
-Updated TestHMemcache to use the correct type declaration.

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636815 13f79535-47bb-0310-9956-ffa450edef68
2008-03-13 18:06:08 +00:00
Jim Kellerman 9057e559a1 HBASE-27 hregioninfo cell empty in meta table
Summary of changes:

HMaster:

- When a row has an empty HRegionInfo (info:regioninfo), log it with the row name and and the other keys still in the row.

- Log the number of rows with empty HRegionInfo

- Delete the rows

- Make RowMap inner class static, change methods to have package scope to avoid synthetic accessors.

- Provide row name to getHRegionInfo so it can issue better log messages

- add method deleteEmptyMetaRows to remove rows with empty HRegionInfo

HRegion

- change removeRegionFromMETA to use deleteAll rather than using a BatchUpdate containing deletes for each cell.

TestEmptyMetaInfo

- new test case



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636589 13f79535-47bb-0310-9956-ffa450edef68
2008-03-13 00:33:13 +00:00
Bryan Duxbury 6fb7767fc6 HBASE-40 [hbase] Add a method of getting multiple (but not all) cells for a row at once
-new override of getRow added to the whole stack
-test for new override added to TestGet2

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636415 13f79535-47bb-0310-9956-ffa450edef68
2008-03-12 16:58:10 +00:00
Jim Kellerman 082e0237fd HBASE-433 HBASE-251 Region server should delete restore log after successful restore, Stuck replaying the edits of crashed machine.
HLog

- don't overwrite oldlogfile in splitLog if it already exists. Rename it and copy it into the new oldlogfile. Then delete it once it has been copied.
- use FileUtil.fullyDelete to delete region server log directory.

HRegion

- delete oldlogfile once it has been successfully processed


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636396 13f79535-47bb-0310-9956-ffa450edef68
2008-03-12 16:20:07 +00:00
Michael Stack da6dde97ce HBASE-495 No server address listed in .META.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634791 13f79535-47bb-0310-9956-ffa450edef68
2008-03-07 19:55:26 +00:00
Michael Stack 57d1bde0e0 HBASE-476 Passing on edits, we dump all to log
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634443 13f79535-47bb-0310-9956-ffa450edef68
2008-03-06 23:00:37 +00:00
Michael Stack 8de1e7de79 HBASE-496 impossible state for createLease writes 400k lines in about 15mins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634395 13f79535-47bb-0310-9956-ffa450edef68
2008-03-06 19:49:54 +00:00
Jim Kellerman a0f73c7efd HBASE-492 hbase TRUNK does not build against hadoop TRUNK
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634168 13f79535-47bb-0310-9956-ffa450edef68
2008-03-06 05:09:33 +00:00
Michael Stack 36b5f4791f HBASE-490 Doubly-assigned .META.; master uses one and clients another
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@633597 13f79535-47bb-0310-9956-ffa450edef68
2008-03-04 19:25:14 +00:00
Michael Stack ab8b5920a9 HBASE-477 Add support for an HBASE_CLASSPATH
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@633240 13f79535-47bb-0310-9956-ffa450edef68
2008-03-03 19:18:53 +00:00
Michael Stack 4e2efbe801 HBASE-480 Tool to manually merge two regions
Commit to TRUNK and branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@632663 13f79535-47bb-0310-9956-ffa450edef68
2008-03-01 22:07:12 +00:00
Jim Kellerman 8aa6130bb4 HBASE-479 Speed up TestLogRolling
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@632533 13f79535-47bb-0310-9956-ffa450edef68
2008-03-01 01:52:59 +00:00
Bryan Duxbury 1dc387a0a6 HBASE-473 When a table is deleted, master sends multiple close messages to the region server
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@632131 13f79535-47bb-0310-9956-ffa450edef68
2008-02-28 22:08:35 +00:00
Bryan Duxbury dee0ea4c7a HBASE-466 Move HMasterInterface, HRegionInterface, and HMasterRegionInterface into o.a.h.h.ipc
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630970 13f79535-47bb-0310-9956-ffa450edef68
2008-02-25 19:54:26 +00:00
Bryan Duxbury f48c1d7893 HBASE-442 Move internal classes out of HRegionServer
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630968 13f79535-47bb-0310-9956-ffa450edef68
2008-02-25 19:50:02 +00:00
Jim Kellerman d280d4d0ec HBASE-468 Move HStoreKey back to o.a.h.h
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630605 13f79535-47bb-0310-9956-ffa450edef68
2008-02-24 09:22:10 +00:00
Bryan Duxbury 8e6a233085 HBASE-464 HBASE-419 introduced javadoc errors
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630556 13f79535-47bb-0310-9956-ffa450edef68
2008-02-24 00:36:10 +00:00
Jim Kellerman 30e6c8c070 HBASE-462 Update migration tool
Other miscellaneous changes included:

IdentityTableReduce
- Added SuppressWarnings("unused") for reporter argument
- Removed unnecessary cast.
AbstractMergeTestBase
- Removed unnecessary compaction
StaticTestEnvironment
- Change logging level for client connections which are too noisy in most cases
TestBloomFilters
- Removed unnecessary config settings
- Modified to use BatchUpdate instead of deprecated startUpdate, etc.
TestScannerAPI
- Modified to use BatchUpdate instead of deprecated startUpdate, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630394 13f79535-47bb-0310-9956-ffa450edef68
2008-02-23 06:11:44 +00:00
Jim Kellerman c180c47e3f HBASE-461 Simplify leases.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630389 13f79535-47bb-0310-9956-ffa450edef68
2008-02-23 04:44:11 +00:00
Jim Kellerman f876238940 HBASE-460 TestMigrate broken when HBase moved to subproject
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630383 13f79535-47bb-0310-9956-ffa450edef68
2008-02-23 03:18:44 +00:00
Michael Stack 9b37593ad6 HBASE-79 When HBase needs to be migrated, it should display a message on
stdout, not just in the logs


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@629203 13f79535-47bb-0310-9956-ffa450edef68
2008-02-19 19:38:37 +00:00
Michael Stack 377fb93ca7 HBASE-428 Under continuous upload of rows, WrongRegionExceptions are thrown
that reach the client even after retries
Applied to TRUNK and branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@629192 13f79535-47bb-0310-9956-ffa450edef68
2008-02-19 19:03:57 +00:00
Bryan Duxbury e714fed123 HBASE-8 [hbase] Delete table does not remove the table directory in the FS
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@629175 13f79535-47bb-0310-9956-ffa450edef68
2008-02-19 18:16:00 +00:00
Bryan Duxbury 1f99a440f1 HBASE-448 Add missing name mark
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@628899 13f79535-47bb-0310-9956-ffa450edef68
2008-02-18 22:33:23 +00:00
Bryan Duxbury 51a7b53e5b 414 Move client classes into client package
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627918 13f79535-47bb-0310-9956-ffa450edef68
2008-02-15 00:29:04 +00:00
Jim Kellerman 21932c5981 HBASE-446 Fully qualified hbase.rootdir doesn't work
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627837 13f79535-47bb-0310-9956-ffa450edef68
2008-02-14 18:49:00 +00:00
Bryan Duxbury dd19c18e76 HBASE-438 XMLOutputter state should be initialized.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627592 13f79535-47bb-0310-9956-ffa450edef68
2008-02-13 21:09:01 +00:00
Bryan Duxbury 6b8c95d8cd HBASE-444 hbase is very slow at determining table is not present
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627585 13f79535-47bb-0310-9956-ffa450edef68
2008-02-13 20:31:17 +00:00
Bryan Duxbury 3067b43dc2 HBASE-407 Client should cache region locations in an LRU structure
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627573 13f79535-47bb-0310-9956-ffa450edef68
2008-02-13 19:30:26 +00:00
Jim Kellerman 77886ac7af HBASE-434, HBASE-435 TestTableIndex and TestTableMapReduce failed in Hudson builds
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627197 13f79535-47bb-0310-9956-ffa450edef68
2008-02-13 00:18:29 +00:00
Jim Kellerman e6c687d159 HBASE-43[45] TestTableIndex and TestTableMapReduce failed in Hudson builds
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627195 13f79535-47bb-0310-9956-ffa450edef68
2008-02-13 00:09:52 +00:00
Jim Kellerman 8b2c345d4c HBASE-440 Add optional log roll interval so that log files are garbage collected
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627152 13f79535-47bb-0310-9956-ffa450edef68
2008-02-12 22:19:24 +00:00
Michael Stack ef9a7c1017 HBASE-417 Factor TableOperation and subclasses into separate files from HMaster
HBASE-439 Add hbase logs path to svn:ignore list


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620706 13f79535-47bb-0310-9956-ffa450edef68
2008-02-12 06:19:46 +00:00
Michael Stack c486b1a8aa HBASE-436 website: http://hadoop.apache.org/hbase/
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620677 13f79535-47bb-0310-9956-ffa450edef68
2008-02-12 00:18:10 +00:00
Michael Stack fcc06c0fef HBASE-437 Clear Command should use system.out
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620531 13f79535-47bb-0310-9956-ffa450edef68
2008-02-11 17:25:50 +00:00
Jim Kellerman e1871f874b HBASE-410 Speed up the test suite - Apparently test timeout was too aggressive for Hudson. TestLogRolling timed out even though it was operating properly. Change test timeout to 10 minutes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620232 13f79535-47bb-0310-9956-ffa450edef68
2008-02-10 01:52:53 +00:00
Michael Stack 8dafaa567a HBASE-426 hbase can't find remote filesystem
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620058 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 01:43:59 +00:00
Michael Stack 7058eb734d HBASE-418 Move HMaster and related classes into master package
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619989 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 20:29:01 +00:00
Michael Stack 2c59895f0b HBASE-406 Remove HTable and HConnection close methods
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619985 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 19:59:21 +00:00
Jim Kellerman b2be058d68 HBASE-421 TestRegionServerExit broken
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619768 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 04:58:00 +00:00
Michael Stack ea98b03b76 HBASE-3 rest server: configure number of threads for jetty
HBASE-416 Add apache-style logging to REST server and add setting log level, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619694 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 00:10:45 +00:00
Michael Stack 655065bcca HBASE-425 Fix doc. so it accomodates new hbase untethered context
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619689 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 23:48:19 +00:00
Michael Stack aa12579a3c HBASE-56 Unnecessary HQLClient Object creation in a shell loop
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619678 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 22:49:37 +00:00
Michael Stack 93a31f6a16 HBASE-2 hlog numbers should wrap around when they reach 999
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619657 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 21:48:58 +00:00
Michael Stack 1d831be81a HBASE-281 Shell should allow deletions in .META. and -ROOT- tables
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619656 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 21:45:44 +00:00
Michael Stack 97f0bea9d0 HBASE-28 thrift put/mutateRow methods need to throw IllegalArgument exceptions
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619638 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 21:08:12 +00:00
Jim Kellerman 1bfcf5a813 HBASE-410 Speed up the test suite (make test timeout 5 minutes instead of 15.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619635 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 20:57:23 +00:00
Michael Stack 51707644ed HBASE-19 CountingBloomFilter can overflow its storage
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619620 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 20:10:40 +00:00
Michael Stack d400b2d941 HBASE-409 Add build path to svn:ignore list
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619617 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 20:08:29 +00:00