Schema Management
Using Vitess requires you to work with two different types of schemas:
- The MySQL database schema. This is the schema of the individual MySQL instances.
- The VSchema, which describes all the keyspaces and how they're sharded.
The workflow for the VSchema
is as follows:
- Apply the
VSchema
for each keyspace using theApplyVschema
command. This saves the VSchemas in the global topology service. - Execute
RebuildVSchemaGraph
for each cell (or all cells). This command propagates a denormalized version of the combined VSchema to all the specified cells. The main purpose for this propagation is to minimize the dependency of each cell from the global topology. The ability to push a change to only specific cells allows you to canary the change to make sure that it's good before deploying it everywhere.
This document describes the vtctl
commands that you can use to review or update your schema in Vitess.
Note that this functionality is not recommended for long-running schema changes. It is recommended to use a tool such as pt-online-schema-change
or gh-ost
instead.
Reviewing your schema #
This section describes the following vtctl commands, which let you look at the schema and validate its consistency across tablets or shards:
GetSchema #
The GetSchema command displays the full schema for a tablet or a subset of the tablet's tables. When you call GetSchema
, you specify the tablet alias that uniquely identifies the tablet. The <tablet alias>
argument value has the format <cell name>-<uid>
.
Note: You can use the vtctl ListAllTablets
command to retrieve a list of tablets in a cell and their unique IDs.
The following example retrieves the schema for the tablet with the unique ID test-000000100:
GetSchema test-000000100
ValidateSchemaShard #
The ValidateSchemaShard
command confirms that for a given keyspace, all of the replica tablets in a specified shard have the same schema as the primary tablet in that shard. When you call ValidateSchemaShard
, you specify both the keyspace and the shard that you are validating.
The following command confirms that the primary and replica tablets in shard 0
all have the same schema for the user
keyspace:
ValidateSchemaShard user/0
ValidateSchemaKeyspace #
The ValidateSchemaKeyspace
command confirms that all of the tablets in a given keyspace have the the same schema as the primary tablet on shard 0
in that keyspace. Thus, whereas the ValidateSchemaShard
command confirms the consistency of the schema on tablets within a shard for a given keyspace, ValidateSchemaKeyspace
confirms the consistency across all tablets in all shards for that keyspace.
The following command confirms that all tablets in all shards have the same schema as the primary tablet in shard 0 for the user keyspace:
ValidateSchemaKeyspace user
GetVSchema #
The GetVSchema
command displays the global VSchema for the specified keyspace.
GetSrvVSchema #
The GetSrvVSchema
command displays the combined VSchema for a given cell.
Changing your schema #
This section describes the following commands:
ApplySchema #
Vitess' schema modification functionality is designed the following goals in mind:
- Enable simple updates that propagate to your entire fleet of servers.
- Require minimal human interaction.
- Minimize errors by testing changes against a temporary database.
- Guarantee very little downtime (or no downtime) for most schema updates.
- Do not store permanent schema data in the topology service.
Note that, at this time, Vitess only supports data definition statements that create, modify, or delete database tables. For instance, ApplySchema
does not affect stored procedures or grants.
The ApplySchema command applies a schema change to the specified keyspace on every primary tablet, running in parallel on all shards. Changes are then propagated to replicas. The command format is: ApplySchema {-sql=<sql> || -sql_file=<filename>} <keyspace>
When the ApplySchema
action actually applies a schema change to the specified keyspace, it performs the following steps:
- It finds shards that belong to the keyspace, including newly added shards if a resharding event has taken place.
- It validates the SQL syntax and determines the impact of the schema change. If the scope of the change is too large, Vitess rejects it. See the permitted schema changes section for more detail.
- It employs a pre-flight check to ensure that a schema update will succeed before the change is actually applied to the live database. In this stage, Vitess copies the current schema into a temporary database, applies the change there to validate it, and retrieves the resulting schema. By doing so, Vitess verifies that the change succeeds without actually touching live database tables.
- It applies the SQL command on the primary tablet in each shard.
The following sample command applies the SQL in the user_table.sql file to the user keyspace:
ApplySchema -sql_file=user_table.sql user
Permitted schema changes #
The ApplySchema
command supports a limited set of DDL statements. In addition, Vitess rejects some schema changes because large changes can slow replication and may reduce the availability of your overall system.
The following list identifies types of DDL statements that Vitess supports:
CREATE TABLE
CREATE INDEX
CREATE VIEW
ALTER TABLE
ALTER VIEW
RENAME TABLE
DROP TABLE
DROP INDEX
DROP VIEW
In addition, Vitess applies the following rules when assessing the impact of a potential change:
DROP
statements are always allowed, regardless of the table's size.ALTER
statements are only allowed if the table on the shard's primary tablet has 100,000 rows or less.- For all other statements, the table on the shard's primary tablet must have 2 million rows or less.
If a schema change gets rejected because it affects too many rows, you can specify the flag -allow_long_unavailability
to tell ApplySchema
to skip this check. However, we do not recommend this. Instead, you should apply large schema changes by using an external tool such as gh-ost
or pt-online-schema-change
.
ApplyVSchema #
The ApplyVSchema
command applies the specified VSchema to the keyspace. The VSchema can be specified as a string or in a file.
RebuildVSchemaGraph #
The RebuildVSchemaGraph
command propagates the global VSchema to a specific cell or the list of specified cells.