Working with Temporary and Transient Tables¶
In addition to permanent tables, which are the default for creating tables, Snowflake supports defining tables as either temporary or transient. These types of tables are especially useful for storing data that does not need to be maintained for extended periods of time (i.e. transitory data).
In this Topic:
- Temporary Tables
- Transient Tables
- Comparison of Table Types
Snowflake supports creating temporary tables for storing non-permanent, transitory data (e.g. ETL data, session-specific data). Temporary tables only exist within the session in which they were created and only persist for the duration of the session. As such, they are not visible to other users or sessions. Once the session ends, data stored in the table is purged completely from the system and, therefore, is not recoverable, either by the user who created the table or Snowflake.
In addition to tables, Snowflake supports creating certain other database objects as temporary (e.g. stages). These objects follow the same semantics (i.e. they are session-based, persisting only for the duration of the session).
Data Storage Usage for Temporary Tables¶
For the duration of the existence of a temporary table, the data stored in the table contributes to the overall storage charges that Snowflake bills your account. To prevent any unexpected storage changes, particularly if you create large temporary tables in sessions that you maintain for periods longer than 24 hours, Snowflake recommends explicitly dropping these tables once they are no longer needed. You can also explicitly exit the session in which the table was created to ensure no additional charges are accrued.
For more details, see Comparison of Table Types (in this topic).
Potential Naming Conflicts with Other Table Types¶
Similar to the other table types (transient and permanent), temporary tables belong to a specified database and schema; however, because they are session-based, they aren’t bound by the same uniqueness requirements. This means you can create temporary and non-temporary tables with the same name within the same schema.
However, note that the temporary table takes precedence in the session over any other table with the same name in the same schema. This can lead to potential conflicts and unexpected behavior, particularly when performing DDL on both temporary and non-temporary tables. For example:
- You can create a temporary table that has the same name as an existing table in the same schema, effectively hiding the existing table.
- You can create a table that has the same name as an existing temporary table in the same schema; however, the newly-created table is hidden by the temporary table.
Subsequently, all queries and other operations performed in the session on the table affect only the temporary table.
This behavior is particularly important to note when dropping a table in a session and then using Time Travel to restore the table. It is also important to note this behavior when using CREATE OR REPLACE to create a table because this essentially drops a table (if it exists) and creates a new table with the specified definition.
Snowflake supports creating transient tables that persist until explicitly dropped and are available to all users with the appropriate privileges. Transient tables are similar to permanent tables with the key difference that they do not have a Fail-safe period. As a result, transient tables are specifically designed for transitory data that needs to be maintained beyond each session (in contrast to temporary tables), but does not need the same level of data protection and recovery provided by permanent tables.
Data Storage Usage for Transient Tables¶
Similar to permanent tables, transient tables contribute to the overall storage charges that Snowflake bills your account; however, because transient tables do not utilize Fail-safe, there are no Fail-safe costs (i.e. the costs associated with maintaining the data required for Fail-safe disaster recovery).
For more details, see Comparison of Table Types (in this topic).
Transient Databases and Schemas¶
Snowflake also supports creating transient databases and schemas. All tables created in a transient schema, as well as all schemas created in a transient database, are transient by definition.
Creating a Transient Table, Schema, or Database¶
To create a transient table, schema, database, simply specify the TRANSIENT keyword when creating the object:
For example, to create a transient table:
CREATE TRANSIENT TABLE mytranstable (id NUMBER, creation_date DATE);
After creation, transient tables cannot be converted to any other table type.
Comparison of Table Types¶
The following table summarizes the differences between the three table types, particularly with regard to their impact on Time Travel and Fail-safe:
|Type||Persistence||Time Travel Retention Period (Days)||Fail-safe Period (Days)|
|Temporary||Duration of session||0 or 1 (default is 1)||0|
|Transient||Until explicitly dropped||0 or 1 (default is 1)||0|
|Permanent (Standard Edition)||Until explicitly dropped||0 or 1 (default is 1)||7|
|Permanent (Enterprise Edition and higher)||Until explicitly dropped||0 to 90 (default is configurable)||7|
Time Travel Notes¶
- The Time Travel retention period for a table can be specified when the table is created or any time afterwards. Within the retention period, all Time Travel operations can be performed on data in the table (e.g. queries) and the table itself (e.g. cloning and restoration).
- Temporary tables can have a Time Travel retention period of 1 day; however, a temporary table is purged once the session (in which the table was created) ends so the actual retention period is for 24 hours or the duration of the session, whichever is shorter.
- The Fail-safe period is not configurable for any table type.
- Transient and temporary tables have no Fail-safe period. As a result, no additional data storage charges are incurred beyond the Time Travel retention period.
Because transient tables do not have a Fail-safe period, they provide a good option for managing the cost of very large tables used to store transitory data; however, the data in these tables cannot be recovered after the Time Travel retention period passes.
For example, if a system failure occurs in which a transient table is dropped or lost, after 1 day, the data is not recoverable by you or Snowflake. As such, we recommend using transient tables only for data that does not need to be protected against failures or data that can be reconstructed outside of Snowflake.
For more information, see Data Storage Considerations.