Airbyte Databases Data Catalog

Config Database

active_declarative_manifest

Column Name	Datatype	Description
actor_definition_id	UUID	Primary key. References the actor_definition table.
version	BIGINT	Version of the manifest.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last updated.

Indexes and Constraints

• Primary Key: (actor_definition_id)
• Foreign Key: actor_definition_id references actor_definition(id)

---

actor

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the actor.
workspace_id	UUID	Foreign key referencing the workspace table.
actor_definition_id	UUID	Foreign key referencing actor_definition table.
name	VARCHAR(256)	Name of the actor.
configuration	JSONB	Configuration JSON blob specific to the actor.
actor_type	ENUM	Indicates whether the actor is a source or destination.
tombstone	BOOLEAN	Soft delete flag.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last updated.
resource_requirements	JSONB	Defines resource requirements for the actor.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: workspace_id references workspace(id)
• Foreign Key: actor_definition_id references actor_definition(id)
• Index: actor_definition_id_idx on (actor_definition_id)
• Index: actor_workspace_id_idx on (workspace_id)

---

actor_catalog

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the catalog.
catalog	JSONB	JSON representation of the catalog.
catalog_hash	VARCHAR(32)	Hash of the catalog for quick comparison.
created_at	TIMESTAMP	Timestamp when the record was created.
modified_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Index: actor_catalog_catalog_hash_id_idx on (catalog_hash)

---

actor_catalog_fetch_event

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the fetch event.
actor_catalog_id	UUID	Foreign key referencing actor_catalog(id).
actor_id	UUID	Foreign key referencing actor(id).
config_hash	VARCHAR(32)	Hash of the configuration at the time of the fetch.
actor_version	VARCHAR(256)	Version of the actor definition when the fetch occurred.
created_at	TIMESTAMP	Timestamp when the record was created.
modified_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: actor_catalog_id references actor_catalog(id)
• Foreign Key: actor_id references actor(id)
• Index: actor_catalog_fetch_event_actor_catalog_id_idx on (actor_catalog_id)
• Index: actor_catalog_fetch_event_actor_id_idx on (actor_id)

---

actor_definition

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the actor definition.
name	VARCHAR(256)	Name of the connector.
icon	VARCHAR(256)	Icon for the connector.
actor_type	ENUM	Indicates whether the actor is a source or destination.
source_type	ENUM	Source category (e.g., API, Database).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
tombstone	BOOLEAN	Soft delete flag.
resource_requirements	JSONB	Defines default resource requirements.
public	BOOLEAN	Determines if the definition is publicly available.
custom	BOOLEAN	Indicates if the connector is user-defined.
max_seconds_between_messages	INT	Maximum allowed seconds between messages.
default_version_id	UUID	Foreign key referencing actor_definition_version(id).
icon_url	VARCHAR(256)	URL of the icon image.
metrics	JSONB	Metadata about the connector.
enterprise	BOOLEAN	Whether the connector is part of the enterprise edition.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: default_version_id references actor_definition_version(id)

---

actor_definition_breaking_change

Column Name	Datatype	Description
actor_definition_id	UUID	Foreign key referencing actor_definition(id).
version	VARCHAR(256)	Version of the breaking change.
migration_documentation_url	VARCHAR(256)	URL linking to migration documentation.
upgrade_deadline	DATE	Deadline for upgrading to the new version.
message	TEXT	Description of the breaking change.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
scoped_impact	JSONB	JSON object describing the impact scope.
deadline_action	VARCHAR(256)	Action required before the deadline.

Indexes and Constraints

• Primary Key: (actor_definition_id, version)
• Foreign Key: actor_definition_id references actor_definition(id)

---

actor_definition_config_injection

Column Name	Datatype	Description
json_to_inject	JSONB	JSON configuration to inject.
injection_path	VARCHAR	Path where the injection applies.
actor_definition_id	UUID	Foreign key referencing actor_definition(id).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (actor_definition_id, injection_path)
• Foreign Key: actor_definition_id references actor_definition(id)

---

actor_definition_version

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the version.
actor_definition_id	UUID	Foreign key referencing actor_definition(id).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
documentation_url	VARCHAR(256)	Documentation URL for this version.
docker_repository	VARCHAR(256)	Docker repository name.
docker_image_tag	VARCHAR(256)	Docker image tag for this version.
spec	JSONB	Specification JSON blob.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: actor_definition_id references actor_definition(id)
• Unique Constraint: actor_definition_id, docker_image_tag

---

actor_definition_workspace_grant

Column Name	Datatype	Description
actor_definition_id	UUID	Foreign key referencing actor_definition(id).
workspace_id	UUID	Foreign key referencing workspace(id).
scope_id	UUID	Scope identifier.

Indexes and Constraints

• Unique Constraint: actor_definition_id, scope_id, scope_type

---

actor_oauth_parameter

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier.
workspace_id	UUID	Foreign key referencing workspace(id).
actor_definition_id	UUID	Foreign key referencing actor_definition(id).

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: workspace_id references workspace(id)
• Foreign Key: actor_definition_id references actor_definition(id)

---

airbyte_configs_migrations

Column Name	Datatype	Description
installed_rank	INT	Primary key. Rank of the installed migration.
version	VARCHAR(50)	Version number of the migration.
description	VARCHAR(200)	Description of the migration.
type	VARCHAR(20)	Type of migration.
script	VARCHAR(1000)	Script executed for the migration.
checksum	INT	Checksum of the migration script.
installed_by	VARCHAR(100)	User who installed the migration.
installed_on	TIMESTAMP	Timestamp when the migration was installed.
execution_time	INT	Time taken to execute the migration.
success	BOOLEAN	Indicates whether the migration was successful.

Indexes and Constraints

• Primary Key: (installed_rank)

---

application

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the application.
user_id	UUID	Foreign key referencing user(id).
name	VARCHAR	Name of the application.
client_id	VARCHAR	Client ID for authentication.
client_secret	VARCHAR	Secret key for authentication.
created_at	TIMESTAMP	Timestamp when the record was created.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: user_id references user(id)

---

auth_refresh_token

Column Name	Datatype	Description
value	VARCHAR	Primary key. Refresh token value.
session_id	VARCHAR	ID of the session associated with the token.
revoked	BOOLEAN	Indicates whether the token has been revoked.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (value)
• Unique Constraint: (session_id, value)

---

auth_user

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the auth user.
user_id	UUID	Foreign key referencing user(id).
auth_user_id	VARCHAR	ID of the authenticated user.
auth_provider	ENUM	Authentication provider used.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: user_id references user(id)
• Unique Constraint: (auth_user_id, auth_provider)

---

connection

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the connection.
namespace_definition	ENUM	Defines how the namespace is set.
namespace_format	VARCHAR	Format for the namespace when using custom.
prefix	VARCHAR	Prefix added to destination tables.
source_id	UUID	Foreign key referencing actor(id).
destination_id	UUID	Foreign key referencing actor(id).
name	VARCHAR	Name of the connection.
catalog	JSONB	JSON blob defining the connection catalog.
status	ENUM	Connection status (active, inactive, etc.).
schedule	JSONB	JSON blob defining the connection schedule.
manual	BOOLEAN	Indicates if the connection runs manually.
resource_requirements	JSONB	Resource requirements for the connection.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: source_id references actor(id)
• Foreign Key: destination_id references actor(id)
• Index: connection_source_id_idx on (source_id)
• Index: connection_destination_id_idx on (destination_id)

---

connection_operation

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the record.
connection_id	UUID	Foreign key referencing connection(id).
operation_id	UUID	Foreign key referencing operation(id).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id, connection_id, operation_id)
• Foreign Key: connection_id references connection(id)
• Foreign Key: operation_id references operation(id)
• Index: connection_operation_connection_id_idx on (connection_id)

---

connection_tag

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the record.
tag_id	UUID	Foreign key referencing tag(id).
connection_id	UUID	Foreign key referencing connection(id).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: tag_id references tag(id)
• Foreign Key: connection_id references connection(id)
• Unique Constraint: (tag_id, connection_id)

---

connection_timeline_event

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the event.
connection_id	UUID	Foreign key referencing connection(id).
user_id	UUID	Foreign key referencing user(id).
event_type	VARCHAR	Type of event that occurred.
summary	JSONB	JSON blob containing event details.
created_at	TIMESTAMP	Timestamp when the event occurred.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: connection_id references connection(id)
• Foreign Key: user_id references user(id)
• Index: idx_connection_timeline_connection_id on (connection_id, created_at, event_type)

---

connector_builder_project

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the project.
workspace_id	UUID	Foreign key referencing workspace(id).
name	VARCHAR	Name of the connector project.
manifest_draft	JSONB	JSON draft of the connector manifest.
actor_definition_id	UUID	Foreign key referencing actor_definition(id).
tombstone	BOOLEAN	Indicates if the project is deleted.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
testing_values	JSONB	JSON containing test values for the connector.
base_actor_definition_version_id	UUID	Foreign key referencing actor_definition_version(id).
contribution_pull_request_url	VARCHAR	URL for the contribution PR.
contribution_actor_definition_id	UUID	Foreign key referencing actor_definition(id).
components_file_content	TEXT	Raw content of component files.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: workspace_id references workspace(id)
• Foreign Key: actor_definition_id references actor_definition(id)
• Foreign Key: base_actor_definition_version_id references actor_definition_version(id)
• Foreign Key: contribution_actor_definition_id references actor_definition(id)
• Index: connector_builder_project_workspace_idx on (workspace_id)

---

connector_rollout

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the rollout.
actor_definition_id	UUID	Foreign key referencing actor_definition(id).
release_candidate_version_id	UUID	Foreign key referencing actor_definition_version(id).
initial_version_id	UUID	Foreign key referencing actor_definition_version(id).
state	VARCHAR	Current state of the rollout.
initial_rollout_pct	INT	Initial rollout percentage.
current_target_rollout_pct	INT	Current target rollout percentage.
final_target_rollout_pct	INT	Final target rollout percentage.
has_breaking_changes	BOOLEAN	Indicates if the rollout has breaking changes.
max_step_wait_time_mins	INT	Maximum wait time between rollout steps.
updated_by	UUID	Foreign key referencing user(id).
created_at	TIMESTAMP	Timestamp when the rollout started.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
completed_at	TIMESTAMP	Timestamp when the rollout was completed.
expires_at	TIMESTAMP	Timestamp when the rollout expires.
error_msg	VARCHAR	Error message if the rollout failed.
failed_reason	VARCHAR	Reason for failure.
rollout_strategy	VARCHAR	Strategy used for the rollout.
workflow_run_id	VARCHAR	Workflow run identifier.
paused_reason	VARCHAR	Reason for pausing the rollout.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: actor_definition_id references actor_definition(id)
• Foreign Key: release_candidate_version_id references actor_definition_version(id)
• Foreign Key: initial_version_id references actor_definition_version(id)
• Foreign Key: updated_by references user(id)
• Unique Index: actor_definition_id_state_unique_idx on actor_definition_id
  • Condition: (state in ['errored', 'finalizing', 'in_progress', 'initialized', 'paused', 'workflow_started'])

---

dataplane

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the dataplane.
dataplane_group_id	UUID	Foreign key referencing dataplane_group(id).
name	VARCHAR	Name of the dataplane.
enabled	BOOLEAN	Indicates if the dataplane is enabled.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
updated_by	UUID	Foreign key referencing user(id).
tombstone	BOOLEAN	Indicates if the record is deleted.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: dataplane_group_id references dataplane_group(id)
• Foreign Key: updated_by references user(id)
• Unique Constraint: (dataplane_group_id, name)

---

dataplane_group

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the group.
organization_id	UUID	Foreign key referencing organization(id).
name	VARCHAR	Name of the dataplane group.
enabled	BOOLEAN	Indicates if the group is enabled.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
updated_by	UUID	Foreign key referencing user(id).
tombstone	BOOLEAN	Indicates if the record is deleted.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: organization_id references organization(id)
• Foreign Key: updated_by references user(id)
• Unique Constraint: (organization_id, name)

---

declarative_manifest

Column Name	Datatype	Description
actor_definition_id	UUID	Foreign key referencing actor_definition(id).
description	VARCHAR	Description of the manifest.
manifest	JSONB	JSON representation of the manifest.
spec	JSONB	JSON specification for the manifest.
version	BIGINT	Version number of the manifest.
created_at	TIMESTAMP	Timestamp when the record was created.

Indexes and Constraints

• Primary Key: (actor_definition_id, version)

---

declarative_manifest_image_version

Column Name	Datatype	Description
major_version	INT	Primary key. Major version number.
image_version	VARCHAR	Version of the image.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
image_sha	VARCHAR	SHA checksum of the image.

Indexes and Constraints

• Primary Key: (major_version)

---

notification_configuration

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the notification configuration.
enabled	BOOLEAN	Indicates if the notification is enabled.
notification_type	ENUM	Type of notification.
connection_id	UUID	Foreign key referencing connection(id).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: connection_id references connection(id)

---

operation

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the operation.
workspace_id	UUID	Foreign key referencing workspace(id).
name	VARCHAR	Name of the operation.
operator_type	ENUM	Type of operator (dbt, normalization, etc.).
operator_normalization	JSONB	JSON blob defining normalization settings.
operator_dbt	JSONB	JSON blob defining dbt settings.
tombstone	BOOLEAN	Indicates if the operation is deleted.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
operator_webhook	JSONB	JSON blob defining webhook settings.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: workspace_id references workspace(id)

---

organization

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the organization.
name	VARCHAR	Name of the organization.
user_id	UUID	Foreign key referencing user(id).
email	VARCHAR	Contact email for the organization.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
tombstone	BOOLEAN	Indicates if the organization is deleted.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: user_id references user(id)

---

organization_email_domain

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the record.
organization_id	UUID	Foreign key referencing organization(id).
email_domain	VARCHAR	Email domain associated with the organization.
created_at	TIMESTAMP	Timestamp when the record was created.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: organization_id references organization(id)
• Unique Constraint: (organization_id, email_domain)
• Index: organization_email_domain_organization_id_idx on (organization_id)

---

organization_payment_config

Column Name	Datatype	Description
organization_id	UUID	Primary key. Unique identifier for the organization payment configuration.
payment_provider_id	VARCHAR	Payment provider ID.
payment_status	ENUM	Status of the organization's payment.
grace_period_end_at	TIMESTAMP	End timestamp for the grace period.
usage_category_override	ENUM	Override for usage category.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
subscription_status	ENUM	Status of the organization's subscription.

Indexes and Constraints

• Primary Key: (organization_id)
• Unique Constraint: (payment_provider_id)
• Foreign Key: organization_id references organization(id)
• Index: organization_payment_config_payment_status_idx on (payment_status)
• Index: organization_payment_config_payment_provider_id_idx on (payment_provider_id)

---

permission

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the permission.
user_id	UUID	Foreign key referencing user(id).
workspace_id	UUID	Foreign key referencing workspace(id).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
organization_id	UUID	Foreign key referencing organization(id).
permission_type	ENUM	Type of permission assigned.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: user_id references user(id)
• Foreign Key: workspace_id references workspace(id)
• Foreign Key: organization_id references organization(id)
• Unique Constraint: (user_id, organization_id)
• Unique Constraint: (user_id, workspace_id)
• Index: permission_organization_id_idx on (organization_id)
• Index: permission_workspace_id_idx on (workspace_id)

---

schema_management

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for schema management.
connection_id	UUID	Foreign key referencing connection(id).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
auto_propagation_status	ENUM	Status of automatic schema propagation.
backfill_preference	ENUM	User preference for backfill operations.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: connection_id references connection(id)
• Index: connection_idx on (connection_id)

---

scoped_configuration

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the scoped configuration.
key	VARCHAR	Configuration key.
resource_type	ENUM	Type of resource associated with the configuration.
resource_id	UUID	Identifier of the associated resource.
scope_type	ENUM	Type of scope (e.g., workspace, organization).
scope_id	UUID	Identifier for the scope of the configuration.
value	VARCHAR	Value of the configuration.
description	TEXT	Description of the configuration setting.
reference_url	VARCHAR	URL reference for more information.
origin_type	ENUM	Type of origin for the configuration setting.
origin	VARCHAR	Source of the configuration setting.
expires_at	DATE	Expiration date of the configuration.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Unique Constraint: (key, resource_type, resource_id, scope_type, scope_id)

---

secret_persistence_config

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for secret persistence configuration.
scope_id	UUID	Identifier for the scope of the secret.
scope_type	ENUM	Scope type (organization, workspace, etc.).
secret_persistence_config_coordinate	VARCHAR	Coordinate for secret persistence configuration.
secret_persistence_type	ENUM	Type of secret persistence method.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Unique Constraint: (scope_id, scope_type)

---

sso_config

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the SSO configuration.
organization_id	UUID	Foreign key referencing organization(id).
keycloak_realm	VARCHAR	Keycloak realm associated with the organization.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: organization_id references organization(id)
• Unique Constraint: (keycloak_realm)
• Unique Constraint: (organization_id)
• Index: sso_config_keycloak_realm_idx on (keycloak_realm)
• Index: sso_config_organization_id_idx on (organization_id)

---

state

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the state record.
connection_id	UUID	Foreign key referencing connection(id).
state	JSONB	JSON blob storing the state information.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
stream_name	TEXT	Name of the stream associated with this state.
namespace	TEXT	Namespace of the stream.
type	ENUM	Type of state (STREAM, GLOBAL, LEGACY).

Indexes and Constraints

• Primary Key: (id, connection_id)
• Foreign Key: connection_id references connection(id)
• Unique Constraint: (connection_id, stream_name, namespace)

---

stream_generation

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the stream generation record.
connection_id	UUID	Foreign key referencing connection(id).
stream_name	VARCHAR	Name of the stream.
stream_namespace	VARCHAR	Namespace of the stream.
generation_id	BIGINT	Identifier for the stream generation.
start_job_id	BIGINT	Job ID that started this stream generation.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: connection_id references connection(id)
• Index: stream_generation_connection_id_stream_name_generation_id_idx on (connection_id, stream_name, generation_id)
• Index: stream_generation_connection_id_stream_name_stream_namespace_idx on (connection_id, stream_name, stream_namespace, generation_id)

---

stream_refreshes

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the stream refresh record.
connection_id	UUID	Foreign key referencing connection(id).
stream_name	VARCHAR	Name of the stream.
stream_namespace	VARCHAR	Namespace of the stream.
created_at	TIMESTAMP	Timestamp when the record was created.
refresh_type	ENUM	Type of refresh operation performed.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: connection_id references connection(id)
• Index: stream_refreshes_connection_id_idx on (connection_id)
• Index: stream_refreshes_connection_id_stream_name_idx on (connection_id, stream_name)
• Index: stream_refreshes_connection_id_stream_name_stream_namespace_idx on (connection_id, stream_name, stream_namespace)

---

stream_reset

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the stream reset record.
connection_id	UUID	Foreign key referencing connection(id).
stream_namespace	TEXT	Namespace of the stream.
stream_name	TEXT	Name of the stream being reset.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: connection_id references connection(id)
• Unique Constraint: (connection_id, stream_name, stream_namespace)
• Index: connection_id_stream_name_namespace_idx on (connection_id, stream_name, stream_namespace)

---

tag

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the tag.
workspace_id	UUID	Foreign key referencing workspace(id).
name	VARCHAR	Name of the tag.
color	CHAR(6)	Hexadecimal color code for the tag.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: workspace_id references workspace(id)
• Unique Constraint: (name, workspace_id)
• Index: tag_workspace_id_idx on (workspace_id)

---

user

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the user.
name	VARCHAR	Name of the user.
default_workspace_id	UUID	Foreign key referencing workspace(id).
status	ENUM	Status of the user account.
company_name	VARCHAR	Name of the company associated with the user.
email	VARCHAR	Email address of the user.
news	BOOLEAN	Whether the user subscribes to newsletters.
ui_metadata	JSONB	UI metadata associated with the user.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: default_workspace_id references workspace(id)
• Unique Constraint: (email)
• Index: user_email_idx on (email)
• Unique Index: user_email_unique_key on lower(email)

---

user_invitation

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the invitation.
invite_code	VARCHAR	Unique code for the invitation.
inviter_user_id	UUID	Foreign key referencing user(id).
invited_email	VARCHAR	Email of the invited user.
permission_type	ENUM	Type of permission granted to the invited user.
status	ENUM	Status of the invitation (pending, accepted, etc.).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
scope_id	UUID	Scope ID for the invitation.
scope_type	ENUM	Type of scope (organization, workspace, etc.).
accepted_by_user_id	UUID	Foreign key referencing user(id).
expires_at	TIMESTAMP	Expiration timestamp of the invitation.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: inviter_user_id references user(id)
• Foreign Key: accepted_by_user_id references user(id)
• Unique Constraint: (invite_code)
• Index: user_invitation_invite_code_idx on (invite_code)
• Index: user_invitation_invited_email_idx on (invited_email)
• Index: user_invitation_scope_id_index on (scope_id)
• Index: user_invitation_scope_type_and_scope_id_index on (scope_type, scope_id)
• Index: user_invitation_accepted_by_user_id_index on (accepted_by_user_id)
• Index: user_invitation_expires_at_index on (expires_at)

---

workload

Column Name	Datatype	Description
id	VARCHAR	Primary key. Unique identifier for the workload.
dataplane_id	VARCHAR	Identifier for the dataplane handling this workload.
status	ENUM	Status of the workload (pending, running, etc.).
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
last_heartbeat_at	TIMESTAMP	Timestamp of the last heartbeat received.
input_payload	TEXT	Payload associated with the workload.
log_path	TEXT	Path to logs for the workload.
geography	VARCHAR	Geography associated with the workload.
mutex_key	VARCHAR	Mutex key used for workload execution control.
type	ENUM	Type of workload being processed.
termination_source	VARCHAR	Source that terminated the workload.
termination_reason	TEXT	Reason for workload termination.
auto_id	UUID	Auto-generated identifier for the workload.
deadline	TIMESTAMP	Deadline for workload execution.
signal_input	TEXT	Signal input for the workload.
dataplane_group	VARCHAR	Dataplane group associated with the workload.
priority	INT	Priority level of the workload.

Indexes and Constraints

• Primary Key: (id)
• Index: active_workload_by_mutex_idx on (mutex_key) where (status is active)
• Index: workload_deadline_idx on (deadline) where (deadline IS NOT NULL)
• Index: workload_mutex_idx on (mutex_key)
• Index: workload_status_idx on (status)

---

workload_label

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the label.
workload_id	VARCHAR	Foreign key referencing workload(id).
key	VARCHAR	Label key.
value	VARCHAR	Label value.

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: workload_id references workload(id)
• Unique Constraint: (workload_id, key)
• Index: workload_label_workload_id_idx on (workload_id)

---

workspace

Column Name	Datatype	Description
id	UUID	Primary key. Unique identifier for the workspace.
customer_id	UUID	Customer associated with the workspace.
name	VARCHAR	Name of the workspace.
slug	VARCHAR	Slug identifier for the workspace.
email	VARCHAR	Contact email for the workspace.
initial_setup_complete	BOOLEAN	Whether the initial setup is complete.
anonymous_data_collection	BOOLEAN	Whether anonymous data collection is enabled.
send_newsletter	BOOLEAN	Whether the user is subscribed to newsletters.
send_security_updates	BOOLEAN	Whether security updates are sent.
display_setup_wizard	BOOLEAN	Whether the setup wizard should be displayed.
tombstone	BOOLEAN	Whether the workspace is deleted.
notifications	JSONB	Notification settings.
first_sync_complete	BOOLEAN	Whether the first sync has completed.
feedback_complete	BOOLEAN	Whether feedback collection is completed.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.
geography	ENUM	Geography associated with the workspace.
webhook_operation_configs	JSONB	Webhook operation configurations.
notification_settings	JSONB	Notification settings for the workspace.
organization_id	UUID	Foreign key referencing organization(id).

Indexes and Constraints

• Primary Key: (id)
• Foreign Key: organization_id references organization(id)

---

workspace_service_account

Column Name	Datatype	Description
workspace_id	UUID	Foreign key referencing workspace(id).
service_account_id	VARCHAR	Service account ID.
service_account_email	VARCHAR	Email associated with the service account.
json_credential	JSONB	JSON blob storing credentials.
hmac_key	JSONB	JSON blob storing HMAC keys.
created_at	TIMESTAMP	Timestamp when the record was created.
updated_at	TIMESTAMP	Timestamp when the record was last modified.

Indexes and Constraints

• Primary Key: (workspace_id, service_account_id)
• Foreign Key: workspace_id references workspace(id)

Jobs Database

jobs

Column Name	Datatype	Description
id	bigint	Primary key, uniquely identifies a job.
config_type	job_config_type	Type of job (sync, reset).
scope	varchar(255)	Identifier for the connection or scope of the job.
config	jsonb	JSON blob containing job configuration.
status	job_status	Current status of the job (running, failed, succeeded, etc.).
started_at	timestamp(6) with time zone	Timestamp when the job started.
created_at	timestamp(6) with time zone	Timestamp when the job was created.
updated_at	timestamp(6) with time zone	Timestamp when the job was last updated.
metadata	jsonb	JSON blob containing metadata for the job.
is_scheduled	boolean	Whether the job was scheduled automatically (default: true).

Indexes & Constraints

• Primary Key: id
• Indexes:
  • jobs_config_type_idx → (config_type)
  • jobs_scope_idx → (scope)
  • jobs_status_idx → (status)
  • jobs_updated_at_idx → (updated_at)
  • scope_created_at_idx → (scope, created_at DESC)
  • scope_non_terminal_status_idx → (scope, status) (only for non-terminal statuses: not failed, succeeded, or cancelled)

---

attempts

Column Name	Datatype	Description
id	bigint	Primary key, uniquely identifies an attempt.
job_id	bigint	Foreign key to jobs(id), linking the attempt to a job.
attempt_number	int	Number of the attempt for a given job.
log_path	varchar(255)	Path where logs for this attempt are stored.
output	jsonb	JSON blob containing the attempt's output details.
status	attempt_status	Status of the attempt (running, failed, succeeded).
created_at	timestamp(6) with time zone	Timestamp when the attempt was created.
updated_at	timestamp(6) with time zone	Timestamp when the attempt was last updated.
ended_at	timestamp(6) with time zone	Timestamp when the attempt ended.
failure_summary	jsonb	JSON blob containing failure reason details.
processing_task_queue	varchar(255)	Task queue identifier for processing.
attempt_sync_config	jsonb	JSON blob for sync configuration.

Indexes & Constraints

• Primary Key: id
• Foreign Key: job_id → jobs(id)
• Indexes:
  • attempts_status_idx → (status)
  • job_attempt_idx → (job_id, attempt_number) (Unique)

---

airbyte_metadata

Column Name	Datatype	Description
key	varchar(255)	Primary key, uniquely identifies a metadata key.
value	varchar(255)	Value associated with the key.

Indexes & Constraints

• Primary Key: key

---

airbyte_jobs_migrations

Column Name	Datatype	Description
installed_rank	int	Primary key, rank of migration execution.
version	varchar(50)	Version number of the migration.
description	varchar(200)	Description of the migration.
type	varchar(20)	Type of migration.
script	varchar(1000)	Name of the migration script.
checksum	int	Checksum of the migration script.
installed_by	varchar(100)	User who installed the migration.
installed_on	timestamp(6)	Timestamp when migration was installed.
execution_time	int	Execution time in milliseconds.
success	boolean	Whether the migration succeeded.

Indexes & Constraints

• Primary Key: installed_rank
• Indexes:
  • airbyte_jobs_migrations_s_idx → (success)

---

normalization_summaries

Column Name	Datatype	Description
id	uuid	Primary key, uniquely identifies a normalization summary.
attempt_id	bigint	Foreign key to attempts(id).
start_time	timestamp(6) with time zone	Start time of the normalization process.
end_time	timestamp(6) with time zone	End time of the normalization process.
failures	jsonb	JSON blob containing failure details.
created_at	timestamp(6) with time zone	Timestamp when the summary was created.
updated_at	timestamp(6) with time zone	Timestamp when the summary was last updated.

Indexes & Constraints

• Primary Key: id
• Foreign Key: attempt_id → attempts(id)
• Indexes:
  • normalization_summary_attempt_id_idx → (attempt_id)