gotosocial/internal/db/bundb/migrations
kim 23fc70f4e6
[feature] add support for receiving federated status edits (#3597)
* add support for extracting Updated field from Statusable implementers

* add support for status edits in the database, and update status dereferencer to handle them

* remove unused AdditionalInfo{}.CreatedAt

* remove unused AdditionalEmojiInfo{}.CreatedAt

* update new mention creation to use status.UpdatedAt

* remove mention.UpdatedAt, fixes related to NewULIDFromTime() change

* add migration to remove Mention{}.UpdatedAt field

* add migration to add the StatusEdit{} table

* start adding tests, add delete function for status edits

* add more of status edit migrations, fill in more of the necessary edit delete functionality

* remove unused function

* allow generating gotosocial compatible ulid via CLI with `go run ./cmd/gen-ulid`

* add StatusEdit{} test models

* fix new statusedits sql

* use model instead of table name

* actually remove the Mention.UpdatedAt field...

* fix tests now new models are added, add more status edit DB tests

* fix panic wording

* add test for deleting status edits

* don't automatically set `updated_at` field on updated statuses

* flesh out more of the dereferencer status edit tests, ensure updated at field set on outgoing AS statuses

* remove media_attachments.updated_at column

* fix up more tests, further complete the dereferencer status edit tests

* update more status serialization tests not expecting 'updated' AS property

* gah!! json serialization tests!!

* undo some gtscontext wrapping changes

* more serialization test fixing 🥲

* more test fixing, ensure the edit.status_id field is actually set 🤦

* fix status edit test

* grrr linter

* add edited_at field to apimodel status

* remove the choice of paging on the timeline public filtered test (otherwise it needs updating every time you add statuses ...)

* ensure that status.updated_at always fits chronologically

* fix more serialization tests ...

* add more code comments

* fix envparsing

* update swagger file

* properly handle media description changes during status edits

* slight formatting tweak

* code comment
2024-12-05 13:35:07 +00:00
..
20211113114307_init
20220214175650_media_cleanup
20220315160814_admin_account_actions
20220905150505_custom_emoji_updates
20230328203024_migration_fix
20230521105850_emoji_empty_domain_fix
20231002153327_add_status_polls [performance] convert enum strings to ints (#3558) 2024-11-25 14:48:59 +01:00
20240126064004_add_filters [bugfix] Fix filter title unique constraint (#3458) 2024-10-19 11:04:07 +02:00
20240318115336_account_settings
20240620074530_interaction_policy [performance] convert enum strings to ints (#3558) 2024-11-25 14:48:59 +01:00
20240715204203_media_pipeline_improvements
20240904084406_fedi_api_reject_interaction [performance] convert enum strings to ints (#3558) 2024-11-25 14:48:59 +01:00
20241113152126_add_status_edits [feature] add support for receiving federated status edits (#3597) 2024-12-05 13:35:07 +00:00
20241121121623_enum_strings_to_ints [performance] convert enum strings to ints (#3558) 2024-11-25 14:48:59 +01:00
20211113114307_init.go
20220214175650_media_cleanup.go
20220305130328_database_optimizations.go
20220315160814_admin_account_actions.go
20220502113806_add_missing_indexes.go
20220506110822_add_account_raw_note.go
20220511165212_add_account_raw_note_fix.go
20220518123621_additional_indexing.go
20220612091800_duplicated_media_cleanup.go
20220710153020_fix_slow_web_profile_queries.go
20220804120132_account_default_post_format.go
20220823140228_user_custom_css.go
20220827085121_assign_missing_in_reply_to_uris.go
20220830014732_regenerate_indexes_for_follows.go
20220903141016_store_gifs_as_image.go
20220905150505_custom_emoji_updates.go
20220916122701_emojis_in_accounts.go
20220922142408_shared_inbox_delivery.go
20220926115233_indexes.go
20221006114842_add_rss_functionality.go
20221011125732_refetch_updated_emojis.go
20221031145649_emoji_categories.go
20221103203553_add_external_id.go
20221108142419_create_account_tombstones.go
20221220134514_mp4_jiggery_pokery.go
20230105171144_report_model.go
20230126170719_format_to_content_type.go
20230202212700_rename_account_webfingered_to_fetched.go
20230221150957_status_pin_client_api.go
20230328203024_migration_fix.go
20230405130021_status_fave_unique_constraints.go
20230430105735_fieldwork.go
20230511181430_add_status_fetched_at.go
20230515173919_lists.go
20230521105850_emoji_empty_domain_fix.go
20230620103932_search_updates.go
20230711214815_account_notes.go
20230713025939_markers_api.go
20230718161520_hashtaggery.go
20230724100000_emoji_cleanup.go
20230815164500_rules_model.go
20230817174700_add_report_rule_ids.go
20230821075342_attachment_cleanup_updates.go
20230828101322_admin_action_locking.go [chore] rename New___(string) int signature functions to Parse___(string) int (#3580) 2024-11-28 12:54:22 +01:00
20230905133904_remote_pubkey_expiry.go
20230908083121_allowlist.go.go
20231002153327_add_status_polls.go [performance] convert enum strings to ints (#3558) 2024-11-25 14:48:59 +01:00
20231016113235_mute_status_thread.go
20231029143819_remove_suspended_at_index.go
20231110142330_small_poll_table_tweaks.go
20231128140847_remove_duplicate_indices.go
20231130103643_fix_index_whoopsie.go
20231208152242_sqlite_analyze.go
20231212144715_add_header_filters.go
20231215115920_add_status_poll_index.go
20231227110845_instance_description_updates.go
20240103170945_moved_to_also_known_as.go
20240114112637_postgres_header_filter_fix.go
20240126064004_add_filters.go [bugfix] Fix filter title unique constraint (#3458) 2024-10-19 11:04:07 +02:00
20240129170725_moved_to_also_known_as.go
20240220204526_add_statuses_mentions_is_null_or_empty_idx.go
20240228113608_readd_statuses_account_id_id_idx.go
20240310120046_fix_empty_move_id.go
20240318115336_account_settings.go
20240320114447_preset_css_themes.go
20240401130338_sign_up.go
20240402113305_nil_domain_fix.go
20240414122348_account_stats_model.go
20240426122821_pageable_admin_accounts.go
20240528071620_add_user_mutes.go
20240611190733_add_conversations.go
20240613091853_drop_unused_media_columns.go
20240617134210_add_worker_tasks_table.go
20240620074530_interaction_policy.go [performance] convert enum strings to ints (#3558) 2024-11-25 14:48:59 +01:00
20240712005536_add_advanced_migrations.go
20240715204203_media_pipeline_improvements.go
20240716151327_interaction_policy.go
20240722222556_remove_boost_content.go
20240725211933_add_followed_tags.go
20240809134448_interaction_requests_client_api.go [feature] add support for receiving federated status edits (#3597) 2024-12-05 13:35:07 +00:00
20240903212842_add_exclusive_lists.go
20240904084406_fedi_api_reject_interaction.go [performance] convert enum strings to ints (#3558) 2024-11-25 14:48:59 +01:00
20240906144432_unauthed_visibility.go.go
20240924222938_add_instance_custom_css.go [feature] Add global instance CSS customization setting (#3352) 2024-12-02 12:24:48 +01:00
20241005100438_interaction_requests_pending_tweak.go
20241011115713_pending_approval_fix.go
20241018151036_filter_unique_fix.go [bugfix] Fix filter title unique constraint (#3458) 2024-10-19 11:04:07 +02:00
20241022153016_domain_permission_draft_exclude.go [feature] Add domain permission drafts and excludes (#3547) 2024-11-21 13:09:58 +00:00
20241113151042_remove_mention_updated_at.go [feature] add support for receiving federated status edits (#3597) 2024-12-05 13:35:07 +00:00
20241113152126_add_status_edits.go [feature] add support for receiving federated status edits (#3597) 2024-12-05 13:35:07 +00:00
20241121121623_enum_strings_to_ints.go [feature] add support for receiving federated status edits (#3597) 2024-12-05 13:35:07 +00:00
20241203124608_remove_media_attachment_updated_at.go [feature] add support for receiving federated status edits (#3597) 2024-12-05 13:35:07 +00:00
main.go
README.md
util.go [feature] add support for receiving federated status edits (#3597) 2024-12-05 13:35:07 +00:00

Migrations

How do I write a migration file?

See here

As a template, take one of the existing migration files and modify it, or use the below code snippet:

// GoToSocial
// Copyright (C) GoToSocial Authors admin@gotosocial.org
// SPDX-License-Identifier: AGPL-3.0-or-later
//
// This program is free software: you can redistribute it and/or modify
// it under the terms of the GNU Affero General Public License as published by
// the Free Software Foundation, either version 3 of the License, or
// (at your option) any later version.
//
// This program is distributed in the hope that it will be useful,
// but WITHOUT ANY WARRANTY; without even the implied warranty of
// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
// GNU Affero General Public License for more details.
//
// You should have received a copy of the GNU Affero General Public License
// along with this program.  If not, see <http://www.gnu.org/licenses/>.

package migrations

import (
    "context"

    "github.com/uptrace/bun"
)

func init() {
    up := func(ctx context.Context, db *bun.DB) error {
        return db.RunInTx(ctx, nil, func(ctx context.Context, tx bun.Tx) error {
            // your logic here
            return nil
        })
    }

    down := func(ctx context.Context, db *bun.DB) error {
        return db.RunInTx(ctx, nil, func(ctx context.Context, tx bun.Tx) error {
            // your logic here
            return nil
        })
    }

    if err := Migrations.Register(up, down); err != nil {
        panic(err)
    }
}

File format

Bun requires a very specific format: 14 digits, then letters or underscores.

You can use the following bash command on your branch to generate a suitable migration filename.

echo "$(date --utc +%Y%m%d%H%M%S | head -c 14)_$(git rev-parse --abbrev-ref HEAD).go"

Rules of thumb

  1. DON'T DROP TABLES!!!!!!!!
  2. Don't make something NOT NULL if it's likely to already contain null fields.