Cleaning up orphaned files using undo logs

Edit
ID 3228
Title Cleaning up orphaned files using undo logs
CI (CFBot) Not processed
Stats (from CFBot) Unknown
Topic Server Features
Tags
Created 2021-06-30 17:28:50
Last modified 2022-02-07 03:08:20 (3 years ago)
Latest email 2022-01-12 08:27:26 (4 years ago)
Status
2022-01 (2022-01-01 – 2022-01-31): Returned with feedback
2021-11 (2021-11-01 – 2021-11-30): Moved to different CF
2021-09 (2021-09-01 – 2021-09-30): Moved to different CF
2021-07 (2021-07-01 – 2021-07-31): Moved to different CF
Target version
Authors Antonin Houska (a.houska)
Reviewers Dmitry Dolgov (erthalion)Become reviewer
Committer
Links
Emails
POC: Cleaning up orphaned files using undo logs
First at 2018-11-01 03:22:51 by Thomas Munro <thomas.munro at enterprisedb.com>
Latest at 2022-01-12 08:27:26 by Julien Rouhaud <rjuju123 at gmail.com>
Latest attachment (undo-20211125.tgz) at 2021-11-25 14:02:22 from Antonin Houska <ah at cybertec.at>
    Attachment (undo-20211125.tgz) at 2021-11-25 14:02:22 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (sync_comment.patch) at 2021-09-29 06:09:34 from Antonin Houska <ah at cybertec.at> (Patch: Yes)
    Attachment (sync.patch) at 2021-09-21 07:02:02 from Antonin Houska <ah at cybertec.at> (Patch: Yes)
    Attachment (undo-20210914.tgz) at 2021-09-14 08:51:42 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210909.tgz) at 2021-09-09 15:04:21 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210831.tgz) at 2021-08-31 12:46:30 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210630.tgz) at 2021-06-30 07:04:51 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20210129.tgz) at 2021-01-29 17:30:15 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (undo-20201204.tgz) at 2020-12-04 09:22:42 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (Infrastructure-to-execute-pending-undo-actions.patch) at 2020-11-15 06:54:54 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (Allow-execution-and-discard-of-undo-by-background-wo.patch) at 2020-11-15 05:56:01 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (undo-20201112.tgz) at 2020-11-12 10:17:36 from Antonin Houska <ah at cybertec.at> (Patch: No)
    Attachment (0001-FailedAssertion-logno-context-recovery_logno-fix.patch) at 2019-09-06 03:31:30 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (v3-0001-New-undo-request-manager-now-with-some-xact.c-int.patch) at 2019-08-24 14:19:19 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (v2-0001-New-undo-request-manager-now-with-UndoRequestMana.patch) at 2019-08-21 02:56:35 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (undo-20190820.tgz) at 2019-08-20 09:02:18 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (undo_13_08_2019.tar.gz) at 2019-08-13 04:01:45 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (0001-Move-some-md.c-specific-logic-from-smgr.c-to-md.c.patch) at 2019-08-09 08:21:04 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Draft-of-new-undo-request-manager.patch) at 2019-08-08 20:27:16 from Robert Haas <robertmhaas at gmail.com> (Patch: Yes)
    Attachment (test_undo_worker_load_balancing.py) at 2019-08-07 11:35:38 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Move-some-md.c-specific-logic-from-smgr.c-to-md.c.patch) at 2019-07-31 13:14:00 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-pg_upgrade-failure-fix.patch) at 2019-07-25 11:26:09 from vignesh C <vignesh21 at gmail.com> (Patch: Yes)
    Attachment (undolog_20190716.tar.gz) at 2019-07-16 08:50:11 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (undo_20190709.tar.gz) at 2019-07-09 10:28:22 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (undo_20190706.tar.gz) at 2019-07-06 14:56:29 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: No)
    Attachment (lookahead-failure-chance.pl) at 2019-07-05 20:16:51 from Robert Haas <robertmhaas at gmail.com> (Patch: No)
    Attachment (undo-20190701.tgz) at 2019-07-01 07:53:26 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Add-SmgrId-to-smgropen-and-BufferTag.patch) at 2019-06-25 19:59:57 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (0005-Add-prefetch-support-for-the-undo-log.patch) at 2019-06-18 11:30:48 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (undo-20190614.tgz) at 2019-06-14 02:55:52 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Extend-binary-heap-functionality.patch) at 2019-05-27 09:58:58 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Provide-interfaces-to-store-and-fetch-undo-records_v7.patch) at 2019-05-15 14:44:18 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0002-Provide-interfaces-to-store-and-fetch-undo-records_v6.patch) at 2019-05-12 06:15:03 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undo-2019-05-11.tgz) at 2019-05-11 09:49:49 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Add-missing-file-in-pg_buffercache.patch) at 2019-05-10 10:46:09 from Kuntal Ghosh <kuntalghosh.2007 at gmail.com> (Patch: Yes)
    Attachment (undo-2019-05-10.tgz) at 2019-05-10 06:18:16 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Update-oldest_data-on-startup_v5.patch) at 2019-05-09 06:34:16 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0005-undo-page-consistency-checker_v4_WIP.patch) at 2019-05-06 12:13:22 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Allow-undo-actions-to-be-applied-on-rollbacks-and-di.v2.patch) at 2019-05-05 04:58:21 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: No)
    Attachment (0005-undo-page-consistency-checker_WIP_v3.patch) at 2019-05-02 04:00:23 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undoprocessing_1.patch) at 2019-05-01 04:38:14 from Amit Kapila <amit.kapila16 at gmail.com> (Patch: Yes)
    Attachment (0001-Enhance-multi-log-handling-in-undo-log.patch) at 2019-04-25 11:15:44 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (0001-Enhance-multi-log-handling-in-undo-log.patch) at 2019-04-19 10:15:43 from Dilip Kumar <dilipbalaut at gmail.com> (Patch: Yes)
    Attachment (undo-smgr-v2.tgz) at 2019-03-12 13:20:29 from Thomas Munro <thomas.munro at gmail.com> (Patch: No)
    Attachment (0001-Fix-shared-memory-size-for-rollback-hash-table.patch) at 2018-11-05 11:42:40 from Kuntal Ghosh <kuntalghosh.2007 at gmail.com> (Patch: Yes)
    Attachment (