Rework repository archive #14723

lunny · 2021-02-18T07:56:53Z

lunny commented

2021-02-18 07:56:53 +00:00

Currently, archives of repository will be stored on git directory's sub directory named archives. These files could be split from git original data directory so that they could be provided by other facilities i.e. minio. So that they can be cached or have better visit performance.

This PR creates a new table to save repositories' archive informations and use storage module to store archives files. And also have a queue to generate the archive files to allow to store lfs and submodule files into archive.

It should also fixes the race on old archive codes and also allow multiple Gitea instances

Save all archives' informations into database
Store repository archives via modules/storage but not put them into git repository
Add new doctor check item to find and delete old archive directories
Delete all related database records and storage files

I will leave these changes in other PRs for easier review:

Store LFS files into the archive packages, ~~fix~~ #4773
Store submodule files into the archive packages, ~~fix~~ #5265

Currently, archives of repository will be stored on git directory's sub directory named `archives`. These files could be split from git original data directory so that they could be provided by other facilities i.e. minio. So that they can be cached or have better visit performance. This PR creates a new table to save repositories' archive informations and use `storage` module to store archives files. And also have a queue to generate the archive files to allow to store lfs and submodule files into archive. It should also fixes the race on old archive codes and also allow multiple Gitea instances - [x] Save all archives' informations into database - [x] Store repository archives via `modules/storage` but not put them into git repository - [x] Add new doctor check item to find and delete old archive directories - [x] Delete all related database records and storage files I will leave these changes in other PRs for easier review: - [ ] Store LFS files into the archive packages, ~~fix~~ #4773 - [ ] Store submodule files into the archive packages, ~~fix~~ #5265

👍 2

KN4CK3R (Migrated from github.com) requested changes 2021-05-31 06:32:51 +00:00

models/repo.go

KN4CK3R (Migrated from github.com) commented

2021-05-31 06:32:39 +00:00

Should not be LFSMetaObject but RepoArchiver.

Should not be `LFSMetaObject` but `RepoArchiver`.

lunny reviewed 2021-05-31 07:55:59 +00:00

models/repo.go

lunny commented

2021-05-31 07:55:59 +00:00

Resolved

6543 (Migrated from github.com) reviewed 2021-06-01 19:31:33 +00:00

modules/setting/repository.go

6543 (Migrated from github.com) commented

2021-06-01 19:31:32 +00:00

	repoArchiveSec := Cfg.Section("repo-archive")
	storageType := repoArchiveSec.Key("STORAGE_TYPE").MustString("")
	RepoArchive.Storage = getStorage("repo-archive", storageType, repoArchiveSec)

```suggestion repoArchiveSec := Cfg.Section("repo-archive") storageType := repoArchiveSec.Key("STORAGE_TYPE").MustString("") RepoArchive.Storage = getStorage("repo-archive", storageType, repoArchiveSec) ```