aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* repology: use srcname for matching with gentoo atomsHEADmasterDmitry Marakasov2024-10-241-10/+10
| | | | | | | | | This is more correct as srcname for Gentoo in repology is derived from atom, while visiblename can be arbitrary string which identifies a package. Closes: https://github.com/gentoo/soko/pull/32 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* small refactorArthur Zamarin2024-09-071-11/+4
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/portage: trim whitespace for metadata.xml valuesArthur Zamarin2024-08-241-7/+8
| | | | | Closes: https://bugs.gentoo.org/938339 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* add SPDX license infoArthur Zamarin2024-07-1922-0/+22
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* repology: verify all outdated entries are indeed outdateddevelopArthur Zamarin2024-07-081-0/+47
| | | | | Resolves: https://github.com/gentoo/soko/issues/30 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* bugs: show all general bugsArthur Zamarin2024-05-162-2/+2
| | | | | Closes: https://bugs.gentoo.org/931966 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* anitya: handle better packages without stable versionsArthur Zamarin2024-05-071-0/+4
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/mask: don't panic upon malformed filesArthur Zamarin2024-05-072-0/+6
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* anitya: add ignore for perl packagesArthur Zamarin2024-05-031-0/+6
| | | | | | | | | We have a special versioning scheme for perl, so until implemented, just ignore them from anitya. https://wiki.gentoo.org/wiki/Project:Perl/Version-Scheme Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* Integrate with release-monitoringArthur Zamarin2024-05-033-45/+233
| | | | | | | | | | - Collect outdated information from Anitya - Prefer it over repology - Add Anitya links to package overview sidebar - Show a little bit different outdated information block for anitya. Resolves: https://github.com/gentoo/soko/issues/13 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/commits: fix bug when >10K commits are analyzedArthur Zamarin2024-04-171-4/+4
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* db connection: cleanup TruncateTable functionArthur Zamarin2024-03-2110-16/+16
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/portage: fix removal of removed packagesArthur Zamarin2024-03-192-16/+23
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/portage: fix USE_EXPAND useflag loadArthur Zamarin2024-03-192-2/+2
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/repology: support versioned atoms & selected repositoriesArthur Zamarin2024-03-161-44/+132
| | | | | | Resolves: https://github.com/gentoo/soko/issues/11 Resolves: https://github.com/gentoo/soko/issues/12 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* use slog for loggingArthur Zamarin2024-03-1617-243/+174
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* remove some deprecated callsArthur Zamarin2024-02-214-64/+16
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/useflags: rebuild all useflags types on fullupdateArthur Zamarin2024-02-211-1/+12
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* use templ instead of html/templateArthur Zamarin2024-02-212-4/+4
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/projects: fix for case of duplicate project emailArthur Zamarin2024-02-201-3/+27
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/mask: support new bugs list format of GLEP-0084Arthur Zamarin2023-11-182-3/+9
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/repology: custom user-agent, add rate limiter of 2secArthur Zamarin2023-11-171-4/+22
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/repology: add some error outputtingArthur Zamarin2023-11-171-4/+9
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* app/package: linkable bug for lower bug literalArthur Zamarin2023-08-161-1/+1
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* app/package: make bug linkable for masks and deprecation notesArthur Zamarin2023-08-162-10/+18
| | | | | Closes: https://bugs.gentoo.org/912355 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/repology: truncate table only if repology respondedArthur Zamarin2023-04-211-3/+2
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/bugs: add missing "Gentoo Security" category for searchArthur Zamarin2023-04-211-5/+6
| | | | | Closes: https://bugs.gentoo.org/904703 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/bugs: fetch old bugsArthur Zamarin2023-04-121-140/+164
| | | | | | | | | | | | | | | | The previous implementation was using the search facility with csv output, which had hard limit of 10000. No passing of offset & limit enabled us to fetch the next pages. By using the REST API, we can fetch beyond that limit without issues. Also implement a better "diff" update, which will only fetch the changed since a week ago. This will reduce the load on the server, and will enable us to update bugs more frequently. Reuse the `last_commit` field in DB to hold the last update time, which enables us to start with "empty" DB and still get the full history on next deploy. Closes: https://bugs.gentoo.org/768174 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* app/packages/show: better rendering of newlines in descriptionArthur Zamarin2023-04-102-2/+10
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater: perform metadata updated on full updateArthur Zamarin2023-04-081-10/+11
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/repo: add package.deprecated parser & collectorArthur Zamarin2023-04-082-1/+148
| | | | | Bug: https://bugs.gentoo.org/903987 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/bugs: better matching of atoms to bugArthur Zamarin2023-04-061-2/+2
| | | | | | | | | Better handling when there are whitespaces in the summary which was causing issues with matching. I'm unsure if I fixed the linked bug, but I suspect the answer is still no, I need a reproducer. Bug: https://bugs.gentoo.org/768174 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater: dedup the version finding codeArthur Zamarin2023-04-063-230/+148
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/repology: fix affected packages and latest versionArthur Zamarin2023-04-051-47/+61
| | | | | | | | | | | | - repology json can combine multiple gentoo packages into one "group" (for example normal and "-bin" packages). Mark outdated for all those packages. - when selecting current latest version, instead of using the last entry in array, version compare them and select latest. Closes: https://bugs.gentoo.org/771126 Closes: https://bugs.gentoo.org/892591 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/bugs: aggregate information per categoryArthur Zamarin2023-04-051-0/+59
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/bugs: optimize bugs deletionArthur Zamarin2023-04-051-19/+9
| | | | | | | | - fetch only bug ids (since only them are used) - delete package_to_bugs entries using just bug id, so no need to compute affected package. Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/pkgcheck: fix category computationArthur Zamarin2023-04-041-1/+1
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/pkgcheck: collect stabilization data per categoryArthur Zamarin2023-03-251-0/+51
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* maintainer: trim spacesArthur Zamarin2023-03-182-3/+5
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* update/packages: override upstream info on updateArthur Zamarin2023-03-171-0/+1
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/maintainers: handle maintainer-neededArthur Zamarin2023-03-091-29/+25
| | | | | Closes: https://bugs.gentoo.org/888205 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* repository/mask: add support for subslot separationArthur Zamarin2023-03-031-21/+53
| | | | | Closes: https://bugs.gentoo.org/832042 Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/pull requests: collect PRs info per categoryArthur Zamarin2023-02-251-0/+42
| | | | | | | | Store in helper table outdated info per category. This is done after all pull requests data is collected, so we don't need to introduce new update step. Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/repology: collect outdated info per categoryArthur Zamarin2023-02-251-4/+43
| | | | | | | | Store in helper table outdated info per category. This is done after all repology data is collected, so we don't need to introduce new update step. Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/commits: bulk optimize the DB queriesArthur Zamarin2023-02-228-452/+461
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* fix regex used for category/package checkArthur Zamarin2023-02-213-3/+3
| | | | | | | | The function ``regexp.MatchString`` checks if a string matches a substring, so for example all package metadata.xml were matching for category and were parsed incorrectly. Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/repology: bulk optimize the DB queriesArthur Zamarin2023-02-211-19/+6
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/projects: bulk optimize the DB queriesArthur Zamarin2023-02-211-36/+22
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/bugs: bulk optimize the DB queriesArthur Zamarin2023-02-211-105/+115
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>
* updater/pull requests: bulk optimize the DB queriesArthur Zamarin2023-02-201-58/+66
| | | | Signed-off-by: Arthur Zamarin <arthurzam@gentoo.org>