open_packages_url: pass urls without extension

since .bz2 and .gz will be tried automatically

Signed-off-by: Andreas Beckmann <anbe@debian.org>
open_packages_url: return the resolved url, too

Signed-off-by: Andreas Beckmann <anbe@debian.org>
lib/db: remember the loaded URLs

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p-r: report all Packages files used for a section

and show the URLs actually loaded

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p-r: generate unique dependency lists

since versioning is ignored, don't report a dependency
  foo (>= 1), foo (<< 2~)
as
  foo, foo

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p: use a tempfile when creating a tarball

and rename this afterwards

to avoid several instances writing to the same file

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p-s: use locking to avoid concurrent basetgz creation

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p-s: new components setting

to restrict the components (archive ares) used in the generated sources.list

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p-s: quote arguments containing spaces

for easy copy&paste manual rerun from logfile

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p.conf.anbe: minor fixes

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p.conf.*: enable components = main for area = main

no longer test packages from main with contrib and non-free available

Signed-off-by: Andreas Beckmann <anbe@debian.org>
p: rewrap adequate tags

Signed-off-by: Andreas Beckmann <anbe@debian.org>
known_problems: upgrade 'missing-copyright-file' from boring

and make it a normal issue found by adequate, and let
pre_remove_50_find_missing_copyright no longer generate a fatal error

Signed-off-by: Andreas Beckmann <anbe@debian.org>
whitespace and typo fixes

Signed-off-by: Andreas Beckmann <anbe@debian.org>
dwke: catch another exception on file disappearance

get_mtime() may throw OSError

Signed-off-by: Andreas Beckmann <anbe@debian.org>
*.py: fixup exception strings

turn them into a single-element tuple to avoid creating a list of characters

Signed-off-by: Andreas Beckmann <anbe@debian.org>
more packages that need a database

Signed-off-by: Andreas Beckmann <anbe@debian.org>