Fixes #37436 - Remove TimedCacheStore class

Foreman uses either redis or file store for quite some time.
This class is not being used anywhere.

Fixes #37432 - Fix Style/GlobalStdStream cop

Fixes #37337 - Fix snapshot task and add Rocky 8 & 9

Fixes #37287 - Iterate on hashes when both key and value are used

This replaces the `hash.keys.each { |k| hash[k] }` and `hash.keys.sort`
patterns with `hash.each { |k, v| }` where it makes sense. This avoids
doing hash lookups when you already know the value anyway.

Fixes #36574 - Update fast_gettext to ~> 2.1

Refs #36574 - Avoid patching Fastgettext

The code defines an additional method on Fastgettext but there's no
reason to do so. It can just as well define a method on itself.

Fixes #37102 - webpack 5

Fixes #36774 - count db:abort_if_pending_migrations as setup task

this avoids loading settings and friends just to check if a migration is
required

Refs #36219 - remove redundant line

in parameters rake task, key_type_name was assigned twice

Fixes #36222 - drop unused puppet rake task

Fixes #36219 - use YAML.safe_load instead of YAML.load

as explained in this rubocop rule https://www.rubydoc.info/gems/rubocop/RuboCop/Cop/Security/YAMLLoad

Fixes #36419 - Generate locale js files as pretty

for smaller diffs on updates

Refs #36330 - Place assets into plugin dir

Fixes #36330 - Fix plugin translations in frontend

- Add plugin:po_to_json rake task
- Load js locale files for all plugins
- Make i18n.js do multi-domain lookup

Fixes #36331 - Expose translation registration in plugin DSL

Fixes #35903 - Support extracting logs from journald

Fixes #35797 - libvirt nil network comparison

When libvirt compares networks, it is possible that `network` will be
`nil` resulting in a match instead of continuing on to the bridge
comparison.

Signed-off-by: Ben Magistro <koncept1@gmail.com>

Fixes #35871 - purge trends only when statistics not installed

We instroduced migration to purge trends data in 34709a3781355b63e7afe2864e03c5f663479602.
It forgot to add condition to check if the statistics plugin is not installed.

Fixes #35347 - purge old trends and foreman_docker references during upgrade (#9343)

Fixes #35488 - Fix snapshots:generate task

• Generating snapshot for provision/coreos_provision.erb
• Generating snapshot for PXEGrub2/kickstart_default_pxegrub2.erb
• Error "undefined method 'include?' for nil:NilClass" when rendering
  'Kickstart default PXEGrub2' on host with empty 'pxe_loader'

Fixes #31966 - Add warning for foreman-rake permissions:reset task (#9395)

Fixes #29539 - Unbundle websockify

Removing the outdated websockify version means relying on the system
version. This allows independent (security) updates.

It is now expected that websockify lives somewhere in $PATH.

Refs #35359 - cleaner add_ca_bundle_to_store

Fixes #35359 - Add cacert to http proxy (#9348)

This PR adds a cacert column to the http proxy and uses to this for
connecting to ec2 and other compute resources. This would also be used
by katello/other plugins when communicating to the CDN over a https...

Fixes #34996 - Ignore http proxies when talking to smart proxies

Fixes #35014 - Rework Net::HTTP extension

Fixes #35014 - Fix injection of global HTTP proxy into net/http

We were passing wrong arguments to proxy_http_request?, causing it to
always evaluate to false so no requests were proxied.

Fixes #35013 - config rake uses Setting DSL

config rake was still using obsolete setting access.

Fixes #34526 - Switch Rails version to 6.1

Changes overview:
- Set default Rails version to 6.1
- Required dynfow >= 1.6.5
- Cleanup deprecation warnings in config/as_deprecation_whitelist.yaml
- ActiveSupport::ParameterFilter instead of ActionDispatch::Http::ParameterFilter...

Fixes #34921 - Fix SettingValueException error message

Fixes #34913 - Take plugins into consideration when checking pending migrations

Also unify migration pending checking

Fixes #34838 - Add errors when setting values are invalid (#9203)

Refs #31147 - fix seed:reports example

Fixes #34690 - rake printing auditable attributes

Add a rake task that prints out all auditable attributes available in the APP.

Fixes #34526 - rescue_from JSON params parse errors

Use rescue_from block instead of the CatchJsonParseErrors middleware
See https://github.com/rails/rails/pull/34341

Refs #34360 - allow host deleting with host_reports plugin

Signed-off-by: Lukas Zapletal <lzap+git@redhat.com>

Fixes #34596 - sanitize default template names

Default boot templates are weirdly interconnected with its settings.

Fixes #33782 - do not use fixtures for Settings

As we no longer require settings in DB, we may drop the fixtures for settings.

Fixes #34339 - sanitize fqdn in tests

Tests were almost not using the fqdn defined in settings.yaml.test
That is quite confusing at first sight and we should not override this value by fixtures, only if overriden in the same test file.

Fixes #32632 - initial verison of Ubuntu autoinstall templates

Signed-off-by: Lukas Zapletal <lzap+git@redhat.com>

Fixes #34462 - shorten DNS timeout for primary detection

Signed-off-by: Lukas Zapletal <lzap+git@redhat.com>

Fixes #30122 - remove usage of controller level force_ssl

Foreman's use case for HTTP-only is provisioning. Many installers, like Red
Hat's Anaconda or Debian Preseed, either do not support it or make it very hard
to use HTTPS. This is especially hard since often a custom CA is used so the...

Fixes #34350 - Require 'foreman/telemetry' in ldap initializer

Fixes #34353 - Fix early load of fog_extensions

Fixes #31027 - transpiler macros for CoreOS family

Refs #33968 - Telemetry is not autoloadable

Fixes #34122 - Report disallowed metric labels as other

Signed-off-by: Lukas Zapletal <lzap+git@redhat.com>

Fixes #34091 - add logging helper log_duration

Signed-off-by: Lukas Zapletal <lzap+git@redhat.com>

Fixes #34146 - Move services from lib/foreman to app/services/foreman

Fixes #34138 - Autoload ProxyAPI files from /app/services

Fixes #34139 - Move Foreman::Renderer from lib/ to app/services

Refs #26968 - don't disable Katellos MeantimeReporter

katello dropped the relevant code, relying on our implementation now

Fixes #34117 - Drop ancient models:consolidate task

This task was written 10 years ago and hasn't seen any updates since. It
is likely broken and useless.

Refs #33968 - Fix the fix of Telemetry initializers

Fixes #33897 - Puppet Environment in taxonomy ignore_types

Fixes #26968 - Switch to minitest-reporters

ci_reporter_minitest is unmaintained and since minitest 5.1 it no longer
shows the class names. minitest-reporters does.

Fixes #33801 - Replace obsolete URI.escape method

Fixes #33991 - Require /lib dependencies in initializers/foreman.rb

Fixes #32461 - add endline in save_to_file

Co-authored-by: Ondřej Ezr <ezrik12@gmail.com>

Fixes #33985 - move identifiers to ApplicationRecord

Move identifiers to ApplicationRecord from core_extensions.

Fixes #33984 - removes custom update methods

These archaic methods are not used anymore
These are in Rails for years so noone shoul be using them for a while now.

Fixes #33992 - drop truncate_bytes method

This method was added in Rails 6 to ActiveSupport.

Fixes #33986 - moves Callback ensures to separate files

We do not need to define the Ensure classes in core_extensions.
These are better off in separate files.

Fixes #33968 - Fix loading of Foreman::Telemetry in initializers

Fixes #33890 - Require Foreman::Gettext in initializers

Fix deprecation warning the about initialization of auto-loaded constants

Fixes #33907 - Add current_date macro

Fixes #33853 - demodulize resource type for plugin types

demodulize resource type for permission in Job templates
Plugins have resources usually in the plugin module namespace and that doesnt work well with permissions, which usually do not have this prefix in name.

Fixes #31947 - add grub2/ks validation to jenkins rake task

Refs #33541 - correct naming of association tables

Refs #31060 - drop also environment_classes

Fixes #27024 - Adding audit cleanup duration and update rake task

Adding setting 'audit_period' to know how long saved audits user wants.
Also updating rake task for cleanup to reflect this setting

Refs #31060 - Move environment cleanup to rake task

Refs #32652 - cleanup schema_migrations from dropped migrations

Fixes #31060 - drop Environments migrations

Drops all migrations related to environments.
Removes all the relations to the environments.
Adds a migration to drop environments from Hostgroup and Host.

Extracted in https://github.com/theforeman/foreman_puppet_enc/pull/41.

Fixes #33541 - drop puppetclass migrations

Removes all migrations related to Puppetclass.

Added in plugin https://github.com/theforeman/foreman_puppet/pull/195

Fixes #31096 - remove config group migrations

These migrations had been added to the plugin foreman_puppet_enc.
Details of addition https://github.com/theforeman/foreman_puppet_enc/pull/13

Fixes #31732 - drop env from TemplateCombination migration

Drop environment relation from TemplateCombination migrations.

Fixes #32652 - task to purge puppet data

Adds rake task to purge all puppet data for users who do not choose to use puppet.

Fixes #14854 - connection libvirt leak fixed

Fixes #32893 - use setting DSL for General category

This uses our new DSL to define the General settings, this showcases how
to use the new DSL and other categories should follow in the same
release.

Fixes #32837 - drop unwanted URI parsing from extension

Fixes #33223 - Improving Job Invocation Report Template

Updating the template to merge outputs lines to one batch to show them
at one line.

Fixes #33180 - add task to migrate Puppet info

Adds task to migrate Puppet provisioning info to Host parameters.

Fixes #31049 - Introduce server CA file setting

Fixes #32822 - Job templates and resource picker

New `resource` user input type for templates with
template macro `input_resource` returning the resource object

Fixes #33197 - Show error message if credentials are wrong

Fixes #33033 - shell_escape template macro

New template macro `shell_escape` using
Ruby's `Shellwords.shellescape` for safe shell strings.

Use `shell_escape` for user input variables
in registration templates (`global` & `host_init`)

Fixes #33090 - load AIX OS attributes

Fixes #32540 - host_param_(true|false)? cleanup

let the `default_value` denote what we "read" by default from the host
(in the case the host doesn't have the param) and then compare it with
`true`/`false` (depending on the func) as done with the existing...

Fixes #31235 - drop Puppetclass models

Drops Puppetclass models and their usage.
Extracted in https://github.com/theforeman/foreman_puppet_enc/pull/81
Tests extracted in:
- hostgroup - https://github.com/theforeman/foreman_puppet_enc/pull/85

Fixes #32918 - Host registration - Update packages

New parameter `update_packages` for update of
all packages on the host when registered

Fixes #32635 - fix already initialized constant

Fixes #28221 - Adding passing of template scope for snippet rendering

In current implementation templates can be much complex by snippet.
Reusable pieces of template code that should be in the same scope like
their templates but they are not. This PR tries to solve that.

Fixes #32192 - Override only the relevant parts

Fixes #32192 - Monkey patch restclient to unescape proxy credentials

Restclient as of version 2.1.0 uses provided credentials stored in a proxy URI
object verbatim. If the credentials are escaped as they should be, then this
leads to errors when we try to use the credentials because restclient sends the...

Fixes #32636 - allow relative filename in settings (#8542)

Fixes #27604 - added Fedora|Redhat CoreOS and IM

Fixes #31407 - prevent spaces for snapshot test files

Fixes #31717 - lazy-load fast_gettext for faster boot (#8275)

It's because we switch over all 20 languages to actually pull language name in the native language into a list of available languages. We use that in three places: settings page, user page and GraphQL....

Fixes #31370 - multi-host stub template snapshots (#8149)

Our snapshot template render test and generator only supports one host stub (ipv4 single NIC redhat OS). In order to test more ERB codepaths, we need a way to create snapshots against multiple host stubs (e.g. IPv6, dualstack, static IPv4 or IPv6, debian family). In order to do that, template metadata can be extended to define list of host stubs to create and test snapshots against....