Daniel Oliver @ Aitrus

STEP 7 – CREATE /etc/yum.repos.d/c7x64.repo for the CentOS 7 64-bit REPOSYNC CLIENTS:

note: client machine has to have nss-mdns (avahi-daemon) working, or file will need to be edited with server’s IP ADDRESS.

provide a copy of the file at “http://c7pxe.local/repos/client-files/c7x64.repo” from
folder “/var/www/html/repos/client-files/”

subsequent kickstart scripts will get this file during system installation.

# File:/etc/yum.repos.d/c7x64.repo
[c7x64-base]
name=CentOS Base
baseurl=http://c7pxe.local/repos/c7x64/base/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
enabled=1

[c7x64-epel]
name=CentOS EPEL
baseurl=http://c7pxe.local/repos/c7x64/epel/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-7
enabled=1

[c7x64-extras]
name=CentOS Extras
baseurl=http://c7pxe.local/repos/c7x64/extras/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
enabled=1

[c7x64-updates]
name=CentOS Updates
baseurl=http://c7pxe.local/repos/c7x64/updates/
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
enabled=1

• “rs32-reposync-update.sh”    # for getting base, updates, and extras.
• “rs64-reposync-update.sh”    # for getting base, extras

And, a REPOTRACK script for getting selected packages from EPEL:

• “rt64-c7x64-update.sh”

An easy way to begin using REPOTRACK is to query existing systems for what packages are installed from a given repo.  To gather my EPEL package list, I ran these two commands on all of my application servers:

• repoquery -a –installed –qf “%{ui_from_repo} %{name}” | grep ‘^@epel’
• repoquery -a –installed –qf “%-20{ui_from_repo} %-30{name} %-7{arch} %{epoch}:%-12{version} %-4{release}” | grep ‘^@epel’

Parse the results however you want, and you’ve got the basis for your repotrack script.  Repotrack doesn’t behave exactly like reposync, but it DOES get dependencies for packages, so it isn’t necessary to identify everything in advance.  It also works with wildcards.

For the “rs-c7x64-update.sh” script:

• reposync –config=/etc/yumrsc7x64.conf –gpgcheck –plugins –repoid=base –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x64/
• reposync –config=/etc/yumrsc7x64.conf –gpgcheck –plugins –repoid=extras –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x64/
• reposync –config=/etc/yumrsc7x64.conf –gpgcheck –plugins –repoid=updates –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x64/

• ---

  reposync –config=/etc/yumrsc7x64.conf –gpgcheck –plugins –repoid=base –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x64/ –urls

• reposync –config=/etc/yumrsc7x64.conf –gpgcheck –plugins –repoid=extras –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x64/ –urls
• reposync –config=/etc/yumrsc7x64.conf –gpgcheck –plugins –repoid=updates –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x64/ –urls
• reposync –config=/etc/yumrsc7x64.conf –gpgcheck –plugins –repoid=epel –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x64/ –urls

• createrepo /var/www/html/repos/c7x64/base/ -g comps.xml
• createrepo /var/www/html/repos/c7x64/extras/
• createrepo /var/www/html/repos/c7x64/updates/
• createrepo /var/www/html/repos/c7x64/epel/

For the “rs-c7x32-update.sh” script:

• reposync –config=/etc/yumrsc7x32.conf –gpgcheck –plugins –repoid=base –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x32/
• reposync –config=/etc/yumrsc7x32.conf –gpgcheck –plugins –repoid=extras –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x32/
• reposync –config=/etc/yumrsc7x32.conf –gpgcheck –plugins –repoid=updates –newest-only –delete –downloadcomps –download-metadata –download_path=/var/www/html/repos/c7x32/

• createrepo /var/www/html/repos/c7x32/base/ -g comps.xml
• createrepo /var/www/html/repos/c7x32/extras/
• createrepo /var/www/html/repos/c7x32/updates/

For the “rt64-c7x64-update.sh” script:

The repotrack options are very similar to reposync:

• –config=CONFIG      # defaults to /etc/yum.conf
• –config=/etc/yumrsc7x64.conf
• –arch=ARCH # defaults to “current arch” (whatever the systems is currently running at).
• –repoid=REPOID # default is all enabled.
• –download_path=DESTDIR # Path to download packages to.
• –urls # only show download urls, don’t download files.
• –newest # defaults to newest-only.

For my script, I’ve sorted commands/packages into common groups.  The script is literally the following commands and comments:

# common packages:
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest etckeeper htop nss-mdns epel-release

# security packages:
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest haveged tripwire fail2ban

# only for a Gui VM:
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest imlib2 openbox openbox-libs python2-pyxdg tweak yumex

# for python pypi … note: using “python36-pip” gets “python36, python36-libs, and python36-setuptools”.
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest python36-pip 

# for a DNS server:
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest dhcping 

# for a docker server… note: using “docker*” gets python dependencies; no need to type them all out.
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest docker*

# some git servers want/need this… note: using “github2fedmsg” gets dependencies; no need to type them all out.
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest github2fedmsg

# for a kitchen sink PYTHON36*…  using python36* gets a lot of stuff… including… numpy, pyvomi, pytests, requests, tkinter, virtualenv
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest python36*

# for more GIT* packages… includes items like gitolite, gitstats, git-extras, git-tools, 
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest git*

# for MYSQL* … fairly small list of items, some connectors, utilities, and some perl.
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest mysql*

# for SQLITE* … small list of items
repotrack –config=/etc/yumrsc7x64.conf –repoid=epel –download_path=/var/www/html/repos/c7x64/epel/Packages/ –newest sqlite*

# BUILD THE LOCAL REPOS:
createrepo /var/www/html/repos/c7x64/epel/

• 4.0G /var/www/html/repos/c7x64/base/        # filter allows for GNOME desktop.
• 206M /var/www/html/repos/c7x64/extras/
• 942M /var/www/html/repos/c7x64/updates/
• 187M /var/www/html/repos/c7x64/epel/
• 3.4G /var/www/html/repos/c7x32/base/          # filter also excludes GUI desktops.

• CREATE extra YUM config files, one for each {Distro-Release-Arch} being sync’d:
  •  /etc/yumrsc7x64.conf # configure an exclude= line.
  •  /etc/yumrsc7x32.conf # configure an exclude= line.
• CREATE extra YUM repo directory, one for each {Distro-Release-Arch} being sync’d:
  •  /etc/yumrsc7x64.repos.d
  •  /etc/yumrsc7x32.repos.d
• CREATE matching repo files under each directory:
  • /etc/yumrsc7x64.repos.d/c7x64.repo # {base,extras,updates,epel}
  • /etc/yumrsc7x32.repos.d/c7x32.repo # {base,extras,updates}
• EDIT each YUM config files to specify where to find it’s “*.repo” files:
  •  IN “/etc/yumrsc7x64.conf”, add the line “reposdir=/etc/yumrsc7x64.repos.d“
  •  IN “/etc/yumrsc7x32.conf”, add the line “reposdir=/etc/yumrsc7x32.repos.d“
• define reposync CONFIG OPTION for each {Distro-Release-Arch} being sync’d (for the reposync script(s):
  •  –config=/etc/yumrsc7x64.conf
  •  –config=/etc/yumrsc7x32.conf

•  –arch= # can skip this option/flag for the x64 version, default already works.
•  –arch= # for the x32… I’m not sure whether it is supposed to be “i386”, “i686”, or something else.
  • note: 2019-03-22, seems to working without actually using this flag.

• This flag refers to the [repo name] in the configured “*.repo” files.
• “REPOID” must match a name in the targeted /etc/yum{$}.repos.d/{$}.repo file(s).
• So, if you keep the names simple there, then this flag remains much simpler.
• the options used by my repo configs and reposync/repotrack scripts:
  •  –repoid=base
  •  –repoid=extras
  •  –repoid=updates
  •  –repoid=epel

• My local repos are being stored/served in these locations (don’t put this syntax in the script):
  • /var/www/html/repos/c7x64/{base,extras,updates,epel}
  • /var/www/html/repos/c7x32/{base,extras,updates}
• note: the reposync utility will make (or use existing) subfolder(s) matching the repo name, so, my reposync scripts only need:
  • –download_path=/var/www/html/repos/c7x64/
  • –download_path=/var/www/html/repos/c7x32/