--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@1299a9d6

CI: add "report-image-diff" job

Add a python script and a GitLab CI job to run it. The job is triggered
when the build is complete.

The script retrieves build artifacts for the default/main branch
(currently "kirkstone") in the manifest repo and build artifacts
for the integration branch of merge request.

After that, it compares those builds and creates a summary of the overall
changes. In particular:
- size of compressed artifacts (artifacts.zip)
- size of built image
- difference between manifest files

The summary is reported to stdout and as a comment to the merge request.
Each run of the pipeline means removing the old summary comment and
creating a new one when the build is finished.

Dmitry Petrov authored 11 months ago and Jonas Höppner committed 11 months ago

The switch case used with $MACHINE was copied from fng-install.sh.
This variable is not retrieved at runtime, but set by the Makefile.

In yocto postinstallation scripts we have get_platform() function to
detect the platform.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@dcc8d92b

build:hardware: Add Trizeps VIII Plus, fix MX93 and sort entries

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@add2bb17

Revert "CI: remove 'setup_ssh' as ssh access is disabled"

The SSH setup is required for some private projects that pull in
external repos via SSH.

This reverts commit 4d5bca8fb8aaebf8794ffa88a6d0aef779c9eedf.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@19ff9d08

package_release: Fix missing variable for os.walk

Even though the variable isn't used in the package_release script, it
seems to be required by the os.walk function. Underscore satisfies the
linter preventing it from causeing unused variable errors.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@6e6f124b

package_release: Add a way to copy the whole directory

Item should end with "/" to be treated as a directory

The status file cannot be found when processing do_installation():
cat: can't open '/mnt/target/var/volatile//tmp/yocto-postinstall-status': No such file or directory

This happends because:
- target rootfs is not mounted at that moment
- ${ABSTARGETTMP}/tmp is not persistant (all files will be removed after umount).

Switch back to /tmp as it's shared between fngsystem and target rootfs
(mount -o bind /tmp $TARGETROOT/tmp).

Fix missing invert of exit code for "sed" command to correctly return error.

[SC2002] Useless cat. Consider cmd < file | .. or cmd file | .. instead.
https://www.shellcheck.net/wiki/SC2002

[SC2268] Avoid x-prefix in comparisons as it no longer serves a purpose.
https://www.shellcheck.net/wiki/SC2268

[SC2295] Expansions inside ${..} need to be quoted separately,
otherwise they will match as a pattern.
https://www.shellcheck.net/wiki/SC2295

[SC2086] Double quote to prevent globbing and word splitting.
https://www.shellcheck.net/wiki/SC2086

Fix style using https://github.com/mvdan/sh
Used command arguments: -s -i 4 -ci -sr -kp -fn

During the installation, the postinstallation script may fail,
but the final result will still be "Update successful".

The commit fixes the fnginstall part calling the postinstallation scripts,
to make sure the update is not reported as successful,
still try to continue all postinstallation scripts as changes to
disk are already done anyway at this state.

Save postinstall script exit code to file and check it at the end
of fng-install.sh to report correct status.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@ab19eb61

CI: collect_release_information: jump to next pipeline if no deploy jobs found

See for error:
https://git.seco.com/seco-ne/yocto/infrastructure/ci-test/minimal-manifest/-/jobs/828261

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@ae764fbc

CI: Confluence page: Fix not created mx6 section

The function that merges the variables of the different jobs, i.e:

`MACHINE="mx6"`

`MACHINE="mx6ull"`

used python `in` to check if a value already exists.
But `"mx6" in "mx6ull"` is true, so mx6 was dropped.
This rewrites it, storing the variables in a set (which is unique
automatically) instead of space seperated strings.
Space seperation is added before printing the variables to be used on
on the shell.

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

i.MX8 machines do not use the FNG-Boot, they use the imx U-Boot instead.
But boot.cfg is still used to get cmdline. And the config format is
slightly different for i.MX6 and i.MX8.

The commit changes the sed command to support both flavors of configs.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@094983ae

git_config: Add "*" as safedir to omnit 'dubious ownership' error

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@44000de1

Check bitbake recipes with linter

The job checks bitbake recipes added/updated in MR using the
oelint-adv tool (https://github.com/priv-kweihmann/oelint-adv).

.oelint.json is a rulefile, created with the command
"oelint-adv --print-rulefile". It can be used during development.
It contains default rules for now, but will probably be customized later.

To get the list of changed files in MR, we adjusted the GIT_DEPTH variable.
The new value is 50, which should be fine for getting MR changes,
and still small enough to keep checkout fast for large projects.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@9d9574d1

convert_md2html: fix text duplication

Fix the problem introduced by commit 4f06516 "convert_md2html: fix id
fields for headings".

The text converted from markdown was written twice to the HTML document.

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

This is a fix for issue [746-001643] bootlogo improvements.

If original logo file won`t be found in boot directory, command line to
load logo will be removed from boot script. logo.dat will also be removed
from boot directory.

Also add the '-o' parameter for "load" command, so a missing logo does not make
the boot fail.

Signed-off-by: Dmitry Petrov <dmitry.petrov@rtsoft.de>

Use this as base:
https://github.com/github/gitignore/blob/4488915eec0b3a45b5c63ead28f286819c0917de/Autotools.gitignore

This removes the --force-yocto parameter, which was added to prohibit
the accidential use of the AB mode, as long as it is experimental.
For the commonly used installations and partition layouts, it is now
stable enough.

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

The dosfstools were downgraded to v2.11 after switching to the nogplv3 image. This version of dosfstools has no partition labeling tool.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@4f06516a



convert_md2html: fix id fields for headings

Converter adds "user-content-" to "id" fields for headings.
As a result links from TOC do not work.
Fix this for now by removing "user-content-" from the resulting html.

Signed-off-by: Mikhail Vanyulin <mikhail.vanyulin@rtsoft.de>

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@97898e9e



convert_md2html: use gitlab api

Update convert_md2html.py to use gitlab api with gitlab flavor.

Signed-off-by: Mikhail Vanyulin <mikhail.vanyulin@rtsoft.de>

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

This is a fix for issue [746-001621] install-script: B Installation does not
work correctly for imx6.
Previously boot.scr was only present for iMX8 boards and fng-install script
only copied boot.scr for them.
Once u-boot was added to iMX6 boards, boot.scr also appeared on them, and
script no longer copied boot.cfg to bootB.cfg.
As a result, fngboot fails to boot from B partition.
boot.cfg is now also moved if we are on iMX6 board and boot.scr was found.

Signed-off-by: Dmitry Petrov <dmitry.petrov@rtsoft.de>

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@4595835d

build:machines: Add Genio510 to the build job template

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@d8b5ab7b

scripts:firmware: Fix check for U-Boot file types

On i.MX6 devices, the U-Boot file types are not set at all. Extent check for
the existance of the uboot_file_types var.

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

A PNG logo can be added to the boot partition during installation via the
"--Image" parameter of the fng-install.sh.

During the postinstallation phase, the prepare-logo.sh script generates
a logo.dat blob in the boot partition which can be used by the custom logo
driver.

During boot, the bootloader reads this blob into the memory.
The logo driver will get logo memory address and size from dtb.
If this points to a correct data, logo, loaded into memory will be displayed.

The prepare-logo.sh can be also executed later by user to exchange the logo:
- manually copy logo file (png or pnm) to target rootfs
- manually call every script in /etc/fng-postinstall
- reboot

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

The logo file can be in PNG or PNM format.
Keep original file name and extension of image.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@3146ed1e

CI: increase timeout of package-documentation to 5m

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@4d5bca8f

CI: remove 'setup_ssh' as ssh access is disabled

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@8353d920

CI: lava testing: replace ssh with https url and CI_JOB_TOKEN

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

This is a part of the fix for issue [746-000797] Flash-N-Go System:
Implement "Disable serial console"

Run with --disable-console argument to disable console in boot-alt.cfg.
Run with --enable-console argument to enable console in boot-alt.cfg.

Example:
fngsystem-console-update.sh --disable-console

Signed-off-by: Dmitry Petrov <dmitry.petrov@rtsoft.de>

Dmitry Petrov authored 1 year ago and Jonas Höppner committed 1 year ago

This is a fix for issue [746-001533] Error: /etc/shared isn't mounted after
fng-install was run.

This adds two new common functions to fng-install.sh.in.
"store_mount" will save the content of /proc/mounts. It will be run before
umount_emmc is called the first time;
"restore_mount" will check that all partitions listed by store_mount are
still mounted. And, if not, it will remount missing partitions. This
routine will be called at the end of the cleanup function.

Signed-off-by: Dmitry Petrov <dmitry.petrov@rtsoft.de>

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@e207c443

gitlab-ci: Disable sourcery

The sourcery plugin fails again due to a missing login. Disable it for
now.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@a3d1e77c

manifest:integration: Fix issue in trigger/include

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@b6e66192

pipelines:build: Add check to JSON generation

Without the check, we have a race condition when building from sources
outside of the Yocto group.

The dosfstools were downgraded to v2.11 after switching to the nogplv3 image.
This version of dosfstools has no partition labeling tool.

Mtools is a collection of utilities to access MS-DOS disks from GNU and Unix
without mounting them. One of the tools is mlabel, which is a tool for
changing the label of FAT partitions.

Mikhail Vanyulin authored 1 year ago and Jonas Höppner committed 1 year ago

This is a fix for issue with id 746-001534: Error: fnginstall-common needs
fallback to gf-versions
prepare-common.sh was also modified for consistency.

Check for both gf-versions.sh and sys-versions.sh scripts.

Signed-off-by: Mikhail Vanyulin <mikhail.vanyulin@rtsoft.de>

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@42bfe4f0

build:prepare: Add setup script for Git Credentials

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@24653ff8

build:machines: Add i.MX93 to the build job template

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@7aae72ea

Re-enable sourcery

With the free open source plan, sourcery works only when called from the
repository's root directory. Re-enable it by calling it from there.

Also apply sourcery's suggestions to file generate_firmware_package.py,
which did not exist before disabling sourcery.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@51e0cf67

build:stages: Add Firmware Package JSON stage

The old Alphaplan stage is deprecated and was removed in a prior commit.
Add new stage to generate the Firmware Package JSON files that do replace
the old Alphaplan articles.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@1830cb02

And another improvement for the build-up-to-date job

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@f7f33de5

Improve the output message in the build-up-to-date job a bit more

Use explicit line breaks to make the message look better.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@68aaab94

Improve the output message in the build-up-to-date job

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@26b9eb1d

Rename "check" job to "build-up-to-date"

This is a more meaningful name and might give a hint what the job does.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@07f0c898

Make build runner tag configurable

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@0d70d719

Disable sourcery check

Sourcery changed its license model to only be available for open source
projects with the free plan. According to the documentation, sourcery
should detect automatically whether it is running on an open source
repo. This does not work in our case, though. Disable it until we find a
way to correctly make it work.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@9be2c52b

pipeline:build: Fix indentation of here-doc

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@245e6537

pipeline:build: Make generation of install script optional

The Genio 700 platform doesn't have an fng_install.sh. Currently, the
pipeline fails because of the exit code in the script check.
Make the generation of the install command optional and only show a
warning if the script is missing.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@8fedce8a

pipeline:build: Add MediaTek Genio 700 SoC

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@6f773de5

Remove Alphaplan stage

We do not use Alphaplan anymore. Remove everything Alphaplan related
stuff from the pipeline.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@56bd1900

Confluence: add helper script to get page content

This can be helpful if something is configurable in the GUI editor and
we can't figure out to do the same thing via the API.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@c3b794c6

Confluence: enforce fixed page width on creation

On page creation via the API, the page always seems to be created with
full width, even if "full_width=False" is set. Update the page right
after creating it in order to correctly set it to fixed width.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@82053a2f

Confluence: set width for download table columns

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@96f5745c

Confluence: group download files by type