--

Commit: clea-os/infrastructure/gitlab-ci@ce304cf6

[CICD][BUILD] Mask sensitive environment variables in build:pass job

  The build:pass job prints environment variables, some of which
  may contain sensitive data.
  This update ensures that variables with names matching substrings
  in FILTER_LIST have their values masked

--

Commit: clea-os/infrastructure/gitlab-ci@62eb8719

[MIRROR][CICD] Adjust sync-mirror job rules for execution in the weekly build

--

Commit: clea-os/infrastructure/gitlab-ci@81ef3d9e

[CICD][MIRROR][AZURE] Add Azure-hosted mirror for Yocto packages

  Some upstream Yocto packages may become unavailable for various reasons,
   causing build failures in CI/CD pipelines, developer environments, and
   customer systems.
  Introducing a mirrored repository ensures package availability,
   mitigating risks from upstream discontinuations and improving build
   reliability.

  This commit introduces a sync script for uploading Yocto packages to
  Azure Blob Storage, ensuring consistent package availability. It also
   configures `DL_DIR` to use a separate folder, allowing packages to be
   collected in a dedicated pipeline stage responsible for syncing.

--

Commit: clea-os/infrastructure/gitlab-ci@dd39d101

[CICD][LOGGING] Modify enhanced logging module to improve usability

  - Set default color values for sections.
  - Apply colors at the "logging format" level instead
    of the "logging message" level.

--

Commit: clea-os/infrastructure/gitlab-ci@fa793019

[CICD][LOGGING] Add enhanced logging module with masking & GitLab collapsible sections

  This introduces two key features to the logging module:
   - Sensitive Data Maskingi which masks sensitive information
     (e.g., passwords, tokens) in log output.
     Useful during debugging when examining arguments,
     ensuring confidential data is not exposed.

   - GitLab Collapsible Sections in Job Logs
     Enables structured and collapsible log sections for better readability.
     Reference: https://docs.gitlab.com/ee/ci/jobs/job_logs.html#custom-collapsible-sections

--

Commit: clea-os/infrastructure/gitlab-ci@29700feb

[QCOM] Make packages versions customizable

E.g. the TZ version was changed from TZ.XF.5.0 to TZ.XF.5.29.1 between releases.
This makes it easier customizable via the .gitlab-ci.yml files inside specific repositories

--

Commit: clea-os/infrastructure/gitlab-ci@deb4e4d7

[CICD][INTEGRATION] Workaround submodule init error and fix logging output order

  Sometimes, during deployment, GitLab-CI changes result in an error message
  in the logs. This occurs when a submodule reference points to a commit
  that no longer exists in the submodule repository.

  This can happen when the commit history in the submodule is rewritten,
  causing the reference hash to become invalid.

  However, this does not cause actual problems, for deployment process,
  as the reference was going to be updated anyway.

  - Changed this error message to a warning instead.
  - Enabled automatic STDOUT flushing to ensure consistent output ordering
     when `print()` and `logging` are used simultaneously.
  - Included a fix from YT-160, which addresses a different problem
     also related to deploy ci changes and may be useful.

--

Commit: clea-os/infrastructure/gitlab-ci@c697705b

[LAVASERVER] fix LAVA test server ip being supposed static and immutable

--

Commit: clea-os/infrastructure/gitlab-ci@4ff932a2

[MYON2] Add machine configuration for Myon 2

--

Commit: clea-os/infrastructure/gitlab-ci@160d8446

[INTEGRATION][RETRIGGER] Fix in function doing MR pipelines retrigger

After a MR is merged in a 'bsp' or 'tools' group repository all MRs
of that group are being retriggered in order to avoid issues in
successive MR integrations. This retrigger was acting on retriggering
 all opened MRs, so this change introduces:
 * Check on repository if INTEGRATION variable is defined, otherwise
skip the project MRs.
 * Check on the target branch of the final integration MR and triggers
 only pipelines on MRs affecting the same branch.
 * Cleanup the print statements for better job readability.

--

Commit: clea-os/infrastructure/gitlab-ci@4d6cd034

[LogParser][Summary] add summary tables to know the test status faster

--

Commit: clea-os/infrastructure/gitlab-ci@7b608ad1

[DOCS] Describe the automation steps for submodules integration

--

Commit: clea-os/infrastructure/gitlab-ci@49f48f52

[TOOLS][INTEGRATION] Add integration jobs for repos inside 'tools' group

The 'tools' group contains repos, e.g. 'seco-base', which inherits
other repositories as submodule, e.g. 'seco-build-configurator'.
This commit:
* Introduces the 'tools-integration.yml' file that dinamically creates the
 integration pipeline (similarly to what already present for layers
 integration).
 * Introduces 'tools-integration-pipeline.yml.jinja2' file used for
 templating of dinamically created pipelines.
 * Introduces 'tools-integration-jobs.yml' to perform MR creation and
 merge as done for the layer integration steps.
 * Leverages 'update_submodule' python module to create integration
 branch and commit that update the SHA of the submodule.
 * A minor fix on python script to accept and merge integration MRs.

--

Commit: clea-os/infrastructure/gitlab-ci@1272b826

Introduce GitLab runners from Hamburg

--

Commit: clea-os/infrastructure/gitlab-ci@ee3d2ce2

[LogParser][Tests] optimize information extraction from lava log, add possibility to compile multiple homonymous tests in the same template

--

Commit: clea-os/infrastructure/gitlab-ci@d432c242

[LogParser][URL] add confluence report url to the pipeline log

--

Commit: clea-os/infrastructure/gitlab-ci@65866cab

[LogParser][RENAME] change the references inside the Report Automation from Edgehog to Clea-OS

--

Commit: clea-os/infrastructure/gitlab-ci@53ac2c72

[DOCKER] Add container for building QCS6490 Firmware

--

Commit: clea-os/infrastructure/gitlab-ci@f10a460d

[QCOM] Add build pipeline for QCS6490 Firmware

--

Commit: clea-os/infrastructure/gitlab-ci@1f35d1d7

[E83] Add machine configuration for D18 variant

--

Commit: clea-os/infrastructure/gitlab-ci@f33f8c03

[CICD][ARTIFACTS][MEDIATEK] Prevent propagating  Mediatek artifacts v2

--

Commit: clea-os/infrastructure/gitlab-ci@d9e02833

[CICD][ARTIFACTS][MEDIATEK] Prevent Mediatek artifacts from being propagated

  The previous implementation for Mediatek-specific artifacts had an issue
  where the same artifacts were applied to all other boards immediately
  after Mediatek.
  This update resolves the issue by ensuring artifacts are correctly
  scoped to Mediatek only.

--

Commit: clea-os/infrastructure/gitlab-ci@1915689b

[CICD][DEPLOY][MD5] Fix overwriting MD5 summs file on Azure.

  Both the SDK and Yocto pipelines compute the MD5 checksum of the released files.
  Since the MD5 checksum file has the same name in both pipelines,
  it gets overwritten by the latest pipeline.
  This update adds a check stage to detect if the file already exists on Azure
  and appends new data to the existing file instead of overwriting it.

--

Commit: clea-os/infrastructure/gitlab-ci@23d2670f

[Report Pipeline] add automatic test reports in the pipeline
- Introduce 'report' stage in Clea OS pipeline leveraging results from LAVA tests to automatically fill Confluence test report.
- The job only executes the 'log_parser.py' script that creates the Confluence page and the report.pdf file to be uploaded as job artifact.
- The 'report' stage follows the same trigger rules as the 'test' one."

--

Commit: clea-os/infrastructure/gitlab-ci@d7f946ee

[LogParser] add logparser script
This script allows to leverage Confluence APIs to perform the following actions:
- Get the plain text log of a LAVA job triggered from the pipeline.
- Get from LAVA's SystemTest and Script tests: their name, log and result from the plain text log.
- Fill,via it's python API,a Confluence report template with:
	* the LAVA test results as described in the previous point.
	* the Device Under Test's hardware and software informations (OS and Test executable's versions).
	* the Gitlab pipeline and LAVA job that generated that report.
- Export the report in PDF format using Scroll PDF Exporter using the request's body json stored under .gitlab_ci/data that contains the informations\
	to export it with the right format

Integrate gitlab-ci/CLEAOS-560-notify-stage-timeout-waiting-to-fetch-artifacts-from-all-previous-jobs and 2 more

--

Commit: clea-os/infrastructure/gitlab-ci@f8d0dcd5

[SANTINO] Fix 'MACHINE' variable value to correctly match artifacts name

* The previous value of that variable was preventing the RAUC bundle
 from being uploaded to Azure.
 * Jira reference: CLEAOS-555

--

Commit: clea-os/infrastructure/gitlab-ci@311474c7

[TEST] Fix on 'git clone' command URL formatting

--

Commit: clea-os/infrastructure/gitlab-ci@4a2e9d1d

[NOTIFY] Add dynamic 'dependencies' on deploy and changelog jobs

* Dynamically creates a list of jobs on which the notify job depends on
to speed up job execution and artifacts fetching.
* Reduce timeout for notify job since no build stage artifacts need to
be downloaded.
* Insert dependency relation between release and notify job as well.

--

Commit: clea-os/infrastructure/gitlab-ci@d21d5947

[CICD][ARTIFACTS][MEDIATEK] Add Custom Artifacts Bundle for MediaTek

  MediaTek requires a unique set of artifacts for image generation.
  Adds the necessary files to create a custom artifacts bundle.

--

Commit: clea-os/infrastructure/gitlab-ci@8c6aa171

[CICD][DEPLOYMENT] Dereference symlinks when collects custom artifacts

 The deployment stage in the CI pipeline includes a mechanism
 for collecting and deploying custom artifacts.
 Current implementation collects symbolic links (symlinks) instead
 of the actual files they point to.
 Use dereference option for "cp" command to copy actual files.

--

Commit: clea-os/infrastructure/gitlab-ci@9f06ff40

[SSH] Remove references to SSH authentication methods in favour of HTTPs

--

Commit: clea-os/infrastructure/gitlab-ci@dcf8c7c2

[CICD][RELEASE] Replace release job script with Python version.

  The `release-cli` tool is deprecated and lacks flexibility.
  This commit replaces it with a Python script leveraging the GitLab Python module.
  This also serves as a base for future extends of functionality in the release job.

--

Commit: clea-os/infrastructure/gitlab-ci@f923eed7

[CICD][SDK] remove unnesessary jobs from SDK pipeline

--

Commit: clea-os/infrastructure/gitlab-ci@21c37436

[RELEASE] Generate MD5 checksum list for released artifact files

--

Commit: clea-os/infrastructure/gitlab-ci@52e1ba49

[CICD][SDK] Introduce delayed start for build jobs in SDK pipeline for Release

  During the release process, all build jobs start automatically,
  leading to significant server load.
  This issue is amplified due to the large number of platform builds
  and additional SDK builds.
  To mitigate this high load on build servers,
  a delayed start mechanism for the SDK build stage has been introduced.

--

Commit: clea-os/infrastructure/gitlab-ci@5da68c19

[BSP][INTEGRATION][CICD] Added new subgroups "modules," "qualcomm," and "intel."

   We specify a more precise group path when
   accepting merge requests for layer integration.
   Refactored group path specification logic to simplify adding
   new BSP subgroups in the future.
   Added new BSP subgroups: "modules," "qualcomm," and "intel."

--

Commit: clea-os/infrastructure/gitlab-ci@6172a7e1

[FIX][INTEGRATION][LAYERS] Set SECO_REMOTE devault value for layers

  The layers-integration pipeline fails to retrigger MR pipelines
  in the bsp group because the SECO_REMOTE variable is undefined.
  Set default value for SECO_REMOTE

--

Commit: clea-os/infrastructure/gitlab-ci@3353ee7a

[DEPLOY] Implement Custom files deployment

--

Commit: clea-os/infrastructure/gitlab-ci@3ed0d141

[HW][SUPPORT] Add Santino SBC based on i.MX6 Solo and Dual Lite CPUs

--

Commit: clea-os/infrastructure/gitlab-ci@12d0d7d2

[DOCKER] Hardcode the tag for clea-os-builder Docker image

It follows the different tagging scheme, so might break if we
change the CI_IMAGES_REV for images from gitlab registry

--

Commit: clea-os/infrastructure/gitlab-ci@ca1a2d56

[DOCKER] Add variable for LAVA an Exein Docker images

--

Commit: clea-os/infrastructure/gitlab-ci@91fe9a6d

[DOCKER] Adopt new Docker images url scheme

--

Commit: clea-os/infrastructure/gitlab-ci@d6cac3d1

[CHANGELOG] Adjust changelog filename for custom projects in the release

--

Commit: clea-os/infrastructure/gitlab-ci@5b87d970

[FIX][TEST][RELEASE] fix in image update job and in custom release
- The bmap files are not accessible from the custom project release pages, this is due to the fact that the access token appended to the links grants access to the "image" files. This commit fix that;
- Delete the appended token in custom images links because another token is already added in the deploy stage, when the deploy_artifacts.sh script is called.

--

Commit: clea-os/infrastructure/gitlab-ci@a4de07e9

[SDK] Implement Automatic SDK Build

  * Add build pipeline for SDK.
  * Introduce variable ARTIFACTS_PATH to separate path to artifacts
    for images and SDK.
  * Remove pathname.txt We detect artifacts path with ARTIFACTS_PATH now
  * Remove BUILD_DIR, BUILD_DIRECTORY and MACHINE from build task.
  * Adapt artifacts_name.sh, check_build_artifacts.sh,
    deploy_artifacts.sh, generate_report.sh to handle SDK artifacts as
    well.

--

Commit: clea-os/infrastructure/gitlab-ci@abe5ca72

[NOTIFY] Fix in token expiration date calculation

--

Commit: clea-os/infrastructure/gitlab-ci@3fc502e4

[TEST] Add correct name to LAVA devices for Clea OS Things testing

--

Commit: clea-os/infrastructure/gitlab-ci@cc44bfe3

[EDGEHOG] This commit allows backward  compatibility of custom projects

* Since the Clea OS rebranding of the project some of the custom
projects build are actually broken because they are still pointing
to the old 'Edgehog OS' brand and the old 'edgehog' tagged recipes.
* Extend the usage of the SECO_REMOTE variable in order to become as
much as possible independent from the name of the Yocto project and
allow backward compatibility.
* This commit refers to Jira ticket: CLEAOS-442

--

Commit: clea-os/infrastructure/gitlab-ci@bb9b1058

[DEPLOY] Fix in filesystem extension handling

* Extend FS_EXTENSION usage in all parts of the code requiring it
* Remove unnecessary variables from .gitlab-ci.yml file (already
defined in the common.yml file)
* This commit is related to Jira issue: CLEAOS-454

--

Commit: clea-os/infrastructure/gitlab-ci@0e7e7345

[DEPLOY] Remove 'latest' tagged SW artifacts from deploy stage

* All SW artifacts are now uniquely identified by the manifest commit
SHA or Tag, so there is no necessity to have 'latest' tagged artifacts.
* The Azure blob storage folder organization easily allows to retrieve
the software artifacts without the necessity of having 'latest' tagged
ones.
* This commit refers to Jira issue: CLEAOS-433

--

Commit: clea-os/infrastructure/gitlab-ci@6994676d

[DOCS] Update image format from 'svg' to 'jpg'

This update is necessary since the same images are used for Clea OS docs
at the following link: https://git-pages.seco.com/clea-os/docs/

--

Commit: clea-os/infrastructure/gitlab-ci@a8b93ddb

[REBRANDING] Apply new brand: Clea OS
All file, variables and "edgehog" (case sensitive) occurrences have been
replaced with the new brand "Clea OS" in accordance with the newest
naming convention.

--

Commit: https://git.seco.com/edgehog/infrastructure/gitlab-ci/-/commit/f2c40bcc6aceabcc7d96ad9cf2773ef9a8d6638f

[RASPBERRY] Add support to Raspberry Pi 4 machine

* The Raspberry Pi 4 machine only supports U-Boot in Edgehog Things distro,
for this reason we introduce a check on the presence of U-Boot files and
eventually not deploy the package in case no files are found.
* At build time, we only check the number of U-Boot artifacts and give a
  warning if they are less than expected.

--

Commit: https://git.seco.com/edgehog/infrastructure/gitlab-ci/-/commit/eade2597502ca78fa045400040b584d390765d36

[FIX] Minor fix in arithmetical operation for link report generation

--

Commit: https://git.seco.com/edgehog/infrastructure/gitlab-ci/-/commit/e46a8e54ea86f5ed84fb1cb86e5e697e50e8f26b

[MEDIATEK] Add support to Mediatek repositories in CICD

* Add support to build on BSP integration branches
* Add dedicated sstate-cache folder support
* Add repositories support in scripts and configuration files for
  changelog creation

--

Commit: https://git.seco.com/edgehog/infrastructure/gitlab-ci/-/commit/b5689acce288efdba55c65b4371bf8fab408bb9d

[MEDIATEK] Insert e58 configuration

All meta-seco-* layers have been placed inside meta-seco folder. In this
way is easier to highlight the code base which composes and
characterizes the Edgehog OS distro.
All other layers from the third part have been leaved in the same layer as
others.