Skip to content

Draft: ci: test pipeline performance

Alex Tercete requested to merge ci-performance into main

Running locally (MacBook M2 Pro), //localhost:test takes 1.2s:

$ podman run \
          --cpus 4 \
          --memory 4G \
          -v $PWD:/mnt/src \
          -w /mnt/src \
          --rm \
          -it registry.gitlab.arm.com/ci/component/bazelisk:1.0.1 \
          sh -c 'cd e2e; bazelisk test //...'

Running on CI runner, //localhost:test takes 14.5s:

test:
  stage: test
  image: registry.gitlab.arm.com/ci/component/bazelisk:1.0.1
  tags:
    - arm64
  script:
    - cd e2e; bazelisk test //...

Running on CI runner with parallel jobs, //localhost:test takes 20-50s:

test:
  stage: test
  image: registry.gitlab.arm.com/ci/component/bazelisk:1.0.1
  tags:
    - arm64
  parallel:
    matrix:
      - FOO: [1, 2, 3]
        BAR: [4, 5, 6]
  script:
    - cd e2e; bazelisk test --test_env=FOO=${FOO} --test_env=BAR=${BAR} //...

On our normal pipeline set up, we've seen it take 70.1s.

Edited by Alex Tercete

Merge request reports