[test] Cherry-pick fixed for DCV, AD, Export-logs and EFA from develop

[himani2411]

Description of changes

• Cherry-picking Integration tests Fixes from develop branch

Test AD + EFA (move to hpc6a)

• [Test] Fix issues causing intermittent test failures: test_efa, test_ad_integration, test_queue_parameters_update, test_slurm, test_multiple_efs #7357

Tag_propogation:

• Modified based on scheduler for slurm specific test change

Move to me-south-1 test

• [test] Remove region to avoid failures #7323

Export Logs

• [Integ] Check for existing export-log tasks before initiating a new task #7329
• [Integ] Extend check for export-log tasks to create ami #7332
• [Integ] Check export task is happening before every pcluster export-log #7341
• [Test] Check for active export tasks only #7362
• [Test] Export image build logs to test outputs on failure. #7374
• [Test] Reduce the risk of export-logs "Resource limit exceeded" failures in parallel tests. #7388

DCV

• [Test] Improve debuggability, stability and coverage of test_dcv_configuration and test_dcv_remote_access #7322
• [Test] In test_dcv_configuration, tolerate intermittent crashes on GNOME Tracker Suite (tracker-store) #7359
• [Test] In test dcv make the crash report include more info from the stack trace (form 100 lines to 500 lines). #7360
• [Test] Tolerate intermittent dcvsessionlauncher crash on g5g instances. #7350

Tests

• ONGOING

{%- import 'common.jinja2' as common with context -%}
{{- common.OSS_COMMERCIAL_X86.append("rocky8") or "" -}}
{{- common.OSS_COMMERCIAL_X86.append("rocky9") or "" -}}
---
test-suites:
  ad_integration:
    test_ad_integration.py::test_ad_integration:
      dimensions:
        - regions: [ "ap-southeast-1" ]
          instances: {{ common.INSTANCES_DEFAULT_X86 }}
          oss: [ {{ LUSTRE_OS_X86_0 }}, {{ LUSTRE_OS_X86_2 }}, {{ LUSTRE_OS_X86_4 }}, {{ LUSTRE_OS_X86_6 }}]
          schedulers: ["slurm"]
  cli_commands:
    test_cli_commands.py::test_slurm_cli_commands:
      dimensions:
        - regions: ["ap-northeast-2"]
          instances: {{ common.INSTANCES_DEFAULT_X86 }}
          oss: [{{ OS_X86_7 }}]
          schedulers: ["slurm"]
  dcv:
    test_dcv.py::test_dcv_configuration:
      dimensions:
        # DCV on GPU enabled instance
        - regions: [{{ g4dn_2xlarge_CAPACITY_RESERVATION_2_INSTANCES_1_HOURS_NOPG_DCV_OS_X86_1 }}]
          instances: ["g4dn.2xlarge"]
          oss: [{{ DCV_OS_X86_1 }}]
          schedulers: ["slurm"]
        # DCV on ARM + GPU
        - regions: [{{ g5g_2xlarge_CAPACITY_RESERVATION_2_INSTANCES_1_HOURS_NOPG_DCV_OS_X86_3 }}]
          instances: ["g5g.2xlarge"]
          oss: [{{ DCV_OS_X86_3 }}]
          schedulers: ["slurm"]
        # DCV in cn regions and non GPU enabled instance
        - regions: ["cn-northwest-1"]
          instances: {{ common.INSTANCES_DEFAULT_X86 }}
          oss: [{{ DCV_OS_X86_2 }}]
          schedulers: ["slurm"]
        # DCV in gov-cloud regions and non GPU enabled instance
        - regions: ["us-gov-west-1"]
          instances: {{ common.INSTANCES_DEFAULT_X86 }}
          oss: [{{ DCV_OS_X86_4 }}]
          schedulers: ["slurm"]
    test_dcv.py::test_dcv_with_remote_access:
      dimensions:
        - regions: ["ap-southeast-2"]
          instances: {{ common.INSTANCES_DEFAULT_X86 }}
          oss: [{{ DCV_OS_X86_1 }}]
          schedulers: ["slurm"]
tags:
    test_tag_propagation.py::test_tag_propagation:
      dimensions:
      - instances:
        - c5.xlarge
        oss:
        - alinux2023
        regions:
        - us-west-1
        schedulers:
        - awsbatch

References

• Link to impacted open issues.
• Link to related PRs in other packages (i.e. cookbook, node).
• Link to documentation useful to understand the changes.

Checklist

• Make sure you are pointing to the right branch.
• If you're creating a patch for a branch other than develop add the branch name as prefix in the PR title (e.g. [release-3.6]).
• Check all commits' messages are clear, describing what and why vs how.
• Make sure to have added unit tests or integration tests to cover the new/modified code.
• Check if documentation is impacted by this change.

Please review the guidelines for contributing and Pull Request Instructions.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.