CircleCI

Siame vadove paaiskiname, kaip integruoti LoadFocus JMeter API klienta su CircleCI automatizuotam nasumui testuoti.

Nustatymo zingsniai

1. Pridekite aplinkos kintamuosius

Saugokite savo LoadFocus API kredencialus kaip aplinkos kintamuosius CircleCI:

Eikite i savo projekta CircleCI
Eikite i Project Settings > Environment Variables
Pridekite siuos kintamuosius:
- LOADFOCUS_API_KEY: jusu LoadFocus API raktas
- LOADFOCUS_TEAM_ID: jusu LoadFocus komandos ID

2. Sukonfiguruokite CircleCI darbo eiga

Sukurkite arba atnaujinkite savo .circleci/config.yml faila, kad itrauktumete nasumo testavima:

version: 2.1
jobs:
  performance_test:
    docker:
      - image: cimg/node:16.13
    steps:
      - checkout
      - run:
          name: Install LoadFocus JMeter API Client
          command: npm install -g @loadfocus/loadfocus-api-client
      - run:
          name: Configure LoadFocus API Client
          command: |
            loadfocus-api config set apikey $LOADFOCUS_API_KEY
            loadfocus-api config set teamid $LOADFOCUS_TEAM_ID
      - run:
          name: Run Performance Tests
          command: |
            loadfocus-api jmeter run-test \
              --name "CircleCI_${CIRCLE_PROJECT_REPONAME}_${CIRCLE_BRANCH}" \
              --thresholds "avgresponse<=200,errors==0,p95<=250" \
              --format json > performance_results.json
      - store_artifacts:
          path: performance_results.json
          destination: performance-test-results

workflows:
  version: 2
  build_test_deploy:
    jobs:
      - build_and_test
      - performance_test:
          requires:
            - build_and_test
      - deploy:
          requires:
            - performance_test
          filters:
            branches:
              only: main

3. Sustabdykite surinkima esant nasumo problemoms

Norint, kad jusu konvejeris nepavyktu, kai nasumo ribines vertes nera pasiektos, modifikuokite "Run Performance Tests" zingsni:

- run:
    name: Run Performance Tests
    command: |
      loadfocus-api jmeter run-test \
        --name "CircleCI_${CIRCLE_PROJECT_REPONAME}_${CIRCLE_BRANCH}" \
        --thresholds "avgresponse<=200,errors==0,p95<=250" \
        --format json > performance_results.json

      # Check exit code - the command will exit with code 1 if thresholds are not met
      if [ $? -ne 0 ]; then
        echo "Performance test failed to meet thresholds"
        exit 1
      fi

Isplestine konfiguracija

Lygiagretus testavimas

Keliu nasumo testu vykdymui lygiagredziai:

performance_tests:
  docker:
    - image: cimg/node:16.13
  parallelism: 3
  steps:
    - checkout
    - run:
        name: Install LoadFocus JMeter API Client
        command: npm install -g @loadfocus/loadfocus-api-client
    - run:
        name: Configure LoadFocus API Client
        command: |
          loadfocus-api config set apikey $LOADFOCUS_API_KEY
          loadfocus-api config set teamid $LOADFOCUS_TEAM_ID
    - run:
        name: Run Performance Tests
        command: |
          # Get test name based on index
          TESTS=("API_Test" "Frontend_Test" "Database_Test")
          INDEX=$(( $CIRCLE_NODE_INDEX % 3 ))
          TEST_NAME=${TESTS[$INDEX]}

          echo "Running test: $TEST_NAME"

          loadfocus-api jmeter run-test \
            --name "$TEST_NAME" \
            --thresholds "avgresponse<=200,errors==0,p95<=250" \
            --format json > "performance_results_${TEST_NAME}.json"
    - store_artifacts:
        path: performance_results_*.json
        destination: performance-test-results

Patarimai CircleCI integracijai

Resursu paskirstymas: isitikinkite, kad jusu CircleCI planas turi pakankamai resursu nasumo testams vykdyti, ypac jei jie trunka ilgai.

Laiko limito nustatymai: ilgesniems testams pakoreguokite uzduoties laiko limita CircleCI:

- run:
    name: Run Performance Tests
    command: loadfocus-api jmeter run-test --name "Test_Name" --waitTimeout 3600
    no_output_timeout: 60m

Salyginis testavimas: vykdykite nasumo testus tik konkreciose sakose arba konkretiems issiuntimams:

performance_test:
  # Only run if commit message contains [PERF-TEST]
  when:
    condition:
      or:
        - equal: [ main, << pipeline.git.branch >> ]
        - matches:
            pattern: ".*\\[PERF-TEST\\].*"
            value: << pipeline.git.commit.message >>

Pranesimai: nustatykite pranesimus apie nasumo testu nesekmes:

- run:
    name: Notify on Performance Test Failure
    command: |
      if [ $? -ne 0 ]; then
        curl -X POST -H "Content-Type: application/json" \
          -d '{"text":"Performance test failed for $CIRCLE_PROJECT_REPONAME"}' \
          $SLACK_WEBHOOK_URL
      fi
    when: on_fail

Daugiau informacijos rasite CircleCI dokumentacijoje ir LoadFocus API kliento dokumentacijoje.