BMC Mainframe DevOps

Helper classes

The helper classes primarily serve as wrapper classes for use by different methods used by the plugins. Other purposes include providing configuration data PipelineConfig or preparing JCL for a specific pipeline execution JclSkeleton.

GitHelper

The GitHelper class serves as a wrapper around the Git SCM plugin and provides these methods:

GitHelper(steps)

The constructor receives the steps from the pipeline to allow use of pipeline step within the class code.

checkout(String gitUrl, String gitBranch, String gitCredentials, String tttFolder)

checks out the branch gitBranch in the Git(Hub) repository at gitUrl. It uses the gitCredentials to authenticate and places the cloned Git repository into the folder tttFolder within the Jenkins workspace.

checkoutPath(String gitUrl, String gitBranch, String path, String gitCredentials, String gitProject)

performs a sparse checkout, and checks out path path in the branch gitBranch in the project gitProject in the Git(Hub) repository at gitUrl. It uses the gitCredentials to authenticate.

IspwHelper

The IspwHelper class serves as a wrapper around the Compuware ISPW plugin and provides these methods:

IspwHelper(steps, pConfig)

The constructor receives the steps from the pipeline to allow use of pipeline step within the class code and a PipelineConfig to make use of pipeline specific execution parameters.

downloadAllSources(String ispwLevel)

Downloads all COBOL sources and copybooks for the ISPW stream, application and level as stored in the PipelineConfig.

downloadSources()

Downloads all sources (COBOL programs and copybooks) contained in the ISPW set triggering the pipeline.

downloadCopyBooks(String workspace)

Performs the following tasks:

  • receives the path to the workspace for the pipeline job
  • uses the referencedCopyBooks method to determine all copybooks used by the download COBOL programs
  • uses a JclSkeleton object's createIebcopyCopyBooksJcl method to create an IEBCOPY job JCL that copies all required copybooks in the list from the ISPW libraries into a temporary PDS
  • submits this JCL using the Topaz Utilities (opens new window) plugin
  • downloads the content of the temporary PDS, using the ISPW PDS downloader (opens new window)
  • uses the JclSkeleton method jclSkeleton.createDeleteTempDsn to create a DELETE job JCL
  • and submits that JCL

referencedCopyBooks(String workspace)

Performs the following tasks:

  • receives the path to the workspace of the pipeline job
  • searches all *.cbl program sources in the folder containing all downloaded sources and builds a list of COBOL programs
  • for each program in the list it
    • reads the source file
    • scans the content for valid COPY statements (e.g. not comments)
    • determines the referenced copybook
    • add each copybook to the list of copybooks
  • returns the resulting list of copybooks

regressAssignmentList(assignmentList, cesToken)

Receives a list of assignment IDs in assignmentList, the CES Token in cesToken and calls method regressAssignment for each element of assignmentList

regressAssignment(assignment, cesToken)

Receives an Assignment ID in assignment, the CES Token in cesToken and uses the ISPW REST API to regress the assignment.

JclSkeleton

The JclSkeleton class allows the pipelines to customize pieces of JCL in certain, predefined ways. This allows changing e.g. job cards, STEPLIB concatenations and others during runtime. The JCL skeletons are read from folder ./resources/skels in the pipeline workspace.

JclSkeleton(steps, String workspace, String ispwApplication, String ispwPathNum)

The constructor receives the steps from the pipeline to allow use of pipeline step within the class code, the path to the pipeline workpace, the name of the ISPW application in ispwApplication and the number of the development path in pathNum.

initialize()

Is used for additional initialization which cannot be executed in the constructor and it:

  • reads the JobCard.jcl skeleton file
  • reads the deleteDs.skel skeleton file
  • reads the cleanUpCcRepo.skel skeleton file
  • initializes the IEBCOPY JCL by using the buildIebcopySkel method.

buildIebcopySkel()

Initializes the IEBCOPY JCL by - reading the iebcopy.skel skeleton file (main JCL) - reading the iebcopyInDd.skel skeleton file (input DD statements) - building the required INDD=INx cards - replacing the placeholders in the skeleton JCL by the concrete values - returning the resulting JCL code -

createIebcopyCopyBooksJcl(String targetDsn, List copyMembers)

Receives the target DSN for the IEBCOPY job in targetDsn and the list of required copybooks in copyMembers and

  • builds a SELECT MEMBER= card for each entry in copyMembers
  • Uses method buildFinalJcl to build the final JCL passing
    • the jobCardJcl from initialize
    • the iebcopyCopyBooksJclSkel built previously in initialize
    • a map array of parameter markers and values
  • returns the resulting JCL code

createDeleteTempDsn(String targetDsn)

Receives the target DSN for the DELETE job in targetDsn and

  • Uses method buildFinalJcl to build the final JCL passing
    • the jobCardJcl from initialize
    • the cleanUpDatasetJclSkel built previously in initialize
    • a map array of parameter markers and values
  • returns the resulting JCL code

createCleanUpCcRepo()

  • Uses method buildFinalJcl to build the final JCL passing
    • the jobCardJcl from initialize
    • the cleanUpCcRepoJclSkel built previously in initialize
    • a map array of parameter markers and values
  • returns the resulting JCL code

buildFinalJcl(jobCard, jclSkel, parametersMap)

Receives a jobCard, a jclSkel skeleton JCL, a parameter map parametersMap and

  • places the jobCard in front of the jclSkel test
  • for each element in parametersMap replaces the corresponding parameter marker stored in parmName by the corresponding value stored in parmValue
  • returns the resulting JCL code

readSkelFile(String fileName)

Receives a fileName and

  • reads the corresponding file from the skeletons folder in the pipeline workspace
  • returns the content of the file as list of records

PipelineConfig

The PipelineConfig class stores and allows retrieval of any pipeline configuration and runtime specific parameters.

PipelineConfig(steps, workspace, params, mailListLines)

The constructor receives the steps from the pipeline to allow use of pipeline step within the class code, the path of the pipeline workspace the Map params containing the key:value parameter pairs from the pipeline call, and a the list of records from the mailList.config file and initializes all parameters that can be initialized immediately.

initialize()

Is used for additional initialization which cannot be executed in the constructor and it:

  • Deletes any old content from the pipeline workspace
  • Uses the following methods to read configuration files and based on the content initialize further parameters:
    • setServerConfig to set server (Sonar, XLR, etc.) specific parameters
    • setTttGitConfig to set parameters for the Git repository containing TTT assets
    • setMailConfig to build the map of ISPW owner IDs and corresponding email addresses.

setServerConfig()

Performs the following tasks:

  • reads the pipeline configuration file pipeline.config, containing server URLs (e.g. Sonar, XL Release) etc.
  • extracts the values for the corresponding parameters
  • sets the parameters

setTttGitConfig()

Performs the following tasks:

  • reads the pipeline configuration file tttgit.config, containing information about the GitHub repository storing the Topaz for Total Test projects
  • extracts the values for the corresponding parameters
  • sets the parameters

setMailConfig()

Performs the following tasks:

  • loops though the list of mailListLines containing the TSO user:email pairs
  • turns the records into a Map
  • determines the email address for the owner of the ISPW set and sets the parameter mailRecipient accordingly

readConfigFile(String fileName)

Reads a (configuration) file and returns the content with each line/record as an element of a list.

SonarHelper

The SonarHelper class serves as a wrapper to execute the SonarQube scanner.

SonarHelper(script, steps, pConfig)

The constructor receives the scriptobject and the steps from the pipeline and a PipelineConfig to make use of pipeline execution specific parameters.

initialize()

Is used for additional initialization which cannot be executed in the constructor and determines the scanner home path.

scan()

Determines the test results locations based on the assumption that the results have been created by Topaz for Total Unit Test. (If Functional Tests have been executed, uses the scan(pipelineType) method.) It then uses the runScan method to execute the Sonar scanner.

scan(pipelineType)

Determines the test results locations based on the type of Topaz for Total tests, either unit tests or functional tests. It then uses the runScan method to execute the Sonar scanner.

checkQualityGate

Receives the results of the Sonar quality gate and returns its status.

determineUtProjectName

Builds the name for the SonarQube project, if Topaz for Total Test unit tests were executed and the pipeline is a "Generate" pipeline.

determineFtProjectName

Builds the name for the SonarQube project, if Topaz for Total Test functional tests were executed and the pipeline is a "Integrate" pipeline.

determineUtResultPath

Builds the path to point to Topaz for Total Test unit test results files to be passed to Sonar.

runScan

Prepares all parameters required for Sonar and executes the Sonar scanner:

TttHelper

The TttHelper class serves as a wrapper around Topaz for Total Test related activities like, executing the unit tests for the downloaded programs in a loop, and gathering the results from Code Coverage.

TttHelper(script, steps, pConfig)

The constructor receives the script object and the steps from the pipeline and a PipelineConfig to make use of pipeline execution specific parameters.

initialize()

Is used for additional initialization which cannot be executed in the constructor and does the following:

  • Instantiates a JclSkeleton for later use by loopThruScenarios().
  • Builds a list of downloaded COBOL sources
  • Builds a list of downloaded .testscenarios.

loopThruScenarios()

Loops through the .testscenarios and for each scenario:

  • determines if the scenario matches one of the COBOL programs
  • in that case
    • the job card of the corresponding runner jcl gets replaced by the configuration job card
    • the scenario gets executed

executeFunctionalTests

Will execute all Topaz for Total Test functional test scenarios previously downloaded from Git.

passResultsToJunit()

Uses the JUnit plugin to display the unit test results on the pipeline dashboard (and stored results in the pipeline output).

collectCodeCoverageResults()

Uses the Xpediter Code Coverage plugin to retrieve code coverage results from the Xpediter Code Coverage repository.

cleanUpCodeCoverageResults()

Uses a JCL Skeleton and the resulting JCL to clean up statistics from the previous build in the Code Coverage repository. This prevents the repository dataset to be cluttered by statistics that are not being used anymore.