Cognadev

Technical Report Series

P Barrett
August 15, 2018

Technical Report Series These articles provide detailed expositions of analyses undertaken as part of the evidence-base supporting Cognadev products. Each contains an executive summary, along with the logic, analysis-details, results, and critical evaluations supporting the statements made in that summary.

1. THE COGNITIVE PROCESS PROFILE (CPP) AND COGNITIVE ABILITY/IQ
  • Evaluating the relationships between 4 subscales and the Full IQ scales of Sigma Assessment System's Multidimensional Aptitute Battery (MAB)
  • Evaluating the relationships between the Abstract Reasoning subscale of Psytech International's General Reasoning Test Battery (GRT2) and a range of CPP attributes which appear in/contribute to the CPP assessment report. The sample numbered 259 South African employment candidates assessed within a recruitment process by an organizational development consultancy. 143 cases completed the CPP, with 138 cases with complete data on both the CPP and GRT2 Abstract Reasoning scale.
  • Evaluating the relationships between the Verbal and Numerical subscales of Psytech International's Critical Reasoning Test Battery (CRTB2) and a range of CPP attributes which appear in/contribute to the CPP assessment report. The sample numbered 128 South African employment candidates assessed within a recruitment process by an HR consultancy.

For the full article in .pdf click the icon

Technical Report 1


2. THE RETEST RELIABILITY OF THE VALUES ORIENTATIONS (VO)
  • The retest reliability of the VO was assessed, where the test results to be compared are two ordered-category sequences of selected and rejected orientations, consisting of up to three orientations per sequence (Accepted Values) and one or two orientations (Rejected Values). A new computational comparison analysis algorithm was constructed to work with ordered category sequences, generating a percentage match index varying between 0% (no agreement) to 100% (absolute identity).

For the full article in .pdf click the icon

Technical Report 2


3. THETA, ALPHA, AND OMEGA ESTIMATES OF RELIABILITY FOR THE VO ORIENTATION SCALES
  • Using the VO Technical Manual mixed-gender sample dataset of n=3,683 cases, four homogeneity (reliability) coefficients were computed for every values orientation "scale"

For the full article in .pdf click the icon

Technical Report 3


4. VALUE ORIENTATIONS (VO) RELATIONSHIPS
  • Analysing and reporting upon the relationships between VO selected and rejected values orientations, MBTI personality scores & types, Belbin ranked team types, and CPP attribute-scores, levels of work, and ranked cognitive styles.

For the full article in .pdf click the icon

Technical Report 4


5. THE RETEST RELIABILITY OF THE COGNITIVE PROCESS PROFILE (CPP)
    Investigating short, medium, and long-term (> 5 years) retest reliability using two samples of data:
  • 87 students undertaking an Accounting degree course at a South African University
  • 2,724 respondents comprised primarily of job applicants who had completed the CPP on two separate occasions, but also included some students, and attendees at CPP training courses.

For the full article in .pdf click the icon

Technical Report 5


6. HIERARCHICAL MULTIPLE LINEAR REGRESSION AND THE CORRECT INTERPRETATION OF THE MAGNITUDE OF A DEVIATION R-SQUARE
  • Does a small deviation r-square value have any pragmatic value at all?
  • What magnitude of deviation r-square is worth reporting beyond: nothing to see here?

For the full article in .pdf click the icon

Technical Report 5


7. THE ROI OF THE GALLUP Q12: ASSESSING THE TRUE VALUE OF HIGH-COST HR INTERVENTIONS
  • This paper investigates how the cost of implementing the Q12 Employee Engagement assessment may be critically evaluated in terms of calculating the likelihood of making or losing money as a corporate-wide Q12 score is increased. i.e. The question posed and answered via computational simulation is "what are the odds of a company making or losing money as a result of an increase in score from 36 (average) to something higher".

For the full article in .pdf click the icon

Technical Report 5


8. COMPARING SST JOB LEVELS WITH CPP-SST LEVELS OF JOB INCUMBENTS
  • This study is aimed at answering the question of whether the CPP results of individuals tend to match the complexity requirements of their work as indicated by the Stratified Systems Theory (SST).

For the full article in .pdf click the icon

Technical Report 5


9. COGNITIVE PROCESSING ATTRIBUTES, VALUE ORIENTATIONS, AND TRAIT EMOTIONAL INTELLIGENCE
  • This study investigates the relationship between: - Cognadev’s Cognitive Process Profile (CPP) - Cognadev’s Values Orientations (VO) - Bar-On’s Emotional Quotient Inventory (EQi)

For the full article in .pdf click the icon

Technical Report 5


10. COGNITIVE COMPLEXITY AND COGNITIVE STYLES: IMPLICATIONS FOR STRATEGIC WORK
  • This study investigates the nature of the proposed holonic model of information processing constructs on which the Cognitive Process Profile (CPP) is based, and what distinguishes low and high information processing competency groups in terms of their preferred cognitive styles, functional area of employment, and educational qualifications.

For the full article in .pdf click the icon

Technical Report 10


11. INCREASING AGE AND CHANGES IN CPP PREFERRED COGNITIVE STYLE ACROSS JOB FAMILIES
  • In this investigation, we look at how preferred cognitive styles vary over different job families and age-groups, equated on their educational level. A sample of the most recently acquired 60,572 cases of CPP data were used, subdivided into four age groups (20-29, 30-39, 40-49, 50 and above). We computed the median ranked style for each of the 14 CPP cognitive styles, within each age-group, across 10 job families.

For the full article in .pdf click the icon

Technical Report 11


12. CPP INFORMATION PROCESSING COMPETENCY TRENDS AS A FUNCTION OF LEVELS OF EDUCATION AND AGE
  • This investigation examines the variation in scores on the 14 CPP Information processing competencies (IPCs) as a function of various current employment categories, age at CPP completion, and highest attained educational level, using a sample of the most recently acquired 60,572 cases of CPP data.

For the full article in .pdf click the icon

Technical Report 12


13. THE BINOMIAL EFFECT SIZE DISPLAY (BESD) Is this always an accurate index of effect?
  • I provide the definition, some warnings of the conditions under which it may not always produce accurate results, and some worked examples demonstrating those conditions. Overall, I think it’s a pretty good ‘quick approximation’ … but it is no substitute to having all the data at hand to calculate the actual effect/accuracy implied by a correlation/validity coefficient.

For the full article in .pdf click the icon

Technical Report 13

Two articles support the content of this technical report: 

Rosenthal, R., & Rubin, D.R. (1982) A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 2, 166-169.

For the full article in .pdf click the icon

A simple, general purpose display of magnitude of experimental effect.

Hsu, L.M. (2004) Biases of success rate differences shown in Binomial Effect Size Displays. Psychological Methods, 9, 2, 183-197.

For the full article in .pdf click the icon

Biases of success rate differences shown in Binomial Effect Size Displays.


14. EQUIFINAL PROFILING I was asked this question recently by an executive responsible for hiring in a large corporate:
  • “We observe too often that people with seemingly disparate profiles can excel in the same role. What type of analyses can someone do with a big dataset of predictors and criteria to determine whether multiple "profiles" can predict success? It seems that traditional model approaches can’t do this as they just create a single ‘average’ profile or solution.”

For the full article in .pdf click the icon

Technical Report 14

Call us on +27 11 884 0878

css.php