Human validationExpert judgment grounds the measurement.
Independent academic research collaboration
How technology reshapes work—and how we measure it.
We study how operations, software development, and artificial intelligence capabilities appear in job postings and organizational work. Our current validation study compares model-based measures with judgments from experienced IT professionals.
Validation
Human
judgment
judgment
01Operations
02Development
03Artificial intelligence
Reproducible samplingSelection rules and study decisions are documented.
Independent reviewRatings are collected without exposing model scores.
Research focus
From job text to evidence about changing work.
Organizations describe work through roles, responsibilities, and required skills. We examine those descriptions to understand how technical capabilities are bundled, how those bundles change over time, and where automated measures agree—or disagree— with experienced human readers.
The goal is not simply to label postings. It is to build transparent, defensible measures that can support research on technology, occupations, and organizational change.
Current study
Validating measures of IT work
Experienced reviewers independently assess job postings across three dimensions. The research team then compares those judgments with model-generated measures.
01
IT Operations
Infrastructure, support, systems administration, service delivery, and reliability.
Operate · support · maintain02
Software Development
Programming, application development, software engineering, and product delivery.
Build · test · improve03
Artificial Intelligence
Machine learning, AI systems, data-driven automation, and intelligent applications.
Learn · predict · automate1SampleDraw postings using a documented design.
2RateCollect independent expert assessments.
3CompareEvaluate agreement with model measures.
For participants
Participating in a study?
Participation is by invitation. Please use the study or bundle link provided by the research team. Your current invitation links remain valid, and progress is saved by the existing survey system.
This research homepage is new; the validated survey system remains at its existing address while the research team completes infrastructure testing.
Collaboration
Three perspectives, one shared measurement problem.
A cross-university academic collaboration studying technology, skills, and the future of work.
Contact
Questions about the study?
For study access, participation, or data-handling questions, contact:
JYEO22@emory.edu Please do not send sensitive personal information by email.